Name | m4PLDmplqc5n9Rq4apOajLDm4fhM0noT9bVo2ijZDmvmUKDmTakrKn_0 |
Workunit | 223624362 |
Created | 15 Jun 2024, 22:09:50 UTC |
Sent | 16 Jun 2024, 4:11:24 UTC |
Report deadline | 24 Jun 2024, 4:11:24 UTC |
Received | 23 Jun 2024, 2:43:02 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 10687303 |
Run time | 4 hours 19 min 32 sec |
CPU time | 1 days 22 hours 12 min 47 sec |
Validate state | Valid |
Credit | 2,676.46 |
Device peak FLOPS | 65.17 GFLOPS |
Application version | ATLAS Simulation v3.01 (native_mt) x86_64-pc-linux-gnu |
Peak working set size | 2.90 GB |
Peak swap size | 3.34 GB |
Peak disk usage | 1.34 GB |
<core_client_version>7.16.6</core_client_version> <![CDATA[ <stderr_txt> 18:21:38 (1181452): wrapper (7.7.26015): starting 18:21:38 (1181452): wrapper: running run_atlas (--nthreads 12) [2024-06-22 18:21:38] Arguments: --nthreads 12 [2024-06-22 18:21:38] Threads: 12 [2024-06-22 18:21:38] Checking for CVMFS [2024-06-22 18:21:38] Probing /cvmfs/atlas.cern.ch... OK [2024-06-22 18:21:38] Probing /cvmfs/atlas-condb.cern.ch... OK [2024-06-22 18:21:38] Running cvmfs_config stat atlas.cern.ch [2024-06-22 18:21:38] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE [2024-06-22 18:21:38] 2.11.2.0 2238775 991 56620 134182 3 55 3741371 4194305 915 130560 0 1277624 99.319 843312 2531 http://s1bnl-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.150.1:3128 1 [2024-06-22 18:21:38] CVMFS is ok [2024-06-22 18:21:38] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 [2024-06-22 18:21:38] Checking for apptainer binary... [2024-06-22 18:21:38] apptainer is not installed, using version from CVMFS [2024-06-22 18:21:38] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname [2024-06-22 18:21:39] Trebeth [2024-06-22 18:21:39] apptainer works [2024-06-22 18:21:39] Set ATHENA_PROC_NUMBER=12 [2024-06-22 18:21:39] Set ATHENA_CORE_NUMBER=12 [2024-06-22 18:21:39] Starting ATLAS job with PandaID=6231689699 [2024-06-22 18:21:39] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/var/lib/boinc-client/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh [2024-06-22 22:41:06] *** The last 200 lines of the pilot log: *** [2024-06-22 22:41:06] 2024-06-23 02:40:45,326 | INFO | model: linear, x: [1719094939.0, 1719095000.0, 1719095061.0, 1719095122.0, 1719095183.0, 1719095244.0, 1719095305.0, 1719095366.0, 1719095427.0, 1719095488.0, 1719 [2024-06-22 22:41:06] 2024-06-23 02:40:45,326 | INFO | sum of square deviations: 5081276667.5 [2024-06-22 22:41:06] 2024-06-23 02:40:45,328 | INFO | sum of deviations: 4146490402.499977 [2024-06-22 22:41:06] 2024-06-23 02:40:45,328 | INFO | mean x: 1719102655.5 [2024-06-22 22:41:06] 2024-06-23 02:40:45,328 | INFO | mean y: 2780473.562992126 [2024-06-22 22:41:06] 2024-06-23 02:40:45,328 | INFO | -- intersect: -1400064348.3959126 [2024-06-22 22:41:06] 2024-06-23 02:40:45,328 | INFO | intersect: -1400064348.3959126 [2024-06-22 22:41:06] 2024-06-23 02:40:45,329 | INFO | chi2: 3.982357239383937 [2024-06-22 22:41:06] 2024-06-23 02:40:45,329 | INFO | model: linear, x: [1719094939.0, 1719095000.0, 1719095061.0, 1719095122.0, 1719095183.0, 1719095244.0, 1719095305.0, 1719095366.0, 1719095427.0, 1719095488.0, 1719 [2024-06-22 22:41:06] 2024-06-23 02:40:45,329 | INFO | sum of square deviations: 4787066500.0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,331 | INFO | sum of deviations: 22653893787.999996 [2024-06-22 22:41:06] 2024-06-23 02:40:45,331 | INFO | mean x: 1719102503.0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,331 | INFO | mean y: 2789918.112449799 [2024-06-22 22:41:06] 2024-06-23 02:40:45,331 | INFO | -- intersect: -8132540040.986081 [2024-06-22 22:41:06] 2024-06-23 02:40:45,331 | INFO | intersect: -8132540040.986081 [2024-06-22 22:41:06] 2024-06-23 02:40:45,331 | INFO | chi2: 3.2875433539726604 [2024-06-22 22:41:06] 2024-06-23 02:40:45,331 | INFO | current chi2=3.2875433539726604 (change=17.447301777445837 %) [2024-06-22 22:41:06] 2024-06-23 02:40:45,332 | INFO | right removable region: 248 [2024-06-22 22:41:06] 2024-06-23 02:40:45,332 | INFO | model: linear, x: [1719095244.0, 1719095305.0, 1719095366.0, 1719095427.0, 1719095488.0, 1719095549.0, 1719095610.0, 1719095671.0, 1719095732.0, 1719095793.0, 1719 [2024-06-22 22:41:06] 2024-06-23 02:40:45,332 | INFO | sum of square deviations: 4787066500.0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,333 | INFO | sum of deviations: -64065048944.0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,333 | INFO | mean x: 1719102808.0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,334 | INFO | mean y: 2815742.0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,334 | INFO | -- intersect: 23009474524.42716 [2024-06-22 22:41:06] 2024-06-23 02:40:45,334 | INFO | intersect: 23009474524.42716 [2024-06-22 22:41:06] 2024-06-23 02:40:45,334 | INFO | chi2: 1.6101278993577415 [2024-06-22 22:41:06] 2024-06-23 02:40:45,334 | INFO | current chi2=1.6101278993577415 (change=59.568471571705985 %) [2024-06-22 22:41:06] 2024-06-23 02:40:45,335 | INFO | model: linear, x: [1719095549.0, 1719095610.0, 1719095671.0, 1719095732.0, 1719095793.0, 1719095854.0, 1719095915.0, 1719095976.0, 1719096037.0, 1719096098.0, 1719 [2024-06-22 22:41:06] 2024-06-23 02:40:45,335 | INFO | sum of square deviations: 4504437945.0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,336 | INFO | sum of deviations: -87704435277.50002 [2024-06-22 22:41:06] 2024-06-23 02:40:45,336 | INFO | mean x: 1719102960.5 [2024-06-22 22:41:06] 2024-06-23 02:40:45,336 | INFO | mean y: 2828408.62704918 [2024-06-22 22:41:06] 2024-06-23 02:40:45,336 | INFO | -- intersect: 33474918861.530586 [2024-06-22 22:41:06] 2024-06-23 02:40:45,336 | INFO | intersect: 33474918861.530586 [2024-06-22 22:41:06] 2024-06-23 02:40:45,337 | INFO | chi2: 1.1785003063181099 [2024-06-22 22:41:06] 2024-06-23 02:40:45,337 | INFO | current chi2=1.1785003063181099 (change=26.80703770252053 %) [2024-06-22 22:41:06] 2024-06-23 02:40:45,337 | INFO | model: linear, x: [1719095854.0, 1719095915.0, 1719095976.0, 1719096037.0, 1719096098.0, 1719096159.0, 1719096220.0, 1719096281.0, 1719096342.0, 1719096403.0, 1719 [2024-06-22 22:41:06] 2024-06-23 02:40:45,337 | INFO | sum of square deviations: 4233158440.0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,339 | INFO | sum of deviations: -97178642378.0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,339 | INFO | mean x: 1719103113.0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,339 | INFO | mean y: 2833735.0376569037 [2024-06-22 22:41:06] 2024-06-23 02:40:45,339 | INFO | -- intersect: 39467481467.22448 [2024-06-22 22:41:06] 2024-06-23 02:40:45,339 | INFO | intersect: 39467481467.22448 [2024-06-22 22:41:06] 2024-06-23 02:40:45,340 | INFO | chi2: 1.0873512777525254 [2024-06-22 22:41:06] 2024-06-23 02:40:45,340 | INFO | current chi2=1.0873512777525254 (change=7.734323705893111 %) [2024-06-22 22:41:06] 2024-06-23 02:40:45,340 | INFO | left removable region: 30 [2024-06-22 22:41:06] 2024-06-23 02:40:45,340 | INFO | model: linear, x: [1719096769.0, 1719096830.0, 1719096891.0, 1719096952.0, 1719097013.0, 1719097074.0, 1719097135.0, 1719097196.0, 1719097257.0, 1719097318.0, 1719 [2024-06-22 22:41:06] 2024-06-23 02:40:45,340 | INFO | sum of square deviations: 3212467674.5 [2024-06-22 22:41:06] 2024-06-23 02:40:45,341 | INFO | sum of deviations: -54170425146.50002 [2024-06-22 22:41:06] 2024-06-23 02:40:45,342 | INFO | mean x: 1719103387.5 [2024-06-22 22:41:06] 2024-06-23 02:40:45,342 | INFO | mean y: 2829969.729357798 [2024-06-22 22:41:06] 2024-06-23 02:40:45,342 | INFO | -- intersect: 28991311974.037033 [2024-06-22 22:41:06] 2024-06-23 02:40:45,342 | INFO | intersect: 28991311974.037033 [2024-06-22 22:41:06] 2024-06-23 02:40:45,342 | INFO | chi2: 0.3081024331644522 [2024-06-22 22:41:06] 2024-06-23 02:40:45,342 | INFO | -- intersect: 28991311974.037033 [2024-06-22 22:41:06] 2024-06-23 02:40:45,342 | INFO | current memory leak: -16.86 B/s (using 218 data points, chi2=0.31) [2024-06-22 22:41:06] 2024-06-23 02:40:45,343 | INFO | .............................. [2024-06-22 22:41:06] 2024-06-23 02:40:45,343 | INFO | . Timing measurements: [2024-06-22 22:41:06] 2024-06-23 02:40:45,343 | INFO | . get job = 0 s [2024-06-22 22:41:06] 2024-06-23 02:40:45,343 | INFO | . initial setup = 2 s [2024-06-22 22:41:06] 2024-06-23 02:40:45,343 | INFO | . payload setup = 6 s [2024-06-22 22:41:06] 2024-06-23 02:40:45,343 | INFO | . stage-in = 0 s [2024-06-22 22:41:06] 2024-06-23 02:40:45,344 | INFO | . payload execution = 15472 s [2024-06-22 22:41:06] 2024-06-23 02:40:45,344 | INFO | . stage-out = 2 s [2024-06-22 22:41:06] 2024-06-23 02:40:45,344 | INFO | . log creation = 0 s [2024-06-22 22:41:06] 2024-06-23 02:40:45,344 | INFO | .............................. [2024-06-22 22:41:06] 2024-06-23 02:40:45,435 | INFO | [2024-06-22 22:41:06] 2024-06-23 02:40:45,437 | WARNING | process 1193888 is no longer using CPU - aborting [2024-06-22 22:41:06] 2024-06-23 02:40:45,437 | INFO | job summary report [2024-06-22 22:41:06] 2024-06-23 02:40:45,437 | INFO | aborting job monitoring since job object (job id=6231689699) has expired [2024-06-22 22:41:06] 2024-06-23 02:40:45,437 | INFO | -------------------------------------------------- [2024-06-22 22:41:06] 2024-06-23 02:40:45,437 | INFO | PanDA job id: 6231689699 [2024-06-22 22:41:06] 2024-06-23 02:40:45,437 | INFO | task id: 38921013 [2024-06-22 22:41:06] 2024-06-23 02:40:45,437 | INFO | errors: (none) [2024-06-22 22:41:06] 2024-06-23 02:40:45,437 | INFO | status: LOG_TRANSFER = DONE [2024-06-22 22:41:06] 2024-06-23 02:40:45,438 | INFO | pilot state: finished [2024-06-22 22:41:06] 2024-06-23 02:40:45,438 | INFO | transexitcode: 0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,438 | INFO | exeerrorcode: 0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,438 | INFO | exeerrordiag: [2024-06-22 22:41:06] 2024-06-23 02:40:45,438 | INFO | exitcode: 0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,438 | INFO | exitmsg: OK [2024-06-22 22:41:06] 2024-06-23 02:40:45,438 | INFO | cpuconsumptiontime: 166464 s [2024-06-22 22:41:06] 2024-06-23 02:40:45,438 | INFO | nevents: 400 [2024-06-22 22:41:06] 2024-06-23 02:40:45,438 | INFO | neventsw: 0 [2024-06-22 22:41:06] 2024-06-23 02:40:45,438 | INFO | pid: 1193888 [2024-06-22 22:41:06] 2024-06-23 02:40:45,438 | INFO | pgrp: 1193888 [2024-06-22 22:41:06] 2024-06-23 02:40:45,439 | INFO | corecount: 12 [2024-06-22 22:41:06] 2024-06-23 02:40:45,439 | INFO | event service: False [2024-06-22 22:41:06] 2024-06-23 02:40:45,439 | INFO | sizes: {0: 2386990, 4: 2387196, 11: 2387224, 15482: 2418352, 15484: 2427326, 15487: 2427382, 15518: 2427680} [2024-06-22 22:41:06] 2024-06-23 02:40:45,439 | INFO | -------------------------------------------------- [2024-06-22 22:41:06] 2024-06-23 02:40:45,439 | INFO | [2024-06-22 22:41:06] 2024-06-23 02:40:45,439 | INFO | executing command: ls -lF /var/lib/boinc-client/slots/5 [2024-06-22 22:41:06] 2024-06-23 02:40:45,458 | INFO | queue jobs had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,458 | INFO | queue payloads had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,458 | INFO | queue data_in had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,458 | INFO | queue data_out had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,458 | INFO | queue current_data_in had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,458 | INFO | queue validated_jobs had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,458 | INFO | queue validated_payloads had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue monitored_payloads had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue finished_jobs had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue finished_payloads had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue finished_data_in had 1 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue finished_data_out had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue failed_jobs had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue failed_payloads had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue failed_data_in had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue failed_data_out had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue completed_jobs had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue completed_jobids has 1 job(s) [2024-06-22 22:41:06] 2024-06-23 02:40:45,459 | INFO | queue realtimelog_payloads had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,460 | INFO | queue messages had 0 job(s) [purged] [2024-06-22 22:41:06] 2024-06-23 02:40:45,460 | INFO | job 6231689699 has completed (purged errors) [2024-06-22 22:41:06] 2024-06-23 02:40:45,460 | INFO | overall cleanup function is called [2024-06-22 22:41:06] 2024-06-23 02:40:46,466 | INFO | --- collectZombieJob: --- 10, [1193888] [2024-06-22 22:41:06] 2024-06-23 02:40:46,467 | INFO | zombie collector waiting for pid 1193888 [2024-06-22 22:41:06] 2024-06-23 02:40:46,467 | INFO | harmless exception when collecting zombies: [Errno 10] No child processes [2024-06-22 22:41:06] 2024-06-23 02:40:47,470 | INFO | collected zombie processes [2024-06-22 22:41:06] 2024-06-23 02:40:47,471 | INFO | will now attempt to kill all subprocesses of pid=1193888 [2024-06-22 22:41:06] 2024-06-23 02:40:47,581 | INFO | process IDs to be killed: [1193888] (in reverse order) [2024-06-22 22:41:06] 2024-06-23 02:40:47,690 | WARNING | found no corresponding commands to process id(s) [2024-06-22 22:41:06] 2024-06-23 02:40:47,691 | INFO | Do not look for orphan processes in BOINC jobs [2024-06-22 22:41:06] 2024-06-23 02:40:47,699 | INFO | did not find any defunct processes belonging to 1193888 [2024-06-22 22:41:06] 2024-06-23 02:40:47,706 | INFO | did not find any defunct processes belonging to 1193888 [2024-06-22 22:41:06] 2024-06-23 02:40:47,706 | INFO | ready for new job [2024-06-22 22:41:06] 2024-06-23 02:40:47,706 | INFO | pilot has finished with previous job - re-establishing logging [2024-06-22 22:41:06] 2024-06-23 02:40:47,708 | INFO | ************************************* [2024-06-22 22:41:06] 2024-06-23 02:40:47,708 | INFO | *** PanDA Pilot version 3.7.7.3 *** [2024-06-22 22:41:06] 2024-06-23 02:40:47,708 | INFO | ************************************* [2024-06-22 22:41:06] 2024-06-23 02:40:47,708 | INFO | [2024-06-22 22:41:06] 2024-06-23 02:40:47,729 | INFO | architecture information: [2024-06-22 22:41:06] 2024-06-23 02:40:47,730 | INFO | executing command: cat /etc/os-release [2024-06-22 22:41:06] 2024-06-23 02:40:47,740 | INFO | cat /etc/os-release: [2024-06-22 22:41:06] NAME="CentOS Linux" [2024-06-22 22:41:06] VERSION="7 (Core)" [2024-06-22 22:41:06] ID="centos" [2024-06-22 22:41:06] ID_LIKE="rhel fedora" [2024-06-22 22:41:06] VERSION_ID="7" [2024-06-22 22:41:06] PRETTY_NAME="CentOS Linux 7 (Core)" [2024-06-22 22:41:06] ANSI_COLOR="0;31" [2024-06-22 22:41:06] CPE_NAME="cpe:/o:centos:centos:7" [2024-06-22 22:41:06] HOME_URL="https://www.centos.org/" [2024-06-22 22:41:06] BUG_REPORT_URL="https://bugs.centos.org/" [2024-06-22 22:41:06] [2024-06-22 22:41:06] CENTOS_MANTISBT_PROJECT="CentOS-7" [2024-06-22 22:41:06] CENTOS_MANTISBT_PROJECT_VERSION="7" [2024-06-22 22:41:06] REDHAT_SUPPORT_PRODUCT="centos" [2024-06-22 22:41:06] REDHAT_SUPPORT_PRODUCT_VERSION="7" [2024-06-22 22:41:06] [2024-06-22 22:41:06] 2024-06-23 02:40:47,740 | INFO | ************************************* [2024-06-22 22:41:06] 2024-06-23 02:40:48,243 | INFO | executing command: df -mP /var/lib/boinc-client/slots/5 [2024-06-22 22:41:06] 2024-06-23 02:40:48,257 | INFO | sufficient remaining disk space (387612409856 B) [2024-06-22 22:41:06] 2024-06-23 02:40:48,258 | WARNING | since timefloor is set to 0, pilot was only allowed to run one job [2024-06-22 22:41:06] 2024-06-23 02:40:48,259 | WARNING | setting graceful_stop since proceed_with_getjob() returned False (pilot will end) [2024-06-22 22:41:06] 2024-06-23 02:40:48,259 | WARNING | data:copytool_out:received graceful stop - abort after this iteration [2024-06-22 22:41:06] 2024-06-23 02:40:48,259 | WARNING | aborting monitor loop since graceful_stop has been set (timing out remaining threads) [2024-06-22 22:41:06] 2024-06-23 02:40:48,259 | WARNING | data:queue_monitoring:received graceful stop - abort after this iteration [2024-06-22 22:41:06] 2024-06-23 02:40:48,260 | INFO | found 0 job(s) in 20 queues [2024-06-22 22:41:06] 2024-06-23 02:40:48,260 | WARNING | pilot monitor received instruction that args.graceful_stop has been set [2024-06-22 22:41:06] 2024-06-23 02:40:48,260 | WARNING | will wait for a maximum of 300 s for threads to finish [2024-06-22 22:41:06] 2024-06-23 02:40:48,830 | INFO | all payload control threads have been joined [2024-06-22 22:41:06] 2024-06-23 02:40:48,918 | INFO | all data control threads have been joined [2024-06-22 22:41:06] 2024-06-23 02:40:48,942 | WARNING | job:job_monitor:received graceful stop - abort after this iteration [2024-06-22 22:41:06] 2024-06-23 02:40:48,943 | INFO | aborting loop [2024-06-22 22:41:06] 2024-06-23 02:40:49,062 | INFO | all job control threads have been joined [2024-06-22 22:41:06] 2024-06-23 02:40:49,263 | INFO | [job] retrieve thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:49,463 | INFO | [job] validate thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:49,743 | INFO | [payload] execute_payloads thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:49,822 | INFO | [payload] validate_pre thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:49,834 | INFO | [payload] control thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:49,856 | INFO | [payload] failed_post thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:49,923 | INFO | [data] control thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:49,946 | INFO | [job] job monitor thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:49,966 | INFO | [job] create_data_payload thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:50,022 | INFO | [data] copytool_in thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:50,066 | INFO | [job] control thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:50,262 | INFO | [data] copytool_out thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:50,438 | WARNING | job:queue_monitor:received graceful stop - abort after this iteration [2024-06-22 22:41:06] 2024-06-23 02:40:50,854 | INFO | [payload] validate_post thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:51,443 | INFO | [job] queue monitor thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:52,262 | INFO | [data] queue_monitor thread has finished [2024-06-22 22:41:06] 2024-06-23 02:40:58,378 | INFO | job.realtimelogging is not enabled [2024-06-22 22:41:06] 2024-06-23 02:40:59,382 | INFO | [payload] run_realtimelog thread has finished [2024-06-22 22:41:06] 2024-06-23 02:41:00,982 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139803901900608)>', '<ExcThread(monitor, started 139803677300480)>'] [2024-06-22 22:41:06] 2024-06-23 02:41:01,310 | WARNING | job_aborted has been set - aborting pilot monitoring [2024-06-22 22:41:06] 2024-06-23 02:41:01,311 | INFO | [monitor] control thread has ended [2024-06-22 22:41:06] 2024-06-23 02:41:06,006 | INFO | all workflow threads have been joined [2024-06-22 22:41:06] 2024-06-23 02:41:06,007 | INFO | end of generic workflow (traces error code: 0) [2024-06-22 22:41:06] 2024-06-23 02:41:06,007 | INFO | traces error code: 0 [2024-06-22 22:41:06] 2024-06-23 02:41:06,007 | INFO | pilot has finished (exit code=0, shell exit code=0) [2024-06-22 22:41:06] 2024-06-23 02:41:06,097 [wrapper] ==== pilot stdout END ==== [2024-06-22 22:41:06] 2024-06-23 02:41:06,099 [wrapper] ==== wrapper stdout RESUME ==== [2024-06-22 22:41:06] 2024-06-23 02:41:06,100 [wrapper] pilotpid: 1186269 [2024-06-22 22:41:06] 2024-06-23 02:41:06,102 [wrapper] Pilot exit status: 0 [2024-06-22 22:41:06] 2024-06-23 02:41:06,108 [wrapper] pandaids: 6231689699 [2024-06-22 22:41:06] 2024-06-23 02:41:06,160 [wrapper] cleanup supervisor_pilot 1872523 1186270 [2024-06-22 22:41:06] 2024-06-23 02:41:06,162 [wrapper] Test setup, not cleaning [2024-06-22 22:41:06] 2024-06-23 02:41:06,164 [wrapper] ==== wrapper stdout END ==== [2024-06-22 22:41:06] 2024-06-23 02:41:06,166 [wrapper] ==== wrapper stderr END ==== [2024-06-22 22:41:06] 2024-06-23 02:41:06,171 [wrapper] apfmon messages muted [2024-06-22 22:41:06] *** Error codes and diagnostics *** [2024-06-22 22:41:06] "exeErrorCode": 0, [2024-06-22 22:41:06] "exeErrorDiag": "", [2024-06-22 22:41:06] "pilotErrorCode": 0, [2024-06-22 22:41:06] "pilotErrorDiag": "", [2024-06-22 22:41:06] *** Listing of results directory *** [2024-06-22 22:41:06] total 873192 [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 469766 Jun 15 18:00 pilot3.tar.gz [2024-06-22 22:41:06] -rwx------ 1 boinc boinc 32308 Jun 15 18:09 runpilot2-wrapper.sh [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 5654 Jun 15 18:09 queuedata.json [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 100 Jun 22 18:21 wrapper_26015_x86_64-pc-linux-gnu [2024-06-22 22:41:06] -rwxr-xr-x 1 boinc boinc 7986 Jun 22 18:21 run_atlas [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 105 Jun 22 18:21 job.xml [2024-06-22 22:41:06] -rw-r--r-- 2 boinc boinc 17537 Jun 22 18:21 start_atlas.sh [2024-06-22 22:41:06] drwxrwx--x 2 boinc boinc 4096 Jun 22 18:21 shared [2024-06-22 22:41:06] -rw-r--r-- 2 boinc boinc 482525 Jun 22 18:21 input.tar.gz [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 7598 Jun 22 18:21 init_data.xml [2024-06-22 22:41:06] -rw-r--r-- 2 boinc boinc 540182436 Jun 22 18:21 EVNT.38776210._001030.pool.root.1 [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 0 Jun 22 18:21 boinc_lockfile [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 2647 Jun 22 18:21 pandaJob.out [2024-06-22 22:41:06] -rw------- 1 boinc boinc 460 Jun 22 18:21 setup.sh.local [2024-06-22 22:41:06] -rw------- 1 boinc boinc 1025753 Jun 22 18:21 agis_schedconf.cvmfs.json [2024-06-22 22:41:06] -rw------- 1 boinc boinc 1321363 Jun 22 18:21 cric_ddmendpoints.json [2024-06-22 22:41:06] drwx------ 4 boinc boinc 4096 Jun 22 18:21 pilot3 [2024-06-22 22:41:06] -rw------- 1 boinc boinc 346307408 Jun 22 22:39 HITS.38921013._038669.pool.root.1 [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 532 Jun 22 22:39 boinc_task_state.xml [2024-06-22 22:41:06] -rw------- 1 boinc boinc 95 Jun 22 22:40 pilot_heartbeat.json [2024-06-22 22:41:06] -rw------- 1 boinc boinc 1030 Jun 22 22:40 memory_monitor_summary.json [2024-06-22 22:41:06] -rw------- 1 boinc boinc 0 Jun 22 22:40 agis_ddmendpoints.agis.ALL.json [2024-06-22 22:41:06] -rw------- 1 boinc boinc 487947 Jun 22 22:40 log.38921013._038669.job.log.tgz.1 [2024-06-22 22:41:06] -rw------- 1 boinc boinc 7699 Jun 22 22:40 heartbeat.json [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 8192 Jun 22 22:41 boinc_mmap_file [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 29 Jun 22 22:41 wrapper_checkpoint.txt [2024-06-22 22:41:06] -rw------- 1 boinc boinc 4414 Jun 22 22:41 pilotlog.txt [2024-06-22 22:41:06] -rw------- 1 boinc boinc 1570800 Jun 22 22:41 log.38921013._038669.job.log.1 [2024-06-22 22:41:06] -rw------- 1 boinc boinc 357 Jun 22 22:41 output.list [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 620 Jun 22 22:41 runtime_log [2024-06-22 22:41:06] -rw------- 1 boinc boinc 2078720 Jun 22 22:41 result.tar.gz [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 11460 Jun 22 22:41 runtime_log.err [2024-06-22 22:41:06] -rw------- 1 boinc boinc 645 Jun 22 22:41 m4PLDmplqc5n9Rq4apOajLDm4fhM0noT9bVo2ijZDmvmUKDmTakrKn.diag [2024-06-22 22:41:06] -rw-r--r-- 1 boinc boinc 21309 Jun 22 22:41 stderr.txt [2024-06-22 22:41:06] HITS file was successfully produced: [2024-06-22 22:41:06] -rw------- 1 boinc boinc 346307408 Jun 22 22:39 shared/HITS.pool.root.1 [2024-06-22 22:41:06] *** Contents of shared directory: *** [2024-06-22 22:41:06] total 868248 [2024-06-22 22:41:06] -rw-r--r-- 2 boinc boinc 17537 Jun 22 18:21 start_atlas.sh [2024-06-22 22:41:06] -rw-r--r-- 2 boinc boinc 482525 Jun 22 18:21 input.tar.gz [2024-06-22 22:41:06] -rw-r--r-- 2 boinc boinc 540182436 Jun 22 18:21 ATLAS.root_0 [2024-06-22 22:41:06] -rw------- 1 boinc boinc 346307408 Jun 22 22:39 HITS.pool.root.1 [2024-06-22 22:41:06] -rw------- 1 boinc boinc 2078720 Jun 22 22:41 result.tar.gz 22:41:07 (1181452): run_atlas exited; CPU time 166146.976742 22:41:07 (1181452): called boinc_finish(0) </stderr_txt> ]]>
©2024 CERN