Stderr output

<core_client_version>8.1.0</core_client_version>
<![CDATA[
<stderr_txt>
03:57:39 (2007074): wrapper (7.7.26015): starting
03:57:39 (2007074): wrapper: running run_atlas (--nthreads 9)
[2026-01-12 03:57:39] Arguments: --nthreads 9
[2026-01-12 03:57:39] Threads: 9
[2026-01-12 03:57:39] Checking for CVMFS
[2026-01-12 03:57:40] Probing /cvmfs/atlas.cern.ch... OK
[2026-01-12 03:57:41] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-01-12 03:57:41] Running cvmfs_config stat atlas.cern.ch
[2026-01-12 03:57:42] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-01-12 03:57:42] 2.13.3.0 13071 34186 255356 155045 3 54 24452640 32935937 17886 16776704 0 30116953 99.662 25864977 14095 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-01-12 03:57:42] CVMFS is ok
[2026-01-12 03:57:43] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-01-12 03:57:43] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-01-12 03:57:43] Further information can be found at the LHC@home message board.
[2026-01-12 03:57:43] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-01-12 03:57:43] Checking for apptainer binary...
[2026-01-12 03:57:43] Using apptainer found in PATH at /usr/bin/apptainer
[2026-01-12 03:57:43] Running /usr/bin/apptainer --version
[2026-01-12 03:57:43] apptainer version 1.4.5-2.el9
[2026-01-12 03:57:43] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-01-12 03:57:45] c6-12-25-4.aglt2.org
[2026-01-12 03:57:45] apptainer works
[2026-01-12 03:57:45] Set ATHENA_PROC_NUMBER=9
[2026-01-12 03:57:45] Set ATHENA_CORE_NUMBER=9
[2026-01-12 03:57:45] Starting ATLAS job with PandaID=6966860572
[2026-01-12 03:57:45] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
10:48:22 (2941061): wrapper (7.7.26015): starting
10:48:22 (2941061): wrapper: running run_atlas (--nthreads 8)
[2026-01-12 10:48:22] Arguments: --nthreads 8
[2026-01-12 10:48:22] Threads: 8
[2026-01-12 10:48:22] This job has been restarted, cleaning up previous attempt
[2026-01-12 10:48:22] Checking for CVMFS
[2026-01-12 10:48:23] Probing /cvmfs/atlas.cern.ch... OK
[2026-01-12 10:48:23] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-01-12 10:48:23] Running cvmfs_config stat atlas.cern.ch
[2026-01-12 10:48:24] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-01-12 10:48:24] 2.13.3.0 13071 34597 255784 155057 1 153 26431489 32935936 19775 16776704 0 30817984 99.662 26306481 14025 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-01-12 10:48:24] CVMFS is ok
[2026-01-12 10:48:24] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-01-12 10:48:24] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-01-12 10:48:24] Further information can be found at the LHC@home message board.
[2026-01-12 10:48:24] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-01-12 10:48:24] Checking for apptainer binary...
[2026-01-12 10:48:24] Using apptainer found in PATH at /usr/bin/apptainer
[2026-01-12 10:48:24] Running /usr/bin/apptainer --version
[2026-01-12 10:48:24] apptainer version 1.4.5-2.el9
[2026-01-12 10:48:24] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-01-12 10:48:25] c6-12-25-4.aglt2.org
[2026-01-12 10:48:25] apptainer works
[2026-01-12 10:48:25] Set ATHENA_PROC_NUMBER=8
[2026-01-12 10:48:25] Set ATHENA_CORE_NUMBER=8
[2026-01-12 10:48:25] Starting ATLAS job with PandaID=6966860572
[2026-01-12 10:48:25] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
07:00:05 (2941061): BOINC client no longer exists - exiting
07:00:05 (2941061): timer handler: client dead, exiting
07:09:44 (482441): wrapper (7.7.26015): starting
07:09:44 (482441): wrapper: running run_atlas (--nthreads 9)
[2026-01-15 07:09:44] Arguments: --nthreads 9
[2026-01-15 07:09:44] Threads: 9
[2026-01-15 07:09:44] This job has been restarted, cleaning up previous attempt
[2026-01-15 07:09:45] Checking for CVMFS
[2026-01-15 07:09:47] Probing /cvmfs/atlas.cern.ch... OK
[2026-01-15 07:09:47] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-01-15 07:09:47] Running cvmfs_config stat atlas.cern.ch
[2026-01-15 07:09:49] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-01-15 07:09:49] 2.13.3.0 13071 38698 255564 155170 3 19 20017692 32935936 25040 16776704 0 38839311 99.660 32334389 13493 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-01-15 07:09:49] CVMFS is ok
[2026-01-15 07:09:49] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-01-15 07:09:49] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-01-15 07:09:49] Further information can be found at the LHC@home message board.
[2026-01-15 07:09:49] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-01-15 07:09:49] Checking for apptainer binary...
[2026-01-15 07:09:49] Using apptainer found in PATH at /usr/bin/apptainer
[2026-01-15 07:09:49] Running /usr/bin/apptainer --version
[2026-01-15 07:09:49] apptainer version 1.4.5-2.el9
[2026-01-15 07:09:49] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-01-15 07:09:50] c6-12-25-4.aglt2.org
[2026-01-15 07:09:50] apptainer works
[2026-01-15 07:09:51] Set ATHENA_PROC_NUMBER=9
[2026-01-15 07:09:51] Set ATHENA_CORE_NUMBER=9
[2026-01-15 07:09:51] Starting ATLAS job with PandaID=6966860572
[2026-01-15 07:09:51] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
02:21:43 (171841): wrapper (7.7.26015): starting
02:21:43 (171841): wrapper: running run_atlas (--nthreads 9)
[2026-01-17 02:21:43] Arguments: --nthreads 9
[2026-01-17 02:21:43] Threads: 9
[2026-01-17 02:21:43] This job has been restarted, cleaning up previous attempt
[2026-01-17 02:21:44] Checking for CVMFS
[2026-01-17 02:21:44] Probing /cvmfs/atlas.cern.ch... OK
[2026-01-17 02:21:44] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-01-17 02:21:44] Running cvmfs_config stat atlas.cern.ch
[2026-01-17 02:21:45] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-01-17 02:21:45] 2.13.3.0 13071 41290 259092 155235 0 135 27901795 32935936 23637 16776704 0 46104069 99.646 39489077 13186 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-01-17 02:21:45] CVMFS is ok
[2026-01-17 02:21:45] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-01-17 02:21:45] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-01-17 02:21:45] Further information can be found at the LHC@home message board.
[2026-01-17 02:21:45] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-01-17 02:21:45] Checking for apptainer binary...
[2026-01-17 02:21:45] Using apptainer found in PATH at /usr/bin/apptainer
[2026-01-17 02:21:45] Running /usr/bin/apptainer --version
[2026-01-17 02:21:45] apptainer version 1.4.5-2.el9
[2026-01-17 02:21:45] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-01-17 02:21:46] c6-12-25-4.aglt2.org
[2026-01-17 02:21:46] apptainer works
[2026-01-17 02:21:46] Set ATHENA_PROC_NUMBER=9
[2026-01-17 02:21:46] Set ATHENA_CORE_NUMBER=9
[2026-01-17 02:21:46] Starting ATLAS job with PandaID=6966860572
[2026-01-17 02:21:46] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2026-01-20 23:36:38]  *** The last 200 lines of the pilot log: ***
[2026-01-20 23:36:38] 2026-01-21 04:34:55,938 | INFO     | mean y: 3747130.7532774946
[2026-01-20 23:36:38] 2026-01-21 04:34:55,939 | INFO     | intersect: -2396900047.6718307
[2026-01-20 23:36:38] 2026-01-21 04:34:56,061 | INFO     | chi2: 38.001683783426365
[2026-01-20 23:36:38] 2026-01-21 04:34:56,061 | INFO     | current chi2=38.001683783426365 (change=10.530690342135781 %)
[2026-01-20 23:36:38] 2026-01-21 04:34:56,061 | INFO     | right removable region: 5491
[2026-01-20 23:36:38] 2026-01-21 04:34:56,192 | INFO     | sum of square deviations: 51363646199245.41
[2026-01-20 23:36:38] 2026-01-21 04:34:56,904 | INFO     | monitor loop #10662: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:34:56,905 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:34:59,573 | INFO     | monitor loop #10663: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:34:59,574 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:02,185 | INFO     | monitor loop #10664: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:35:02,186 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:04,798 | INFO     | monitor loop #10665: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:35:04,799 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:07,590 | INFO     | monitor loop #10666: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:35:07,590 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:10,334 | INFO     | monitor loop #10667: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:35:10,335 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:12,893 | INFO     | monitor loop #10668: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:35:12,894 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:15,447 | INFO     | monitor loop #10669: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:35:15,448 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:17,992 | INFO     | monitor loop #10670: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:35:17,993 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:19,105 | INFO     | sum of deviations: 63961071524546.984
[2026-01-20 23:36:38] 2026-01-21 04:35:19,110 | INFO     | mean x: 1768802430.7312455
[2026-01-20 23:36:38] 2026-01-21 04:35:19,111 | INFO     | mean y: 3747116.458485069
[2026-01-20 23:36:38] 2026-01-21 04:35:19,111 | INFO     | intersect: -2198871022.1746683
[2026-01-20 23:36:38] 2026-01-21 04:35:19,151 | INFO     | chi2: 38.401579652980935
[2026-01-20 23:36:38] 2026-01-21 04:35:19,151 | INFO     | current chi2=38.401579652980935 (change=9.589195023455122 %)
[2026-01-20 23:36:38] 2026-01-21 04:35:19,152 | INFO     | left removable region: 10
[2026-01-20 23:36:38] 2026-01-21 04:35:19,194 | INFO     | sum of square deviations: 51055625197546.375
[2026-01-20 23:36:38] 2026-01-21 04:35:20,424 | INFO     | PID=195339 has CPU usage=19.4% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i P
[2026-01-20 23:36:38] 2026-01-21 04:35:20,428 | INFO     | .. there are 38 such processes running
[2026-01-20 23:36:38] 2026-01-21 04:35:20,577 | INFO     | monitor loop #10671: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:35:20,578 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:21,472 | INFO     | time since job start (335580s) is within the limit (349056.0s)
[2026-01-20 23:36:38] 2026-01-21 04:35:23,147 | INFO     | monitor loop #10672: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:35:23,148 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:23,586 | INFO     | time since job start (335582s) is within the limit (349056.0s)
[2026-01-20 23:36:38] 2026-01-21 04:35:25,616 | INFO     | time since job start (335584s) is within the limit (349056.0s)
[2026-01-20 23:36:38] 2026-01-21 04:35:25,757 | INFO     | monitor loop #10673: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:35:25,758 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:27,666 | INFO     | time since job start (335586s) is within the limit (349056.0s)
[2026-01-20 23:36:38] 2026-01-21 04:35:28,363 | INFO     | monitor loop #10674: job 0:6966860572 is in state 'finished'
[2026-01-20 23:36:38] 2026-01-21 04:35:28,363 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-01-20 23:36:38] 2026-01-21 04:35:29,715 | INFO     | time since job start (335588s) is within the limit (349056.0s)
[2026-01-20 23:36:38] 2026-01-21 04:35:30,465 | INFO     | sum of deviations: 65208779543448.82
[2026-01-20 23:36:38] 2026-01-21 04:35:30,531 | INFO     | mean x: 1768802400.243751
[2026-01-20 23:36:38] 2026-01-21 04:35:30,532 | INFO     | mean y: 3753143.4373289547
[2026-01-20 23:36:38] 2026-01-21 04:35:30,532 | INFO     | intersect: -2255379818.4475636
[2026-01-20 23:36:38] 2026-01-21 04:35:30,676 | INFO     | chi2: 30.999099185323768
[2026-01-20 23:36:38] 2026-01-21 04:35:30,678 | INFO     | current memory leak: 1.28 B/s (using 5481 data points, chi2=31.00)
[2026-01-20 23:36:38] 2026-01-21 04:35:30,733 | INFO     | could have reported an average CPU frequency of 999 MHz (181 samples)
[2026-01-20 23:36:38] 2026-01-21 04:35:30,734 | INFO     | ..............................
[2026-01-20 23:36:38] 2026-01-21 04:35:30,734 | INFO     | . Timing measurements:
[2026-01-20 23:36:38] 2026-01-21 04:35:30,735 | INFO     | . get job = 0 s
[2026-01-20 23:36:38] 2026-01-21 04:35:30,735 | INFO     | . initial setup = 3 s
[2026-01-20 23:36:38] 2026-01-21 04:35:30,735 | INFO     | . payload setup = 41 s
[2026-01-20 23:36:38] 2026-01-21 04:35:30,735 | INFO     | . stage-in = 0 s
[2026-01-20 23:36:38] 2026-01-21 04:35:30,736 | INFO     | . payload execution = 335336 s
[2026-01-20 23:36:38] 2026-01-21 04:35:30,744 | INFO     | . stage-out = 47 s
[2026-01-20 23:36:38] 2026-01-21 04:35:30,745 | INFO     | . log creation = 18 s
[2026-01-20 23:36:38] 2026-01-21 04:35:30,745 | INFO     | ..............................
[2026-01-20 23:36:38] 2026-01-21 04:35:31,776 | INFO     | time since job start (335590s) is within the limit (349056.0s)
[2026-01-20 23:36:38] 2026-01-21 04:35:31,977 | INFO     | 
[2026-01-20 23:36:38] 2026-01-21 04:35:31,978 | INFO     | job summary report
[2026-01-20 23:36:38] 2026-01-21 04:35:31,978 | INFO     | --------------------------------------------------
[2026-01-20 23:36:38] 2026-01-21 04:35:31,978 | INFO     | PanDA job id: 6966860572
[2026-01-20 23:36:38] 2026-01-21 04:35:31,979 | INFO     | task id: 48187943
[2026-01-20 23:36:38] 2026-01-21 04:35:31,979 | INFO     | errors: (none)
[2026-01-20 23:36:38] 2026-01-21 04:35:31,979 | INFO     | status: LOG_TRANSFER = DONE 
[2026-01-20 23:36:38] 2026-01-21 04:35:31,979 | INFO     | pilot state: finished 
[2026-01-20 23:36:38] 2026-01-21 04:35:31,979 | INFO     | transexitcode: 0
[2026-01-20 23:36:38] 2026-01-21 04:35:31,980 | INFO     | exeerrorcode: 0
[2026-01-20 23:36:38] 2026-01-21 04:35:31,980 | INFO     | exeerrordiag: 
[2026-01-20 23:36:38] 2026-01-21 04:35:31,980 | INFO     | exitcode: 0
[2026-01-20 23:36:38] 2026-01-21 04:35:31,980 | INFO     | exitmsg: OK
[2026-01-20 23:36:38] 2026-01-21 04:35:31,980 | INFO     | cpuconsumptiontime: 844156 s
[2026-01-20 23:36:38] 2026-01-21 04:35:31,981 | INFO     | nevents: 2050
[2026-01-20 23:36:38] 2026-01-21 04:35:31,981 | INFO     | neventsw: 0
[2026-01-20 23:36:38] 2026-01-21 04:35:31,990 | INFO     | pid: 244880
[2026-01-20 23:36:38] 2026-01-21 04:35:31,990 | INFO     | pgrp: 244880
[2026-01-20 23:36:38] 2026-01-21 04:35:31,991 | INFO     | corecount: 9
[2026-01-20 23:36:38] 2026-01-21 04:35:31,991 | INFO     | event service: False
[2026-01-20 23:36:38] 2026-01-21 04:35:31,991 | INFO     | sizes: {0: 2283793, 1: 2284478, 2: 2284677, 13: 2284677, 18: 2284995, 24: 2285023, 335388: 2458343, 335390: 2458342, 335439: 2467396, 335440: 2467452, 335552: 2467
[2026-01-20 23:36:38] 2026-01-21 04:35:31,991 | INFO     | --------------------------------------------------
[2026-01-20 23:36:38] 2026-01-21 04:35:31,991 | INFO     | 
[2026-01-20 23:36:38] 2026-01-21 04:35:31,992 | INFO     | executing command: ls -lF /tmp/boinchome/slots/0
[2026-01-20 23:36:38] 2026-01-21 04:35:32,221 | INFO     | queue jobs had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,222 | INFO     | queue payloads had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,222 | INFO     | queue data_in had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,223 | INFO     | queue data_out had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,223 | INFO     | queue current_data_in had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,223 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,223 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,224 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,249 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,250 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,250 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,250 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,251 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,251 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,251 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,251 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,252 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,252 | INFO     | queue completed_jobids has 1 job(s)
[2026-01-20 23:36:38] 2026-01-21 04:35:32,252 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,252 | INFO     | queue messages had 0 job(s) [purged]
[2026-01-20 23:36:38] 2026-01-21 04:35:32,272 | INFO     | job 6966860572 has completed (purged errors)
[2026-01-20 23:36:38] 2026-01-21 04:35:32,273 | INFO     | overall cleanup function is called
[2026-01-20 23:36:38] 2026-01-21 04:35:33,380 | INFO     | --- collectZombieJob: --- 10, [244880]
[2026-01-20 23:36:38] 2026-01-21 04:35:33,381 | INFO     | zombie collector waiting for pid 244880
[2026-01-20 23:36:38] 2026-01-21 04:35:33,381 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2026-01-20 23:36:38] 2026-01-21 04:35:33,381 | INFO     | collected zombie processes
[2026-01-20 23:36:38] 2026-01-21 04:35:33,381 | INFO     | will attempt to kill all subprocesses of pid=244880
[2026-01-20 23:36:38] 2026-01-21 04:35:39,737 | INFO     | process IDs to be killed: [244880] (in reverse order)
[2026-01-20 23:36:38] 2026-01-21 04:35:40,384 | WARNING  | found no corresponding commands to process id(s)
[2026-01-20 23:36:38] 2026-01-21 04:35:40,395 | INFO     | Do not look for orphan processes in BOINC jobs
[2026-01-20 23:36:38] 2026-01-21 04:35:40,480 | INFO     | did not find any defunct processes belonging to 244880
[2026-01-20 23:36:38] 2026-01-21 04:35:40,600 | INFO     | did not find any defunct processes belonging to 244880
[2026-01-20 23:36:38] 2026-01-21 04:35:40,667 | INFO     | ready for new job
[2026-01-20 23:36:38] 2026-01-21 04:35:40,667 | INFO     | pilot has finished with previous job - re-establishing logging
[2026-01-20 23:36:38] 2026-01-21 04:35:40,878 | INFO     | ***************************************
[2026-01-20 23:36:38] 2026-01-21 04:35:40,879 | INFO     | ***  PanDA Pilot version 3.11.2.19  ***
[2026-01-20 23:36:38] 2026-01-21 04:35:40,879 | INFO     | ***************************************
[2026-01-20 23:36:38] 2026-01-21 04:35:40,893 | INFO     | 
[2026-01-20 23:36:38] 2026-01-21 04:35:40,962 | INFO     | architecture information:
[2026-01-20 23:36:38] 2026-01-21 04:35:41,015 | INFO     | executing command: cat /etc/os-release
[2026-01-20 23:36:38] 2026-01-21 04:35:41,211 | INFO     | cat /etc/os-release:
[2026-01-20 23:36:38] NAME="CentOS Linux"
[2026-01-20 23:36:38] VERSION="7 (Core)"
[2026-01-20 23:36:38] ID="centos"
[2026-01-20 23:36:38] ID_LIKE="rhel fedora"
[2026-01-20 23:36:38] VERSION_ID="7"
[2026-01-20 23:36:38] PRETTY_NAME="CentOS Linux 7 (Core)"
[2026-01-20 23:36:38] ANSI_COLOR="0;31"
[2026-01-20 23:36:38] CPE_NAME="cpe:/o:centos:centos:7"
[2026-01-20 23:36:38] HOME_URL="https://www.centos.org/"
[2026-01-20 23:36:38] BUG_REPORT_URL="https://bugs.centos.org/"
[2026-01-20 23:36:38] 
[2026-01-20 23:36:38] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2026-01-20 23:36:38] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2026-01-20 23:36:38] REDHAT_SUPPORT_PRODUCT="centos"
[2026-01-20 23:36:38] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2026-01-20 23:36:38] 
[2026-01-20 23:36:38] 2026-01-21 04:35:41,212 | INFO     | ***************************************
[2026-01-20 23:36:38] 2026-01-21 04:35:41,753 | INFO     | executing command: df -mP /tmp/boinchome/slots/0
[2026-01-20 23:36:38] 2026-01-21 04:35:41,943 | INFO     | sufficient remaining disk space (87449141248 B)
[2026-01-20 23:36:38] 2026-01-21 04:35:41,944 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2026-01-20 23:36:38] 2026-01-21 04:35:41,944 | INFO     | current server update state: UPDATING_FINAL
[2026-01-20 23:36:38] 2026-01-21 04:35:41,944 | INFO     | update_server=False
[2026-01-20 23:36:38] 2026-01-21 04:35:41,945 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2026-01-20 23:36:38] 2026-01-21 04:35:41,945 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2026-01-20 23:36:38] 2026-01-21 04:35:41,945 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2026-01-20 23:36:38] 2026-01-21 04:35:42,050 | INFO     | all data control threads have been joined
[2026-01-20 23:36:38] 2026-01-21 04:35:42,261 | INFO     | all payload control threads have been joined
[2026-01-20 23:36:38] 2026-01-21 04:35:42,506 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2026-01-20 23:36:38] 2026-01-21 04:35:42,507 | INFO     | aborting loop
[2026-01-20 23:36:38] 2026-01-21 04:35:42,950 | INFO     | [job] retrieve thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:42,956 | INFO     | [job] queue monitor thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:43,065 | INFO     | [data] control thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:43,145 | INFO     | [job] create_data_payload thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:43,151 | INFO     | [payload] validate_pre thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:43,176 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2026-01-20 23:36:38] 2026-01-21 04:35:43,236 | INFO     | [payload] failed_post thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:43,267 | INFO     | [payload] control thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:43,421 | INFO     | [payload] validate_post thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:43,458 | INFO     | all job control threads have been joined
[2026-01-20 23:36:38] 2026-01-21 04:35:43,537 | INFO     | [job] job monitor thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:43,650 | INFO     | [payload] execute_payloads thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:43,893 | INFO     | [job] validate thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:44,023 | INFO     | [payload] run_realtimelog thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:44,402 | INFO     | [data] copytool_in thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:44,478 | INFO     | [job] control thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:45,210 | INFO     | [data] copytool_out thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:35:45,960 | INFO     | [data] queue_monitor thread has finished
[2026-01-20 23:36:38] 2026-01-21 04:36:14,108 | INFO     | PID=195339 has CPU usage=12.0% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i P
[2026-01-20 23:36:38] 2026-01-21 04:36:14,109 | INFO     | .. there are 39 such processes running
[2026-01-20 23:36:38] 2026-01-21 04:36:14,127 | INFO     | found 0 job(s) in 20 queues
[2026-01-20 23:36:38] 2026-01-21 04:36:14,128 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2026-01-20 23:36:38] 2026-01-21 04:36:14,128 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2026-01-20 23:36:38] 2026-01-21 04:36:28,463 | INFO     | [monitor] cgroup control has ended
[2026-01-20 23:36:38] 2026-01-21 04:36:29,658 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140213100734272)>', '<ExcThread(monitor, started 140212554426112)>']
[2026-01-20 23:36:38] 2026-01-21 04:36:30,242 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2026-01-20 23:36:38] 2026-01-21 04:36:30,243 | INFO     | [monitor] control thread has ended
[2026-01-20 23:36:38] 2026-01-21 04:36:34,684 | INFO     | all workflow threads have been joined
[2026-01-20 23:36:38] 2026-01-21 04:36:34,706 | INFO     | end of generic workflow (traces error code: 0)
[2026-01-20 23:36:38] 2026-01-21 04:36:34,707 | INFO     | traces error code: 0
[2026-01-20 23:36:38] 2026-01-21 04:36:34,708 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2026-01-20 23:36:38] 2026-01-21 04:36:35,712 [wrapper] ==== pilot stdout END ====
[2026-01-20 23:36:38] 2026-01-21 04:36:35,738 [wrapper] ==== wrapper stdout RESUME ====
[2026-01-20 23:36:38] 2026-01-21 04:36:35,777 [wrapper] pilotpid: 195339
[2026-01-20 23:36:38] 2026-01-21 04:36:35,798 [wrapper] Pilot exit status: 0
[2026-01-20 23:36:38] 2026-01-21 04:36:36,062 [wrapper] pandaids: 6966860572 6966860572 6966860572 6966860572
[2026-01-20 23:36:38] 2026-01-21 04:36:36,695 [wrapper] cleanup supervisor_pilot 3065378 195340
[2026-01-20 23:36:38] 2026-01-21 04:36:36,744 [wrapper] Test setup, not cleaning
[2026-01-20 23:36:38] 2026-01-21 04:36:36,809 [wrapper] apfmon messages muted
[2026-01-20 23:36:38] 2026-01-21 04:36:36,844 [wrapper] ==== wrapper stdout END ====
[2026-01-20 23:36:38] 2026-01-21 04:36:36,876 [wrapper] ==== wrapper stderr END ====
[2026-01-20 23:36:38]  *** Error codes and diagnostics ***
[2026-01-20 23:36:38]     "exeErrorCode": 0,
[2026-01-20 23:36:38]     "exeErrorDiag": "",
[2026-01-20 23:36:38]     "pilotErrorCode": 0,
[2026-01-20 23:36:38]     "pilotErrorDiag": "",
[2026-01-20 23:36:38]  *** Listing of results directory ***
[2026-01-20 23:36:38] total 1860164
[2026-01-20 23:36:38] drwx------. 5 boincer umatlas       4096 Dec  3 09:30 pilot3
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas     579449 Jan 12 03:50 pilot3.tar.gz
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas       5112 Jan 12 03:53 queuedata.json
[2026-01-20 23:36:38] -rwx------. 1 boincer umatlas      36322 Jan 12 03:54 runpilot2-wrapper.sh
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas        100 Jan 12 03:57 wrapper_26015_x86_64-pc-linux-gnu
[2026-01-20 23:36:38] -rwxr-xr-x. 1 boincer umatlas       7986 Jan 12 03:57 run_atlas
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas        105 Jan 12 03:57 job.xml
[2026-01-20 23:36:38] -rw-r--r--. 3 boincer umatlas  321583132 Jan 12 03:57 EVNT.48118027._000180.pool.root.1
[2026-01-20 23:36:38] -rw-r--r--. 3 boincer umatlas  321583132 Jan 12 03:57 ATLAS.root_0
[2026-01-20 23:36:38] -rw-r--r--. 2 boincer umatlas      15847 Jan 12 03:57 start_atlas.sh
[2026-01-20 23:36:38] drwxrwx--x. 2 boincer umatlas       4096 Jan 12 03:57 shared
[2026-01-20 23:36:38] -rw-r--r--. 2 boincer umatlas     592608 Jan 12 03:57 input.tar.gz
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas          0 Jan 12 03:57 boinc_lockfile
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas       2896 Jan 17 02:21 pandaJob.out
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas         57 Jan 17 02:21 setup.sh.local
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas    1004099 Jan 17 02:22 agis_schedconf.cvmfs.json
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas        535 Jan 20 22:30 boinc_task_state.xml
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas 1190199449 Jan 20 23:27 HITS.48187943._000878.pool.root.1
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas       6860 Jan 20 23:29 init_data.xml
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas       1079 Jan 20 23:32 memory_monitor_summary.json
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas    1516246 Jan 20 23:33 agis_ddmendpoints.agis.ALL.json
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas    4977168 Jan 20 23:33 log.48187943._000878.job.log.tgz.1
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas      26589 Jan 20 23:35 heartbeat.json
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas         96 Jan 20 23:36 pilot_heartbeat.json
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas       4824 Jan 20 23:36 pilotlog.txt
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas       8192 Jan 20 23:36 boinc_mmap_file
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas         31 Jan 20 23:36 wrapper_checkpoint.txt
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas   28749288 Jan 20 23:36 log.48187943._000878.job.log.1
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas        353 Jan 20 23:36 output.list
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas        620 Jan 20 23:36 runtime_log
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas   33761280 Jan 20 23:36 result.tar.gz
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas       1048 Jan 20 23:36 uTYLDmBsSz8n9Rq4apOajLDm4fhM0noT9bVo0NGKDm3mhKDmzjKxsm.diag
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas       9439 Jan 20 23:36 runtime_log.err
[2026-01-20 23:36:38] -rw-r--r--. 1 boincer umatlas      28873 Jan 20 23:36 stderr.txt
[2026-01-20 23:36:38] HITS file was successfully produced:
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas 1190199449 Jan 20 23:27 shared/HITS.pool.root.1
[2026-01-20 23:36:38]  *** Contents of shared directory: ***
[2026-01-20 23:36:38] total 1509932
[2026-01-20 23:36:38] -rw-r--r--. 3 boincer umatlas  321583132 Jan 12 03:57 ATLAS.root_0
[2026-01-20 23:36:38] -rw-r--r--. 2 boincer umatlas      15847 Jan 12 03:57 start_atlas.sh
[2026-01-20 23:36:38] -rw-r--r--. 2 boincer umatlas     592608 Jan 12 03:57 input.tar.gz
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas 1190199449 Jan 20 23:27 HITS.pool.root.1
[2026-01-20 23:36:38] -rw-------. 1 boincer umatlas   33761280 Jan 20 23:36 result.tar.gz
23:36:40 (171841): run_atlas exited; CPU time 864073.765129
23:36:40 (171841): called boinc_finish(0)

</stderr_txt>
]]>

©2026 CERN