Stderr output

<core_client_version>7.7.0</core_client_version>
<![CDATA[
<stderr_txt>
01:14:14 (362): wrapper (7.7.26015): starting
01:14:14 (362): wrapper: running run_atlas (--nthreads 8)
[2026-03-26 01:14:14] Arguments: --nthreads 8
[2026-03-26 01:14:14] Threads: 8
[2026-03-26 01:14:14] Checking for CVMFS
[2026-03-26 01:14:14] Probing /cvmfs/atlas.cern.ch... OK
[2026-03-26 01:14:14] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-03-26 01:14:14] Running cvmfs_config stat atlas.cern.ch
[2026-03-26 01:14:14] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-03-26 01:14:14] 2.11.2.0 3838 314830 138772 157708 2 52 10526995 18432000 917 130560 0 219021367 99.989 10816056 24705 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-03-26 01:14:14] CVMFS is ok
[2026-03-26 01:14:14] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-03-26 01:14:14] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-03-26 01:14:14] Further information can be found at the LHC@home message board.
[2026-03-26 01:14:14] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-03-26 01:14:14] Checking for apptainer binary...
[2026-03-26 01:14:14] Using apptainer found in PATH at /usr/bin/apptainer
[2026-03-26 01:14:14] Running /usr/bin/apptainer --version
[2026-03-26 01:14:14] apptainer version 1.3.2-1.el7
[2026-03-26 01:14:14] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-03-26 01:14:15] c-206-4.aglt2.org
[2026-03-26 01:14:15] apptainer works
[2026-03-26 01:14:15] Set ATHENA_PROC_NUMBER=8
[2026-03-26 01:14:15] Set ATHENA_CORE_NUMBER=8
[2026-03-26 01:14:15] Starting ATLAS job with PandaID=7057542047
[2026-03-26 01:14:15] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
05:11:40 (29958): wrapper (7.7.26015): starting
05:11:40 (29958): wrapper: running run_atlas (--nthreads 8)
[2026-03-26 05:11:40] Arguments: --nthreads 8
[2026-03-26 05:11:40] Threads: 8
[2026-03-26 05:11:40] This job has been restarted, cleaning up previous attempt
[2026-03-26 05:11:40] Checking for CVMFS
[2026-03-26 05:11:40] Probing /cvmfs/atlas.cern.ch... OK
[2026-03-26 05:11:40] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-03-26 05:11:40] Running cvmfs_config stat atlas.cern.ch
[2026-03-26 05:11:40] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-03-26 05:11:40] 2.11.2.0 3838 315068 137828 157713 1 32 10564355 18432000 1 130560 0 219225129 99.989 10823286 24711 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-03-26 05:11:40] CVMFS is ok
[2026-03-26 05:11:40] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-03-26 05:11:40] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-03-26 05:11:40] Further information can be found at the LHC@home message board.
[2026-03-26 05:11:40] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-03-26 05:11:40] Checking for apptainer binary...
[2026-03-26 05:11:40] Using apptainer found in PATH at /usr/bin/apptainer
[2026-03-26 05:11:40] Running /usr/bin/apptainer --version
[2026-03-26 05:11:40] apptainer version 1.3.2-1.el7
[2026-03-26 05:11:40] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-03-26 05:11:41] c-206-4.aglt2.org
[2026-03-26 05:11:41] apptainer works
[2026-03-26 05:11:41] Set ATHENA_PROC_NUMBER=8
[2026-03-26 05:11:41] Set ATHENA_CORE_NUMBER=8
[2026-03-26 05:11:41] Starting ATLAS job with PandaID=7057542047
[2026-03-26 05:11:41] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2026-03-26 11:34:40]  *** The last 200 lines of the pilot log: ***
[2026-03-26 11:34:40] 2026-03-26 15:33:40,274 | INFO     | intersect: -10974471193.851624
[2026-03-26 11:34:40] 2026-03-26 15:33:40,274 | INFO     | chi2: 1.4392181643462503
[2026-03-26 11:34:40] 2026-03-26 15:33:40,275 | INFO     | sum of square deviations: 15706536352.5
[2026-03-26 11:34:40] 2026-03-26 15:33:40,280 | INFO     | sum of deviations: 99420416107.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,280 | INFO     | mean x: 1774527595.5
[2026-03-26 11:34:40] 2026-03-26 15:33:40,281 | INFO     | mean y: 2494022.7405405403
[2026-03-26 11:34:40] 2026-03-26 15:33:40,281 | INFO     | intersect: -11230044328.076878
[2026-03-26 11:34:40] 2026-03-26 15:33:40,281 | INFO     | chi2: 1.4390536828449918
[2026-03-26 11:34:40] 2026-03-26 15:33:40,281 | INFO     | current chi2=1.4390536828449918 (change=0.011428531499474735 %)
[2026-03-26 11:34:40] 2026-03-26 15:33:40,281 | INFO     | right removable region: 369
[2026-03-26 11:34:40] 2026-03-26 15:33:40,282 | INFO     | sum of square deviations: 15706536352.5
[2026-03-26 11:34:40] 2026-03-26 15:33:40,285 | INFO     | sum of deviations: 43366038687.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,285 | INFO     | mean x: 1774527900.5
[2026-03-26 11:34:40] 2026-03-26 15:33:40,285 | INFO     | mean y: 2508008.9567567566
[2026-03-26 11:34:40] 2026-03-26 15:33:40,285 | INFO     | intersect: -4896996493.95646
[2026-03-26 11:34:40] 2026-03-26 15:33:40,285 | INFO     | chi2: 0.07236963264108248
[2026-03-26 11:34:40] 2026-03-26 15:33:40,285 | INFO     | current chi2=0.07236963264108248 (change=94.97160094043451 %)
[2026-03-26 11:34:40] 2026-03-26 15:33:40,286 | INFO     | sum of square deviations: 15078347830.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,289 | INFO     | sum of deviations: 28158806274.999996
[2026-03-26 11:34:40] 2026-03-26 15:33:40,289 | INFO     | mean x: 1774528053.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,289 | INFO     | mean y: 2511686.8328767125
[2026-03-26 11:34:40] 2026-03-26 15:33:40,289 | INFO     | intersect: -3311418475.632405
[2026-03-26 11:34:40] 2026-03-26 15:33:40,289 | INFO     | chi2: 0.0046707901999300805
[2026-03-26 11:34:40] 2026-03-26 15:33:40,290 | INFO     | current chi2=0.0046707901999300805 (change=93.54592523207229 %)
[2026-03-26 11:34:40] 2026-03-26 15:33:40,290 | INFO     | sum of square deviations: 14467136370.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,293 | INFO     | sum of deviations: 24650487685.499996
[2026-03-26 11:34:40] 2026-03-26 15:33:40,293 | INFO     | mean x: 1774528205.5
[2026-03-26 11:34:40] 2026-03-26 15:33:40,293 | INFO     | mean y: 2512561.158333333
[2026-03-26 11:34:40] 2026-03-26 15:33:40,293 | INFO     | intersect: -3021097955.7065296
[2026-03-26 11:34:40] 2026-03-26 15:33:40,293 | INFO     | chi2: 0.0030572760434137373
[2026-03-26 11:34:40] 2026-03-26 15:33:40,293 | INFO     | current chi2=0.0030572760434137373 (change=34.54477909413479 %)
[2026-03-26 11:34:40] 2026-03-26 15:33:40,294 | INFO     | sum of square deviations: 13872669410.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,296 | INFO     | sum of deviations: 21990854471.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,297 | INFO     | mean x: 1774528358.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,297 | INFO     | mean y: 2513243.1492957748
[2026-03-26 11:34:40] 2026-03-26 15:33:40,297 | INFO     | intersect: -2810456180.5515885
[2026-03-26 11:34:40] 2026-03-26 15:33:40,297 | INFO     | chi2: 0.0022860367571817426
[2026-03-26 11:34:40] 2026-03-26 15:33:40,297 | INFO     | current chi2=0.0022860367571817426 (change=25.226354286635928 %)
[2026-03-26 11:34:40] 2026-03-26 15:33:40,298 | INFO     | sum of square deviations: 13294714387.5
[2026-03-26 11:34:40] 2026-03-26 15:33:40,300 | INFO     | sum of deviations: 19779199736.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,300 | INFO     | mean x: 1774528510.5
[2026-03-26 11:34:40] 2026-03-26 15:33:40,300 | INFO     | mean y: 2513826.52
[2026-03-26 11:34:40] 2026-03-26 15:33:40,301 | INFO     | intersect: -2637539417.452412
[2026-03-26 11:34:40] 2026-03-26 15:33:40,301 | INFO     | chi2: 0.0017974448288808039
[2026-03-26 11:34:40] 2026-03-26 15:33:40,301 | INFO     | current chi2=0.0017974448288808039 (change=21.372881549957295 %)
[2026-03-26 11:34:40] 2026-03-26 15:33:40,301 | INFO     | left removable region: 50
[2026-03-26 11:34:40] 2026-03-26 15:33:40,302 | INFO     | sum of square deviations: 10065751520.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,304 | INFO     | sum of deviations: 14263451270.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,304 | INFO     | mean x: 1774529090.0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,304 | INFO     | mean y: 2515049.905956113
[2026-03-26 11:34:40] 2026-03-26 15:33:40,304 | INFO     | intersect: -2512042273.719736
[2026-03-26 11:34:40] 2026-03-26 15:33:40,304 | INFO     | chi2: 0.0014511708090824455
[2026-03-26 11:34:40] 2026-03-26 15:33:40,305 | INFO     | current memory leak: 1.42 B/s (using 319 data points, chi2=0.00)
[2026-03-26 11:34:40] 2026-03-26 15:33:40,305 | INFO     | could have reported an average CPU frequency of 2067 MHz (16 samples)
[2026-03-26 11:34:40] 2026-03-26 15:33:40,305 | INFO     | ..............................
[2026-03-26 11:34:40] 2026-03-26 15:33:40,305 | INFO     | . Timing measurements:
[2026-03-26 11:34:40] 2026-03-26 15:33:40,305 | INFO     | . get job = 0 s
[2026-03-26 11:34:40] 2026-03-26 15:33:40,306 | INFO     | . initial setup = 2 s
[2026-03-26 11:34:40] 2026-03-26 15:33:40,306 | INFO     | . payload setup = 9 s
[2026-03-26 11:34:40] 2026-03-26 15:33:40,306 | INFO     | . stage-in = 0 s
[2026-03-26 11:34:40] 2026-03-26 15:33:40,306 | INFO     | . payload execution = 22875 s
[2026-03-26 11:34:40] 2026-03-26 15:33:40,306 | INFO     | . stage-out = 2 s
[2026-03-26 11:34:40] 2026-03-26 15:33:40,306 | INFO     | . log creation = 0 s
[2026-03-26 11:34:40] 2026-03-26 15:33:40,306 | INFO     | ..............................
[2026-03-26 11:34:40] 2026-03-26 15:33:40,382 | INFO     | 
[2026-03-26 11:34:40] 2026-03-26 15:33:40,382 | INFO     | job summary report
[2026-03-26 11:34:40] 2026-03-26 15:33:40,382 | INFO     | --------------------------------------------------
[2026-03-26 11:34:40] 2026-03-26 15:33:40,382 | INFO     | PanDA job id: 7057542047
[2026-03-26 11:34:40] 2026-03-26 15:33:40,382 | INFO     | task id: 49176370
[2026-03-26 11:34:40] 2026-03-26 15:33:40,383 | INFO     | errors: (none)
[2026-03-26 11:34:40] 2026-03-26 15:33:40,383 | INFO     | status: LOG_TRANSFER = DONE 
[2026-03-26 11:34:40] 2026-03-26 15:33:40,383 | INFO     | pilot state: finished 
[2026-03-26 11:34:40] 2026-03-26 15:33:40,383 | INFO     | transexitcode: 0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,383 | INFO     | exeerrorcode: 0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,383 | INFO     | exeerrordiag: 
[2026-03-26 11:34:40] 2026-03-26 15:33:40,384 | INFO     | exitcode: 0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,384 | INFO     | exitmsg: OK
[2026-03-26 11:34:40] 2026-03-26 15:33:40,384 | INFO     | cpuconsumptiontime: 176025 s
[2026-03-26 11:34:40] 2026-03-26 15:33:40,384 | INFO     | nevents: 400
[2026-03-26 11:34:40] 2026-03-26 15:33:40,384 | INFO     | neventsw: 0
[2026-03-26 11:34:40] 2026-03-26 15:33:40,385 | INFO     | pid: 17336
[2026-03-26 11:34:40] 2026-03-26 15:33:40,385 | INFO     | pgrp: 17336
[2026-03-26 11:34:40] 2026-03-26 15:33:40,385 | INFO     | corecount: 8
[2026-03-26 11:34:40] 2026-03-26 15:33:40,385 | INFO     | event service: False
[2026-03-26 11:34:40] 2026-03-26 15:33:40,385 | INFO     | sizes: {0: 2279874, 1: 2280335, 11: 2280335, 22889: 2314897, 22892: 2323951, 22893: 2324089}
[2026-03-26 11:34:40] 2026-03-26 15:33:40,385 | INFO     | --------------------------------------------------
[2026-03-26 11:34:40] 2026-03-26 15:33:40,386 | INFO     | 
[2026-03-26 11:34:40] 2026-03-26 15:33:40,386 | INFO     | executing command: ls -lF /tmp/boinchome/slots/1
[2026-03-26 11:34:40] 2026-03-26 15:33:40,399 | INFO     | queue jobs had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,400 | INFO     | queue payloads had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,400 | INFO     | queue data_in had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,400 | INFO     | queue data_out had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,400 | INFO     | queue current_data_in had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,400 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,400 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,401 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,401 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,401 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,401 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,401 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,402 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,402 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,402 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,402 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,402 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,402 | INFO     | queue completed_jobids has 1 job(s)
[2026-03-26 11:34:40] 2026-03-26 15:33:40,403 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,403 | INFO     | queue messages had 0 job(s) [purged]
[2026-03-26 11:34:40] 2026-03-26 15:33:40,403 | INFO     | job 7057542047 has completed (purged errors)
[2026-03-26 11:34:40] 2026-03-26 15:33:40,403 | INFO     | overall cleanup function is called
[2026-03-26 11:34:40] 2026-03-26 15:33:41,412 | INFO     | --- collectZombieJob: --- 10, [17336]
[2026-03-26 11:34:40] 2026-03-26 15:33:41,412 | INFO     | zombie collector waiting for pid 17336
[2026-03-26 11:34:40] 2026-03-26 15:33:41,412 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2026-03-26 11:34:40] 2026-03-26 15:33:41,412 | INFO     | collected zombie processes
[2026-03-26 11:34:40] 2026-03-26 15:33:41,413 | INFO     | will attempt to kill all subprocesses of pid=17336
[2026-03-26 11:34:40] 2026-03-26 15:33:41,518 | INFO     | process IDs to be killed: [17336] (in reverse order)
[2026-03-26 11:34:40] 2026-03-26 15:33:41,555 | WARNING  | found no corresponding commands to process id(s)
[2026-03-26 11:34:40] 2026-03-26 15:33:41,556 | INFO     | Do not look for orphan processes in BOINC jobs
[2026-03-26 11:34:40] 2026-03-26 15:33:41,558 | INFO     | did not find any defunct processes belonging to 17336
[2026-03-26 11:34:40] 2026-03-26 15:33:41,560 | INFO     | did not find any defunct processes belonging to 17336
[2026-03-26 11:34:40] 2026-03-26 15:33:41,561 | INFO     | ready for new job
[2026-03-26 11:34:40] 2026-03-26 15:33:41,561 | INFO     | pilot has finished with previous job - re-establishing logging
[2026-03-26 11:34:40] 2026-03-26 15:33:41,563 | INFO     | **************************************
[2026-03-26 11:34:40] 2026-03-26 15:33:41,563 | INFO     | ***  PanDA Pilot version 3.11.5.1  ***
[2026-03-26 11:34:40] 2026-03-26 15:33:41,563 | INFO     | **************************************
[2026-03-26 11:34:40] 2026-03-26 15:33:41,563 | INFO     | 
[2026-03-26 11:34:40] 2026-03-26 15:33:41,564 | INFO     | architecture information:
[2026-03-26 11:34:40] 2026-03-26 15:33:41,564 | INFO     | executing command: cat /etc/os-release
[2026-03-26 11:34:40] 2026-03-26 15:33:41,573 | INFO     | cat /etc/os-release:
[2026-03-26 11:34:40] NAME="CentOS Linux"
[2026-03-26 11:34:40] VERSION="7 (Core)"
[2026-03-26 11:34:40] ID="centos"
[2026-03-26 11:34:40] ID_LIKE="rhel fedora"
[2026-03-26 11:34:40] VERSION_ID="7"
[2026-03-26 11:34:40] PRETTY_NAME="CentOS Linux 7 (Core)"
[2026-03-26 11:34:40] ANSI_COLOR="0;31"
[2026-03-26 11:34:40] CPE_NAME="cpe:/o:centos:centos:7"
[2026-03-26 11:34:40] HOME_URL="https://www.centos.org/"
[2026-03-26 11:34:40] BUG_REPORT_URL="https://bugs.centos.org/"
[2026-03-26 11:34:40] 
[2026-03-26 11:34:40] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2026-03-26 11:34:40] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2026-03-26 11:34:40] REDHAT_SUPPORT_PRODUCT="centos"
[2026-03-26 11:34:40] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2026-03-26 11:34:40] 
[2026-03-26 11:34:40] 2026-03-26 15:33:41,573 | INFO     | **************************************
[2026-03-26 11:34:40] 2026-03-26 15:33:42,076 | INFO     | executing command: df -mP /tmp/boinchome/slots/1
[2026-03-26 11:34:40] 2026-03-26 15:33:42,091 | INFO     | sufficient remaining disk space (28037873664 B)
[2026-03-26 11:34:40] 2026-03-26 15:33:42,092 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2026-03-26 11:34:40] 2026-03-26 15:33:42,092 | INFO     | current server update state: UPDATING_FINAL
[2026-03-26 11:34:40] 2026-03-26 15:33:42,092 | INFO     | update_server=False
[2026-03-26 11:34:40] 2026-03-26 15:33:42,092 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2026-03-26 11:34:40] 2026-03-26 15:33:42,093 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2026-03-26 11:34:40] 2026-03-26 15:33:42,093 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2026-03-26 11:34:40] 2026-03-26 15:33:42,244 | INFO     | job.realtimelogging is not enabled
[2026-03-26 11:34:40] 2026-03-26 15:33:42,449 | INFO     | all data control threads have been joined
[2026-03-26 11:34:40] 2026-03-26 15:33:42,552 | INFO     | all job control threads have been joined
[2026-03-26 11:34:40] 2026-03-26 15:33:42,669 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2026-03-26 11:34:40] 2026-03-26 15:33:42,669 | INFO     | aborting loop
[2026-03-26 11:34:40] 2026-03-26 15:33:43,098 | INFO     | [job] retrieve thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:43,098 | INFO     | [job] queue monitor thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:43,131 | INFO     | [payload] execute_payloads thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:43,249 | INFO     | [payload] run_realtimelog thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:43,285 | INFO     | [data] copytool_in thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:43,295 | INFO     | [job] validate thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:43,309 | INFO     | [payload] validate_pre thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:43,354 | INFO     | [job] create_data_payload thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:43,449 | INFO     | all payload control threads have been joined
[2026-03-26 11:34:40] 2026-03-26 15:33:43,454 | INFO     | [data] control thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:43,557 | INFO     | [job] control thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:43,674 | INFO     | [job] job monitor thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:43,684 | INFO     | [payload] validate_post thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:44,039 | INFO     | [payload] failed_post thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:44,098 | INFO     | [data] copytool_out thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:44,454 | INFO     | [payload] control thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:33:45,385 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2026-03-26 11:34:40] 2026-03-26 15:33:49,391 | INFO     | [data] queue_monitor thread has finished
[2026-03-26 11:34:40] 2026-03-26 15:34:13,111 | INFO     | PID=8754 has CPU usage=5.0% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i PR -
[2026-03-26 11:34:40] 2026-03-26 15:34:13,111 | INFO     | .. there are 3 such processes running
[2026-03-26 11:34:40] 2026-03-26 15:34:13,111 | INFO     | found 0 job(s) in 20 queues
[2026-03-26 11:34:40] 2026-03-26 15:34:13,112 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2026-03-26 11:34:40] 2026-03-26 15:34:13,112 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2026-03-26 11:34:40] 2026-03-26 15:34:33,458 | INFO     | [monitor] cgroup control has ended
[2026-03-26 11:34:40] 2026-03-26 15:34:35,564 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140002095822656)>', '<ExcThread(monitor, started 140001505441536)>']
[2026-03-26 11:34:40] 2026-03-26 15:34:36,212 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2026-03-26 11:34:40] 2026-03-26 15:34:36,212 | INFO     | [monitor] control thread has ended
[2026-03-26 11:34:40] 2026-03-26 15:34:40,590 | INFO     | all workflow threads have been joined
[2026-03-26 11:34:40] 2026-03-26 15:34:40,590 | INFO     | end of generic workflow (traces error code: 0)
[2026-03-26 11:34:40] 2026-03-26 15:34:40,590 | INFO     | traces error code: 0
[2026-03-26 11:34:40] 2026-03-26 15:34:40,590 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2026-03-26 11:34:40] 2026-03-26 15:34:40,688 [wrapper] ==== pilot stdout END ====
[2026-03-26 11:34:40] 2026-03-26 15:34:40,690 [wrapper] ==== wrapper stdout RESUME ====
[2026-03-26 11:34:40] 2026-03-26 15:34:40,693 [wrapper] pilotpid: 8754
[2026-03-26 11:34:40] 2026-03-26 15:34:40,695 [wrapper] Pilot exit status: 0
[2026-03-26 11:34:40] 2026-03-26 15:34:40,706 [wrapper] pandaids: 7057542047 7057542047
[2026-03-26 11:34:40] 2026-03-26 15:34:40,744 [wrapper] cleanup supervisor_pilot 21141 8755
[2026-03-26 11:34:40] 2026-03-26 15:34:40,747 [wrapper] Test setup, not cleaning
[2026-03-26 11:34:40] 2026-03-26 15:34:40,749 [wrapper] apfmon messages muted
[2026-03-26 11:34:40] 2026-03-26 15:34:40,752 [wrapper] ==== wrapper stdout END ====
[2026-03-26 11:34:40] 2026-03-26 15:34:40,754 [wrapper] ==== wrapper stderr END ====
[2026-03-26 11:34:40]  *** Error codes and diagnostics ***
[2026-03-26 11:34:40]     "exeErrorCode": 0,
[2026-03-26 11:34:40]     "exeErrorDiag": "",
[2026-03-26 11:34:40]     "pilotErrorCode": 0,
[2026-03-26 11:34:40]     "pilotErrorDiag": "",
[2026-03-26 11:34:40]  *** Listing of results directory ***
[2026-03-26 11:34:40] total 687904
[2026-03-26 11:34:40] drwx------ 5 boincer umatlas      4096 Mar 10 12:00 pilot3
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas    585013 Mar 17 17:36 pilot3.tar.gz
[2026-03-26 11:34:40] -rwx------ 1 boincer umatlas     36322 Mar 17 17:39 runpilot2-wrapper.sh
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas      5111 Mar 17 17:40 queuedata.json
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas       100 Mar 26 01:14 wrapper_26015_x86_64-pc-linux-gnu
[2026-03-26 11:34:40] -rwxr-xr-x 1 boincer umatlas      7986 Mar 26 01:14 run_atlas
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas       105 Mar 26 01:14 job.xml
[2026-03-26 11:34:40] -rw-r--r-- 3 boincer umatlas 238350543 Mar 26 01:14 EVNT.49133711._000002.pool.root.1
[2026-03-26 11:34:40] -rw-r--r-- 3 boincer umatlas 238350543 Mar 26 01:14 ATLAS.root_0
[2026-03-26 11:34:40] -rw-r--r-- 2 boincer umatlas    597539 Mar 26 01:14 input.tar.gz
[2026-03-26 11:34:40] -rw-r--r-- 2 boincer umatlas     15845 Mar 26 01:14 start_atlas.sh
[2026-03-26 11:34:40] drwxrwx--x 2 boincer umatlas      4096 Mar 26 01:14 shared
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas         0 Mar 26 01:14 boinc_lockfile
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas      2620 Mar 26 05:11 pandaJob.out
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas        57 Mar 26 05:11 setup.sh.local
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas   1012192 Mar 26 05:11 agis_schedconf.cvmfs.json
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas       444 Mar 26 05:11 workernode_map.json
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas      5952 Mar 26 11:28 init_data.xml
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas       531 Mar 26 11:32 boinc_task_state.xml
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas 216216198 Mar 26 11:33 HITS.49176370._000035.pool.root.1
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas        96 Mar 26 11:33 pilot_heartbeat.json
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas      1053 Mar 26 11:33 memory_monitor_summary.json
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas   1511579 Mar 26 11:33 agis_ddmendpoints.agis.ALL.json
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas    581797 Mar 26 11:33 log.49176370._000035.job.log.tgz.1
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas      6413 Mar 26 11:33 heartbeat.json
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas      8192 Mar 26 11:34 boinc_mmap_file
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas        29 Mar 26 11:34 wrapper_checkpoint.txt
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas      4888 Mar 26 11:34 pilotlog.txt
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas   3188454 Mar 26 11:34 log.49176370._000035.job.log.1
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas       357 Mar 26 11:34 output.list
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas       620 Mar 26 11:34 runtime_log
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas   3788800 Mar 26 11:34 result.tar.gz
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas      9422 Mar 26 11:34 runtime_log.err
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas       787 Mar 26 11:34 2pfMDmwJrM9n9Rq4apOajLDm4fhM0noT9bVooX4SDma7xLDmHbSCun.diag
[2026-03-26 11:34:40] -rw-r--r-- 1 boincer umatlas     23026 Mar 26 11:34 stderr.txt
[2026-03-26 11:34:40] HITS file was successfully produced:
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas 216216198 Mar 26 11:33 shared/HITS.pool.root.1
[2026-03-26 11:34:40]  *** Contents of shared directory: ***
[2026-03-26 11:34:40] total 448224
[2026-03-26 11:34:40] -rw-r--r-- 3 boincer umatlas 238350543 Mar 26 01:14 ATLAS.root_0
[2026-03-26 11:34:40] -rw-r--r-- 2 boincer umatlas    597539 Mar 26 01:14 input.tar.gz
[2026-03-26 11:34:40] -rw-r--r-- 2 boincer umatlas     15845 Mar 26 01:14 start_atlas.sh
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas 216216198 Mar 26 11:33 HITS.pool.root.1
[2026-03-26 11:34:40] -rw------- 1 boincer umatlas   3788800 Mar 26 11:34 result.tar.gz
11:34:41 (29958): run_atlas exited; CPU time 176384.457299
11:34:41 (29958): called boinc_finish(0)

</stderr_txt>
]]>

©2026 CERN