Name d70dc03a4db1_0
Workunit 240552200
Created 11 Apr 2026, 23:26:21 UTC
Sent 12 Apr 2026, 1:35:46 UTC
Report deadline 20 Apr 2026, 1:35:46 UTC
Received 13 Apr 2026, 23:58:39 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10857198
Run time 1 days 16 hours 27 min 24 sec
CPU time 22 hours 9 min 11 sec
Priority 28
Validate state Valid
Credit 1,534.58
Device peak FLOPS 25.49 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.38 GB
Peak swap size 31.84 GB
Peak disk usage 644.75 MB

Stderr output

<core_client_version>8.1.0</core_client_version>
<![CDATA[
<stderr_txt>
00:02:33 (955074): wrapper (7.7.26015): starting
00:02:33 (955074): wrapper: running run_atlas (--nthreads 8)
[2026-04-12 00:02:33] Arguments: --nthreads 8
[2026-04-12 00:02:33] Threads: 8
[2026-04-12 00:02:33] Checking for CVMFS
[2026-04-12 00:02:34] Probing /cvmfs/atlas.cern.ch... OK
[2026-04-12 00:02:35] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-04-12 00:02:35] Running cvmfs_config stat atlas.cern.ch
[2026-04-12 00:02:37] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-04-12 00:02:37] 2.13.3.0 9262 226690 192432 158366 0 200 24702077 32935936 29293 16776704 0 993551002 99.693 769764061 31865 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-04-12 00:02:37] CVMFS is ok
[2026-04-12 00:02:37] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-04-12 00:02:37] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-04-12 00:02:37] Further information can be found at the LHC@home message board.
[2026-04-12 00:02:37] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-04-12 00:02:37] Checking for apptainer binary...
[2026-04-12 00:02:37] Using apptainer found in PATH at /usr/bin/apptainer
[2026-04-12 00:02:37] Running /usr/bin/apptainer --version
[2026-04-12 00:02:37] apptainer version 1.4.5-2.el9
[2026-04-12 00:02:37] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-04-12 00:02:39] c-8-32.aglt2.org
[2026-04-12 00:02:39] apptainer works
[2026-04-12 00:02:39] Set ATHENA_PROC_NUMBER=8
[2026-04-12 00:02:39] Set ATHENA_CORE_NUMBER=8
[2026-04-12 00:02:39] Starting ATLAS job with PandaID=7087553993
[2026-04-12 00:02:39] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2026-04-13 19:56:19]  *** The last 200 lines of the pilot log: ***
[2026-04-13 19:56:19] 2026-04-13 23:55:14,993 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-04-13 19:56:19] 2026-04-13 23:55:14,999 | INFO     | sum of square deviations: 5331377685832.639
[2026-04-13 19:56:19] 2026-04-13 23:55:15,916 | INFO     | sum of deviations: 5675864557859.777
[2026-04-13 19:56:19] 2026-04-13 23:55:15,916 | INFO     | mean x (centered): 0.0
[2026-04-13 19:56:19] 2026-04-13 23:55:15,916 | INFO     | mean y: 2465434.1011235956
[2026-04-13 19:56:19] 2026-04-13 23:55:15,916 | INFO     | intersect: 2465434.1011235956
[2026-04-13 19:56:19] 2026-04-13 23:55:15,953 | INFO     | chi2: 15.086538292316988
[2026-04-13 19:56:19] 2026-04-13 23:55:15,983 | INFO     | sum of square deviations: 5300453805550.674
[2026-04-13 19:56:19] 2026-04-13 23:55:17,640 | INFO     | monitor loop #7314: job 0:7087553993 is in state 'finished'
[2026-04-13 19:56:19] 2026-04-13 23:55:17,640 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-04-13 19:56:19] 2026-04-13 23:55:17,949 | INFO     | sum of deviations: 6311415847445.869
[2026-04-13 19:56:19] 2026-04-13 23:55:17,949 | INFO     | mean x (centered): 0.0
[2026-04-13 19:56:19] 2026-04-13 23:55:17,977 | INFO     | mean y: 2468566.969720497
[2026-04-13 19:56:19] 2026-04-13 23:55:17,978 | INFO     | intersect: 2468566.969720497
[2026-04-13 19:56:19] 2026-04-13 23:55:17,991 | INFO     | chi2: 12.3240053887112
[2026-04-13 19:56:19] 2026-04-13 23:55:17,992 | INFO     | current chi2=12.3240053887112 (change=18.31124443579375 %)
[2026-04-13 19:56:19] 2026-04-13 23:55:17,992 | INFO     | right removable region: 2575
[2026-04-13 19:56:19] 2026-04-13 23:55:18,026 | INFO     | sum of square deviations: 5300452212046.441
[2026-04-13 19:56:19] 2026-04-13 23:55:18,976 | INFO     | sum of deviations: 4744758149164.112
[2026-04-13 19:56:19] 2026-04-13 23:55:18,976 | INFO     | mean x (centered): 0.0
[2026-04-13 19:56:19] 2026-04-13 23:55:18,977 | INFO     | mean y: 2470025.441770186
[2026-04-13 19:56:19] 2026-04-13 23:55:18,977 | INFO     | intersect: 2470025.441770186
[2026-04-13 19:56:19] 2026-04-13 23:55:18,980 | INFO     | chi2: 10.372351480891842
[2026-04-13 19:56:19] 2026-04-13 23:55:18,981 | INFO     | current chi2=10.372351480891842 (change=31.247637596398807 %)
[2026-04-13 19:56:19] 2026-04-13 23:55:18,984 | INFO     | sum of square deviations: 5269647025505.929
[2026-04-13 19:56:19] 2026-04-13 23:55:19,238 | INFO     | sum of deviations: 4003758710381.0933
[2026-04-13 19:56:19] 2026-04-13 23:55:19,238 | INFO     | mean x (centered): 0.0
[2026-04-13 19:56:19] 2026-04-13 23:55:19,238 | INFO     | mean y: 2473693.486192143
[2026-04-13 19:56:19] 2026-04-13 23:55:19,239 | INFO     | intersect: 2473693.486192143
[2026-04-13 19:56:19] 2026-04-13 23:55:19,274 | INFO     | chi2: 7.441431039042492
[2026-04-13 19:56:19] 2026-04-13 23:55:19,274 | INFO     | current chi2=7.441431039042492 (change=28.25704901389769 %)
[2026-04-13 19:56:19] 2026-04-13 23:55:19,278 | INFO     | sum of square deviations: 5238962050413.821
[2026-04-13 19:56:19] 2026-04-13 23:55:19,493 | INFO     | sum of deviations: 3381728348801.802
[2026-04-13 19:56:19] 2026-04-13 23:55:19,493 | INFO     | mean x (centered): 0.0
[2026-04-13 19:56:19] 2026-04-13 23:55:19,493 | INFO     | mean y: 2476784.6469212784
[2026-04-13 19:56:19] 2026-04-13 23:55:19,494 | INFO     | intersect: 2476784.6469212784
[2026-04-13 19:56:19] 2026-04-13 23:55:19,497 | INFO     | chi2: 5.406504125251251
[2026-04-13 19:56:19] 2026-04-13 23:55:19,497 | INFO     | current chi2=5.406504125251251 (change=27.34590837588518 %)
[2026-04-13 19:56:19] 2026-04-13 23:55:19,501 | INFO     | sum of square deviations: 5208396112736.247
[2026-04-13 19:56:19] 2026-04-13 23:55:19,754 | INFO     | sum of deviations: 2904015566824.358
[2026-04-13 19:56:19] 2026-04-13 23:55:19,755 | INFO     | mean x (centered): 0.0
[2026-04-13 19:56:19] 2026-04-13 23:55:19,756 | INFO     | mean y: 2479167.7743069115
[2026-04-13 19:56:19] 2026-04-13 23:55:19,756 | INFO     | intersect: 2479167.7743069115
[2026-04-13 19:56:19] 2026-04-13 23:55:19,760 | INFO     | chi2: 4.219360937797344
[2026-04-13 19:56:19] 2026-04-13 23:55:19,760 | INFO     | current chi2=4.219360937797344 (change=21.95768577904744 %)
[2026-04-13 19:56:19] 2026-04-13 23:55:19,760 | INFO     | left removable region: 20
[2026-04-13 19:56:19] 2026-04-13 23:55:19,764 | INFO     | sum of square deviations: 5171875200572.012
[2026-04-13 19:56:19] 2026-04-13 23:55:20,268 | INFO     | monitor loop #7315: job 0:7087553993 is in state 'finished'
[2026-04-13 19:56:19] 2026-04-13 23:55:20,268 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-04-13 19:56:19] 2026-04-13 23:55:20,955 | INFO     | sum of deviations: 3537644677156.4937
[2026-04-13 19:56:19] 2026-04-13 23:55:20,955 | INFO     | mean x (centered): 0.0
[2026-04-13 19:56:19] 2026-04-13 23:55:20,955 | INFO     | mean y: 2482340.1589041096
[2026-04-13 19:56:19] 2026-04-13 23:55:20,955 | INFO     | intersect: 2482340.1589041096
[2026-04-13 19:56:19] 2026-04-13 23:55:20,961 | INFO     | chi2: 1.4176320229950072
[2026-04-13 19:56:19] 2026-04-13 23:55:20,962 | INFO     | current memory leak: 0.68 B/s (using 2555 data points, chi2=1.42)
[2026-04-13 19:56:19] 2026-04-13 23:55:20,965 | INFO     | could have reported an average CPU frequency of 2600 MHz (90 samples)
[2026-04-13 19:56:19] 2026-04-13 23:55:20,965 | INFO     | ..............................
[2026-04-13 19:56:19] 2026-04-13 23:55:20,965 | INFO     | . Timing measurements:
[2026-04-13 19:56:19] 2026-04-13 23:55:20,965 | INFO     | . get job = 1 s
[2026-04-13 19:56:19] 2026-04-13 23:55:20,966 | INFO     | . initial setup = 81 s
[2026-04-13 19:56:19] 2026-04-13 23:55:20,966 | INFO     | . payload setup = 166 s
[2026-04-13 19:56:19] 2026-04-13 23:55:20,966 | INFO     | . stage-in = 1 s
[2026-04-13 19:56:19] 2026-04-13 23:55:20,966 | INFO     | . payload execution = 157487 s
[2026-04-13 19:56:19] 2026-04-13 23:55:20,966 | INFO     | . stage-out = 6 s
[2026-04-13 19:56:19] 2026-04-13 23:55:20,966 | INFO     | . log creation = 1 s
[2026-04-13 19:56:19] 2026-04-13 23:55:20,967 | INFO     | ..............................
[2026-04-13 19:56:19] 2026-04-13 23:55:21,470 | INFO     | 
[2026-04-13 19:56:19] 2026-04-13 23:55:21,470 | INFO     | job summary report
[2026-04-13 19:56:19] 2026-04-13 23:55:21,470 | INFO     | --------------------------------------------------
[2026-04-13 19:56:19] 2026-04-13 23:55:21,470 | INFO     | PanDA job id: 7087553993
[2026-04-13 19:56:19] 2026-04-13 23:55:21,470 | INFO     | task id: 49645815
[2026-04-13 19:56:19] 2026-04-13 23:55:21,470 | INFO     | errors: (none)
[2026-04-13 19:56:19] 2026-04-13 23:55:21,471 | INFO     | status: LOG_TRANSFER = DONE 
[2026-04-13 19:56:19] 2026-04-13 23:55:21,471 | INFO     | pilot state: finished 
[2026-04-13 19:56:19] 2026-04-13 23:55:21,471 | INFO     | transexitcode: 0
[2026-04-13 19:56:19] 2026-04-13 23:55:21,471 | INFO     | exeerrorcode: 0
[2026-04-13 19:56:19] 2026-04-13 23:55:21,471 | INFO     | exeerrordiag: 
[2026-04-13 19:56:19] 2026-04-13 23:55:21,471 | INFO     | exitcode: 0
[2026-04-13 19:56:19] 2026-04-13 23:55:21,471 | INFO     | exitmsg: OK
[2026-04-13 19:56:19] 2026-04-13 23:55:21,471 | INFO     | cpuconsumptiontime: 67375 s
[2026-04-13 19:56:19] 2026-04-13 23:55:21,471 | INFO     | nevents: 400
[2026-04-13 19:56:19] 2026-04-13 23:55:21,472 | INFO     | neventsw: 0
[2026-04-13 19:56:19] 2026-04-13 23:55:21,472 | INFO     | pid: 1000423
[2026-04-13 19:56:19] 2026-04-13 23:55:21,472 | INFO     | pgrp: 1000423
[2026-04-13 19:56:19] 2026-04-13 23:55:21,472 | INFO     | corecount: 8
[2026-04-13 19:56:19] 2026-04-13 23:55:21,472 | INFO     | event service: False
[2026-04-13 19:56:19] 2026-04-13 23:55:21,472 | INFO     | sizes: {0: 2279106, 2: 2279707, 5: 2279791, 9: 2279847, 10: 2279847, 13: 2279847, 15: 2281832, 16: 2281860, 17: 2281888, 157661: 2375043, 157662: 2375042, 157672: 
[2026-04-13 19:56:19] 2026-04-13 23:55:21,472 | INFO     | --------------------------------------------------
[2026-04-13 19:56:19] 2026-04-13 23:55:21,472 | INFO     | 
[2026-04-13 19:56:19] 2026-04-13 23:55:21,472 | INFO     | executing command: ls -lF /tmp/boinchome/slots/1
[2026-04-13 19:56:19] 2026-04-13 23:55:21,759 | INFO     | queue jobs had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,759 | INFO     | queue payloads had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,759 | INFO     | queue data_in had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,759 | INFO     | queue data_out had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,760 | INFO     | queue current_data_in had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,760 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,760 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,760 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,760 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,760 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,760 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,760 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,761 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,761 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,761 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,761 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,761 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,761 | INFO     | queue completed_jobids has 1 job(s)
[2026-04-13 19:56:19] 2026-04-13 23:55:21,761 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,761 | INFO     | queue messages had 0 job(s) [purged]
[2026-04-13 19:56:19] 2026-04-13 23:55:21,762 | INFO     | job 7087553993 has completed (purged errors)
[2026-04-13 19:56:19] 2026-04-13 23:55:21,762 | INFO     | overall cleanup function is called
[2026-04-13 19:56:19] 2026-04-13 23:55:22,865 | INFO     | --- collectZombieJob: --- 10, [1000423]
[2026-04-13 19:56:19] 2026-04-13 23:55:22,866 | INFO     | zombie collector waiting for pid 1000423
[2026-04-13 19:56:19] 2026-04-13 23:55:22,871 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2026-04-13 19:56:19] 2026-04-13 23:55:22,871 | INFO     | collected zombie processes
[2026-04-13 19:56:19] 2026-04-13 23:55:22,872 | INFO     | will attempt to kill all subprocesses of pid=1000423
[2026-04-13 19:56:19] 2026-04-13 23:55:26,141 | INFO     | process IDs to be killed: [1000423] (in reverse order)
[2026-04-13 19:56:19] 2026-04-13 23:55:26,824 | WARNING  | found no corresponding commands to process id(s)
[2026-04-13 19:56:19] 2026-04-13 23:55:26,825 | INFO     | Do not look for orphan processes in BOINC jobs
[2026-04-13 19:56:19] 2026-04-13 23:55:26,917 | INFO     | did not find any defunct processes belonging to 1000423
[2026-04-13 19:56:19] 2026-04-13 23:55:27,014 | INFO     | did not find any defunct processes belonging to 1000423
[2026-04-13 19:56:19] 2026-04-13 23:55:27,014 | INFO     | Ready for new job
[2026-04-13 19:56:19] 2026-04-13 23:55:27,054 | INFO     | **************************************
[2026-04-13 19:56:19] 2026-04-13 23:55:27,054 | INFO     | ***  PanDA Pilot version 3.12.4.1  ***
[2026-04-13 19:56:19] 2026-04-13 23:55:27,055 | INFO     | **************************************
[2026-04-13 19:56:19] 2026-04-13 23:55:27,055 | INFO     | 
[2026-04-13 19:56:19] 2026-04-13 23:55:27,057 | INFO     | architecture information:
[2026-04-13 19:56:19] 2026-04-13 23:55:27,086 | INFO     | executing command: cat /etc/os-release
[2026-04-13 19:56:19] 2026-04-13 23:55:27,281 | INFO     | cat /etc/os-release:
[2026-04-13 19:56:19] NAME="CentOS Linux"
[2026-04-13 19:56:19] VERSION="7 (Core)"
[2026-04-13 19:56:19] ID="centos"
[2026-04-13 19:56:19] ID_LIKE="rhel fedora"
[2026-04-13 19:56:19] VERSION_ID="7"
[2026-04-13 19:56:19] PRETTY_NAME="CentOS Linux 7 (Core)"
[2026-04-13 19:56:19] ANSI_COLOR="0;31"
[2026-04-13 19:56:19] CPE_NAME="cpe:/o:centos:centos:7"
[2026-04-13 19:56:19] HOME_URL="https://www.centos.org/"
[2026-04-13 19:56:19] BUG_REPORT_URL="https://bugs.centos.org/"
[2026-04-13 19:56:19] 
[2026-04-13 19:56:19] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2026-04-13 19:56:19] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2026-04-13 19:56:19] REDHAT_SUPPORT_PRODUCT="centos"
[2026-04-13 19:56:19] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2026-04-13 19:56:19] 
[2026-04-13 19:56:19] 2026-04-13 23:55:27,282 | INFO     | **************************************
[2026-04-13 19:56:19] 2026-04-13 23:55:27,786 | INFO     | executing command: df -mP /tmp/boinchome/slots/1
[2026-04-13 19:56:19] 2026-04-13 23:55:27,941 | INFO     | sufficient remaining disk space (74493984768 B)
[2026-04-13 19:56:19] 2026-04-13 23:55:27,949 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2026-04-13 19:56:19] 2026-04-13 23:55:27,949 | INFO     | current server update state: UPDATING_FINAL
[2026-04-13 19:56:19] 2026-04-13 23:55:27,949 | INFO     | update_server=False
[2026-04-13 19:56:19] 2026-04-13 23:55:27,949 | WARNING  | proceed_with_getjob() returned False &#226;&#128;&#148; stopping retrieve loop (pilot will end)
[2026-04-13 19:56:19] 2026-04-13 23:55:28,574 | INFO     | all job control threads have been joined
[2026-04-13 19:56:19] 2026-04-13 23:55:28,706 | INFO     | all payload control threads have been joined
[2026-04-13 19:56:19] 2026-04-13 23:55:28,916 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2026-04-13 19:56:19] 2026-04-13 23:55:28,917 | INFO     | aborting loop
[2026-04-13 19:56:19] 2026-04-13 23:55:28,955 | INFO     | [job] retrieve thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:29,037 | INFO     | all data control threads have been joined
[2026-04-13 19:56:19] 2026-04-13 23:55:29,132 | INFO     | [job] create_data_payload thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:29,144 | INFO     | [payload] validate_pre thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:29,156 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2026-04-13 19:56:19] 2026-04-13 23:55:29,197 | INFO     | [data] copytool_in thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:29,391 | INFO     | [job] validate thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:29,564 | INFO     | [payload] run_realtimelog thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:29,589 | INFO     | [job] control thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:29,713 | INFO     | [payload] control thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:29,739 | INFO     | [payload] execute_payloads thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:29,891 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2026-04-13 19:56:19] 2026-04-13 23:55:29,923 | INFO     | [job] job monitor thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:29,956 | INFO     | [payload] validate_post thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:30,044 | INFO     | [data] control thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:30,459 | INFO     | [payload] failed_post thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:30,543 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2026-04-13 19:56:19] 2026-04-13 23:55:31,164 | INFO     | [data] copytool_out thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:31,550 | INFO     | [job] queue monitor thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:33,915 | INFO     | [data] queue_monitor thread has finished
[2026-04-13 19:56:19] 2026-04-13 23:55:55,102 | INFO     | PID=971063 has CPU usage=7.3% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i PR
[2026-04-13 19:56:19] 2026-04-13 23:55:55,102 | INFO     | .. there are 27 such processes running
[2026-04-13 19:56:19] 2026-04-13 23:55:55,102 | INFO     | found 0 job(s) in 20 queues
[2026-04-13 19:56:19] 2026-04-13 23:55:55,102 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2026-04-13 19:56:19] 2026-04-13 23:55:55,103 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2026-04-13 19:56:19] 2026-04-13 23:56:10,041 | INFO     | [monitor] cgroup control has ended
[2026-04-13 19:56:19] 2026-04-13 23:56:11,056 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140290549466944)>', '<ExcThread(monitor, started 140289905768192)>']
[2026-04-13 19:56:19] 2026-04-13 23:56:11,220 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2026-04-13 19:56:19] 2026-04-13 23:56:11,221 | INFO     | [monitor] control thread has ended
[2026-04-13 19:56:19] 2026-04-13 23:56:16,081 | INFO     | all workflow threads have been joined
[2026-04-13 19:56:19] 2026-04-13 23:56:16,083 | INFO     | end of generic workflow (traces error code: 0)
[2026-04-13 19:56:19] 2026-04-13 23:56:16,083 | INFO     | traces error code: 0
[2026-04-13 19:56:19] 2026-04-13 23:56:16,083 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2026-04-13 19:56:19] 2026-04-13 23:56:17,505 [wrapper] ==== pilot stdout END ====
[2026-04-13 19:56:19] 2026-04-13 23:56:17,589 [wrapper] ==== wrapper stdout RESUME ====
[2026-04-13 19:56:19] 2026-04-13 23:56:17,648 [wrapper] pilotpid: 971063
[2026-04-13 19:56:19] 2026-04-13 23:56:17,667 [wrapper] Pilot exit status: 0
[2026-04-13 19:56:19] 2026-04-13 23:56:17,812 [wrapper] pandaids: 7087553993
[2026-04-13 19:56:19] 2026-04-13 23:56:18,222 [wrapper] cleanup supervisor_pilot 2470548 971064
[2026-04-13 19:56:19] 2026-04-13 23:56:18,256 [wrapper] Test setup, not cleaning
[2026-04-13 19:56:19] 2026-04-13 23:56:18,337 [wrapper] apfmon messages muted
[2026-04-13 19:56:19] 2026-04-13 23:56:18,363 [wrapper] ==== wrapper stdout END ====
[2026-04-13 19:56:19] 2026-04-13 23:56:18,401 [wrapper] ==== wrapper stderr END ====
[2026-04-13 19:56:19]  *** Error codes and diagnostics ***
[2026-04-13 19:56:19]     "exeErrorCode": 0,
[2026-04-13 19:56:19]     "pilotErrorCode": 0,
[2026-04-13 19:56:19]  *** Listing of results directory ***
[2026-04-13 19:56:19] total 436256
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas    644190 Apr 11 18:43 pilot3.tar.gz
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas      5094 Apr 11 19:19 queuedata.json
[2026-04-13 19:56:19] -rwx------. 1 boincer umatlas     36322 Apr 11 19:19 runpilot2-wrapper.sh
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas       100 Apr 12 00:02 wrapper_26015_x86_64-pc-linux-gnu
[2026-04-13 19:56:19] -rwxr-xr-x. 1 boincer umatlas      7986 Apr 12 00:02 run_atlas
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas       105 Apr 12 00:02 job.xml
[2026-04-13 19:56:19] -rw-r--r--. 2 boincer umatlas 223523772 Apr 12 00:02 EVNT.48629115._000152.pool.root.1
[2026-04-13 19:56:19] -rw-r--r--. 2 boincer umatlas     15665 Apr 12 00:02 start_atlas.sh
[2026-04-13 19:56:19] drwxrwx--x. 2 boincer umatlas      4096 Apr 12 00:02 shared
[2026-04-13 19:56:19] -rw-r--r--. 2 boincer umatlas    656946 Apr 12 00:02 input.tar.gz
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas         0 Apr 12 00:02 boinc_lockfile
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas      2627 Apr 12 00:02 pandaJob.out
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas        57 Apr 12 00:02 setup.sh.local
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas       440 Apr 12 00:06 workernode_map.json
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas    997751 Apr 12 00:07 agis_schedconf.cvmfs.json
[2026-04-13 19:56:19] drwx------. 5 boincer umatlas      4096 Apr 12 00:07 pilot3
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas      6626 Apr 13 19:45 init_data.xml
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas 194931571 Apr 13 19:50 HITS.49645815._003782.pool.root.1
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas       490 Apr 13 19:50 boinc_task_state.xml
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas      1081 Apr 13 19:54 memory_monitor_summary.json
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas        95 Apr 13 19:54 pilot_heartbeat.json
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas   1511579 Apr 13 19:55 agis_ddmendpoints.agis.ALL.json
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas   1458024 Apr 13 19:55 log.49645815._003782.job.log.tgz.1
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas      6457 Apr 13 19:55 heartbeat_new.json
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas      6348 Apr 13 19:55 heartbeat.json
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas      4818 Apr 13 19:56 pilotlog.txt
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas  10647821 Apr 13 19:56 log.49645815._003782.job.log.1
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas      8192 Apr 13 19:56 boinc_mmap_file
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas       357 Apr 13 19:56 output.list
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas        29 Apr 13 19:56 wrapper_checkpoint.txt
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas       410 Apr 13 19:56 runtime_log
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas  12124160 Apr 13 19:56 result.tar.gz
[2026-04-13 19:56:19] -rw-------. 1 boincer umatlas       664 Apr 13 19:56 d70dc03a4db1.diag
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas      8955 Apr 13 19:56 runtime_log.err
[2026-04-13 19:56:19] -rw-r--r--. 1 boincer umatlas     20842 Apr 13 19:56 stderr.txt
[2026-04-13 19:56:20] HITS file was successfully produced:
[2026-04-13 19:56:20] -rw-------. 1 boincer umatlas 194931571 Apr 13 19:50 shared/HITS.pool.root.1
[2026-04-13 19:56:20]  *** Contents of shared directory: ***
[2026-04-13 19:56:20] total 421156
[2026-04-13 19:56:20] -rw-r--r--. 2 boincer umatlas 223523772 Apr 12 00:02 ATLAS.root_0
[2026-04-13 19:56:20] -rw-r--r--. 2 boincer umatlas     15665 Apr 12 00:02 start_atlas.sh
[2026-04-13 19:56:20] -rw-r--r--. 2 boincer umatlas    656946 Apr 12 00:02 input.tar.gz
[2026-04-13 19:56:20] -rw-------. 1 boincer umatlas 194931571 Apr 13 19:50 HITS.pool.root.1
[2026-04-13 19:56:20] -rw-------. 1 boincer umatlas  12124160 Apr 13 19:56 result.tar.gz
19:56:21 (955074): run_atlas exited; CPU time 74589.462266
19:56:21 (955074): called boinc_finish(0)

</stderr_txt>
]]>


©2026 CERN