Stderr output

<core_client_version>8.1.0</core_client_version>
<![CDATA[
<stderr_txt>
19:49:37 (3034944): wrapper (7.7.26015): starting
19:49:37 (3034944): wrapper: running run_atlas (--nthreads 10)
[2026-03-24 19:49:37] Arguments: --nthreads 10
[2026-03-24 19:49:37] Threads: 10
[2026-03-24 19:49:37] Checking for CVMFS
[2026-03-24 19:49:38] Probing /cvmfs/atlas.cern.ch... OK
[2026-03-24 19:49:38] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-03-24 19:49:38] Running cvmfs_config stat atlas.cern.ch
[2026-03-24 19:49:40] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-03-24 19:49:40] 2.13.3.0 9601 139920 377784 157663 1 653 29827817 32935936 13625 16776704 0 241262782 99.545 352608751 39143 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-03-24 19:49:40] CVMFS is ok
[2026-03-24 19:49:40] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-03-24 19:49:40] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-03-24 19:49:40] Further information can be found at the LHC@home message board.
[2026-03-24 19:49:40] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-03-24 19:49:40] Checking for apptainer binary...
[2026-03-24 19:49:40] Using apptainer found in PATH at /usr/bin/apptainer
[2026-03-24 19:49:40] Running /usr/bin/apptainer --version
[2026-03-24 19:49:40] apptainer version 1.4.5-2.el9
[2026-03-24 19:49:40] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-03-24 19:49:40] c6-5-7-2.aglt2.org
[2026-03-24 19:49:40] apptainer works
[2026-03-24 19:49:40] Set ATHENA_PROC_NUMBER=10
[2026-03-24 19:49:40] Set ATHENA_CORE_NUMBER=10
[2026-03-24 19:49:41] Starting ATLAS job with PandaID=7056956001
[2026-03-24 19:49:41] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2026-03-25 02:41:19]  *** The last 200 lines of the pilot log: ***
[2026-03-25 02:41:20] 2026-03-25 06:40:31,063 | INFO     | pilot will not update the server (heartbeat message will be written to file)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,064 | INFO     | log transfer has been attempted: DONE
[2026-03-25 02:41:20] 2026-03-25 06:40:31,064 | INFO     | job 7056956001 has finished - writing final server update
[2026-03-25 02:41:20] 2026-03-25 06:40:31,064 | INFO     | total number of processed events: 400 (read)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,257 | INFO     | using path: /tmp/boinchome/slots/0/PanDA_Pilot-7056956001/memory_monitor_summary.json (trf name=prmon)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,258 | INFO     | extracted standard info from prmon json
[2026-03-25 02:41:20] 2026-03-25 06:40:31,258 | INFO     | extracted standard memory fields from prmon json
[2026-03-25 02:41:20] 2026-03-25 06:40:31,258 | WARNING  | GPU info not found in prmon json: 'gpu'
[2026-03-25 02:41:20] 2026-03-25 06:40:31,386 | WARNING  | format EVNTtoHITS has no such key: dbData
[2026-03-25 02:41:20] 2026-03-25 06:40:31,386 | WARNING  | format EVNTtoHITS has no such key: dbTime
[2026-03-25 02:41:20] 2026-03-25 06:40:31,510 | INFO     | fitting pss+swap vs Time
[2026-03-25 02:41:20] 2026-03-25 06:40:31,511 | INFO     | sum of square deviations: 19995015094.927834
[2026-03-25 02:41:20] 2026-03-25 06:40:31,518 | INFO     | sum of deviations: -36943752188.09473
[2026-03-25 02:41:20] 2026-03-25 06:40:31,518 | INFO     | mean x: 1774408563.4089775
[2026-03-25 02:41:20] 2026-03-25 06:40:31,518 | INFO     | mean y: 2612897.91521197
[2026-03-25 02:41:20] 2026-03-25 06:40:31,518 | INFO     | intersect: 3281095556.507625
[2026-03-25 02:41:20] 2026-03-25 06:40:31,519 | INFO     | chi2: 4.036775299084012
[2026-03-25 02:41:20] 2026-03-25 06:40:31,519 | INFO     | sum of square deviations: 19256403425.90659
[2026-03-25 02:41:20] 2026-03-25 06:40:31,527 | INFO     | sum of deviations: 43601940613.07319
[2026-03-25 02:41:20] 2026-03-25 06:40:31,527 | INFO     | mean x: 1774408410.911616
[2026-03-25 02:41:20] 2026-03-25 06:40:31,527 | INFO     | mean y: 2629444.744949495
[2026-03-25 02:41:20] 2026-03-25 06:40:31,527 | INFO     | intersect: -4015132774.123987
[2026-03-25 02:41:20] 2026-03-25 06:40:31,527 | INFO     | chi2: 1.8927066049738572
[2026-03-25 02:41:20] 2026-03-25 06:40:31,527 | INFO     | current chi2=1.8927066049738572 (change=53.11340204139346 %)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,528 | INFO     | sum of square deviations: 18536186794.705948
[2026-03-25 02:41:20] 2026-03-25 06:40:31,535 | INFO     | sum of deviations: 42867305915.35299
[2026-03-25 02:41:20] 2026-03-25 06:40:31,535 | INFO     | mean x: 1774408258.4117646
[2026-03-25 02:41:20] 2026-03-25 06:40:31,535 | INFO     | mean y: 2629289.1841432224
[2026-03-25 02:41:20] 2026-03-25 06:40:31,536 | INFO     | intersect: -4100917059.075048
[2026-03-25 02:41:20] 2026-03-25 06:40:31,536 | INFO     | chi2: 1.8930820991897088
[2026-03-25 02:41:20] 2026-03-25 06:40:31,536 | INFO     | current chi2=1.8930820991897088 (change=-0.019839008056759914 %)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,536 | INFO     | right removable region: 390
[2026-03-25 02:41:20] 2026-03-25 06:40:31,537 | INFO     | sum of square deviations: 19256327969.080803
[2026-03-25 02:41:20] 2026-03-25 06:40:31,545 | INFO     | sum of deviations: -111557681588.0101
[2026-03-25 02:41:20] 2026-03-25 06:40:31,545 | INFO     | mean x: 1774408715.9141414
[2026-03-25 02:41:20] 2026-03-25 06:40:31,545 | INFO     | mean y: 2628227.3232323234
[2026-03-25 02:41:20] 2026-03-25 06:40:31,545 | INFO     | intersect: 10282309943.109295
[2026-03-25 02:41:20] 2026-03-25 06:40:31,546 | INFO     | chi2: 2.3807829234494085
[2026-03-25 02:41:20] 2026-03-25 06:40:31,546 | INFO     | current chi2=2.3807829234494085 (change=41.02265429562964 %)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,550 | INFO     | sum of square deviations: 18536059793.212387
[2026-03-25 02:41:20] 2026-03-25 06:40:31,553 | INFO     | sum of deviations: -111622228661.711
[2026-03-25 02:41:20] 2026-03-25 06:40:31,553 | INFO     | mean x: 1774408868.4194374
[2026-03-25 02:41:20] 2026-03-25 06:40:31,553 | INFO     | mean y: 2628235.0409207162
[2026-03-25 02:41:20] 2026-03-25 06:40:31,553 | INFO     | intersect: 10687934317.32978
[2026-03-25 02:41:20] 2026-03-25 06:40:31,558 | INFO     | chi2: 2.3740645836643495
[2026-03-25 02:41:20] 2026-03-25 06:40:31,558 | INFO     | current chi2=2.3740645836643495 (change=0.2821903550671088 %)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,558 | INFO     | left removable region: 20
[2026-03-25 02:41:20] 2026-03-25 06:40:31,559 | INFO     | sum of square deviations: 15707016520.17296
[2026-03-25 02:41:20] 2026-03-25 06:40:31,561 | INFO     | sum of deviations: 6471709597.443242
[2026-03-25 02:41:20] 2026-03-25 06:40:31,561 | INFO     | mean x: 1774408837.9297297
[2026-03-25 02:41:20] 2026-03-25 06:40:31,562 | INFO     | mean y: 2636513.6324324324
[2026-03-25 02:41:20] 2026-03-25 06:40:31,562 | INFO     | intersect: -728467238.0870246
[2026-03-25 02:41:20] 2026-03-25 06:40:31,562 | INFO     | chi2: 0.04503501178913156
[2026-03-25 02:41:20] 2026-03-25 06:40:31,566 | INFO     | current memory leak: 0.41 B/s (using 370 data points, chi2=0.05)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,567 | INFO     | could have reported an average CPU frequency of 3062 MHz (17 samples)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,567 | INFO     | ..............................
[2026-03-25 02:41:20] 2026-03-25 06:40:31,567 | INFO     | . Timing measurements:
[2026-03-25 02:41:20] 2026-03-25 06:40:31,567 | INFO     | . get job = 0 s
[2026-03-25 02:41:20] 2026-03-25 06:40:31,568 | INFO     | . initial setup = 40 s
[2026-03-25 02:41:20] 2026-03-25 06:40:31,568 | INFO     | . payload setup = 44 s
[2026-03-25 02:41:20] 2026-03-25 06:40:31,568 | INFO     | . stage-in = 0 s
[2026-03-25 02:41:20] 2026-03-25 06:40:31,568 | INFO     | . payload execution = 24474 s
[2026-03-25 02:41:20] 2026-03-25 06:40:31,568 | INFO     | . stage-out = 11 s
[2026-03-25 02:41:20] 2026-03-25 06:40:31,568 | INFO     | . log creation = 3 s
[2026-03-25 02:41:20] 2026-03-25 06:40:31,568 | INFO     | ..............................
[2026-03-25 02:41:20] 2026-03-25 06:40:31,648 | INFO     | 
[2026-03-25 02:41:20] 2026-03-25 06:40:31,648 | INFO     | job summary report
[2026-03-25 02:41:20] 2026-03-25 06:40:31,648 | INFO     | --------------------------------------------------
[2026-03-25 02:41:20] 2026-03-25 06:40:31,648 | INFO     | PanDA job id: 7056956001
[2026-03-25 02:41:20] 2026-03-25 06:40:31,648 | INFO     | task id: 49179572
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | errors: (none)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | status: LOG_TRANSFER = DONE 
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | pilot state: finished 
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | transexitcode: 0
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | exeerrorcode: 0
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | exeerrordiag: 
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | exitcode: 0
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | exitmsg: OK
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | cpuconsumptiontime: 67033 s
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | nevents: 400
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | neventsw: 0
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | pid: 3048463
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | pgrp: 3048463
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | corecount: 10
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | event service: False
[2026-03-25 02:41:20] 2026-03-25 06:40:31,649 | INFO     | sizes: {0: 2279214, 1: 2279815, 2: 2280360, 3: 2280360, 24524: 2315667, 24525: 2315666, 24539: 2324848, 24542: 2324904, 24543: 2325162}
[2026-03-25 02:41:20] 2026-03-25 06:40:31,650 | INFO     | --------------------------------------------------
[2026-03-25 02:41:20] 2026-03-25 06:40:31,650 | INFO     | 
[2026-03-25 02:41:20] 2026-03-25 06:40:31,650 | INFO     | executing command: ls -lF /tmp/boinchome/slots/0
[2026-03-25 02:41:20] 2026-03-25 06:40:31,721 | INFO     | queue jobs had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,721 | INFO     | queue payloads had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,721 | INFO     | queue data_in had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,721 | INFO     | queue data_out had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,721 | INFO     | queue current_data_in had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,721 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,721 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,721 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,721 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | queue completed_jobids has 1 job(s)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | queue messages had 0 job(s) [purged]
[2026-03-25 02:41:20] 2026-03-25 06:40:31,722 | INFO     | job 7056956001 has completed (purged errors)
[2026-03-25 02:41:20] 2026-03-25 06:40:31,723 | INFO     | overall cleanup function is called
[2026-03-25 02:41:20] 2026-03-25 06:40:32,763 | INFO     | --- collectZombieJob: --- 10, [3048463]
[2026-03-25 02:41:20] 2026-03-25 06:40:32,764 | INFO     | zombie collector waiting for pid 3048463
[2026-03-25 02:41:20] 2026-03-25 06:40:32,764 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2026-03-25 02:41:20] 2026-03-25 06:40:32,764 | INFO     | collected zombie processes
[2026-03-25 02:41:20] 2026-03-25 06:40:32,764 | INFO     | will attempt to kill all subprocesses of pid=3048463
[2026-03-25 02:41:20] 2026-03-25 06:40:35,977 | INFO     | process IDs to be killed: [3048463] (in reverse order)
[2026-03-25 02:41:20] 2026-03-25 06:40:36,316 | WARNING  | found no corresponding commands to process id(s)
[2026-03-25 02:41:20] 2026-03-25 06:40:36,317 | INFO     | Do not look for orphan processes in BOINC jobs
[2026-03-25 02:41:20] 2026-03-25 06:40:36,349 | INFO     | did not find any defunct processes belonging to 3048463
[2026-03-25 02:41:20] 2026-03-25 06:40:36,362 | INFO     | did not find any defunct processes belonging to 3048463
[2026-03-25 02:41:20] 2026-03-25 06:40:36,362 | INFO     | ready for new job
[2026-03-25 02:41:20] 2026-03-25 06:40:36,362 | INFO     | pilot has finished with previous job - re-establishing logging
[2026-03-25 02:41:20] 2026-03-25 06:40:36,365 | INFO     | **************************************
[2026-03-25 02:41:20] 2026-03-25 06:40:36,365 | INFO     | ***  PanDA Pilot version 3.11.5.1  ***
[2026-03-25 02:41:20] 2026-03-25 06:40:36,365 | INFO     | **************************************
[2026-03-25 02:41:20] 2026-03-25 06:40:36,365 | INFO     | 
[2026-03-25 02:41:20] 2026-03-25 06:40:36,368 | INFO     | architecture information:
[2026-03-25 02:41:20] 2026-03-25 06:40:36,368 | INFO     | executing command: cat /etc/os-release
[2026-03-25 02:41:20] 2026-03-25 06:40:36,386 | INFO     | cat /etc/os-release:
[2026-03-25 02:41:20] NAME="CentOS Linux"
[2026-03-25 02:41:20] VERSION="7 (Core)"
[2026-03-25 02:41:20] ID="centos"
[2026-03-25 02:41:20] ID_LIKE="rhel fedora"
[2026-03-25 02:41:20] VERSION_ID="7"
[2026-03-25 02:41:20] PRETTY_NAME="CentOS Linux 7 (Core)"
[2026-03-25 02:41:20] ANSI_COLOR="0;31"
[2026-03-25 02:41:20] CPE_NAME="cpe:/o:centos:centos:7"
[2026-03-25 02:41:20] HOME_URL="https://www.centos.org/"
[2026-03-25 02:41:20] BUG_REPORT_URL="https://bugs.centos.org/"
[2026-03-25 02:41:20] 
[2026-03-25 02:41:20] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2026-03-25 02:41:20] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2026-03-25 02:41:20] REDHAT_SUPPORT_PRODUCT="centos"
[2026-03-25 02:41:20] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2026-03-25 02:41:20] 
[2026-03-25 02:41:20] 2026-03-25 06:40:36,386 | INFO     | **************************************
[2026-03-25 02:41:20] 2026-03-25 06:40:36,889 | INFO     | executing command: df -mP /tmp/boinchome/slots/0
[2026-03-25 02:41:20] 2026-03-25 06:40:37,038 | INFO     | sufficient remaining disk space (74067214336 B)
[2026-03-25 02:41:20] 2026-03-25 06:40:37,038 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2026-03-25 02:41:20] 2026-03-25 06:40:37,039 | INFO     | current server update state: UPDATING_FINAL
[2026-03-25 02:41:20] 2026-03-25 06:40:37,039 | INFO     | update_server=False
[2026-03-25 02:41:20] 2026-03-25 06:40:37,039 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2026-03-25 02:41:20] 2026-03-25 06:40:37,039 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2026-03-25 02:41:20] 2026-03-25 06:40:37,061 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2026-03-25 02:41:20] 2026-03-25 06:40:37,062 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2026-03-25 02:41:20] 2026-03-25 06:40:37,686 | INFO     | all data control threads have been joined
[2026-03-25 02:41:20] 2026-03-25 06:40:37,702 | INFO     | all job control threads have been joined
[2026-03-25 02:41:20] 2026-03-25 06:40:37,787 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2026-03-25 02:41:20] 2026-03-25 06:40:37,788 | INFO     | aborting loop
[2026-03-25 02:41:20] 2026-03-25 06:40:38,050 | INFO     | [job] retrieve thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:38,069 | INFO     | [job] queue monitor thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:38,214 | INFO     | all payload control threads have been joined
[2026-03-25 02:41:20] 2026-03-25 06:40:38,252 | INFO     | [payload] validate_post thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:38,268 | INFO     | [data] copytool_in thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:38,274 | INFO     | [job] validate thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:38,279 | INFO     | [payload] run_realtimelog thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:38,291 | INFO     | [payload] execute_payloads thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:38,539 | INFO     | [job] create_data_payload thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:38,692 | INFO     | [data] control thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:38,708 | INFO     | [job] control thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:38,793 | INFO     | [job] job monitor thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:39,055 | INFO     | [data] copytool_out thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:39,088 | INFO     | [payload] validate_pre thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:39,194 | INFO     | [payload] failed_post thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:39,223 | INFO     | [payload] control thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:40:41,110 | INFO     | [data] queue_monitor thread has finished
[2026-03-25 02:41:20] 2026-03-25 06:41:06,828 | INFO     | PID=3041480 has CPU usage=3.4% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i P
[2026-03-25 02:41:20] 2026-03-25 06:41:06,851 | INFO     | .. there are 26 such processes running
[2026-03-25 02:41:20] 2026-03-25 06:41:06,852 | INFO     | found 0 job(s) in 20 queues
[2026-03-25 02:41:20] 2026-03-25 06:41:06,852 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2026-03-25 02:41:20] 2026-03-25 06:41:06,853 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2026-03-25 02:41:20] 2026-03-25 06:41:11,454 | INFO     | [monitor] cgroup control has ended
[2026-03-25 02:41:20] 2026-03-25 06:41:12,101 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140605165119296)>', '<ExcThread(monitor, started 140604788950784)>']
[2026-03-25 02:41:20] 2026-03-25 06:41:12,924 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2026-03-25 02:41:20] 2026-03-25 06:41:12,925 | INFO     | [monitor] control thread has ended
[2026-03-25 02:41:20] 2026-03-25 06:41:17,127 | INFO     | all workflow threads have been joined
[2026-03-25 02:41:20] 2026-03-25 06:41:17,128 | INFO     | end of generic workflow (traces error code: 0)
[2026-03-25 02:41:20] 2026-03-25 06:41:17,128 | INFO     | traces error code: 0
[2026-03-25 02:41:20] 2026-03-25 06:41:17,128 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2026-03-25 02:41:20] 2026-03-25 06:41:18,237 [wrapper] ==== pilot stdout END ====
[2026-03-25 02:41:20] 2026-03-25 06:41:18,253 [wrapper] ==== wrapper stdout RESUME ====
[2026-03-25 02:41:20] 2026-03-25 06:41:18,316 [wrapper] pilotpid: 3041480
[2026-03-25 02:41:20] 2026-03-25 06:41:18,356 [wrapper] Pilot exit status: 0
[2026-03-25 02:41:20] 2026-03-25 06:41:18,580 [wrapper] pandaids: 7056956001
[2026-03-25 02:41:20] 2026-03-25 06:41:18,751 [wrapper] cleanup supervisor_pilot  367788 3041481
[2026-03-25 02:41:20] 2026-03-25 06:41:18,803 [wrapper] Test setup, not cleaning
[2026-03-25 02:41:20] 2026-03-25 06:41:18,899 [wrapper] apfmon messages muted
[2026-03-25 02:41:20] 2026-03-25 06:41:18,919 [wrapper] ==== wrapper stdout END ====
[2026-03-25 02:41:20] 2026-03-25 06:41:18,959 [wrapper] ==== wrapper stderr END ====
[2026-03-25 02:41:20]  *** Error codes and diagnostics ***
[2026-03-25 02:41:20]     "exeErrorCode": 0,
[2026-03-25 02:41:20]     "exeErrorDiag": "",
[2026-03-25 02:41:20]     "pilotErrorCode": 0,
[2026-03-25 02:41:20]     "pilotErrorDiag": "",
[2026-03-25 02:41:20]  *** Listing of results directory ***
[2026-03-25 02:41:20] total 443024
[2026-03-25 02:41:20] -rwx------. 1 boincer umatlas     36322 Mar 16 11:26 runpilot2-wrapper.sh
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas      5111 Mar 16 11:28 queuedata.json
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas    585013 Mar 16 11:28 pilot3.tar.gz
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas       100 Mar 24 19:49 wrapper_26015_x86_64-pc-linux-gnu
[2026-03-25 02:41:20] -rwxr-xr-x. 1 boincer umatlas      7986 Mar 24 19:49 run_atlas
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas       105 Mar 24 19:49 job.xml
[2026-03-25 02:41:20] -rw-r--r--. 2 boincer umatlas 235724046 Mar 24 19:49 EVNT.49131779._000008.pool.root.1
[2026-03-25 02:41:20] -rw-r--r--. 2 boincer umatlas     15845 Mar 24 19:49 start_atlas.sh
[2026-03-25 02:41:20] drwxrwx--x. 2 boincer umatlas      4096 Mar 24 19:49 shared
[2026-03-25 02:41:20] -rw-r--r--. 2 boincer umatlas    597541 Mar 24 19:49 input.tar.gz
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas         0 Mar 24 19:49 boinc_lockfile
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas      2615 Mar 24 19:49 pandaJob.out
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas        57 Mar 24 19:49 setup.sh.local
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas   1010852 Mar 24 19:50 agis_schedconf.cvmfs.json
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas       440 Mar 24 19:51 workernode_map.json
[2026-03-25 02:41:20] drwx------. 5 boincer umatlas      4096 Mar 24 19:51 pilot3
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas 206673438 Mar 25 02:36 HITS.49179572._000188.pool.root.1
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas       530 Mar 25 02:37 boinc_task_state.xml
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas      6842 Mar 25 02:38 init_data.xml
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas      1039 Mar 25 02:40 memory_monitor_summary.json
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas   1511579 Mar 25 02:40 agis_ddmendpoints.agis.ALL.json
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas    606133 Mar 25 02:40 log.49179572._000188.job.log.tgz.1
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas      6375 Mar 25 02:40 heartbeat.json
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas        95 Mar 25 02:41 pilot_heartbeat.json
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas      4820 Mar 25 02:41 pilotlog.txt
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas      8192 Mar 25 02:41 boinc_mmap_file
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas        28 Mar 25 02:41 wrapper_checkpoint.txt
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas   3048802 Mar 25 02:41 log.49179572._000188.job.log.1
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas       357 Mar 25 02:41 output.list
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas       620 Mar 25 02:41 runtime_log
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas   3676160 Mar 25 02:41 result.tar.gz
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas      9344 Mar 25 02:41 runtime_log.err
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas       657 Mar 25 02:41 CzcLDmC1OM9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmD5xLDmbFSlRn.diag
[2026-03-25 02:41:20] -rw-r--r--. 1 boincer umatlas     21186 Mar 25 02:41 stderr.txt
[2026-03-25 02:41:20] HITS file was successfully produced:
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas 206673438 Mar 25 02:36 shared/HITS.pool.root.1
[2026-03-25 02:41:20]  *** Contents of shared directory: ***
[2026-03-25 02:41:20] total 436232
[2026-03-25 02:41:20] -rw-r--r--. 2 boincer umatlas 235724046 Mar 24 19:49 ATLAS.root_0
[2026-03-25 02:41:20] -rw-r--r--. 2 boincer umatlas     15845 Mar 24 19:49 start_atlas.sh
[2026-03-25 02:41:20] -rw-r--r--. 2 boincer umatlas    597541 Mar 24 19:49 input.tar.gz
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas 206673438 Mar 25 02:36 HITS.pool.root.1
[2026-03-25 02:41:20] -rw-------. 1 boincer umatlas   3676160 Mar 25 02:41 result.tar.gz
02:41:43 (3034944): run_atlas exited; CPU time 67855.171433
02:41:43 (3034944): called boinc_finish(0)

</stderr_txt>
]]>

©2026 CERN