Stderr output

<core_client_version>8.1.0</core_client_version>
<![CDATA[
<stderr_txt>
01:23:44 (3441439): wrapper (7.7.26015): starting
01:23:44 (3441439): wrapper: running run_atlas (--nthreads 8)
[2025-03-10 01:23:44] Arguments: --nthreads 8
[2025-03-10 01:23:44] Threads: 8
[2025-03-10 01:23:44] Checking for CVMFS
[2025-03-10 01:23:44] Probing /cvmfs/atlas.cern.ch... OK
[2025-03-10 01:23:44] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-03-10 01:23:44] Running cvmfs_config stat atlas.cern.ch
[2025-03-10 01:23:44] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-03-10 01:23:44] 2.12.6.0 2898667 15018 307564 143511 3 341 23832214 37641217 28991 130560 0 6002974 99.526 6840069 20341 http://cvmfs-egi.gridpp.rl.ac.uk:8000/cvmfs/atlas.cern.ch http://192.41.231.237:6081 1
[2025-03-10 01:23:44] CVMFS is ok
[2025-03-10 01:23:44] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-03-10 01:23:44] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-03-10 01:23:44] Further information can be found at the LHC@home message board.
[2025-03-10 01:23:44] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-03-10 01:23:44] Checking for apptainer binary...
[2025-03-10 01:23:44] Using apptainer found in PATH at /usr/bin/apptainer
[2025-03-10 01:23:44] Running /usr/bin/apptainer --version
[2025-03-10 01:23:44] apptainer version 1.3.6-1.el9
[2025-03-10 01:23:44] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-03-10 01:23:44] c6-12-27-4.aglt2.org
[2025-03-10 01:23:44] apptainer works
[2025-03-10 01:23:45] Set ATHENA_PROC_NUMBER=8
[2025-03-10 01:23:45] Set ATHENA_CORE_NUMBER=8
[2025-03-10 01:23:45] Starting ATLAS job with PandaID=6550273762
[2025-03-10 01:23:45] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2025-03-10 04:52:53]  *** The last 200 lines of the pilot log: ***
[2025-03-10 04:52:53] 2025-03-10 08:52:32,861 | INFO     | model: linear, x: [1741584562.0, 1741584623.0, 1741584684.0, 1741584745.0, 1741584806.0, 1741584867.0, 1741584928.0, 1741584989.0, 1741585050.0, 1741585111.0, 1741
[2025-03-10 04:52:53] 2025-03-10 08:52:32,861 | INFO     | sum of square deviations: 2480595561.995003
[2025-03-10 04:52:53] 2025-03-10 08:52:32,862 | INFO     | sum of deviations: 65011448535.96994
[2025-03-10 04:52:53] 2025-03-10 08:52:32,863 | INFO     | mean x: 1741590631.505
[2025-03-10 04:52:53] 2025-03-10 08:52:32,863 | INFO     | mean y: 2176541.03
[2025-03-10 04:52:53] 2025-03-10 08:52:32,863 | INFO     | -- intersect: -45641430762.594925
[2025-03-10 04:52:53] 2025-03-10 08:52:32,863 | INFO     | intersect: -45641430762.594925
[2025-03-10 04:52:53] 2025-03-10 08:52:32,863 | INFO     | chi2: 2.5243300646438196
[2025-03-10 04:52:53] 2025-03-10 08:52:32,863 | INFO     | current chi2=2.5243300646438196 (change=52.75002919660733 %)
[2025-03-10 04:52:53] 2025-03-10 08:52:32,863 | INFO     | model: linear, x: [1741584867.0, 1741584928.0, 1741584989.0, 1741585050.0, 1741585111.0, 1741585172.0, 1741585233.0, 1741585294.0, 1741585355.0, 1741585416.0, 1741
[2025-03-10 04:52:53] 2025-03-10 08:52:32,864 | INFO     | sum of square deviations: 2299159296.994864
[2025-03-10 04:52:53] 2025-03-10 08:52:32,865 | INFO     | sum of deviations: 28497846483.523083
[2025-03-10 04:52:53] 2025-03-10 08:52:32,865 | INFO     | mean x: 1741590784.0051281
[2025-03-10 04:52:53] 2025-03-10 08:52:32,865 | INFO     | mean y: 2207236.476923077
[2025-03-10 04:52:53] 2025-03-10 08:52:32,865 | INFO     | -- intersect: -21584634033.968384
[2025-03-10 04:52:53] 2025-03-10 08:52:32,865 | INFO     | intersect: -21584634033.968384
[2025-03-10 04:52:53] 2025-03-10 08:52:32,865 | INFO     | chi2: 0.9837611786772072
[2025-03-10 04:52:53] 2025-03-10 08:52:32,865 | INFO     | current chi2=0.9837611786772072 (change=61.028821371027206 %)
[2025-03-10 04:52:53] 2025-03-10 08:52:32,866 | INFO     | model: linear, x: [1741585172.0, 1741585233.0, 1741585294.0, 1741585355.0, 1741585416.0, 1741585477.0, 1741585538.0, 1741585599.0, 1741585660.0, 1741585721.0, 1741
[2025-03-10 04:52:53] 2025-03-10 08:52:32,866 | INFO     | sum of square deviations: 2126792969.4947298
[2025-03-10 04:52:53] 2025-03-10 08:52:32,867 | INFO     | sum of deviations: 3970664727.7473655
[2025-03-10 04:52:53] 2025-03-10 08:52:32,867 | INFO     | mean x: 1741590936.505263
[2025-03-10 04:52:53] 2025-03-10 08:52:32,867 | INFO     | mean y: 2228788.752631579
[2025-03-10 04:52:53] 2025-03-10 08:52:32,867 | INFO     | -- intersect: -3249274202.339556
[2025-03-10 04:52:53] 2025-03-10 08:52:32,867 | INFO     | intersect: -3249274202.339556
[2025-03-10 04:52:53] 2025-03-10 08:52:32,867 | INFO     | chi2: 0.1128232053644734
[2025-03-10 04:52:53] 2025-03-10 08:52:32,867 | INFO     | current chi2=0.1128232053644734 (change=88.53144362576101 %)
[2025-03-10 04:52:53] 2025-03-10 08:52:32,868 | INFO     | model: linear, x: [1741585477.0, 1741585538.0, 1741585599.0, 1741585660.0, 1741585721.0, 1741585782.0, 1741585843.0, 1741585904.0, 1741585965.0, 1741586026.0, 1741
[2025-03-10 04:52:53] 2025-03-10 08:52:32,869 | INFO     | sum of square deviations: 1963264016.9945984
[2025-03-10 04:52:53] 2025-03-10 08:52:32,870 | INFO     | sum of deviations: -144368226.98918918
[2025-03-10 04:52:53] 2025-03-10 08:52:32,870 | INFO     | mean x: 1741591089.0054054
[2025-03-10 04:52:53] 2025-03-10 08:52:32,870 | INFO     | mean y: 2232578.9891891894
[2025-03-10 04:52:53] 2025-03-10 08:52:32,870 | INFO     | -- intersect: 130300131.536083
[2025-03-10 04:52:53] 2025-03-10 08:52:32,870 | INFO     | intersect: 130300131.536083
[2025-03-10 04:52:53] 2025-03-10 08:52:32,871 | INFO     | chi2: 0.07377379555921831
[2025-03-10 04:52:53] 2025-03-10 08:52:32,871 | INFO     | current chi2=0.07377379555921831 (change=34.61115085243913 %)
[2025-03-10 04:52:53] 2025-03-10 08:52:32,871 | INFO     | model: linear, x: [1741585782.0, 1741585843.0, 1741585904.0, 1741585965.0, 1741586026.0, 1741586088.0, 1741586148.0, 1741586209.0, 1741586270.0, 1741586331.0, 1741
[2025-03-10 04:52:53] 2025-03-10 08:52:32,871 | INFO     | sum of square deviations: 1808339876.9944415
[2025-03-10 04:52:53] 2025-03-10 08:52:32,872 | INFO     | sum of deviations: -1274267039.3055546
[2025-03-10 04:52:53] 2025-03-10 08:52:32,872 | INFO     | mean x: 1741591241.5055556
[2025-03-10 04:52:53] 2025-03-10 08:52:32,872 | INFO     | mean y: 2233667.8055555555
[2025-03-10 04:52:53] 2025-03-10 08:52:32,872 | INFO     | -- intersect: 1229465530.148981
[2025-03-10 04:52:53] 2025-03-10 08:52:32,872 | INFO     | intersect: 1229465530.148981
[2025-03-10 04:52:53] 2025-03-10 08:52:32,872 | INFO     | chi2: 0.06864059676144346
[2025-03-10 04:52:53] 2025-03-10 08:52:32,872 | INFO     | current chi2=0.06864059676144346 (change=6.9580245382039845 %)
[2025-03-10 04:52:53] 2025-03-10 08:52:32,873 | INFO     | left removable region: 50
[2025-03-10 04:52:53] 2025-03-10 08:52:32,873 | INFO     | model: linear, x: [1741587307.0, 1741587368.0, 1741587429.0, 1741587490.0, 1741587551.0, 1741587612.0, 1741587673.0, 1741587734.0, 1741587795.0, 1741587856.0, 1741
[2025-03-10 04:52:53] 2025-03-10 08:52:32,873 | INFO     | sum of square deviations: 1025693650.0
[2025-03-10 04:52:53] 2025-03-10 08:52:32,873 | INFO     | sum of deviations: 1396093214.0000002
[2025-03-10 04:52:53] 2025-03-10 08:52:32,874 | INFO     | mean x: 1741591821.0
[2025-03-10 04:52:53] 2025-03-10 08:52:32,874 | INFO     | mean y: 2229020.8187919464
[2025-03-10 04:52:53] 2025-03-10 08:52:32,874 | INFO     | -- intersect: -2368288260.6872435
[2025-03-10 04:52:53] 2025-03-10 08:52:32,874 | INFO     | intersect: -2368288260.6872435
[2025-03-10 04:52:53] 2025-03-10 08:52:32,874 | INFO     | chi2: 0.0566094572914388
[2025-03-10 04:52:53] 2025-03-10 08:52:32,874 | INFO     | -- intersect: -2368288260.6872435
[2025-03-10 04:52:53] 2025-03-10 08:52:32,874 | INFO     | current memory leak: 1.36 B/s (using 149 data points, chi2=0.06)
[2025-03-10 04:52:53] 2025-03-10 08:52:32,875 | INFO     | ..............................
[2025-03-10 04:52:53] 2025-03-10 08:52:32,875 | INFO     | . Timing measurements:
[2025-03-10 04:52:53] 2025-03-10 08:52:32,875 | INFO     | . get job = 0 s
[2025-03-10 04:52:53] 2025-03-10 08:52:32,875 | INFO     | . initial setup = 2 s
[2025-03-10 04:52:53] 2025-03-10 08:52:32,875 | INFO     | . payload setup = 4 s
[2025-03-10 04:52:53] 2025-03-10 08:52:32,875 | INFO     | . stage-in = 0 s
[2025-03-10 04:52:53] 2025-03-10 08:52:32,875 | INFO     | . payload execution = 12488 s
[2025-03-10 04:52:53] 2025-03-10 08:52:32,875 | INFO     | . stage-out = 2 s
[2025-03-10 04:52:53] 2025-03-10 08:52:32,875 | INFO     | . log creation = 0 s
[2025-03-10 04:52:53] 2025-03-10 08:52:32,875 | INFO     | ..............................
[2025-03-10 04:52:53] 2025-03-10 08:52:32,957 | INFO     | 
[2025-03-10 04:52:53] 2025-03-10 08:52:32,957 | INFO     | job summary report
[2025-03-10 04:52:53] 2025-03-10 08:52:32,957 | INFO     | --------------------------------------------------
[2025-03-10 04:52:53] 2025-03-10 08:52:32,957 | INFO     | PanDA job id: 6550273762
[2025-03-10 04:52:53] 2025-03-10 08:52:32,957 | INFO     | task id: 43558382
[2025-03-10 04:52:53] 2025-03-10 08:52:32,957 | INFO     | errors: (none)
[2025-03-10 04:52:53] 2025-03-10 08:52:32,957 | INFO     | status: LOG_TRANSFER = DONE 
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | pilot state: finished 
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | transexitcode: 0
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | exeerrorcode: 0
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | exeerrordiag: 
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | exitcode: 0
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | exitmsg: OK
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | cpuconsumptiontime: 57277 s
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | nevents: 400
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | neventsw: 0
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | pid: 3476288
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | pgrp: 3476288
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | corecount: 8
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | event service: False
[2025-03-10 04:52:53] 2025-03-10 08:52:32,958 | INFO     | sizes: {0: 2378257, 1: 2378456, 4: 2378662, 11: 2378690, 12495: 2408394, 12499: 2417335, 12500: 2417519, 12504: 2417689}
[2025-03-10 04:52:53] 2025-03-10 08:52:32,959 | INFO     | --------------------------------------------------
[2025-03-10 04:52:53] 2025-03-10 08:52:32,959 | INFO     | 
[2025-03-10 04:52:53] 2025-03-10 08:52:32,959 | INFO     | executing command: ls -lF /tmp/boinchome/slots/5
[2025-03-10 04:52:53] 2025-03-10 08:52:32,977 | INFO     | queue jobs had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue payloads had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue data_in had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue data_out had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue current_data_in had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue completed_jobids has 1 job(s)
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,978 | INFO     | queue messages had 0 job(s) [purged]
[2025-03-10 04:52:53] 2025-03-10 08:52:32,979 | INFO     | job 6550273762 has completed (purged errors)
[2025-03-10 04:52:53] 2025-03-10 08:52:32,979 | INFO     | overall cleanup function is called
[2025-03-10 04:52:53] 2025-03-10 08:52:33,985 | INFO     | --- collectZombieJob: --- 10, [3476288]
[2025-03-10 04:52:53] 2025-03-10 08:52:33,986 | INFO     | zombie collector waiting for pid 3476288
[2025-03-10 04:52:53] 2025-03-10 08:52:33,986 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2025-03-10 04:52:53] 2025-03-10 08:52:33,986 | INFO     | collected zombie processes
[2025-03-10 04:52:53] 2025-03-10 08:52:33,986 | INFO     | will attempt to kill all subprocesses of pid=3476288
[2025-03-10 04:52:53] 2025-03-10 08:52:34,140 | INFO     | process IDs to be killed: [3476288] (in reverse order)
[2025-03-10 04:52:53] 2025-03-10 08:52:34,267 | WARNING  | found no corresponding commands to process id(s)
[2025-03-10 04:52:53] 2025-03-10 08:52:34,267 | INFO     | Do not look for orphan processes in BOINC jobs
[2025-03-10 04:52:53] 2025-03-10 08:52:34,319 | INFO     | did not find any defunct processes belonging to 3476288
[2025-03-10 04:52:53] 2025-03-10 08:52:34,371 | INFO     | did not find any defunct processes belonging to 3476288
[2025-03-10 04:52:53] 2025-03-10 08:52:34,372 | INFO     | ready for new job
[2025-03-10 04:52:53] 2025-03-10 08:52:34,372 | INFO     | pilot has finished with previous job - re-establishing logging
[2025-03-10 04:52:53] 2025-03-10 08:52:34,375 | INFO     | **************************************
[2025-03-10 04:52:53] 2025-03-10 08:52:34,375 | INFO     | ***  PanDA Pilot version 3.9.4.15  ***
[2025-03-10 04:52:53] 2025-03-10 08:52:34,375 | INFO     | **************************************
[2025-03-10 04:52:53] 2025-03-10 08:52:34,375 | INFO     | 
[2025-03-10 04:52:53] 2025-03-10 08:52:34,394 | INFO     | architecture information:
[2025-03-10 04:52:53] 2025-03-10 08:52:34,395 | INFO     | executing command: cat /etc/os-release
[2025-03-10 04:52:53] 2025-03-10 08:52:34,413 | INFO     | cat /etc/os-release:
[2025-03-10 04:52:53] NAME="CentOS Linux"
[2025-03-10 04:52:53] VERSION="7 (Core)"
[2025-03-10 04:52:53] ID="centos"
[2025-03-10 04:52:53] ID_LIKE="rhel fedora"
[2025-03-10 04:52:53] VERSION_ID="7"
[2025-03-10 04:52:53] PRETTY_NAME="CentOS Linux 7 (Core)"
[2025-03-10 04:52:53] ANSI_COLOR="0;31"
[2025-03-10 04:52:53] CPE_NAME="cpe:/o:centos:centos:7"
[2025-03-10 04:52:53] HOME_URL="https://www.centos.org/"
[2025-03-10 04:52:53] BUG_REPORT_URL="https://bugs.centos.org/"
[2025-03-10 04:52:53] 
[2025-03-10 04:52:53] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2025-03-10 04:52:53] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2025-03-10 04:52:53] REDHAT_SUPPORT_PRODUCT="centos"
[2025-03-10 04:52:53] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2025-03-10 04:52:53] 
[2025-03-10 04:52:53] 2025-03-10 08:52:34,413 | INFO     | **************************************
[2025-03-10 04:52:53] 2025-03-10 08:52:34,675 | INFO     | PID=3446882 has CPU usage=9.7% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i P
[2025-03-10 04:52:53] 2025-03-10 08:52:34,676 | INFO     | .. there are 40 such processes running
[2025-03-10 04:52:53] 2025-03-10 08:52:34,917 | INFO     | executing command: df -mP /tmp/boinchome/slots/5
[2025-03-10 04:52:53] 2025-03-10 08:52:34,934 | INFO     | sufficient remaining disk space (96464797696 B)
[2025-03-10 04:52:53] 2025-03-10 08:52:34,935 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2025-03-10 04:52:53] 2025-03-10 08:52:34,935 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2025-03-10 04:52:53] 2025-03-10 08:52:34,935 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2025-03-10 04:52:53] 2025-03-10 08:52:34,936 | WARNING  | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2025-03-10 04:52:53] 2025-03-10 08:52:34,936 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2025-03-10 04:52:53] 2025-03-10 08:52:34,937 | INFO     | found 0 job(s) in 20 queues
[2025-03-10 04:52:53] 2025-03-10 08:52:34,937 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2025-03-10 04:52:53] 2025-03-10 08:52:34,937 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2025-03-10 04:52:53] 2025-03-10 08:52:35,506 | INFO     | all job control threads have been joined
[2025-03-10 04:52:53] 2025-03-10 08:52:35,584 | INFO     | all data control threads have been joined
[2025-03-10 04:52:53] 2025-03-10 08:52:35,686 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2025-03-10 04:52:53] 2025-03-10 08:52:35,686 | INFO     | aborting loop
[2025-03-10 04:52:53] 2025-03-10 08:52:35,818 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2025-03-10 04:52:53] 2025-03-10 08:52:35,907 | INFO     | all payload control threads have been joined
[2025-03-10 04:52:53] 2025-03-10 08:52:35,938 | INFO     | [job] queue monitor thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:35,940 | INFO     | [job] retrieve thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:36,433 | INFO     | [payload] validate_post thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:36,462 | INFO     | [job] create_data_payload thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:36,512 | INFO     | [job] control thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:36,547 | INFO     | [payload] failed_post thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:36,590 | INFO     | [data] control thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:36,691 | INFO     | [job] job monitor thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:36,720 | INFO     | [payload] validate_pre thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:36,913 | INFO     | [payload] control thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:37,177 | INFO     | [payload] execute_payloads thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:37,178 | INFO     | [job] validate thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:37,178 | INFO     | [data] copytool_in thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:37,823 | INFO     | [data] copytool_out thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:38,943 | INFO     | [data] queue_monitor thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:45,243 | INFO     | job.realtimelogging is not enabled
[2025-03-10 04:52:53] 2025-03-10 08:52:46,249 | INFO     | [payload] run_realtimelog thread has finished
[2025-03-10 04:52:53] 2025-03-10 08:52:47,854 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140095238203200)>', '<ExcThread(monitor, started 140094744798976)>']
[2025-03-10 04:52:53] 2025-03-10 08:52:47,994 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2025-03-10 04:52:53] 2025-03-10 08:52:47,995 | INFO     | [monitor] control thread has ended
[2025-03-10 04:52:53] 2025-03-10 08:52:52,879 | INFO     | all workflow threads have been joined
[2025-03-10 04:52:53] 2025-03-10 08:52:52,880 | INFO     | end of generic workflow (traces error code: 0)
[2025-03-10 04:52:53] 2025-03-10 08:52:52,880 | INFO     | traces error code: 0
[2025-03-10 04:52:53] 2025-03-10 08:52:52,880 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2025-03-10 04:52:53] 2025-03-10 08:52:53,113 [wrapper] ==== pilot stdout END ====
[2025-03-10 04:52:53] 2025-03-10 08:52:53,116 [wrapper] ==== wrapper stdout RESUME ====
[2025-03-10 04:52:53] 2025-03-10 08:52:53,118 [wrapper] pilotpid: 3446882
[2025-03-10 04:52:53] 2025-03-10 08:52:53,120 [wrapper] Pilot exit status: 0
[2025-03-10 04:52:53] 2025-03-10 08:52:53,129 [wrapper] pandaids: 6550273762
[2025-03-10 04:52:53] 2025-03-10 08:52:53,217 [wrapper] cleanup supervisor_pilot 1033144 3446883
[2025-03-10 04:52:53] 2025-03-10 08:52:53,220 [wrapper] Test setup, not cleaning
[2025-03-10 04:52:53] 2025-03-10 08:52:53,225 [wrapper] apfmon messages muted
[2025-03-10 04:52:53] 2025-03-10 08:52:53,228 [wrapper] ==== wrapper stdout END ====
[2025-03-10 04:52:53] 2025-03-10 08:52:53,231 [wrapper] ==== wrapper stderr END ====
[2025-03-10 04:52:53]  *** Error codes and diagnostics ***
[2025-03-10 04:52:53]     "exeErrorCode": 0,
[2025-03-10 04:52:53]     "exeErrorDiag": "",
[2025-03-10 04:52:53]     "pilotErrorCode": 0,
[2025-03-10 04:52:53]     "pilotErrorDiag": "",
[2025-03-10 04:52:53]  *** Listing of results directory ***
[2025-03-10 04:52:53] total 426920
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas    491065 Mar 10 00:48 pilot3.tar.gz
[2025-03-10 04:52:53] -rwx------. 1 boincer umatlas     35865 Mar 10 01:21 runpilot2-wrapper.sh
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas      5118 Mar 10 01:21 queuedata.json
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas       100 Mar 10 01:23 wrapper_26015_x86_64-pc-linux-gnu
[2025-03-10 04:52:53] -rwxr-xr-x. 1 boincer umatlas      7986 Mar 10 01:23 run_atlas
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas       105 Mar 10 01:23 job.xml
[2025-03-10 04:52:53] -rw-r--r--. 2 boincer umatlas 247558548 Mar 10 01:23 EVNT.43558378._000026.pool.root.1
[2025-03-10 04:52:53] -rw-r--r--. 2 boincer umatlas     17569 Mar 10 01:23 start_atlas.sh
[2025-03-10 04:52:53] drwxrwx--x. 2 boincer umatlas      4096 Mar 10 01:23 shared
[2025-03-10 04:52:53] -rw-r--r--. 2 boincer umatlas    503562 Mar 10 01:23 input.tar.gz
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas         0 Mar 10 01:23 boinc_lockfile
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas      2589 Mar 10 01:23 pandaJob.out
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas       467 Mar 10 01:23 setup.sh.local
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas    992413 Mar 10 01:23 agis_schedconf.cvmfs.json
[2025-03-10 04:52:53] drwx------. 4 boincer umatlas      4096 Mar 10 01:23 pilot3
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas      6859 Mar 10 04:48 init_data.xml
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas 182514115 Mar 10 04:51 HITS.43558382._000637.pool.root.1
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas       531 Mar 10 04:51 boinc_task_state.xml
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas      1044 Mar 10 04:52 memory_monitor_summary.json
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas   1579410 Mar 10 04:52 agis_ddmendpoints.agis.ALL.json
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas    389823 Mar 10 04:52 log.43558382._000637.job.log.tgz.1
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas        95 Mar 10 04:52 pilot_heartbeat.json
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas      7740 Mar 10 04:52 heartbeat.json
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas      4805 Mar 10 04:52 pilotlog.txt
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas      8192 Mar 10 04:52 boinc_mmap_file
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas        28 Mar 10 04:52 wrapper_checkpoint.txt
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas   1249792 Mar 10 04:52 log.43558382._000637.job.log.1
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas       357 Mar 10 04:52 output.list
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas       620 Mar 10 04:52 runtime_log
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas   1658880 Mar 10 04:52 result.tar.gz
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas     11429 Mar 10 04:52 runtime_log.err
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas       657 Mar 10 04:52 4wUKDmJlkB7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmYn0KDmlgogsn.diag
[2025-03-10 04:52:53] -rw-r--r--. 1 boincer umatlas     21780 Mar 10 04:52 stderr.txt
[2025-03-10 04:52:53] HITS file was successfully produced:
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas 182514115 Mar 10 04:51 shared/HITS.pool.root.1
[2025-03-10 04:52:53]  *** Contents of shared directory: ***
[2025-03-10 04:52:53] total 422140
[2025-03-10 04:52:53] -rw-r--r--. 2 boincer umatlas 247558548 Mar 10 01:23 ATLAS.root_0
[2025-03-10 04:52:53] -rw-r--r--. 2 boincer umatlas     17569 Mar 10 01:23 start_atlas.sh
[2025-03-10 04:52:53] -rw-r--r--. 2 boincer umatlas    503562 Mar 10 01:23 input.tar.gz
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas 182514115 Mar 10 04:51 HITS.pool.root.1
[2025-03-10 04:52:53] -rw-------. 1 boincer umatlas   1658880 Mar 10 04:52 result.tar.gz
04:52:55 (3441439): run_atlas exited; CPU time 57295.789288
04:52:55 (3441439): called boinc_finish(0)

</stderr_txt>
]]>

©2025 CERN