Stderr output

<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
02:09:43 (19377): wrapper (7.7.26015): starting
02:09:43 (19377): wrapper: running run_atlas (--nthreads 8)
[2025-03-14 02:09:43] Arguments: --nthreads 8
[2025-03-14 02:09:43] Threads: 8
[2025-03-14 02:09:43] Checking for CVMFS
[2025-03-14 02:09:44] Probing /cvmfs/atlas.cern.ch... OK
[2025-03-14 02:09:44] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-03-14 02:09:44] Running cvmfs_config stat atlas.cern.ch
[2025-03-14 02:09:45] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-03-14 02:09:45] 2.11.2.0 6981 41632 76952 143663 2 113 22548988 25165824 4134 130560 0 2078307 99.990 847047 5352 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.73.11:3128/ 1
[2025-03-14 02:09:45] CVMFS is ok
[2025-03-14 02:09:45] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-03-14 02:09:45] Checking for apptainer binary...
[2025-03-14 02:09:45] Using apptainer found in PATH at /usr/bin/apptainer
[2025-03-14 02:09:45] Running /usr/bin/apptainer --version
[2025-03-14 02:09:45] apptainer version 1.3.2-1.el7
[2025-03-14 02:09:45] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-03-14 02:09:50] cg-vwn373.simple-grid.lan
[2025-03-14 02:09:50] apptainer works
[2025-03-14 02:09:50] Set ATHENA_PROC_NUMBER=8
[2025-03-14 02:09:50] Set ATHENA_CORE_NUMBER=8
[2025-03-14 02:09:50] Starting ATLAS job with PandaID=6554947262
[2025-03-14 02:09:50] Running command: /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/14 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2025-03-14 07:51:26]  *** The last 200 lines of the pilot log: ***
[2025-03-14 07:51:26] 2025-03-14 06:27:52,179 | INFO     | current chi2=6.099754895699262 (change=-0.030994883760282792 %)
[2025-03-14 07:51:26] 2025-03-14 06:27:52,179 | INFO     | right removable region: 304
[2025-03-14 07:51:26] 2025-03-14 06:27:52,179 | INFO     | model: linear, x: [1741915056.0, 1741915117.0, 1741915178.0, 1741915239.0, 1741915300.0, 1741915361.0, 1741915422.0, 1741915483.0, 1741915544.0, 1741915605.0, 1741
[2025-03-14 07:51:26] 2025-03-14 06:27:52,180 | INFO     | sum of square deviations: 8797783560.0
[2025-03-14 07:51:26] 2025-03-14 06:27:52,182 | INFO     | sum of deviations: 111542625064.00002
[2025-03-14 07:51:26] 2025-03-14 06:27:52,183 | INFO     | mean x: 1741924328.0
[2025-03-14 07:51:26] 2025-03-14 06:27:52,183 | INFO     | mean y: 2478553.593442623
[2025-03-14 07:51:26] 2025-03-14 06:27:52,183 | INFO     | -- intersect: -22082494426.574326
[2025-03-14 07:51:26] 2025-03-14 06:27:52,183 | INFO     | intersect: -22082494426.574326
[2025-03-14 07:51:26] 2025-03-14 06:27:52,183 | INFO     | chi2: 2.8992994452001892
[2025-03-14 07:51:26] 2025-03-14 06:27:52,184 | INFO     | current chi2=2.8992994452001892 (change=52.45385873229223 %)
[2025-03-14 07:51:26] 2025-03-14 06:27:52,184 | INFO     | model: linear, x: [1741915361.0, 1741915422.0, 1741915483.0, 1741915544.0, 1741915605.0, 1741915666.0, 1741915727.0, 1741915788.0, 1741915849.0, 1741915910.0, 1741
[2025-03-14 07:51:26] 2025-03-14 06:27:52,184 | INFO     | sum of square deviations: 8372156975.0
[2025-03-14 07:51:26] 2025-03-14 06:27:52,187 | INFO     | sum of deviations: 43731944533.49999
[2025-03-14 07:51:26] 2025-03-14 06:27:52,187 | INFO     | mean x: 1741924480.5
[2025-03-14 07:51:26] 2025-03-14 06:27:52,187 | INFO     | mean y: 2502849.5833333335
[2025-03-14 07:51:26] 2025-03-14 06:27:52,187 | INFO     | -- intersect: -9096436048.748991
[2025-03-14 07:51:26] 2025-03-14 06:27:52,187 | INFO     | intersect: -9096436048.748991
[2025-03-14 07:51:26] 2025-03-14 06:27:52,188 | INFO     | chi2: 1.1059335553713863
[2025-03-14 07:51:26] 2025-03-14 06:27:52,188 | INFO     | current chi2=1.1059335553713863 (change=61.855145483428174 %)
[2025-03-14 07:51:26] 2025-03-14 06:27:52,188 | INFO     | model: linear, x: [1741915666.0, 1741915727.0, 1741915788.0, 1741915849.0, 1741915910.0, 1741915971.0, 1741916032.0, 1741916093.0, 1741916154.0, 1741916215.0, 1741
[2025-03-14 07:51:26] 2025-03-14 06:27:52,189 | INFO     | sum of square deviations: 7960484140.0
[2025-03-14 07:51:26] 2025-03-14 06:27:52,191 | INFO     | sum of deviations: -4265744029.999999
[2025-03-14 07:51:26] 2025-03-14 06:27:52,192 | INFO     | mean x: 1741924633.0
[2025-03-14 07:51:26] 2025-03-14 06:27:52,192 | INFO     | mean y: 2520574.3254237287
[2025-03-14 07:51:26] 2025-03-14 06:27:52,192 | INFO     | -- intersect: 935956841.9253099
[2025-03-14 07:51:26] 2025-03-14 06:27:52,192 | INFO     | intersect: 935956841.9253099
[2025-03-14 07:51:26] 2025-03-14 06:27:52,192 | INFO     | chi2: 0.1057389566410381
[2025-03-14 07:51:26] 2025-03-14 06:27:52,192 | INFO     | current chi2=0.1057389566410381 (change=90.43894127929507 %)
[2025-03-14 07:51:26] 2025-03-14 06:27:52,193 | INFO     | model: linear, x: [1741915971.0, 1741916032.0, 1741916093.0, 1741916154.0, 1741916215.0, 1741916276.0, 1741916337.0, 1741916398.0, 1741916459.0, 1741916520.0, 1741
[2025-03-14 07:51:26] 2025-03-14 06:27:52,193 | INFO     | sum of square deviations: 7562532492.5
[2025-03-14 07:51:26] 2025-03-14 06:27:52,196 | INFO     | sum of deviations: -17745952036.500004
[2025-03-14 07:51:26] 2025-03-14 06:27:52,196 | INFO     | mean x: 1741924785.5
[2025-03-14 07:51:26] 2025-03-14 06:27:52,196 | INFO     | mean y: 2525740.148275862
[2025-03-14 07:51:26] 2025-03-14 06:27:52,196 | INFO     | -- intersect: 4090060402.026432
[2025-03-14 07:51:26] 2025-03-14 06:27:52,198 | INFO     | intersect: 4090060402.026432
[2025-03-14 07:51:26] 2025-03-14 06:27:52,199 | INFO     | chi2: 0.027641158259312692
[2025-03-14 07:51:26] 2025-03-14 06:27:52,199 | INFO     | current chi2=0.027641158259312692 (change=73.85905900968106 %)
[2025-03-14 07:51:26] 2025-03-14 06:27:52,200 | INFO     | model: linear, x: [1741916276.0, 1741916337.0, 1741916398.0, 1741916459.0, 1741916520.0, 1741916581.0, 1741916642.0, 1741916703.0, 1741916764.0, 1741916825.0, 1741
[2025-03-14 07:51:26] 2025-03-14 06:27:52,200 | INFO     | sum of square deviations: 7178069470.0
[2025-03-14 07:51:26] 2025-03-14 06:27:52,202 | INFO     | sum of deviations: -17736654203.000004
[2025-03-14 07:51:26] 2025-03-14 06:27:52,203 | INFO     | mean x: 1741924938.0
[2025-03-14 07:51:26] 2025-03-14 06:27:52,203 | INFO     | mean y: 2525733.9368421054
[2025-03-14 07:51:26] 2025-03-14 06:27:52,203 | INFO     | -- intersect: 4306735995.764834
[2025-03-14 07:51:26] 2025-03-14 06:27:52,203 | INFO     | intersect: 4306735995.764834
[2025-03-14 07:51:26] 2025-03-14 06:27:52,203 | INFO     | chi2: 0.027114147717982484
[2025-03-14 07:51:26] 2025-03-14 06:27:52,204 | INFO     | current chi2=0.027114147717982484 (change=1.9066152597011758 %)
[2025-03-14 07:51:26] 2025-03-14 06:27:52,204 | INFO     | left removable region: 50
[2025-03-14 07:51:26] 2025-03-14 06:27:52,204 | INFO     | model: linear, x: [1741917801.0, 1741917862.0, 1741917923.0, 1741917984.0, 1741918045.0, 1741918106.0, 1741918167.0, 1741918228.0, 1741918289.0, 1741918350.0, 1741
[2025-03-14 07:51:26] 2025-03-14 06:27:52,204 | INFO     | sum of square deviations: 5081276667.5
[2025-03-14 07:51:26] 2025-03-14 06:27:52,206 | INFO     | sum of deviations: -6122934536.000001
[2025-03-14 07:51:26] 2025-03-14 06:27:52,207 | INFO     | mean x: 1741925517.5
[2025-03-14 07:51:26] 2025-03-14 06:27:52,207 | INFO     | mean y: 2520580.9212598423
[2025-03-14 07:51:26] 2025-03-14 06:27:52,207 | INFO     | -- intersect: 2101539510.2502885
[2025-03-14 07:51:26] 2025-03-14 06:27:52,207 | INFO     | intersect: 2101539510.2502885
[2025-03-14 07:51:26] 2025-03-14 06:27:52,208 | INFO     | chi2: 0.0188863963981345
[2025-03-14 07:51:26] 2025-03-14 06:27:52,208 | INFO     | -- intersect: 2101539510.2502885
[2025-03-14 07:51:26] 2025-03-14 06:27:52,208 | INFO     | current memory leak: -1.20 B/s (using 254 data points, chi2=0.02)
[2025-03-14 07:51:26] 2025-03-14 06:27:52,209 | INFO     | ..............................
[2025-03-14 07:51:26] 2025-03-14 06:27:52,210 | INFO     | . Timing measurements:
[2025-03-14 07:51:26] 2025-03-14 06:27:52,210 | INFO     | . get job = 0 s
[2025-03-14 07:51:26] 2025-03-14 06:27:52,210 | INFO     | . initial setup = 3 s
[2025-03-14 07:51:26] 2025-03-14 06:27:52,210 | INFO     | . payload setup = 25 s
[2025-03-14 07:51:26] 2025-03-14 06:27:52,210 | INFO     | . stage-in = 0 s
[2025-03-14 07:51:26] 2025-03-14 06:27:52,210 | INFO     | . payload execution = 18943 s
[2025-03-14 07:51:26] 2025-03-14 06:27:52,210 | INFO     | . stage-out = 2 s
[2025-03-14 07:51:26] 2025-03-14 06:27:52,210 | INFO     | . log creation = 0 s
[2025-03-14 07:51:26] 2025-03-14 06:27:52,210 | INFO     | ..............................
[2025-03-14 07:51:26] 2025-03-14 06:27:52,349 | INFO     | 
[2025-03-14 07:51:26] 2025-03-14 06:27:52,350 | INFO     | job summary report
[2025-03-14 07:51:26] 2025-03-14 06:27:52,350 | INFO     | --------------------------------------------------
[2025-03-14 07:51:26] 2025-03-14 06:27:52,350 | INFO     | PanDA job id: 6554947262
[2025-03-14 07:51:26] 2025-03-14 06:27:52,350 | INFO     | task id: 43625193
[2025-03-14 07:51:26] 2025-03-14 06:27:52,350 | INFO     | errors: (none)
[2025-03-14 07:51:26] 2025-03-14 06:27:52,350 | INFO     | status: LOG_TRANSFER = DONE 
[2025-03-14 07:51:26] 2025-03-14 06:27:52,350 | INFO     | pilot state: finished 
[2025-03-14 07:51:26] 2025-03-14 06:27:52,350 | INFO     | transexitcode: 0
[2025-03-14 07:51:26] 2025-03-14 06:27:52,350 | INFO     | exeerrorcode: 0
[2025-03-14 07:51:26] 2025-03-14 06:27:52,351 | INFO     | exeerrordiag: 
[2025-03-14 07:51:26] 2025-03-14 06:27:52,351 | INFO     | exitcode: 0
[2025-03-14 07:51:26] 2025-03-14 06:27:52,351 | INFO     | exitmsg: OK
[2025-03-14 07:51:26] 2025-03-14 06:27:52,351 | INFO     | cpuconsumptiontime: 67174 s
[2025-03-14 07:51:26] 2025-03-14 06:27:52,351 | INFO     | nevents: 400
[2025-03-14 07:51:26] 2025-03-14 06:27:52,351 | INFO     | neventsw: 0
[2025-03-14 07:51:26] 2025-03-14 06:27:52,351 | INFO     | pid: 10019
[2025-03-14 07:51:26] 2025-03-14 06:27:52,351 | INFO     | pgrp: 10019
[2025-03-14 07:51:26] 2025-03-14 06:27:52,351 | INFO     | corecount: 8
[2025-03-14 07:51:26] 2025-03-14 06:27:52,351 | INFO     | event service: False
[2025-03-14 07:51:26] 2025-03-14 06:27:52,351 | INFO     | sizes: {0: 2392879, 1: 2393078, 12: 2393078, 13: 2393312, 22: 2393368, 18972: 2425809, 18975: 2434752, 18978: 2434808, 18996: 2434978}
[2025-03-14 07:51:26] 2025-03-14 06:27:52,352 | INFO     | --------------------------------------------------
[2025-03-14 07:51:26] 2025-03-14 06:27:52,352 | INFO     | 
[2025-03-14 07:51:26] 2025-03-14 06:27:52,352 | INFO     | executing command: ls -lF /var/lib/boinc/slots/14
[2025-03-14 07:51:26] 2025-03-14 06:27:52,428 | INFO     | queue jobs had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,428 | INFO     | queue payloads had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,428 | INFO     | queue data_in had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue data_out had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue current_data_in had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,429 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,430 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,430 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,430 | INFO     | queue completed_jobids has 1 job(s)
[2025-03-14 07:51:26] 2025-03-14 06:27:52,430 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,430 | INFO     | queue messages had 0 job(s) [purged]
[2025-03-14 07:51:26] 2025-03-14 06:27:52,430 | INFO     | job 6554947262 has completed (purged errors)
[2025-03-14 07:51:26] 2025-03-14 06:27:52,430 | INFO     | overall cleanup function is called
[2025-03-14 07:51:26] 2025-03-14 06:27:53,440 | INFO     | --- collectZombieJob: --- 10, [10019]
[2025-03-14 07:51:26] 2025-03-14 06:27:53,441 | INFO     | zombie collector waiting for pid 10019
[2025-03-14 07:51:26] 2025-03-14 06:27:53,441 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2025-03-14 07:51:26] 2025-03-14 06:27:53,441 | INFO     | collected zombie processes
[2025-03-14 07:51:26] 2025-03-14 06:27:53,441 | INFO     | will attempt to kill all subprocesses of pid=10019
[2025-03-14 07:51:26] 2025-03-14 06:27:53,545 | INFO     | process IDs to be killed: [10019] (in reverse order)
[2025-03-14 07:51:26] 2025-03-14 06:27:53,681 | WARNING  | found no corresponding commands to process id(s)
[2025-03-14 07:51:26] 2025-03-14 06:27:53,682 | INFO     | Do not look for orphan processes in BOINC jobs
[2025-03-14 07:51:26] 2025-03-14 06:27:53,691 | INFO     | did not find any defunct processes belonging to 10019
[2025-03-14 07:51:26] 2025-03-14 06:27:53,696 | INFO     | did not find any defunct processes belonging to 10019
[2025-03-14 07:51:26] 2025-03-14 06:27:53,697 | INFO     | ready for new job
[2025-03-14 07:51:26] 2025-03-14 06:27:53,697 | INFO     | pilot has finished with previous job - re-establishing logging
[2025-03-14 07:51:26] 2025-03-14 06:27:53,700 | INFO     | ***************************************
[2025-03-14 07:51:26] 2025-03-14 06:27:53,701 | INFO     | ***  PanDA Pilot version 3.10.0.24  ***
[2025-03-14 07:51:26] 2025-03-14 06:27:53,701 | INFO     | ***************************************
[2025-03-14 07:51:26] 2025-03-14 06:27:53,701 | INFO     | 
[2025-03-14 07:51:26] 2025-03-14 06:27:53,702 | INFO     | pilot is running in a VM
[2025-03-14 07:51:26] 2025-03-14 06:27:53,702 | INFO     | architecture information:
[2025-03-14 07:51:26] 2025-03-14 06:27:53,703 | INFO     | executing command: cat /etc/os-release
[2025-03-14 07:51:26] 2025-03-14 06:27:53,764 | INFO     | cat /etc/os-release:
[2025-03-14 07:51:26] NAME="CentOS Linux"
[2025-03-14 07:51:26] VERSION="7 (Core)"
[2025-03-14 07:51:26] ID="centos"
[2025-03-14 07:51:26] ID_LIKE="rhel fedora"
[2025-03-14 07:51:26] VERSION_ID="7"
[2025-03-14 07:51:26] PRETTY_NAME="CentOS Linux 7 (Core)"
[2025-03-14 07:51:26] ANSI_COLOR="0;31"
[2025-03-14 07:51:26] CPE_NAME="cpe:/o:centos:centos:7"
[2025-03-14 07:51:26] HOME_URL="https://www.centos.org/"
[2025-03-14 07:51:26] BUG_REPORT_URL="https://bugs.centos.org/"
[2025-03-14 07:51:26] 
[2025-03-14 07:51:26] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2025-03-14 07:51:26] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2025-03-14 07:51:26] REDHAT_SUPPORT_PRODUCT="centos"
[2025-03-14 07:51:26] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2025-03-14 07:51:26] 
[2025-03-14 07:51:26] 2025-03-14 06:27:53,765 | INFO     | ***************************************
[2025-03-14 07:51:26] 2025-03-14 06:27:54,269 | INFO     | executing command: df -mP /var/lib/boinc/slots/14
[2025-03-14 07:51:26] 2025-03-14 06:27:54,306 | INFO     | sufficient remaining disk space (485816795136 B)
[2025-03-14 07:51:26] 2025-03-14 06:27:54,306 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2025-03-14 07:51:26] 2025-03-14 06:27:54,306 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2025-03-14 07:51:26] 2025-03-14 06:27:54,307 | WARNING  | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2025-03-14 07:51:26] 2025-03-14 06:27:54,307 | INFO     | found 0 job(s) in 20 queues
[2025-03-14 07:51:26] 2025-03-14 06:27:54,308 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2025-03-14 07:51:26] 2025-03-14 06:27:54,308 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2025-03-14 07:51:26] 2025-03-14 06:27:54,309 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2025-03-14 07:51:26] 2025-03-14 06:27:54,478 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2025-03-14 07:51:26] 2025-03-14 06:27:54,857 | INFO     | all data control threads have been joined
[2025-03-14 07:51:26] 2025-03-14 06:27:55,072 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2025-03-14 07:51:26] 2025-03-14 06:27:55,154 | INFO     | all job control threads have been joined
[2025-03-14 07:51:26] 2025-03-14 06:27:55,169 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2025-03-14 07:51:26] 2025-03-14 06:27:55,170 | INFO     | aborting loop
[2025-03-14 07:51:26] 2025-03-14 06:27:55,312 | INFO     | [job] retrieve thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:55,317 | INFO     | [job] queue monitor thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:55,473 | INFO     | [payload] execute_payloads thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:55,524 | INFO     | [payload] validate_pre thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:55,605 | INFO     | [payload] failed_post thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:55,711 | INFO     | [payload] validate_post thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:55,774 | INFO     | all payload control threads have been joined
[2025-03-14 07:51:26] 2025-03-14 06:27:55,791 | INFO     | [job] validate thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:55,864 | INFO     | [data] control thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:55,869 | INFO     | [payload] run_realtimelog thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:56,090 | INFO     | [data] copytool_in thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:56,161 | INFO     | [job] control thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:56,176 | INFO     | [job] job monitor thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:56,233 | INFO     | [job] create_data_payload thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:56,781 | INFO     | [payload] control thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:57,079 | INFO     | [data] copytool_out thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:58,487 | INFO     | [data] queue_monitor thread has finished
[2025-03-14 07:51:26] 2025-03-14 06:27:59,347 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140141555439424)>', '<ExcThread(monitor, started 140140689225472)>']
[2025-03-14 07:51:26] 2025-03-14 06:28:00,341 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2025-03-14 07:51:26] 2025-03-14 06:28:00,342 | INFO     | [monitor] control thread has ended
[2025-03-14 07:51:26] 2025-03-14 06:28:04,372 | INFO     | all workflow threads have been joined
[2025-03-14 07:51:26] 2025-03-14 06:28:04,373 | INFO     | end of generic workflow (traces error code: 0)
[2025-03-14 07:51:26] 2025-03-14 06:28:04,373 | INFO     | traces error code: 0
[2025-03-14 07:51:26] 2025-03-14 06:28:04,374 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2025-03-14 07:51:26] 2025-03-14 06:28:04,763 [wrapper] ==== pilot stdout END ====
[2025-03-14 07:51:26] 2025-03-14 06:28:04,818 [wrapper] ==== wrapper stdout RESUME ====
[2025-03-14 07:51:26] 2025-03-14 06:28:04,886 [wrapper] pilotpid: 24356
[2025-03-14 07:51:26] 2025-03-14 06:28:04,993 [wrapper] Pilot exit status: 0
[2025-03-14 07:51:26] 2025-03-14 06:28:05,349 [wrapper] pandaids: 6554947262
[2025-03-14 07:51:26] 2025-03-14 06:28:06,209 [wrapper] cleanup supervisor_pilot  3821 24357
[2025-03-14 07:51:26] 2025-03-14 06:28:06,240 [wrapper] Test setup, not cleaning
[2025-03-14 07:51:26] 2025-03-14 06:28:06,459 [wrapper] apfmon messages muted
[2025-03-14 07:51:26] 2025-03-14 06:28:06,541 [wrapper] ==== wrapper stdout END ====
[2025-03-14 07:51:26] 2025-03-14 06:28:06,679 [wrapper] ==== wrapper stderr END ====
[2025-03-14 07:51:26]  *** Error codes and diagnostics ***
[2025-03-14 07:51:26]     "exeErrorCode": 0,
[2025-03-14 07:51:26]     "exeErrorDiag": "",
[2025-03-14 07:51:26]     "pilotErrorCode": 0,
[2025-03-14 07:51:26]     "pilotErrorDiag": "",
[2025-03-14 07:51:26]  *** Listing of results directory ***
[2025-03-14 07:51:26] total 467560
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc    494584 Mar 13 05:32 pilot3.tar.gz
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc      5119 Mar 13 05:39 queuedata.json
[2025-03-14 07:51:26] -rwx------. 1 boinc boinc     35865 Mar 13 05:39 runpilot2-wrapper.sh
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc       100 Mar 14 02:09 wrapper_26015_x86_64-pc-linux-gnu
[2025-03-14 07:51:26] -rwxr-xr-x. 1 boinc boinc      7986 Mar 14 02:09 run_atlas
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc       105 Mar 14 02:09 job.xml
[2025-03-14 07:51:26] -rw-r--r--. 2 boinc boinc 311944756 Mar 14 02:09 EVNT.43625189._000025.pool.root.1
[2025-03-14 07:51:26] drwxrwx--x. 2 boinc boinc        68 Mar 14 02:09 shared
[2025-03-14 07:51:26] -rw-r--r--. 2 boinc boinc    507027 Mar 14 02:09 input.tar.gz
[2025-03-14 07:51:26] -rw-r--r--. 2 boinc boinc     17571 Mar 14 02:09 start_atlas.sh
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc         0 Mar 14 02:09 boinc_lockfile
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc      2503 Mar 14 02:09 pandaJob.out
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc       424 Mar 14 02:09 setup.sh.local
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc    994585 Mar 14 02:10 agis_schedconf.cvmfs.json
[2025-03-14 07:51:26] drwx------. 4 boinc boinc      4096 Mar 14 02:10 pilot3
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc      6322 Mar 14 02:40 init_data.xml
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc 158498718 Mar 14 07:26 HITS.43625193._000605.pool.root.1
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc       531 Mar 14 07:27 boinc_task_state.xml
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc      1014 Mar 14 07:27 memory_monitor_summary.json
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc   1589745 Mar 14 07:27 agis_ddmendpoints.agis.ALL.json
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc    431781 Mar 14 07:27 log.43625193._000605.job.log.tgz.1
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc        95 Mar 14 07:27 pilot_heartbeat.json
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc      7674 Mar 14 07:27 heartbeat.json
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc      4406 Mar 14 07:28 pilotlog.txt
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc   1828354 Mar 14 07:28 log.43625193._000605.job.log.1
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc       357 Mar 14 07:28 output.list
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc       620 Mar 14 07:28 runtime_log
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc   2283520 Mar 14 07:28 result.tar.gz
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc       657 Mar 14 07:28 V8CLDmQXpC7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmA90KDmFNJChn.diag
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc     11032 Mar 14 07:28 runtime_log.err
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc      8192 Mar 14 07:51 boinc_mmap_file
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc        28 Mar 14 07:51 wrapper_checkpoint.txt
[2025-03-14 07:51:26] -rw-r--r--. 1 boinc boinc     21314 Mar 14 07:51 stderr.txt
[2025-03-14 07:51:26] HITS file was successfully produced:
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc 158498718 Mar 14 07:26 shared/HITS.pool.root.1
[2025-03-14 07:51:26]  *** Contents of shared directory: ***
[2025-03-14 07:51:26] total 462168
[2025-03-14 07:51:26] -rw-r--r--. 2 boinc boinc 311944756 Mar 14 02:09 ATLAS.root_0
[2025-03-14 07:51:26] -rw-r--r--. 2 boinc boinc    507027 Mar 14 02:09 input.tar.gz
[2025-03-14 07:51:26] -rw-r--r--. 2 boinc boinc     17571 Mar 14 02:09 start_atlas.sh
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc 158498718 Mar 14 07:26 HITS.pool.root.1
[2025-03-14 07:51:26] -rw-------. 1 boinc boinc   2283520 Mar 14 07:28 result.tar.gz
07:51:28 (19377): run_atlas exited; CPU time 67134.901195
07:51:28 (19377): called boinc_finish(0)

</stderr_txt>
]]>

©2025 CERN