Stderr output

<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
22:44:46 (16937): wrapper (7.7.26015): starting
22:44:46 (16937): wrapper: running run_atlas (--nthreads 8)
[2024-10-02 22:44:46] Arguments: --nthreads 8
[2024-10-02 22:44:46] Threads: 8
[2024-10-02 22:44:46] Checking for CVMFS
[2024-10-02 22:44:46] Probing /cvmfs/atlas.cern.ch... OK
[2024-10-02 22:44:47] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-10-02 22:44:47] Running cvmfs_config stat atlas.cern.ch
[2024-10-02 22:44:48] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-10-02 22:44:48] 2.11.2.0 14852 53373 77052 137903 3 59 14791646 25165825 4391 130560 0 49770585 99.958 17335264 8046 http://cvmfs-stratum-one.cern.ch:8000/cvmfs/atlas.cern.ch http://192.168.73.11:3128/ 1
[2024-10-02 22:44:48] CVMFS is ok
[2024-10-02 22:44:48] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-10-02 22:44:48] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-10-02 22:44:48] Further information can be found at the LHC@home message board.
[2024-10-02 22:44:48] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-10-02 22:44:48] Checking for apptainer binary...
[2024-10-02 22:44:48] Using apptainer found in PATH at /usr/bin/apptainer
[2024-10-02 22:44:48] Running /usr/bin/apptainer --version
[2024-10-02 22:44:48] apptainer version 1.3.2-1.el7
[2024-10-02 22:44:48] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-10-02 22:53:13] cg-vwn265.simple-grid.lan
[2024-10-02 22:53:13] apptainer works
[2024-10-02 22:53:13] Set ATHENA_PROC_NUMBER=8
[2024-10-02 22:53:13] Set ATHENA_CORE_NUMBER=8
[2024-10-02 22:53:13] Starting ATLAS job with PandaID=6353941558
[2024-10-02 22:53:13] Running command: /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-10-03 09:03:07]  *** The last 200 lines of the pilot log: ***
[2024-10-03 09:03:07] 2024-10-03 04:08:11,849 | INFO     | sum of square deviations: 21527882710.0
[2024-10-03 09:03:07] 2024-10-03 04:08:11,855 | INFO     | sum of deviations: 272134251823.0
[2024-10-03 09:03:07] 2024-10-03 04:08:11,855 | INFO     | mean x: 1727915560.0
[2024-10-03 09:03:07] 2024-10-03 04:08:11,855 | INFO     | mean y: 2489571.897810219
[2024-10-03 09:03:07] 2024-10-03 04:08:11,855 | INFO     | -- intersect: -21840114016.58672
[2024-10-03 09:03:07] 2024-10-03 04:08:11,855 | INFO     | intersect: -21840114016.58672
[2024-10-03 09:03:07] 2024-10-03 04:08:11,856 | INFO     | chi2: 5.6493040083058474
[2024-10-03 09:03:07] 2024-10-03 04:08:11,856 | INFO     | current chi2=5.6493040083058474 (change=11.769913500256548 %)
[2024-10-03 09:03:07] 2024-10-03 04:08:11,856 | INFO     | right removable region: 410
[2024-10-03 09:03:07] 2024-10-03 04:08:11,857 | INFO     | model: linear, x: [1727903360.0, 1727903421.0, 1727903482.0, 1727903543.0, 1727903604.0, 1727903665.0, 1727903726.0, 1727903787.0, 1727903848.0, 1727903909.0, 1727
[2024-10-03 09:03:07] 2024-10-03 04:08:11,865 | INFO     | sum of square deviations: 21527882710.0
[2024-10-03 09:03:07] 2024-10-03 04:08:11,871 | INFO     | sum of deviations: 122270027601.99986
[2024-10-03 09:03:07] 2024-10-03 04:08:11,872 | INFO     | mean x: 1727915865.0
[2024-10-03 09:03:07] 2024-10-03 04:08:11,872 | INFO     | mean y: 2508798.98053528
[2024-10-03 09:03:07] 2024-10-03 04:08:11,872 | INFO     | -- intersect: -9811383414.829443
[2024-10-03 09:03:07] 2024-10-03 04:08:11,872 | INFO     | intersect: -9811383414.829443
[2024-10-03 09:03:07] 2024-10-03 04:08:11,873 | INFO     | chi2: 2.9262006941208365
[2024-10-03 09:03:07] 2024-10-03 04:08:11,873 | INFO     | current chi2=2.9262006941208365 (change=54.29898267497995 %)
[2024-10-03 09:03:07] 2024-10-03 04:08:11,874 | INFO     | model: linear, x: [1727903665.0, 1727903726.0, 1727903787.0, 1727903848.0, 1727903909.0, 1727903970.0, 1727904031.0, 1727904092.0, 1727904153.0, 1727904214.0, 1727
[2024-10-03 09:03:07] 2024-10-03 04:08:11,874 | INFO     | sum of square deviations: 20751710017.5
[2024-10-03 09:03:07] 2024-10-03 04:08:11,879 | INFO     | sum of deviations: 43833282461.000015
[2024-10-03 09:03:07] 2024-10-03 04:08:11,879 | INFO     | mean x: 1727916017.5
[2024-10-03 09:03:07] 2024-10-03 04:08:11,879 | INFO     | mean y: 2524209.9901477834
[2024-10-03 09:03:07] 2024-10-03 04:08:11,880 | INFO     | -- intersect: -3647306613.594593
[2024-10-03 09:03:07] 2024-10-03 04:08:11,880 | INFO     | intersect: -3647306613.594593
[2024-10-03 09:03:07] 2024-10-03 04:08:11,880 | INFO     | chi2: 1.6751627393617468
[2024-10-03 09:03:07] 2024-10-03 04:08:11,880 | INFO     | current chi2=1.6751627393617468 (change=42.75297853877922 %)
[2024-10-03 09:03:07] 2024-10-03 04:08:11,881 | INFO     | model: linear, x: [1727903970.0, 1727904031.0, 1727904092.0, 1727904153.0, 1727904214.0, 1727904275.0, 1727904336.0, 1727904397.0, 1727904458.0, 1727904519.0, 1727
[2024-10-03 09:03:07] 2024-10-03 04:08:11,881 | INFO     | sum of square deviations: 19994421400.0
[2024-10-03 09:03:07] 2024-10-03 04:08:11,892 | INFO     | sum of deviations: -18143284595.0
[2024-10-03 09:03:07] 2024-10-03 04:08:11,893 | INFO     | mean x: 1727916170.0
[2024-10-03 09:03:07] 2024-10-03 04:08:11,893 | INFO     | mean y: 2536669.7605985035
[2024-10-03 09:03:07] 2024-10-03 04:08:11,893 | INFO     | -- intersect: 1570477756.9986818
[2024-10-03 09:03:07] 2024-10-03 04:08:11,893 | INFO     | intersect: 1570477756.9986818
[2024-10-03 09:03:07] 2024-10-03 04:08:11,894 | INFO     | chi2: 0.8378479814006187
[2024-10-03 09:03:07] 2024-10-03 04:08:11,894 | INFO     | current chi2=0.8378479814006187 (change=49.9840844287256 %)
[2024-10-03 09:03:07] 2024-10-03 04:08:11,894 | INFO     | model: linear, x: [1727904275.0, 1727904336.0, 1727904397.0, 1727904458.0, 1727904519.0, 1727904580.0, 1727904641.0, 1727904702.0, 1727904763.0, 1727904824.0, 1727
[2024-10-03 09:03:07] 2024-10-03 04:08:11,895 | INFO     | sum of square deviations: 19255784295.0
[2024-10-03 09:03:07] 2024-10-03 04:08:11,899 | INFO     | sum of deviations: -28628908631.00003
[2024-10-03 09:03:07] 2024-10-03 04:08:11,900 | INFO     | mean x: 1727916322.5
[2024-10-03 09:03:07] 2024-10-03 04:08:11,900 | INFO     | mean y: 2538822.5353535353
[2024-10-03 09:03:07] 2024-10-03 04:08:11,900 | INFO     | -- intersect: 2571551736.317897
[2024-10-03 09:03:07] 2024-10-03 04:08:11,900 | INFO     | intersect: 2571551736.317897
[2024-10-03 09:03:07] 2024-10-03 04:08:11,901 | INFO     | chi2: 0.797219764718152
[2024-10-03 09:03:07] 2024-10-03 04:08:11,901 | INFO     | current chi2=0.797219764718152 (change=4.849115541765586 %)
[2024-10-03 09:03:07] 2024-10-03 04:08:11,901 | INFO     | left removable region: 40
[2024-10-03 09:03:07] 2024-10-03 04:08:11,902 | INFO     | model: linear, x: [1727905495.0, 1727905556.0, 1727905617.0, 1727905678.0, 1727905739.0, 1727905800.0, 1727905861.0, 1727905922.0, 1727905983.0, 1727906044.0, 1727
[2024-10-03 09:03:07] 2024-10-03 04:08:11,902 | INFO     | sum of square deviations: 15706536352.5
[2024-10-03 09:03:07] 2024-10-03 04:08:11,906 | INFO     | sum of deviations: 1607851694.4999971
[2024-10-03 09:03:07] 2024-10-03 04:08:11,907 | INFO     | mean x: 1727916749.5
[2024-10-03 09:03:07] 2024-10-03 04:08:11,907 | INFO     | mean y: 2543688.57027027
[2024-10-03 09:03:07] 2024-10-03 04:08:11,907 | INFO     | -- intersect: -174340241.23366082
[2024-10-03 09:03:07] 2024-10-03 04:08:11,907 | INFO     | intersect: -174340241.23366082
[2024-10-03 09:03:07] 2024-10-03 04:08:11,908 | INFO     | chi2: 0.010914488543703355
[2024-10-03 09:03:07] 2024-10-03 04:08:11,908 | INFO     | -- intersect: -174340241.23366082
[2024-10-03 09:03:07] 2024-10-03 04:08:11,908 | INFO     | current memory leak: 0.10 B/s (using 370 data points, chi2=0.01)
[2024-10-03 09:03:07] 2024-10-03 04:08:11,916 | INFO     | ..............................
[2024-10-03 09:03:07] 2024-10-03 04:08:11,916 | INFO     | . Timing measurements:
[2024-10-03 09:03:07] 2024-10-03 04:08:11,916 | INFO     | . get job = 0 s
[2024-10-03 09:03:07] 2024-10-03 04:08:11,916 | INFO     | . initial setup = 9 s
[2024-10-03 09:03:07] 2024-10-03 04:08:11,916 | INFO     | . payload setup = 132 s
[2024-10-03 09:03:07] 2024-10-03 04:08:11,916 | INFO     | . stage-in = 0 s
[2024-10-03 09:03:07] 2024-10-03 04:08:11,916 | INFO     | . payload execution = 25490 s
[2024-10-03 09:03:07] 2024-10-03 04:08:11,916 | INFO     | . stage-out = 4 s
[2024-10-03 09:03:07] 2024-10-03 04:08:11,917 | INFO     | . log creation = 2 s
[2024-10-03 09:03:07] 2024-10-03 04:08:11,917 | INFO     | ..............................
[2024-10-03 09:03:07] 2024-10-03 04:08:12,132 | INFO     | 
[2024-10-03 09:03:07] 2024-10-03 04:08:12,133 | INFO     | job summary report
[2024-10-03 09:03:07] 2024-10-03 04:08:12,133 | INFO     | --------------------------------------------------
[2024-10-03 09:03:07] 2024-10-03 04:08:12,133 | INFO     | PanDA job id: 6353941558
[2024-10-03 09:03:07] 2024-10-03 04:08:12,133 | INFO     | task id: 41481123
[2024-10-03 09:03:07] 2024-10-03 04:08:12,133 | INFO     | errors: (none)
[2024-10-03 09:03:07] 2024-10-03 04:08:12,133 | INFO     | status: LOG_TRANSFER = DONE 
[2024-10-03 09:03:07] 2024-10-03 04:08:12,133 | INFO     | pilot state: finished 
[2024-10-03 09:03:07] 2024-10-03 04:08:12,133 | INFO     | transexitcode: 0
[2024-10-03 09:03:07] 2024-10-03 04:08:12,134 | INFO     | exeerrorcode: 0
[2024-10-03 09:03:07] 2024-10-03 04:08:12,134 | INFO     | exeerrordiag: 
[2024-10-03 09:03:07] 2024-10-03 04:08:12,134 | INFO     | exitcode: 0
[2024-10-03 09:03:07] 2024-10-03 04:08:12,134 | INFO     | exitmsg: OK
[2024-10-03 09:03:07] 2024-10-03 04:08:12,134 | INFO     | cpuconsumptiontime: 92944 s
[2024-10-03 09:03:07] 2024-10-03 04:08:12,134 | INFO     | nevents: 400
[2024-10-03 09:03:07] 2024-10-03 04:08:12,134 | INFO     | neventsw: 0
[2024-10-03 09:03:07] 2024-10-03 04:08:12,134 | INFO     | pid: 9417
[2024-10-03 09:03:07] 2024-10-03 04:08:12,134 | INFO     | pgrp: 9417
[2024-10-03 09:03:07] 2024-10-03 04:08:12,135 | INFO     | corecount: 8
[2024-10-03 09:03:07] 2024-10-03 04:08:12,135 | INFO     | event service: False
[2024-10-03 09:03:07] 2024-10-03 04:08:12,135 | INFO     | sizes: {0: 2433926, 1: 2435462, 2: 2435462, 13: 2435490, 23: 2435546, 34: 2435574, 45: 2435730, 56: 2435758, 66: 2435786, 77: 2435814, 87: 2436076, 88: 2436384, 25
[2024-10-03 09:03:07] 2024-10-03 04:08:12,135 | INFO     | --------------------------------------------------
[2024-10-03 09:03:07] 2024-10-03 04:08:12,135 | INFO     | 
[2024-10-03 09:03:07] 2024-10-03 04:08:12,135 | INFO     | executing command: ls -lF /var/lib/boinc/slots/0
[2024-10-03 09:03:07] 2024-10-03 04:08:12,625 | INFO     | queue jobs had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,625 | INFO     | queue payloads had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,625 | INFO     | queue data_in had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,625 | INFO     | queue data_out had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,626 | INFO     | queue current_data_in had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,626 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,626 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,626 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,626 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,626 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,626 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,626 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,627 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,627 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,627 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,627 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,627 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,627 | INFO     | queue completed_jobids has 1 job(s)
[2024-10-03 09:03:07] 2024-10-03 04:08:12,627 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,627 | INFO     | queue messages had 0 job(s) [purged]
[2024-10-03 09:03:07] 2024-10-03 04:08:12,628 | INFO     | job 6353941558 has completed (purged errors)
[2024-10-03 09:03:07] 2024-10-03 04:08:12,628 | INFO     | overall cleanup function is called
[2024-10-03 09:03:07] 2024-10-03 04:08:13,637 | INFO     | --- collectZombieJob: --- 10, [9417]
[2024-10-03 09:03:07] 2024-10-03 04:08:13,638 | INFO     | zombie collector waiting for pid 9417
[2024-10-03 09:03:07] 2024-10-03 04:08:13,638 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2024-10-03 09:03:07] 2024-10-03 04:08:13,638 | INFO     | collected zombie processes
[2024-10-03 09:03:07] 2024-10-03 04:08:13,638 | INFO     | will  attempt to kill all subprocesses of pid=9417
[2024-10-03 09:03:07] 2024-10-03 04:08:14,476 | INFO     | process IDs to be killed: [9417] (in reverse order)
[2024-10-03 09:03:07] 2024-10-03 04:08:14,919 | WARNING  | found no corresponding commands to process id(s)
[2024-10-03 09:03:07] 2024-10-03 04:08:14,919 | INFO     | Do not look for orphan processes in BOINC jobs
[2024-10-03 09:03:07] 2024-10-03 04:08:14,922 | INFO     | did not find any defunct processes belonging to 9417
[2024-10-03 09:03:07] 2024-10-03 04:08:14,925 | INFO     | did not find any defunct processes belonging to 9417
[2024-10-03 09:03:07] 2024-10-03 04:08:14,925 | INFO     | ready for new job
[2024-10-03 09:03:07] 2024-10-03 04:08:14,925 | INFO     | pilot has finished with previous job - re-establishing logging
[2024-10-03 09:03:07] 2024-10-03 04:08:14,928 | INFO     | *************************************
[2024-10-03 09:03:07] 2024-10-03 04:08:14,928 | INFO     | ***  PanDA Pilot version 3.8.2.8  ***
[2024-10-03 09:03:07] 2024-10-03 04:08:14,928 | INFO     | *************************************
[2024-10-03 09:03:07] 2024-10-03 04:08:14,928 | INFO     | 
[2024-10-03 09:03:07] 2024-10-03 04:08:14,929 | INFO     | pilot is running in a VM
[2024-10-03 09:03:07] 2024-10-03 04:08:14,929 | INFO     | architecture information:
[2024-10-03 09:03:07] 2024-10-03 04:08:14,944 | INFO     | executing command: cat /etc/os-release
[2024-10-03 09:03:07] 2024-10-03 04:08:15,224 | INFO     | cat /etc/os-release:
[2024-10-03 09:03:07] NAME="CentOS Linux"
[2024-10-03 09:03:07] VERSION="7 (Core)"
[2024-10-03 09:03:07] ID="centos"
[2024-10-03 09:03:07] ID_LIKE="rhel fedora"
[2024-10-03 09:03:07] VERSION_ID="7"
[2024-10-03 09:03:07] PRETTY_NAME="CentOS Linux 7 (Core)"
[2024-10-03 09:03:07] ANSI_COLOR="0;31"
[2024-10-03 09:03:07] CPE_NAME="cpe:/o:centos:centos:7"
[2024-10-03 09:03:07] HOME_URL="https://www.centos.org/"
[2024-10-03 09:03:07] BUG_REPORT_URL="https://bugs.centos.org/"
[2024-10-03 09:03:07] 
[2024-10-03 09:03:07] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2024-10-03 09:03:07] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2024-10-03 09:03:07] REDHAT_SUPPORT_PRODUCT="centos"
[2024-10-03 09:03:07] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2024-10-03 09:03:07] 
[2024-10-03 09:03:07] 2024-10-03 04:08:15,224 | INFO     | *************************************
[2024-10-03 09:03:07] 2024-10-03 04:08:15,728 | INFO     | executing command: df -mP /var/lib/boinc/slots/0
[2024-10-03 09:03:07] 2024-10-03 04:08:15,918 | INFO     | sufficient remaining disk space (485959401472 B)
[2024-10-03 09:03:07] 2024-10-03 04:08:15,918 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2024-10-03 09:03:07] 2024-10-03 04:08:15,919 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2024-10-03 09:03:07] 2024-10-03 04:08:15,919 | WARNING  | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2024-10-03 09:03:07] 2024-10-03 04:08:15,919 | INFO     | found 0 job(s) in 20 queues
[2024-10-03 09:03:07] 2024-10-03 04:08:15,919 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2024-10-03 09:03:07] 2024-10-03 04:08:15,919 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2024-10-03 09:03:07] 2024-10-03 04:08:15,926 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2024-10-03 09:03:07] 2024-10-03 04:08:16,188 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2024-10-03 09:03:07] 2024-10-03 04:08:16,205 | WARNING  | job monitor detected an abort_job request (signal=args.signal)
[2024-10-03 09:03:07] 2024-10-03 04:08:16,206 | WARNING  | cannot recover job monitoring - aborting pilot
[2024-10-03 09:03:07] 2024-10-03 04:08:16,206 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2024-10-03 09:03:07] 2024-10-03 04:08:16,206 | INFO     | will abort loop
[2024-10-03 09:03:07] 2024-10-03 04:08:16,404 | INFO     | all data control threads have been joined
[2024-10-03 09:03:07] 2024-10-03 04:08:16,924 | INFO     | [job] retrieve thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:17,002 | INFO     | [job] create_data_payload thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:17,053 | INFO     | [payload] validate_pre thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:17,107 | INFO     | all payload control threads have been joined
[2024-10-03 09:03:07] 2024-10-03 04:08:17,144 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2024-10-03 09:03:07] 2024-10-03 04:08:17,199 | INFO     | [payload] execute_payloads thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:17,212 | INFO     | [job] job monitor thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:17,410 | INFO     | [data] control thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:17,419 | INFO     | all job control threads have been joined
[2024-10-03 09:03:07] 2024-10-03 04:08:17,495 | INFO     | [payload] run_realtimelog thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:17,566 | INFO     | [job] validate thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:17,618 | INFO     | [payload] failed_post thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:17,787 | INFO     | [payload] validate_post thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:18,113 | INFO     | [payload] control thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:18,150 | INFO     | [job] queue monitor thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:18,195 | INFO     | [data] copytool_out thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:18,287 | INFO     | [data] copytool_in thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:18,425 | INFO     | [job] control thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:19,935 | INFO     | [data] queue_monitor thread has finished
[2024-10-03 09:03:07] 2024-10-03 04:08:20,489 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140467407390528)>', '<ExcThread(monitor, started 140466695694080)>']
[2024-10-03 09:03:07] 2024-10-03 04:08:20,947 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2024-10-03 09:03:07] 2024-10-03 04:08:20,947 | INFO     | [monitor] control thread has ended
[2024-10-03 09:03:07] 2024-10-03 04:08:25,515 | INFO     | all workflow threads have been joined
[2024-10-03 09:03:07] 2024-10-03 04:08:25,516 | INFO     | end of generic workflow (traces error code: 0)
[2024-10-03 09:03:07] 2024-10-03 04:08:25,516 | INFO     | traces error code: 0
[2024-10-03 09:03:07] 2024-10-03 04:08:25,516 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2024-10-03 09:03:07] 2024-10-03 04:08:25,832 [wrapper] ==== pilot stdout END ====
[2024-10-03 09:03:07] 2024-10-03 04:08:25,839 [wrapper] ==== wrapper stdout RESUME ====
[2024-10-03 09:03:07] 2024-10-03 04:08:25,915 [wrapper] pilotpid: 29987
[2024-10-03 09:03:07] 2024-10-03 04:08:26,017 [wrapper] Pilot exit status: 0
[2024-10-03 09:03:07] 2024-10-03 04:08:26,496 [wrapper] pandaids: 6353941558
[2024-10-03 09:03:07] 2024-10-03 04:08:27,356 [wrapper] cleanup supervisor_pilot 25978 29988
[2024-10-03 09:03:07] 2024-10-03 04:08:27,512 [wrapper] Test setup, not cleaning
[2024-10-03 09:03:07] 2024-10-03 04:08:27,605 [wrapper] ==== wrapper stdout END ====
[2024-10-03 09:03:07] 2024-10-03 04:08:27,699 [wrapper] ==== wrapper stderr END ====
[2024-10-03 09:03:07] 2024-10-03 04:08:27,900 [wrapper] apfmon messages muted
[2024-10-03 09:03:07]  *** Error codes and diagnostics ***
[2024-10-03 09:03:07]     "exeErrorCode": 0,
[2024-10-03 09:03:07]     "exeErrorDiag": "",
[2024-10-03 09:03:07]     "pilotErrorCode": 0,
[2024-10-03 09:03:07]     "pilotErrorDiag": "",
[2024-10-03 09:03:07]  *** Listing of results directory ***
[2024-10-03 09:03:07] total 814424
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc    484599 Oct  2 08:02 pilot3.tar.gz
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc      5653 Oct  2 08:05 queuedata.json
[2024-10-03 09:03:07] -rwx------. 1 boinc boinc     33814 Oct  2 08:05 runpilot2-wrapper.sh
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc       100 Oct  2 22:44 wrapper_26015_x86_64-pc-linux-gnu
[2024-10-03 09:03:07] -rwxr-xr-x. 1 boinc boinc      7986 Oct  2 22:44 run_atlas
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc       105 Oct  2 22:44 job.xml
[2024-10-03 09:03:07] -rw-r--r--. 2 boinc boinc 593123583 Oct  2 22:44 EVNT.41481121._000013.pool.root.1
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc      6346 Oct  2 22:44 init_data.xml
[2024-10-03 09:03:07] -rw-r--r--. 2 boinc boinc    498161 Oct  2 22:44 input.tar.gz
[2024-10-03 09:03:07] drwxrwx--x. 2 boinc boinc        68 Oct  2 22:44 shared
[2024-10-03 09:03:07] -rw-r--r--. 2 boinc boinc     17537 Oct  2 22:44 start_atlas.sh
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc         0 Oct  2 22:44 boinc_lockfile
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc      2536 Oct  2 22:53 pandaJob.out
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc       424 Oct  2 22:53 setup.sh.local
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc   1022889 Oct  2 22:56 agis_schedconf.cvmfs.json
[2024-10-03 09:03:07] drwx------. 4 boinc boinc      4096 Oct  2 22:56 pilot3
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc 231116663 Oct  3 06:05 HITS.41481123._000467.pool.root.1
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc       532 Oct  3 06:05 boinc_task_state.xml
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc      1016 Oct  3 06:06 memory_monitor_summary.json
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc   1615815 Oct  3 06:06 agis_ddmendpoints.agis.ALL.json
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc    494650 Oct  3 06:06 log.41481123._000467.job.log.tgz.1
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc        95 Oct  3 06:07 pilot_heartbeat.json
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc      7679 Oct  3 06:08 heartbeat.json
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc      4583 Oct  3 06:08 pilotlog.txt
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc   2443248 Oct  3 06:08 log.41481123._000467.job.log.1
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc       357 Oct  3 06:08 output.list
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc       620 Oct  3 06:08 runtime_log
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc   2959360 Oct  3 06:08 result.tar.gz
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc     10999 Oct  3 06:08 runtime_log.err
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc       646 Oct  3 06:08 GT3NDm9e7F6nsSi4ap6QjLDmwznN0nGgGQJmDC4LDm8LnKDmqU3NCo.diag
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc        28 Oct  3 09:03 wrapper_checkpoint.txt
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc      8192 Oct  3 09:03 boinc_mmap_file
[2024-10-03 09:03:07] -rw-r--r--. 1 boinc boinc     21496 Oct  3 09:03 stderr.txt
[2024-10-03 09:03:07] HITS file was successfully produced:
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc 231116663 Oct  3 06:05 shared/HITS.pool.root.1
[2024-10-03 09:03:07]  *** Contents of shared directory: ***
[2024-10-03 09:03:07] total 808324
[2024-10-03 09:03:07] -rw-r--r--. 2 boinc boinc 593123583 Oct  2 22:44 ATLAS.root_0
[2024-10-03 09:03:07] -rw-r--r--. 2 boinc boinc    498161 Oct  2 22:44 input.tar.gz
[2024-10-03 09:03:07] -rw-r--r--. 2 boinc boinc     17537 Oct  2 22:44 start_atlas.sh
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc 231116663 Oct  3 06:05 HITS.pool.root.1
[2024-10-03 09:03:07] -rw-------. 1 boinc boinc   2959360 Oct  3 06:08 result.tar.gz
09:03:09 (16937): run_atlas exited; CPU time 92873.953907
09:03:09 (16937): called boinc_finish(0)

</stderr_txt>
]]>

©2024 CERN