Name aTiMDmHl7e5n7Olcko1bjSoqABFKDmABFKDmOtvXDmTYrKDmrX30Wn_0
Workunit 223698165
Created 22 Jun 2024, 4:43:18 UTC
Sent 22 Jun 2024, 10:46:45 UTC
Report deadline 30 Jun 2024, 10:46:45 UTC
Received 23 Jun 2024, 3:34:57 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10635186
Run time 1 hours 58 min 58 sec
CPU time 19 hours 54 min 35 sec
Validate state Valid
Credit 1,620.04
Device peak FLOPS 44.58 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.97 GB
Peak swap size 3.38 GB
Peak disk usage 1.50 GB

Stderr output

<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
20:34:09 (547043): wrapper (7.7.26015): starting
20:34:09 (547043): wrapper: running run_atlas (--nthreads 12)
[2024-06-22 20:34:09] Arguments: --nthreads 12
[2024-06-22 20:34:09] Threads: 12
[2024-06-22 20:34:09] Checking for CVMFS
[2024-06-22 20:34:09] Probing /cvmfs/atlas.cern.ch... OK
[2024-06-22 20:34:09] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-06-22 20:34:09] Running cvmfs_config stat atlas.cern.ch
[2024-06-22 20:34:10] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-06-22 20:34:10] 2.11.2.0 2508 2121 77136 134184 1 55 3291834 4096000 0 65024 0 1895551 99.991 303990 1951 http://cvmfs-stratum-one.cern.ch:8000/cvmfs/atlas.cern.ch DIRECT 1
[2024-06-22 20:34:10] CVMFS is ok
[2024-06-22 20:34:10] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-06-22 20:34:10] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-06-22 20:34:10] Small home clusters do not require a local http proxy but it is suggested if
[2024-06-22 20:34:10] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
[2024-06-22 20:34:10] Further information can be found at the LHC@home message board.
[2024-06-22 20:34:10] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-06-22 20:34:10] Checking for apptainer binary...
[2024-06-22 20:34:10] Using apptainer found in PATH at /usr/bin/apptainer
[2024-06-22 20:34:10] Running /usr/bin/apptainer --version
[2024-06-22 20:34:10] /usr/bin/apptainer: symbol lookup error: /usr/bin/apptainer: undefined symbol: seccomp_notify_respond
[2024-06-22 20:34:10] apptainer seems to be installed but not working
[2024-06-22 20:34:10] Will use version from CVMFS
[2024-06-22 20:34:10] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-06-22 20:34:10] sarnet8.local
[2024-06-22 20:34:10] apptainer works
[2024-06-22 20:34:10] Set ATHENA_PROC_NUMBER=12
[2024-06-22 20:34:10] Set ATHENA_CORE_NUMBER=12
[2024-06-22 20:34:10] Starting ATLAS job with PandaID=6241027552
[2024-06-22 20:34:10] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-06-22 22:33:04]  *** The last 200 lines of the pilot log: ***
[2024-06-22 22:33:04] 2024-06-23 02:32:48,626 | INFO     | sum of square deviations: 435610028.0
[2024-06-22 22:33:04] 2024-06-23 02:32:48,626 | INFO     | sum of deviations: 45198591720.000015
[2024-06-22 22:33:04] 2024-06-23 02:32:48,627 | INFO     | mean x: 1719106264.5
[2024-06-22 22:33:04] 2024-06-23 02:32:48,627 | INFO     | mean y: 2771527.464285714
[2024-06-22 22:33:04] 2024-06-23 02:32:48,627 | INFO     | -- intersect: -178370491662.0366
[2024-06-22 22:33:04] 2024-06-23 02:32:48,627 | INFO     | intersect: -178370491662.0366
[2024-06-22 22:33:04] 2024-06-23 02:32:48,627 | INFO     | chi2: 4.461455777946894
[2024-06-22 22:33:04] 2024-06-23 02:32:48,627 | INFO     | current chi2=4.461455777946894 (change=13.452369885229018 %)
[2024-06-22 22:33:04] 2024-06-23 02:32:48,627 | INFO     | right removable region: 111
[2024-06-22 22:33:04] 2024-06-23 02:32:48,628 | INFO     | model: linear, x: [1719103184.0, 1719103245.0, 1719103306.0, 1719103367.0, 1719103428.0, 1719103489.0, 1719103550.0, 1719103611.0, 1719103672.0, 1719103733.0, 1719
[2024-06-22 22:33:04] 2024-06-23 02:32:48,628 | INFO     | sum of square deviations: 435610028.0
[2024-06-22 22:33:04] 2024-06-23 02:32:48,628 | INFO     | sum of deviations: 7771243535.000002
[2024-06-22 22:33:04] 2024-06-23 02:32:48,628 | INFO     | mean x: 1719106569.5
[2024-06-22 22:33:04] 2024-06-23 02:32:48,628 | INFO     | mean y: 2830129.2321428573
[2024-06-22 22:33:04] 2024-06-23 02:32:48,628 | INFO     | -- intersect: -30665875721.13663
[2024-06-22 22:33:04] 2024-06-23 02:32:48,629 | INFO     | intersect: -30665875721.13663
[2024-06-22 22:33:04] 2024-06-23 02:32:48,629 | INFO     | chi2: 2.7440863886133138
[2024-06-22 22:33:04] 2024-06-23 02:32:48,629 | INFO     | current chi2=2.7440863886133138 (change=46.76756072790783 %)
[2024-06-22 22:33:04] 2024-06-23 02:32:48,629 | INFO     | model: linear, x: [1719103489.0, 1719103550.0, 1719103611.0, 1719103672.0, 1719103733.0, 1719103794.0, 1719103855.0, 1719103916.0, 1719103977.0, 1719104038.0, 1719
[2024-06-22 22:33:04] 2024-06-23 02:32:48,629 | INFO     | sum of square deviations: 379832238.0
[2024-06-22 22:33:04] 2024-06-23 02:32:48,629 | INFO     | sum of deviations: -15819102550.000008
[2024-06-22 22:33:04] 2024-06-23 02:32:48,629 | INFO     | mean x: 1719106722.0
[2024-06-22 22:33:04] 2024-06-23 02:32:48,630 | INFO     | mean y: 2894658.5887850467
[2024-06-22 22:33:04] 2024-06-23 02:32:48,630 | INFO     | -- intersect: 71599570267.02504
[2024-06-22 22:33:04] 2024-06-23 02:32:48,630 | INFO     | intersect: 71599570267.02504
[2024-06-22 22:33:04] 2024-06-23 02:32:48,630 | INFO     | chi2: 1.3449815199925272
[2024-06-22 22:33:04] 2024-06-23 02:32:48,630 | INFO     | current chi2=1.3449815199925272 (change=50.98618157308833 %)
[2024-06-22 22:33:04] 2024-06-23 02:32:48,630 | INFO     | model: linear, x: [1719103794.0, 1719103855.0, 1719103916.0, 1719103977.0, 1719104038.0, 1719104099.0, 1719104160.0, 1719104221.0, 1719104282.0, 1719104343.0, 1719
[2024-06-22 22:33:04] 2024-06-23 02:32:48,630 | INFO     | sum of square deviations: 329031285.5
[2024-06-22 22:33:04] 2024-06-23 02:32:48,630 | INFO     | sum of deviations: -26226672266.999996
[2024-06-22 22:33:04] 2024-06-23 02:32:48,630 | INFO     | mean x: 1719106874.5
[2024-06-22 22:33:04] 2024-06-23 02:32:48,631 | INFO     | mean y: 2925420.31372549
[2024-06-22 22:33:04] 2024-06-23 02:32:48,631 | INFO     | -- intersect: 137030784400.18024
[2024-06-22 22:33:04] 2024-06-23 02:32:48,631 | INFO     | intersect: 137030784400.18024
[2024-06-22 22:33:04] 2024-06-23 02:32:48,631 | INFO     | chi2: 0.8913308187050457
[2024-06-22 22:33:04] 2024-06-23 02:32:48,631 | INFO     | current chi2=0.8913308187050457 (change=33.729140106698416 %)
[2024-06-22 22:33:04] 2024-06-23 02:32:48,631 | INFO     | model: linear, x: [1719104099.0, 1719104160.0, 1719104221.0, 1719104282.0, 1719104343.0, 1719104404.0, 1719104465.0, 1719104526.0, 1719104587.0, 1719104648.0, 1719
[2024-06-22 22:33:04] 2024-06-23 02:32:48,631 | INFO     | sum of square deviations: 282974608.0
[2024-06-22 22:33:04] 2024-06-23 02:32:48,631 | INFO     | sum of deviations: -24518368425.999996
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | mean x: 1719107027.0
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | mean y: 2919513.412371134
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | -- intersect: 148955151480.8528
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | intersect: 148955151480.8528
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | chi2: 0.8657612954049295
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | current chi2=0.8657612954049295 (change=2.868690587549124 %)
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | left removable region: 40
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | model: linear, x: [1719105319.0, 1719105380.0, 1719105441.0, 1719105502.0, 1719105563.0, 1719105624.0, 1719105685.0, 1719105746.0, 1719105807.0, 1719105868.0, 1719
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | sum of square deviations: 110960220.0
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | sum of deviations: 6049797.00000025
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | mean x: 1719107454.0
[2024-06-22 22:33:04] 2024-06-23 02:32:48,632 | INFO     | mean y: 2868733.3098591547
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | -- intersect: -90860813.35008138
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | intersect: -90860813.35008138
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | chi2: 0.020371712135522774
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | -- intersect: -90860813.35008138
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | current memory leak: 0.05 B/s (using 71 data points, chi2=0.02)
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | ..............................
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | . Timing measurements:
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | . get job = 0 s
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | . initial setup = 1 s
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | . payload setup = 3 s
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | . stage-in = 0 s
[2024-06-22 22:33:04] 2024-06-23 02:32:48,633 | INFO     | . payload execution = 7082 s
[2024-06-22 22:33:04] 2024-06-23 02:32:48,634 | INFO     | . stage-out = 0 s
[2024-06-22 22:33:04] 2024-06-23 02:32:48,634 | INFO     | . log creation = 0 s
[2024-06-22 22:33:04] 2024-06-23 02:32:48,634 | INFO     | ..............................
[2024-06-22 22:33:04] 2024-06-23 02:32:48,676 | WARNING  | process 557709 is no longer using CPU - aborting
[2024-06-22 22:33:04] 2024-06-23 02:32:48,681 | INFO     | aborting job monitoring since job object (job id=6241027552) has expired
[2024-06-22 22:33:04] 2024-06-23 02:32:49,130 | INFO     | 
[2024-06-22 22:33:04] 2024-06-23 02:32:49,130 | INFO     | job summary report
[2024-06-22 22:33:04] 2024-06-23 02:32:49,130 | INFO     | --------------------------------------------------
[2024-06-22 22:33:04] 2024-06-23 02:32:49,130 | INFO     | PanDA job id: 6241027552
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | task id: 38920987
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | errors: (none)
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | status: LOG_TRANSFER = DONE 
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | pilot state: finished 
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | transexitcode: 0
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | exeerrorcode: 0
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | exeerrordiag: 
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | exitcode: 0
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | exitmsg: OK
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | cpuconsumptiontime: 71703 s
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | nevents: 400
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | neventsw: 0
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | pid: 557709
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | pgrp: 557709
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | corecount: 12
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | event service: False
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | sizes: {0: 2387076, 1: 2387104, 3: 2387310, 11: 2387338, 7088: 2414463, 7089: 2423423, 7090: 2423607, 7096: 2423777}
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | --------------------------------------------------
[2024-06-22 22:33:04] 2024-06-23 02:32:49,131 | INFO     | 
[2024-06-22 22:33:04] 2024-06-23 02:32:49,132 | INFO     | executing command: ls -lF /var/lib/boinc/slots/0
[2024-06-22 22:33:04] 2024-06-23 02:32:49,150 | INFO     | queue jobs had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,150 | INFO     | queue payloads had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,150 | INFO     | queue data_in had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,150 | INFO     | queue data_out had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,150 | INFO     | queue current_data_in had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue completed_jobids has 1 job(s)
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | queue messages had 0 job(s) [purged]
[2024-06-22 22:33:04] 2024-06-23 02:32:49,151 | INFO     | job 6241027552 has completed (purged errors)
[2024-06-22 22:33:04] 2024-06-23 02:32:49,152 | INFO     | overall cleanup function is called
[2024-06-22 22:33:04] 2024-06-23 02:32:50,158 | INFO     | --- collectZombieJob: --- 10, [557709]
[2024-06-22 22:33:04] 2024-06-23 02:32:50,159 | INFO     | zombie collector waiting for pid 557709
[2024-06-22 22:33:04] 2024-06-23 02:32:50,159 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2024-06-22 22:33:04] 2024-06-23 02:32:50,799 | INFO     | 7114s have passed since pilot start
[2024-06-22 22:33:04] 2024-06-23 02:32:51,164 | INFO     | collected zombie processes
[2024-06-22 22:33:04] 2024-06-23 02:32:51,164 | INFO     | will now attempt to kill all subprocesses of pid=557709
[2024-06-22 22:33:04] 2024-06-23 02:32:51,211 | INFO     | process IDs to be killed: [557709] (in reverse order)
[2024-06-22 22:33:04] 2024-06-23 02:32:51,245 | WARNING  | found no corresponding commands to process id(s)
[2024-06-22 22:33:04] 2024-06-23 02:32:51,245 | INFO     | Do not look for orphan processes in BOINC jobs
[2024-06-22 22:33:04] 2024-06-23 02:32:51,247 | INFO     | did not find any defunct processes belonging to 557709
[2024-06-22 22:33:04] 2024-06-23 02:32:51,248 | INFO     | did not find any defunct processes belonging to 557709
[2024-06-22 22:33:04] 2024-06-23 02:32:51,249 | INFO     | ready for new job
[2024-06-22 22:33:04] 2024-06-23 02:32:51,249 | INFO     | pilot has finished with previous job - re-establishing logging
[2024-06-22 22:33:04] 2024-06-23 02:32:51,250 | INFO     | *************************************
[2024-06-22 22:33:04] 2024-06-23 02:32:51,250 | INFO     | ***  PanDA Pilot version 3.7.7.3  ***
[2024-06-22 22:33:04] 2024-06-23 02:32:51,250 | INFO     | *************************************
[2024-06-22 22:33:04] 2024-06-23 02:32:51,250 | INFO     | 
[2024-06-22 22:33:04] 2024-06-23 02:32:51,250 | INFO     | pilot is running in a VM
[2024-06-22 22:33:04] 2024-06-23 02:32:51,250 | INFO     | architecture information:
[2024-06-22 22:33:04] 2024-06-23 02:32:51,250 | INFO     | executing command: cat /etc/os-release
[2024-06-22 22:33:04] 2024-06-23 02:32:51,264 | INFO     | cat /etc/os-release:
[2024-06-22 22:33:04] NAME="CentOS Linux"
[2024-06-22 22:33:04] VERSION="7 (Core)"
[2024-06-22 22:33:04] ID="centos"
[2024-06-22 22:33:04] ID_LIKE="rhel fedora"
[2024-06-22 22:33:04] VERSION_ID="7"
[2024-06-22 22:33:04] PRETTY_NAME="CentOS Linux 7 (Core)"
[2024-06-22 22:33:04] ANSI_COLOR="0;31"
[2024-06-22 22:33:04] CPE_NAME="cpe:/o:centos:centos:7"
[2024-06-22 22:33:04] HOME_URL="https://www.centos.org/"
[2024-06-22 22:33:04] BUG_REPORT_URL="https://bugs.centos.org/"
[2024-06-22 22:33:04] 
[2024-06-22 22:33:04] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2024-06-22 22:33:04] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2024-06-22 22:33:04] REDHAT_SUPPORT_PRODUCT="centos"
[2024-06-22 22:33:04] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2024-06-22 22:33:04] 
[2024-06-22 22:33:04] 2024-06-23 02:32:51,265 | INFO     | *************************************
[2024-06-22 22:33:04] 2024-06-23 02:32:51,765 | INFO     | executing command: df -mP /var/lib/boinc/slots/0
[2024-06-22 22:33:04] 2024-06-23 02:32:51,783 | INFO     | sufficient remaining disk space (29085401088 B)
[2024-06-22 22:33:04] 2024-06-23 02:32:51,783 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2024-06-22 22:33:04] 2024-06-23 02:32:51,783 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2024-06-22 22:33:04] 2024-06-23 02:32:51,805 | INFO     | found 0 job(s) in 20 queues
[2024-06-22 22:33:04] 2024-06-23 02:32:51,805 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2024-06-22 22:33:04] 2024-06-23 02:32:51,805 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2024-06-22 22:33:04] 2024-06-23 02:32:51,877 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2024-06-22 22:33:04] 2024-06-23 02:32:52,099 | INFO     | all payload control threads have been joined
[2024-06-22 22:33:04] 2024-06-23 02:32:52,122 | INFO     | all data control threads have been joined
[2024-06-22 22:33:04] 2024-06-23 02:32:52,189 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2024-06-22 22:33:04] 2024-06-23 02:32:52,189 | INFO     | aborting loop
[2024-06-22 22:33:04] 2024-06-23 02:32:52,464 | INFO     | all job control threads have been joined
[2024-06-22 22:33:04] 2024-06-23 02:32:52,788 | INFO     | [job] retrieve thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:52,965 | INFO     | [payload] validate_post thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:53,102 | INFO     | [payload] control thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:53,127 | INFO     | [data] control thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:53,191 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2024-06-22 22:33:04] 2024-06-23 02:32:53,194 | INFO     | [job] job monitor thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:53,204 | INFO     | [payload] failed_post thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:53,251 | INFO     | [data] copytool_in thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:53,469 | INFO     | [job] control thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:53,590 | INFO     | [job] validate thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:53,704 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2024-06-22 22:33:04] 2024-06-23 02:32:53,711 | INFO     | [payload] execute_payloads thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:53,883 | INFO     | [data] copytool_out thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:53,962 | INFO     | [payload] validate_pre thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:54,070 | INFO     | [payload] run_realtimelog thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:54,136 | INFO     | [job] create_data_payload thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:54,709 | INFO     | [job] queue monitor thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:57,197 | INFO     | [data] queue_monitor thread has finished
[2024-06-22 22:33:04] 2024-06-23 02:32:59,253 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139850294544192)>', '<ExcThread(monitor, started 139849612904192)>']
[2024-06-22 22:33:04] 2024-06-23 02:32:59,843 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2024-06-22 22:33:04] 2024-06-23 02:32:59,844 | INFO     | [monitor] control thread has ended
[2024-06-22 22:33:04] 2024-06-23 02:33:04,279 | INFO     | all workflow threads have been joined
[2024-06-22 22:33:04] 2024-06-23 02:33:04,280 | INFO     | end of generic workflow (traces error code: 0)
[2024-06-22 22:33:04] 2024-06-23 02:33:04,281 | INFO     | traces error code: 0
[2024-06-22 22:33:04] 2024-06-23 02:33:04,281 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2024-06-22 22:33:04] 2024-06-23 02:33:04,343 [wrapper] ==== pilot stdout END ====
[2024-06-22 22:33:04] 2024-06-23 02:33:04,345 [wrapper] ==== wrapper stdout RESUME ====
[2024-06-22 22:33:04] 2024-06-23 02:33:04,347 [wrapper] pilotpid: 551246
[2024-06-22 22:33:04] 2024-06-23 02:33:04,348 [wrapper] Pilot exit status: 0
[2024-06-22 22:33:04] 2024-06-23 02:33:04,355 [wrapper] pandaids: 6241027552
[2024-06-22 22:33:04] 2024-06-23 02:33:04,373 [wrapper] cleanup supervisor_pilot  577458 551247
[2024-06-22 22:33:04] 2024-06-23 02:33:04,375 [wrapper] Test setup, not cleaning
[2024-06-22 22:33:04] 2024-06-23 02:33:04,377 [wrapper] ==== wrapper stdout END ====
[2024-06-22 22:33:04] 2024-06-23 02:33:04,379 [wrapper] ==== wrapper stderr END ====
[2024-06-22 22:33:04] 2024-06-23 02:33:04,383 [wrapper] apfmon messages muted
[2024-06-22 22:33:04]  *** Error codes and diagnostics ***
[2024-06-22 22:33:04]     "exeErrorCode": 0,
[2024-06-22 22:33:04]     "exeErrorDiag": "",
[2024-06-22 22:33:04]     "pilotErrorCode": 0,
[2024-06-22 22:33:04]     "pilotErrorDiag": "",
[2024-06-22 22:33:04]  *** Listing of results directory ***
[2024-06-22 22:33:04] total 952948
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc    469766 Jun 22 00:36 pilot3.tar.gz
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc      5654 Jun 22 00:40 queuedata.json
[2024-06-22 22:33:04] -rwx------. 1 boinc boinc     32308 Jun 22 00:42 runpilot2-wrapper.sh
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc       100 Jun 22 20:34 wrapper_26015_x86_64-pc-linux-gnu
[2024-06-22 22:33:04] -rwxr-xr-x. 1 boinc boinc      7986 Jun 22 20:34 run_atlas
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc       105 Jun 22 20:34 job.xml
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc      6167 Jun 22 20:34 init_data.xml
[2024-06-22 22:33:04] -rw-r--r--. 2 boinc boinc 638724090 Jun 22 20:34 EVNT.38776170._000709.pool.root.1
[2024-06-22 22:33:04] -rw-r--r--. 2 boinc boinc     17537 Jun 22 20:34 start_atlas.sh
[2024-06-22 22:33:04] drwxrwx--x. 2 boinc boinc        68 Jun 22 20:34 shared
[2024-06-22 22:33:04] -rw-r--r--. 2 boinc boinc    482528 Jun 22 20:34 input.tar.gz
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc         0 Jun 22 20:34 boinc_lockfile
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc      2620 Jun 22 20:34 pandaJob.out
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc       424 Jun 22 20:34 setup.sh.local
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc   1026074 Jun 22 20:34 agis_schedconf.cvmfs.json
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc         0 Jun 22 20:34 agis_ddmendpoints.agis.ALL.json
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc   1321363 Jun 22 20:34 cric_ddmendpoints.json
[2024-06-22 22:33:04] drwx------. 4 boinc boinc      4096 Jun 22 20:34 pilot3
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc 331563305 Jun 22 22:32 HITS.38920987._060134.pool.root.1
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc       530 Jun 22 22:32 boinc_task_state.xml
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc      1051 Jun 22 22:32 memory_monitor_summary.json
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc    373289 Jun 22 22:32 log.38920987._060134.job.log.tgz.1
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc        95 Jun 22 22:32 pilot_heartbeat.json
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc      7735 Jun 22 22:32 heartbeat.json
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc      8192 Jun 22 22:32 boinc_mmap_file
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc        27 Jun 22 22:32 wrapper_checkpoint.txt
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc      4273 Jun 22 22:33 pilotlog.txt
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc    627640 Jun 22 22:33 log.38920987._060134.job.log.1
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc       357 Jun 22 22:33 output.list
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc       620 Jun 22 22:33 runtime_log
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc   1024000 Jun 22 22:33 result.tar.gz
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc     10988 Jun 22 22:33 runtime_log.err
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc       645 Jun 22 22:33 aTiMDmHl7e5n7Olcko1bjSoqABFKDmABFKDmOtvXDmTYrKDmrX30Wn.diag
[2024-06-22 22:33:04] -rw-r--r--. 1 boinc boinc     21918 Jun 22 22:33 stderr.txt
[2024-06-22 22:33:04] HITS file was successfully produced:
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc 331563305 Jun 22 22:32 shared/HITS.pool.root.1
[2024-06-22 22:33:04]  *** Contents of shared directory: ***
[2024-06-22 22:33:04] total 949044
[2024-06-22 22:33:04] -rw-r--r--. 2 boinc boinc 638724090 Jun 22 20:34 ATLAS.root_0
[2024-06-22 22:33:04] -rw-r--r--. 2 boinc boinc     17537 Jun 22 20:34 start_atlas.sh
[2024-06-22 22:33:04] -rw-r--r--. 2 boinc boinc    482528 Jun 22 20:34 input.tar.gz
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc 331563305 Jun 22 22:32 HITS.pool.root.1
[2024-06-22 22:33:04] -rw-------. 1 boinc boinc   1024000 Jun 22 22:33 result.tar.gz
22:33:06 (547043): run_atlas exited; CPU time 71675.057627
22:33:06 (547043): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN