Name 0vmNDm7n1d5n7Olcko1bjSoqABFKDmABFKDmOtvXDmrUqKDmMclRQn_0
Workunit 223654317
Created 19 Jun 2024, 4:10:56 UTC
Sent 19 Jun 2024, 10:30:13 UTC
Report deadline 27 Jun 2024, 10:30:13 UTC
Received 20 Jun 2024, 14:38:12 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10628444
Run time 1 days 3 hours 56 min 1 sec
CPU time 1 days 14 hours 52 min 29 sec
Validate state Valid
Credit 7,835.00
Device peak FLOPS 39.54 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.52 GB
Peak swap size 25.20 GB
Peak disk usage 1.38 GB

Stderr output

<core_client_version>7.7.0</core_client_version>
<![CDATA[
<stderr_txt>
06:30:54 (43358): wrapper (7.7.26015): starting
06:30:54 (43358): wrapper: running run_atlas (--nthreads 8)
[2024-06-19 06:30:55] Arguments: --nthreads 8
[2024-06-19 06:30:55] Threads: 8
[2024-06-19 06:30:55] Checking for CVMFS
[2024-06-19 06:30:55] Probing /cvmfs/atlas.cern.ch... OK
[2024-06-19 06:30:56] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-06-19 06:30:56] Running cvmfs_config stat atlas.cern.ch
[2024-06-19 06:30:57] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-06-19 06:30:57] 2.11.2.0 2197843 9415 79012 134050 1 125 11482175 18432000 4527 130560 0 30131978 99.982 2228613 30162 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.237:6081 1
[2024-06-19 06:30:57] CVMFS is ok
[2024-06-19 06:30:57] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-06-19 06:30:57] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-06-19 06:30:57] Further information can be found at the LHC@home message board.
[2024-06-19 06:30:57] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-06-19 06:30:57] Checking for apptainer binary...
[2024-06-19 06:30:57] Using apptainer found in PATH at /usr/bin/apptainer
[2024-06-19 06:30:57] Running /usr/bin/apptainer --version
[2024-06-19 06:30:57] apptainer version 1.2.4-1.el7
[2024-06-19 06:30:57] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-06-19 06:30:58] gc-9-36.aglt2.org
[2024-06-19 06:30:58] apptainer works
[2024-06-19 06:30:58] Set ATHENA_PROC_NUMBER=8
[2024-06-19 06:30:58] Set ATHENA_CORE_NUMBER=8
[2024-06-19 06:30:58] Starting ATLAS job with PandaID=6237371386
[2024-06-19 06:30:58] Running command: /usr/bin/apptainer exec -B /cvmfs,/data/boinchome/slots/3 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-06-20 10:26:53]  *** The last 200 lines of the pilot log: ***
[2024-06-20 10:26:53] 2024-06-20 14:26:34,379 | INFO     | fitting pss+swap vs Time
[2024-06-20 10:26:53] 2024-06-20 14:26:34,381 | INFO     | model: linear, x: [1718793300.0, 1718793361.0, 1718793422.0, 1718793483.0, 1718793544.0, 1718793605.0, 1718793666.0, 1718793728.0, 1718793788.0, 1718793849.0, 1718
[2024-06-20 10:26:53] 2024-06-20 14:26:34,381 | INFO     | sum of square deviations: 1377792287688.4075
[2024-06-20 10:26:53] 2024-06-20 14:26:34,448 | INFO     | sum of deviations: 1239136050806.5112
[2024-06-20 10:26:53] 2024-06-20 14:26:34,449 | INFO     | monitor loop #6562: job 0:6237371386 is in state 'finished'
[2024-06-20 10:26:53] 2024-06-20 14:26:34,450 | INFO     | mean x: 1718843412.388078
[2024-06-20 10:26:53] 2024-06-20 14:26:34,450 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2024-06-20 10:26:53] 2024-06-20 14:26:34,451 | INFO     | mean y: 2529779.0054744524
[2024-06-20 10:26:53] 2024-06-20 14:26:34,451 | INFO     | -- intersect: -1543335194.2661936
[2024-06-20 10:26:53] 2024-06-20 14:26:34,451 | INFO     | intersect: -1543335194.2661936
[2024-06-20 10:26:53] 2024-06-20 14:26:34,453 | INFO     | chi2: 6.476885854913664
[2024-06-20 10:26:53] 2024-06-20 14:26:34,454 | INFO     | model: linear, x: [1718793300.0, 1718793361.0, 1718793422.0, 1718793483.0, 1718793544.0, 1718793605.0, 1718793666.0, 1718793728.0, 1718793788.0, 1718793849.0, 1718
[2024-06-20 10:26:53] 2024-06-20 14:26:34,454 | INFO     | sum of square deviations: 1365259828229.4495
[2024-06-20 10:26:53] 2024-06-20 14:26:34,520 | INFO     | sum of deviations: 1458390727075.2534
[2024-06-20 10:26:53] 2024-06-20 14:26:34,520 | INFO     | mean x: 1718843259.8907871
[2024-06-20 10:26:53] 2024-06-20 14:26:34,520 | INFO     | mean y: 2532441.9176327027
[2024-06-20 10:26:53] 2024-06-20 14:26:34,520 | INFO     | -- intersect: -1833561332.8266373
[2024-06-20 10:26:53] 2024-06-20 14:26:34,520 | INFO     | intersect: -1833561332.8266373
[2024-06-20 10:26:53] 2024-06-20 14:26:34,522 | INFO     | chi2: 4.929565295651448
[2024-06-20 10:26:53] 2024-06-20 14:26:34,522 | INFO     | current chi2=4.929565295651448 (change=23.889884643996723 %)
[2024-06-20 10:26:53] 2024-06-20 14:26:34,522 | INFO     | right removable region: 1638
[2024-06-20 10:26:53] 2024-06-20 14:26:34,531 | INFO     | model: linear, x: [1718793605.0, 1718793666.0, 1718793728.0, 1718793788.0, 1718793849.0, 1718793910.0, 1718793971.0, 1718794032.0, 1718794093.0, 1718794154.0, 1718
[2024-06-20 10:26:53] 2024-06-20 14:26:34,532 | INFO     | sum of square deviations: 1365258937629.452
[2024-06-20 10:26:53] 2024-06-20 14:26:34,668 | INFO     | sum of deviations: 729744812044.8438
[2024-06-20 10:26:53] 2024-06-20 14:26:34,668 | INFO     | mean x: 1718843564.8907871
[2024-06-20 10:26:53] 2024-06-20 14:26:34,669 | INFO     | mean y: 2535975.3007931667
[2024-06-20 10:26:53] 2024-06-20 14:26:34,669 | INFO     | -- intersect: -916203422.4969847
[2024-06-20 10:26:53] 2024-06-20 14:26:34,669 | INFO     | intersect: -916203422.4969847
[2024-06-20 10:26:53] 2024-06-20 14:26:34,670 | INFO     | chi2: 3.123975589567354
[2024-06-20 10:26:53] 2024-06-20 14:26:34,670 | INFO     | current chi2=3.123975589567354 (change=51.767320599028885 %)
[2024-06-20 10:26:53] 2024-06-20 14:26:34,680 | INFO     | model: linear, x: [1718793910.0, 1718793971.0, 1718794032.0, 1718794093.0, 1718794154.0, 1718794215.0, 1718794276.0, 1718794337.0, 1718794398.0, 1718794459.0, 1718
[2024-06-20 10:26:53] 2024-06-20 14:26:34,680 | INFO     | sum of square deviations: 1352801921537.7585
[2024-06-20 10:26:53] 2024-06-20 14:26:34,813 | INFO     | sum of deviations: 410621057285.15735
[2024-06-20 10:26:53] 2024-06-20 14:26:34,813 | INFO     | mean x: 1718843717.392901
[2024-06-20 10:26:53] 2024-06-20 14:26:34,813 | INFO     | mean y: 2539880.806609547
[2024-06-20 10:26:53] 2024-06-20 14:26:34,813 | INFO     | -- intersect: -519187220.04015213
[2024-06-20 10:26:53] 2024-06-20 14:26:34,813 | INFO     | intersect: -519187220.04015213
[2024-06-20 10:26:53] 2024-06-20 14:26:34,823 | INFO     | chi2: 1.80255989162066
[2024-06-20 10:26:53] 2024-06-20 14:26:34,823 | INFO     | current chi2=1.80255989162066 (change=42.29916848132926 %)
[2024-06-20 10:26:53] 2024-06-20 14:26:34,825 | INFO     | model: linear, x: [1718794215.0, 1718794276.0, 1718794337.0, 1718794398.0, 1718794459.0, 1718794521.0, 1718794581.0, 1718794642.0, 1718794703.0, 1718794764.0, 1718
[2024-06-20 10:26:53] 2024-06-20 14:26:34,825 | INFO     | sum of square deviations: 1340420807196.2585
[2024-06-20 10:26:53] 2024-06-20 14:26:34,954 | INFO     | sum of deviations: 306557035322.1792
[2024-06-20 10:26:53] 2024-06-20 14:26:34,954 | INFO     | mean x: 1718843869.8956416
[2024-06-20 10:26:53] 2024-06-20 14:26:34,955 | INFO     | mean y: 2541161.7716390425
[2024-06-20 10:26:53] 2024-06-20 14:26:34,955 | INFO     | -- intersect: -390562017.54939
[2024-06-20 10:26:53] 2024-06-20 14:26:34,955 | INFO     | intersect: -390562017.54939
[2024-06-20 10:26:53] 2024-06-20 14:26:34,963 | INFO     | chi2: 1.6557656330848858
[2024-06-20 10:26:53] 2024-06-20 14:26:34,964 | INFO     | current chi2=1.6557656330848858 (change=8.143654988561476 %)
[2024-06-20 10:26:53] 2024-06-20 14:26:34,964 | INFO     | left removable region: 30
[2024-06-20 10:26:53] 2024-06-20 14:26:34,965 | INFO     | model: linear, x: [1718795130.0, 1718795191.0, 1718795252.0, 1718795313.0, 1718795374.0, 1718795435.0, 1718795496.0, 1718795557.0, 1718795618.0, 1718795679.0, 1718
[2024-06-20 10:26:53] 2024-06-20 14:26:34,965 | INFO     | sum of square deviations: 1289245981288.0085
[2024-06-20 10:26:53] 2024-06-20 14:26:35,094 | INFO     | sum of deviations: 463148188140.1832
[2024-06-20 10:26:53] 2024-06-20 14:26:35,095 | INFO     | mean x: 1718844144.4067163
[2024-06-20 10:26:53] 2024-06-20 14:26:35,095 | INFO     | mean y: 2544654.797885572
[2024-06-20 10:26:53] 2024-06-20 14:26:35,095 | INFO     | -- intersect: -614932198.1313115
[2024-06-20 10:26:53] 2024-06-20 14:26:35,095 | INFO     | intersect: -614932198.1313115
[2024-06-20 10:26:53] 2024-06-20 14:26:35,104 | INFO     | chi2: 0.026596273565752705
[2024-06-20 10:26:53] 2024-06-20 14:26:35,105 | INFO     | -- intersect: -614932198.1313115
[2024-06-20 10:26:53] 2024-06-20 14:26:35,105 | INFO     | current memory leak: 0.36 B/s (using 1608 data points, chi2=0.03)
[2024-06-20 10:26:53] 2024-06-20 14:26:35,106 | INFO     | ..............................
[2024-06-20 10:26:53] 2024-06-20 14:26:35,107 | INFO     | . Timing measurements:
[2024-06-20 10:26:53] 2024-06-20 14:26:35,107 | INFO     | . get job = 0 s
[2024-06-20 10:26:53] 2024-06-20 14:26:35,107 | INFO     | . initial setup = 9 s
[2024-06-20 10:26:53] 2024-06-20 14:26:35,107 | INFO     | . payload setup = 51 s
[2024-06-20 10:26:53] 2024-06-20 14:26:35,107 | INFO     | . stage-in = 0 s
[2024-06-20 10:26:53] 2024-06-20 14:26:35,115 | INFO     | . payload execution = 100285 s
[2024-06-20 10:26:53] 2024-06-20 14:26:35,115 | INFO     | . stage-out = 5 s
[2024-06-20 10:26:53] 2024-06-20 14:26:35,115 | INFO     | . log creation = 2 s
[2024-06-20 10:26:53] 2024-06-20 14:26:35,115 | INFO     | ..............................
[2024-06-20 10:26:53] 2024-06-20 14:26:35,480 | INFO     | 
[2024-06-20 10:26:53] 2024-06-20 14:26:35,480 | INFO     | job summary report
[2024-06-20 10:26:53] 2024-06-20 14:26:35,480 | INFO     | --------------------------------------------------
[2024-06-20 10:26:53] 2024-06-20 14:26:35,480 | INFO     | PanDA job id: 6237371386
[2024-06-20 10:26:53] 2024-06-20 14:26:35,480 | INFO     | task id: 38921013
[2024-06-20 10:26:53] 2024-06-20 14:26:35,480 | INFO     | errors: (none)
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | status: LOG_TRANSFER = DONE 
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | pilot state: finished 
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | transexitcode: 0
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | exeerrorcode: 0
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | exeerrordiag: 
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | exitcode: 0
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | exitmsg: OK
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | cpuconsumptiontime: 140499 s
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | nevents: 400
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | neventsw: 0
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | pid: 63868
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | pgrp: 63868
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | corecount: 8
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | event service: False
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | sizes: {0: 2379692, 1: 2381058, 2: 2381229, 13: 2381257, 23: 2381313, 30: 2381547, 34: 2381703, 100341: 2451706, 100342: 2451705, 100349: 2460779, 100381: 2460893}
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | --------------------------------------------------
[2024-06-20 10:26:53] 2024-06-20 14:26:35,481 | INFO     | 
[2024-06-20 10:26:53] 2024-06-20 14:26:35,482 | INFO     | executing command: ls -lF /data/boinchome/slots/3
[2024-06-20 10:26:53] 2024-06-20 14:26:35,516 | INFO     | queue jobs had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,517 | INFO     | queue payloads had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,517 | INFO     | queue data_in had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,517 | INFO     | queue data_out had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,517 | INFO     | queue current_data_in had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,517 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,517 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,517 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,517 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,517 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,517 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,518 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,518 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,518 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,518 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,518 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,518 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,518 | INFO     | queue completed_jobids has 1 job(s)
[2024-06-20 10:26:53] 2024-06-20 14:26:35,518 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,518 | INFO     | queue messages had 0 job(s) [purged]
[2024-06-20 10:26:53] 2024-06-20 14:26:35,518 | INFO     | job 6237371386 has completed (purged errors)
[2024-06-20 10:26:53] 2024-06-20 14:26:35,518 | INFO     | overall cleanup function is called
[2024-06-20 10:26:53] 2024-06-20 14:26:36,527 | INFO     | --- collectZombieJob: --- 10, [63868]
[2024-06-20 10:26:53] 2024-06-20 14:26:36,527 | INFO     | zombie collector waiting for pid 63868
[2024-06-20 10:26:53] 2024-06-20 14:26:36,527 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2024-06-20 10:26:53] 2024-06-20 14:26:37,533 | INFO     | collected zombie processes
[2024-06-20 10:26:53] 2024-06-20 14:26:37,533 | INFO     | will now attempt to kill all subprocesses of pid=63868
[2024-06-20 10:26:53] 2024-06-20 14:26:38,085 | INFO     | process IDs to be killed: [63868] (in reverse order)
[2024-06-20 10:26:53] 2024-06-20 14:26:38,659 | WARNING  | found no corresponding commands to process id(s)
[2024-06-20 10:26:53] 2024-06-20 14:26:38,659 | INFO     | Do not look for orphan processes in BOINC jobs
[2024-06-20 10:26:53] 2024-06-20 14:26:38,673 | INFO     | did not find any defunct processes belonging to 63868
[2024-06-20 10:26:53] 2024-06-20 14:26:38,680 | INFO     | did not find any defunct processes belonging to 63868
[2024-06-20 10:26:53] 2024-06-20 14:26:38,680 | INFO     | ready for new job
[2024-06-20 10:26:53] 2024-06-20 14:26:38,680 | INFO     | pilot has finished with previous job - re-establishing logging
[2024-06-20 10:26:53] 2024-06-20 14:26:38,690 | INFO     | *************************************
[2024-06-20 10:26:53] 2024-06-20 14:26:38,690 | INFO     | ***  PanDA Pilot version 3.7.7.3  ***
[2024-06-20 10:26:53] 2024-06-20 14:26:38,690 | INFO     | *************************************
[2024-06-20 10:26:53] 2024-06-20 14:26:38,690 | INFO     | 
[2024-06-20 10:26:53] 2024-06-20 14:26:38,692 | INFO     | architecture information:
[2024-06-20 10:26:53] 2024-06-20 14:26:38,703 | INFO     | executing command: cat /etc/os-release
[2024-06-20 10:26:53] 2024-06-20 14:26:38,908 | INFO     | cat /etc/os-release:
[2024-06-20 10:26:53] NAME="CentOS Linux"
[2024-06-20 10:26:53] VERSION="7 (Core)"
[2024-06-20 10:26:53] ID="centos"
[2024-06-20 10:26:53] ID_LIKE="rhel fedora"
[2024-06-20 10:26:53] VERSION_ID="7"
[2024-06-20 10:26:53] PRETTY_NAME="CentOS Linux 7 (Core)"
[2024-06-20 10:26:53] ANSI_COLOR="0;31"
[2024-06-20 10:26:53] CPE_NAME="cpe:/o:centos:centos:7"
[2024-06-20 10:26:53] HOME_URL="https://www.centos.org/"
[2024-06-20 10:26:53] BUG_REPORT_URL="https://bugs.centos.org/"
[2024-06-20 10:26:53] 
[2024-06-20 10:26:53] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2024-06-20 10:26:53] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2024-06-20 10:26:53] REDHAT_SUPPORT_PRODUCT="centos"
[2024-06-20 10:26:53] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2024-06-20 10:26:53] 
[2024-06-20 10:26:53] 2024-06-20 14:26:38,909 | INFO     | *************************************
[2024-06-20 10:26:53] 2024-06-20 14:26:39,412 | INFO     | executing command: df -mP /data/boinchome/slots/3
[2024-06-20 10:26:53] 2024-06-20 14:26:39,489 | INFO     | sufficient remaining disk space (905512484864 B)
[2024-06-20 10:26:53] 2024-06-20 14:26:39,489 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2024-06-20 10:26:53] 2024-06-20 14:26:39,489 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2024-06-20 10:26:53] 2024-06-20 14:26:39,490 | WARNING  | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2024-06-20 10:26:53] 2024-06-20 14:26:39,490 | INFO     | found 0 job(s) in 20 queues
[2024-06-20 10:26:53] 2024-06-20 14:26:39,490 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2024-06-20 10:26:53] 2024-06-20 14:26:39,490 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2024-06-20 10:26:53] 2024-06-20 14:26:39,490 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2024-06-20 10:26:53] 2024-06-20 14:26:39,818 | INFO     | all data control threads have been joined
[2024-06-20 10:26:53] 2024-06-20 14:26:40,231 | INFO     | all payload control threads have been joined
[2024-06-20 10:26:53] 2024-06-20 14:26:40,379 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2024-06-20 10:26:53] 2024-06-20 14:26:40,447 | INFO     | all job control threads have been joined
[2024-06-20 10:26:53] 2024-06-20 14:26:40,470 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2024-06-20 10:26:53] 2024-06-20 14:26:40,470 | INFO     | aborting loop
[2024-06-20 10:26:53] 2024-06-20 14:26:40,495 | INFO     | [job] retrieve thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:40,516 | INFO     | [payload] execute_payloads thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:40,517 | INFO     | [job] validate thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:40,517 | INFO     | [payload] run_realtimelog thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:40,827 | INFO     | [data] control thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:40,929 | INFO     | [payload] validate_post thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:40,941 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2024-06-20 10:26:53] 2024-06-20 14:26:41,239 | INFO     | [payload] control thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:41,385 | INFO     | [job] queue monitor thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:41,453 | INFO     | [job] control thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:41,475 | INFO     | [job] job monitor thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:41,497 | INFO     | [data] copytool_out thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:41,704 | INFO     | [payload] failed_post thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:41,808 | INFO     | [payload] validate_pre thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:41,877 | INFO     | [data] copytool_in thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:41,877 | INFO     | [job] create_data_payload thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:44,959 | INFO     | [data] queue_monitor thread has finished
[2024-06-20 10:26:53] 2024-06-20 14:26:45,459 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139770769090368)>', '<ExcThread(monitor, started 139770114078464)>']
[2024-06-20 10:26:53] 2024-06-20 14:26:45,544 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2024-06-20 10:26:53] 2024-06-20 14:26:45,544 | INFO     | [monitor] control thread has ended
[2024-06-20 10:26:53] 2024-06-20 14:26:50,484 | INFO     | all workflow threads have been joined
[2024-06-20 10:26:53] 2024-06-20 14:26:50,484 | INFO     | end of generic workflow (traces error code: 0)
[2024-06-20 10:26:53] 2024-06-20 14:26:50,485 | INFO     | traces error code: 0
[2024-06-20 10:26:53] 2024-06-20 14:26:50,485 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2024-06-20 10:26:53] 2024-06-20 14:26:51,240 [wrapper] ==== pilot stdout END ====
[2024-06-20 10:26:53] 2024-06-20 14:26:51,281 [wrapper] ==== wrapper stdout RESUME ====
[2024-06-20 10:26:53] 2024-06-20 14:26:51,340 [wrapper] pilotpid: 51345
[2024-06-20 10:26:53] 2024-06-20 14:26:51,365 [wrapper] Pilot exit status: 0
[2024-06-20 10:26:53] 2024-06-20 14:26:51,516 [wrapper] pandaids: 6237371386
[2024-06-20 10:26:53] 2024-06-20 14:26:51,873 [wrapper] cleanup supervisor_pilot 2430249 51346
[2024-06-20 10:26:53] 2024-06-20 14:26:51,906 [wrapper] Test setup, not cleaning
[2024-06-20 10:26:53] 2024-06-20 14:26:51,943 [wrapper] ==== wrapper stdout END ====
[2024-06-20 10:26:53] 2024-06-20 14:26:51,968 [wrapper] ==== wrapper stderr END ====
[2024-06-20 10:26:53] 2024-06-20 14:26:52,022 [wrapper] apfmon messages muted
[2024-06-20 10:26:53]  *** Error codes and diagnostics ***
[2024-06-20 10:26:53]     "exeErrorCode": 0,
[2024-06-20 10:26:53]     "exeErrorDiag": "",
[2024-06-20 10:26:53]     "pilotErrorCode": 0,
[2024-06-20 10:26:53]     "pilotErrorDiag": "",
[2024-06-20 10:26:53]  *** Listing of results directory ***
[2024-06-20 10:26:53] total 915476
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas    469766 Jun 18 23:52 pilot3.tar.gz
[2024-06-20 10:26:53] -rwx------ 1 boincer umatlas     32308 Jun 19 00:08 runpilot2-wrapper.sh
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas      5654 Jun 19 00:09 queuedata.json
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas       100 Jun 19 06:30 wrapper_26015_x86_64-pc-linux-gnu
[2024-06-20 10:26:53] -rwxr-xr-x 1 boincer umatlas      7986 Jun 19 06:30 run_atlas
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas       105 Jun 19 06:30 job.xml
[2024-06-20 10:26:53] -rw-r--r-- 2 boincer umatlas 542575092 Jun 19 06:30 EVNT.38776210._001001.pool.root.1
[2024-06-20 10:26:53] -rw-r--r-- 2 boincer umatlas     17537 Jun 19 06:30 start_atlas.sh
[2024-06-20 10:26:53] drwxrwx--x 2 boincer umatlas      4096 Jun 19 06:30 shared
[2024-06-20 10:26:53] -rw-r--r-- 2 boincer umatlas    482512 Jun 19 06:30 input.tar.gz
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas         0 Jun 19 06:30 boinc_lockfile
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas      2643 Jun 19 06:30 pandaJob.out
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas       461 Jun 19 06:31 setup.sh.local
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas   1012165 Jun 19 06:32 agis_schedconf.cvmfs.json
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas   1317838 Jun 19 06:32 cric_ddmendpoints.json
[2024-06-20 10:26:53] drwx------ 4 boincer umatlas      4096 Jun 19 06:32 pilot3
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas      9222 Jun 20 10:19 init_data.xml
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas 351843520 Jun 20 10:23 HITS.38921013._047819.pool.root.1
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas       534 Jun 20 10:24 boinc_task_state.xml
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas        95 Jun 20 10:25 pilot_heartbeat.json
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas      1068 Jun 20 10:25 memory_monitor_summary.json
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas         0 Jun 20 10:25 agis_ddmendpoints.agis.ALL.json
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas   2252514 Jun 20 10:26 log.38921013._047819.job.log.tgz.1
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas      8192 Jun 20 10:26 boinc_mmap_file
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas        29 Jun 20 10:26 wrapper_checkpoint.txt
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas      7785 Jun 20 10:26 heartbeat.json
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas      4336 Jun 20 10:26 pilotlog.txt
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas  17497880 Jun 20 10:26 log.38921013._047819.job.log.1
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas       357 Jun 20 10:26 output.list
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas       620 Jun 20 10:26 runtime_log
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas  19773440 Jun 20 10:26 result.tar.gz
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas     11383 Jun 20 10:26 runtime_log.err
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas       654 Jun 20 10:26 0vmNDm7n1d5n7Olcko1bjSoqABFKDmABFKDmOtvXDmrUqKDmMclRQn.diag
[2024-06-20 10:26:53] -rw-r--r-- 1 boincer umatlas     21714 Jun 20 10:26 stderr.txt
[2024-06-20 10:26:53] HITS file was successfully produced:
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas 351843520 Jun 20 10:23 shared/HITS.pool.root.1
[2024-06-20 10:26:53]  *** Contents of shared directory: ***
[2024-06-20 10:26:53] total 893272
[2024-06-20 10:26:53] -rw-r--r-- 2 boincer umatlas 542575092 Jun 19 06:30 ATLAS.root_0
[2024-06-20 10:26:53] -rw-r--r-- 2 boincer umatlas     17537 Jun 19 06:30 start_atlas.sh
[2024-06-20 10:26:53] -rw-r--r-- 2 boincer umatlas    482512 Jun 19 06:30 input.tar.gz
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas 351843520 Jun 20 10:23 HITS.pool.root.1
[2024-06-20 10:26:53] -rw------- 1 boincer umatlas  19773440 Jun 20 10:26 result.tar.gz
10:26:55 (43358): run_atlas exited; CPU time 139437.481493
10:26:55 (43358): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN