Name ldBODm7GQ66nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmqUvKDmZ7pMln_0
Workunit 230526581
Created 23 Feb 2025, 12:28:39 UTC
Sent 23 Feb 2025, 17:58:17 UTC
Report deadline 3 Mar 2025, 17:58:17 UTC
Received 24 Feb 2025, 10:40:06 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10695644
Run time 7 hours 59 min 42 sec
CPU time 1 days 0 hours 34 min 8 sec
Validate state Valid
Credit 1,289.75
Device peak FLOPS 35.97 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.40 GB
Peak swap size 31.65 GB
Peak disk usage 993.87 MB

Stderr output

<core_client_version>7.7.0</core_client_version>
<![CDATA[
<stderr_txt>
21:39:19 (101698): wrapper (7.7.26015): starting
21:39:19 (101698): wrapper: running run_atlas (--nthreads 9)
[2025-02-23 21:39:19] Arguments: --nthreads 9
[2025-02-23 21:39:19] Threads: 9
[2025-02-23 21:39:19] Checking for CVMFS
[2025-02-23 21:39:21] Probing /cvmfs/atlas.cern.ch... OK
[2025-02-23 21:39:22] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-02-23 21:39:22] Running cvmfs_config stat atlas.cern.ch
[2025-02-23 21:39:24] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-02-23 21:39:24] 2.11.2.0 7053 139090 117952 142995 2 90 16255748 18432000 11158 130560 0 79162327 99.482 98376601 51671 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2025-02-23 21:39:24] CVMFS is ok
[2025-02-23 21:39:24] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-02-23 21:39:24] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-02-23 21:39:24] Further information can be found at the LHC@home message board.
[2025-02-23 21:39:24] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-02-23 21:39:24] Checking for apptainer binary...
[2025-02-23 21:39:24] Using apptainer found in PATH at /usr/bin/apptainer
[2025-02-23 21:39:24] Running /usr/bin/apptainer --version
[2025-02-23 21:39:26] apptainer version 1.3.2-1.el7
[2025-02-23 21:39:26] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-02-23 21:40:03] c-210-33-1.aglt2.org
[2025-02-23 21:40:03] apptainer works
[2025-02-23 21:40:03] Set ATHENA_PROC_NUMBER=9
[2025-02-23 21:40:03] Set ATHENA_CORE_NUMBER=9
[2025-02-23 21:40:03] Starting ATLAS job with PandaID=6524897062
[2025-02-23 21:40:03] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/2 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2025-02-24 05:38:58]  *** The last 200 lines of the pilot log: ***
[2025-02-24 05:38:58] 2025-02-24 10:38:33,327 | INFO     | intersect: -30093822997.482777
[2025-02-24 05:38:58] 2025-02-24 10:38:33,328 | INFO     | chi2: 8.080577046891381
[2025-02-24 05:38:58] 2025-02-24 10:38:33,328 | INFO     | current chi2=8.080577046891381 (change=15.900241274561978 %)
[2025-02-24 05:38:58] 2025-02-24 10:38:33,328 | INFO     | right removable region: 458
[2025-02-24 05:38:58] 2025-02-24 10:38:33,328 | INFO     | model: linear, x: [1740365480.0, 1740365541.0, 1740365602.0, 1740365663.0, 1740365724.0, 1740365785.0, 1740365846.0, 1740365907.0, 1740365968.0, 1740366029.0, 1740
[2025-02-24 05:38:58] 2025-02-24 10:38:33,329 | INFO     | sum of square deviations: 29984762334.004498
[2025-02-24 05:38:58] 2025-02-24 10:38:33,380 | INFO     | sum of deviations: 308350994546.70807
[2025-02-24 05:38:58] 2025-02-24 10:38:33,381 | INFO     | mean x: 1740379449.422658
[2025-02-24 05:38:58] 2025-02-24 10:38:33,381 | INFO     | mean y: 2545237.6819172115
[2025-02-24 05:38:58] 2025-02-24 10:38:33,381 | INFO     | -- intersect: -17894803026.757668
[2025-02-24 05:38:58] 2025-02-24 10:38:33,381 | INFO     | intersect: -17894803026.757668
[2025-02-24 05:38:58] 2025-02-24 10:38:33,381 | INFO     | chi2: 5.761464900062077
[2025-02-24 05:38:58] 2025-02-24 10:38:33,381 | INFO     | current chi2=5.761464900062077 (change=40.036731883312285 %)
[2025-02-24 05:38:58] 2025-02-24 10:38:33,382 | INFO     | model: linear, x: [1740365785.0, 1740365846.0, 1740365907.0, 1740365968.0, 1740366029.0, 1740366090.0, 1740366151.0, 1740366212.0, 1740366273.0, 1740366334.0, 1740
[2025-02-24 05:38:58] 2025-02-24 10:38:33,382 | INFO     | sum of square deviations: 29015410570.601295
[2025-02-24 05:38:58] 2025-02-24 10:38:33,411 | INFO     | sum of deviations: 204363470937.1081
[2025-02-24 05:38:58] 2025-02-24 10:38:33,411 | INFO     | mean x: 1740379601.9273129
[2025-02-24 05:38:58] 2025-02-24 10:38:33,411 | INFO     | mean y: 2561592.063876652
[2025-02-24 05:38:58] 2025-02-24 10:38:33,411 | INFO     | -- intersect: -12255407852.572435
[2025-02-24 05:38:58] 2025-02-24 10:38:33,411 | INFO     | intersect: -12255407852.572435
[2025-02-24 05:38:58] 2025-02-24 10:38:33,412 | INFO     | chi2: 4.061628551581198
[2025-02-24 05:38:58] 2025-02-24 10:38:33,436 | INFO     | current chi2=4.061628551581198 (change=29.503544288928385 %)
[2025-02-24 05:38:58] 2025-02-24 10:38:33,437 | INFO     | model: linear, x: [1740366090.0, 1740366151.0, 1740366212.0, 1740366273.0, 1740366334.0, 1740366395.0, 1740366456.0, 1740366517.0, 1740366578.0, 1740366639.0, 1740
[2025-02-24 05:38:58] 2025-02-24 10:38:33,437 | INFO     | sum of square deviations: 28067175482.177998
[2025-02-24 05:38:58] 2025-02-24 10:38:33,466 | INFO     | sum of deviations: 111350579514.10031
[2025-02-24 05:38:58] 2025-02-24 10:38:33,467 | INFO     | mean x: 1740379754.4320712
[2025-02-24 05:38:58] 2025-02-24 10:38:33,467 | INFO     | mean y: 2576554.118040089
[2025-02-24 05:38:58] 2025-02-24 10:38:33,467 | INFO     | -- intersect: -6902011845.012906
[2025-02-24 05:38:58] 2025-02-24 10:38:33,467 | INFO     | intersect: -6902011845.012906
[2025-02-24 05:38:58] 2025-02-24 10:38:33,467 | INFO     | chi2: 2.7157499725019383
[2025-02-24 05:38:58] 2025-02-24 10:38:33,468 | INFO     | current chi2=2.7157499725019383 (change=33.13642697718646 %)
[2025-02-24 05:38:58] 2025-02-24 10:38:33,468 | INFO     | model: linear, x: [1740366395.0, 1740366456.0, 1740366517.0, 1740366578.0, 1740366639.0, 1740366700.0, 1740366761.0, 1740366822.0, 1740366883.0, 1740366944.0, 1740
[2025-02-24 05:38:58] 2025-02-24 10:38:33,468 | INFO     | sum of square deviations: 27139824506.234352
[2025-02-24 05:38:58] 2025-02-24 10:38:33,495 | INFO     | sum of deviations: 35959778390.53151
[2025-02-24 05:38:58] 2025-02-24 10:38:33,519 | INFO     | mean x: 1740379906.9369369
[2025-02-24 05:38:58] 2025-02-24 10:38:33,519 | INFO     | mean y: 2588927.376126126
[2025-02-24 05:38:58] 2025-02-24 10:38:33,519 | INFO     | -- intersect: -2303383086.348939
[2025-02-24 05:38:58] 2025-02-24 10:38:33,519 | INFO     | intersect: -2303383086.348939
[2025-02-24 05:38:58] 2025-02-24 10:38:33,520 | INFO     | chi2: 1.7176268133354526
[2025-02-24 05:38:58] 2025-02-24 10:38:33,520 | INFO     | current chi2=1.7176268133354526 (change=36.75313152068064 %)
[2025-02-24 05:38:58] 2025-02-24 10:38:33,521 | INFO     | model: linear, x: [1740366700.0, 1740366761.0, 1740366822.0, 1740366883.0, 1740366944.0, 1740367005.0, 1740367066.0, 1740367127.0, 1740367188.0, 1740367249.0, 1740
[2025-02-24 05:38:58] 2025-02-24 10:38:33,521 | INFO     | sum of square deviations: 26233125080.2688
[2025-02-24 05:38:58] 2025-02-24 10:38:33,528 | INFO     | sum of deviations: 9486550753.159454
[2025-02-24 05:38:58] 2025-02-24 10:38:33,529 | INFO     | mean x: 1740380059.4419134
[2025-02-24 05:38:58] 2025-02-24 10:38:33,529 | INFO     | mean y: 2593372.143507973
[2025-02-24 05:38:58] 2025-02-24 10:38:33,529 | INFO     | -- intersect: -626771360.924475
[2025-02-24 05:38:58] 2025-02-24 10:38:33,529 | INFO     | intersect: -626771360.924475
[2025-02-24 05:38:58] 2025-02-24 10:38:33,529 | INFO     | chi2: 1.6001220667573934
[2025-02-24 05:38:58] 2025-02-24 10:38:33,529 | INFO     | current chi2=1.6001220667573934 (change=6.841110401035088 %)
[2025-02-24 05:38:58] 2025-02-24 10:38:33,530 | INFO     | left removable region: 50
[2025-02-24 05:38:58] 2025-02-24 10:38:33,530 | INFO     | model: linear, x: [1740368226.0, 1740368286.0, 1740368349.0, 1740368409.0, 1740368470.0, 1740368530.0, 1740368591.0, 1740368652.0, 1740368713.0, 1740368776.0, 1740
[2025-02-24 05:38:58] 2025-02-24 10:38:33,530 | INFO     | sum of square deviations: 21058792622.588165
[2025-02-24 05:38:58] 2025-02-24 10:38:33,534 | INFO     | sum of deviations: 55925164733.705864
[2025-02-24 05:38:58] 2025-02-24 10:38:33,535 | INFO     | mean x: 1740380638.9411764
[2025-02-24 05:38:58] 2025-02-24 10:38:33,536 | INFO     | mean y: 2606189.987745098
[2025-02-24 05:38:58] 2025-02-24 10:38:33,536 | INFO     | -- intersect: -4619267232.505523
[2025-02-24 05:38:58] 2025-02-24 10:38:33,536 | INFO     | intersect: -4619267232.505523
[2025-02-24 05:38:58] 2025-02-24 10:38:33,536 | INFO     | chi2: 0.0031039248785354194
[2025-02-24 05:38:58] 2025-02-24 10:38:33,537 | INFO     | -- intersect: -4619267232.505523
[2025-02-24 05:38:58] 2025-02-24 10:38:33,537 | INFO     | current memory leak: 2.66 B/s (using 408 data points, chi2=0.00)
[2025-02-24 05:38:58] 2025-02-24 10:38:33,537 | INFO     | ..............................
[2025-02-24 05:38:58] 2025-02-24 10:38:33,538 | INFO     | . Timing measurements:
[2025-02-24 05:38:58] 2025-02-24 10:38:33,538 | INFO     | . get job = 0 s
[2025-02-24 05:38:58] 2025-02-24 10:38:33,538 | INFO     | . initial setup = 7 s
[2025-02-24 05:38:58] 2025-02-24 10:38:33,538 | INFO     | . payload setup = 93 s
[2025-02-24 05:38:58] 2025-02-24 10:38:33,538 | INFO     | . stage-in = 0 s
[2025-02-24 05:38:58] 2025-02-24 10:38:33,538 | INFO     | . payload execution = 28298 s
[2025-02-24 05:38:58] 2025-02-24 10:38:33,538 | INFO     | . stage-out = 6 s
[2025-02-24 05:38:58] 2025-02-24 10:38:33,538 | INFO     | . log creation = 2 s
[2025-02-24 05:38:58] 2025-02-24 10:38:33,538 | INFO     | ..............................
[2025-02-24 05:38:58] 2025-02-24 10:38:34,022 | INFO     | 
[2025-02-24 05:38:58] 2025-02-24 10:38:34,022 | INFO     | job summary report
[2025-02-24 05:38:58] 2025-02-24 10:38:34,026 | INFO     | --------------------------------------------------
[2025-02-24 05:38:58] 2025-02-24 10:38:34,026 | INFO     | PanDA job id: 6524897062
[2025-02-24 05:38:58] 2025-02-24 10:38:34,026 | INFO     | task id: 43078919
[2025-02-24 05:38:58] 2025-02-24 10:38:34,026 | INFO     | errors: (none)
[2025-02-24 05:38:58] 2025-02-24 10:38:34,026 | INFO     | status: LOG_TRANSFER = DONE 
[2025-02-24 05:38:58] 2025-02-24 10:38:34,026 | INFO     | pilot state: finished 
[2025-02-24 05:38:58] 2025-02-24 10:38:34,026 | INFO     | transexitcode: 0
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | exeerrorcode: 0
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | exeerrordiag: 
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | exitcode: 0
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | exitmsg: OK
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | cpuconsumptiontime: 88323 s
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | nevents: 400
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | neventsw: 0
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | pid: 137139
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | pgrp: 137139
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | corecount: 9
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | event service: False
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | sizes: {0: 2383190, 1: 2383389, 12: 2383389, 23: 2383417, 33: 2383445, 44: 2383501, 52: 2383863, 55: 2383891, 28395: 2420426, 28403: 2429395, 28404: 2429451, 28451
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | --------------------------------------------------
[2025-02-24 05:38:58] 2025-02-24 10:38:34,027 | INFO     | 
[2025-02-24 05:38:58] 2025-02-24 10:38:34,028 | INFO     | executing command: ls -lF /tmp/boinchome/slots/2
[2025-02-24 05:38:58] 2025-02-24 10:38:34,338 | INFO     | queue jobs had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,343 | INFO     | queue payloads had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,343 | INFO     | queue data_in had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,343 | INFO     | queue data_out had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,343 | INFO     | queue current_data_in had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,343 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,343 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue completed_jobids has 1 job(s)
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,344 | INFO     | queue messages had 0 job(s) [purged]
[2025-02-24 05:38:58] 2025-02-24 10:38:34,345 | INFO     | job 6524897062 has completed (purged errors)
[2025-02-24 05:38:58] 2025-02-24 10:38:34,345 | INFO     | overall cleanup function is called
[2025-02-24 05:38:58] 2025-02-24 10:38:35,357 | INFO     | --- collectZombieJob: --- 10, [137139]
[2025-02-24 05:38:58] 2025-02-24 10:38:35,357 | INFO     | zombie collector waiting for pid 137139
[2025-02-24 05:38:58] 2025-02-24 10:38:35,361 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2025-02-24 05:38:58] 2025-02-24 10:38:35,361 | INFO     | collected zombie processes
[2025-02-24 05:38:58] 2025-02-24 10:38:35,361 | INFO     | will attempt to kill all subprocesses of pid=137139
[2025-02-24 05:38:58] 2025-02-24 10:38:35,962 | INFO     | process IDs to be killed: [137139] (in reverse order)
[2025-02-24 05:38:58] 2025-02-24 10:38:36,469 | WARNING  | found no corresponding commands to process id(s)
[2025-02-24 05:38:58] 2025-02-24 10:38:36,469 | INFO     | Do not look for orphan processes in BOINC jobs
[2025-02-24 05:38:58] 2025-02-24 10:38:36,491 | INFO     | did not find any defunct processes belonging to 137139
[2025-02-24 05:38:58] 2025-02-24 10:38:36,532 | INFO     | did not find any defunct processes belonging to 137139
[2025-02-24 05:38:58] 2025-02-24 10:38:36,532 | INFO     | ready for new job
[2025-02-24 05:38:58] 2025-02-24 10:38:36,532 | INFO     | pilot has finished with previous job - re-establishing logging
[2025-02-24 05:38:58] 2025-02-24 10:38:36,535 | INFO     | **************************************
[2025-02-24 05:38:58] 2025-02-24 10:38:36,535 | INFO     | ***  PanDA Pilot version 3.9.4.15  ***
[2025-02-24 05:38:58] 2025-02-24 10:38:36,535 | INFO     | **************************************
[2025-02-24 05:38:58] 2025-02-24 10:38:36,535 | INFO     | 
[2025-02-24 05:38:58] 2025-02-24 10:38:36,547 | INFO     | architecture information:
[2025-02-24 05:38:58] 2025-02-24 10:38:36,559 | INFO     | executing command: cat /etc/os-release
[2025-02-24 05:38:58] 2025-02-24 10:38:36,674 | INFO     | cat /etc/os-release:
[2025-02-24 05:38:58] NAME="CentOS Linux"
[2025-02-24 05:38:58] VERSION="7 (Core)"
[2025-02-24 05:38:58] ID="centos"
[2025-02-24 05:38:58] ID_LIKE="rhel fedora"
[2025-02-24 05:38:58] VERSION_ID="7"
[2025-02-24 05:38:58] PRETTY_NAME="CentOS Linux 7 (Core)"
[2025-02-24 05:38:58] ANSI_COLOR="0;31"
[2025-02-24 05:38:58] CPE_NAME="cpe:/o:centos:centos:7"
[2025-02-24 05:38:58] HOME_URL="https://www.centos.org/"
[2025-02-24 05:38:58] BUG_REPORT_URL="https://bugs.centos.org/"
[2025-02-24 05:38:58] 
[2025-02-24 05:38:58] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2025-02-24 05:38:58] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2025-02-24 05:38:58] REDHAT_SUPPORT_PRODUCT="centos"
[2025-02-24 05:38:58] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2025-02-24 05:38:58] 
[2025-02-24 05:38:58] 2025-02-24 10:38:36,674 | INFO     | **************************************
[2025-02-24 05:38:58] 2025-02-24 10:38:37,176 | INFO     | executing command: df -mP /tmp/boinchome/slots/2
[2025-02-24 05:38:58] 2025-02-24 10:38:37,292 | INFO     | sufficient remaining disk space (54892953600 B)
[2025-02-24 05:38:58] 2025-02-24 10:38:37,292 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2025-02-24 05:38:58] 2025-02-24 10:38:37,292 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2025-02-24 05:38:58] 2025-02-24 10:38:37,292 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2025-02-24 05:38:58] 2025-02-24 10:38:37,293 | INFO     | aborting loop
[2025-02-24 05:38:58] 2025-02-24 10:38:37,293 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2025-02-24 05:38:58] 2025-02-24 10:38:37,680 | INFO     | found 0 job(s) in 20 queues
[2025-02-24 05:38:58] 2025-02-24 10:38:37,680 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2025-02-24 05:38:58] 2025-02-24 10:38:37,680 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2025-02-24 05:38:58] 2025-02-24 10:38:37,821 | INFO     | all data control threads have been joined
[2025-02-24 05:38:58] 2025-02-24 10:38:38,298 | INFO     | [job] retrieve thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:38,299 | INFO     | [job] job monitor thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:38,540 | INFO     | all job control threads have been joined
[2025-02-24 05:38:58] 2025-02-24 10:38:38,579 | INFO     | all payload control threads have been joined
[2025-02-24 05:38:58] 2025-02-24 10:38:38,701 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2025-02-24 05:38:58] 2025-02-24 10:38:38,825 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2025-02-24 05:38:58] 2025-02-24 10:38:38,836 | INFO     | [data] control thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:38,954 | INFO     | [job] validate thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:39,016 | INFO     | [data] copytool_in thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:39,300 | INFO     | [data] copytool_out thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:39,487 | INFO     | [payload] run_realtimelog thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:39,491 | INFO     | [payload] validate_pre thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:39,511 | INFO     | [payload] execute_payloads thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:39,546 | INFO     | [job] control thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:39,548 | INFO     | [job] create_data_payload thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:39,585 | INFO     | [payload] control thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:39,619 | INFO     | [payload] validate_post thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:39,681 | INFO     | [payload] failed_post thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:39,831 | INFO     | [job] queue monitor thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:42,710 | INFO     | [data] queue_monitor thread has finished
[2025-02-24 05:38:58] 2025-02-24 10:38:44,184 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139748784101184)>', '<ExcThread(monitor, started 139748362413824)>']
[2025-02-24 05:38:58] 2025-02-24 10:38:44,753 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2025-02-24 05:38:58] 2025-02-24 10:38:44,753 | INFO     | [monitor] control thread has ended
[2025-02-24 05:38:58] 2025-02-24 10:38:49,214 | INFO     | all workflow threads have been joined
[2025-02-24 05:38:58] 2025-02-24 10:38:49,214 | INFO     | end of generic workflow (traces error code: 0)
[2025-02-24 05:38:58] 2025-02-24 10:38:49,214 | INFO     | traces error code: 0
[2025-02-24 05:38:58] 2025-02-24 10:38:49,215 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2025-02-24 05:38:58] 2025-02-24 10:38:51,502 [wrapper] ==== pilot stdout END ====
[2025-02-24 05:38:58] 2025-02-24 10:38:51,535 [wrapper] ==== wrapper stdout RESUME ====
[2025-02-24 05:38:58] 2025-02-24 10:38:51,624 [wrapper] pilotpid: 111576
[2025-02-24 05:38:58] 2025-02-24 10:38:51,666 [wrapper] Pilot exit status: 0
[2025-02-24 05:38:58] 2025-02-24 10:38:51,973 [wrapper] pandaids: 6524897062
[2025-02-24 05:38:58] 2025-02-24 10:38:52,929 [wrapper] cleanup supervisor_pilot 264688 111577
[2025-02-24 05:38:58] 2025-02-24 10:38:53,030 [wrapper] Test setup, not cleaning
[2025-02-24 05:38:58] 2025-02-24 10:38:53,073 [wrapper] apfmon messages muted
[2025-02-24 05:38:58] 2025-02-24 10:38:53,116 [wrapper] ==== wrapper stdout END ====
[2025-02-24 05:38:58] 2025-02-24 10:38:53,155 [wrapper] ==== wrapper stderr END ====
[2025-02-24 05:38:58]  *** Error codes and diagnostics ***
[2025-02-24 05:38:58]     "exeErrorCode": 0,
[2025-02-24 05:38:58]     "exeErrorDiag": "",
[2025-02-24 05:38:58]     "pilotErrorCode": 0,
[2025-02-24 05:38:58]     "pilotErrorDiag": "",
[2025-02-24 05:38:58]  *** Listing of results directory ***
[2025-02-24 05:38:58] total 676476
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas    491065 Feb 23 07:13 pilot3.tar.gz
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas      5118 Feb 23 07:28 queuedata.json
[2025-02-24 05:38:58] -rwx------ 1 boincer umatlas     35865 Feb 23 07:28 runpilot2-wrapper.sh
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas       100 Feb 23 21:38 wrapper_26015_x86_64-pc-linux-gnu
[2025-02-24 05:38:58] -rwxr-xr-x 1 boincer umatlas      7986 Feb 23 21:38 run_atlas
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas       105 Feb 23 21:38 job.xml
[2025-02-24 05:38:58] -rw-r--r-- 2 boincer umatlas 346484582 Feb 23 21:39 EVNT.43078917._001306.pool.root.1
[2025-02-24 05:38:58] drwxrwx--x 2 boincer umatlas      4096 Feb 23 21:39 shared
[2025-02-24 05:38:58] -rw-r--r-- 2 boincer umatlas    503556 Feb 23 21:39 input.tar.gz
[2025-02-24 05:38:58] -rw-r--r-- 2 boincer umatlas     17569 Feb 23 21:39 start_atlas.sh
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas         0 Feb 23 21:39 boinc_lockfile
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas      2547 Feb 23 21:40 pandaJob.out
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas       467 Feb 23 21:40 setup.sh.local
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas    987720 Feb 23 21:42 agis_schedconf.cvmfs.json
[2025-02-24 05:38:58] drwx------ 4 boincer umatlas      4096 Feb 23 21:42 pilot3
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas 334659452 Feb 24 05:34 HITS.43078919._091275.pool.root.1
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas       532 Feb 24 05:35 boinc_task_state.xml
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas      6356 Feb 24 05:36 init_data.xml
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas      1067 Feb 24 05:37 memory_monitor_summary.json
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas   1582569 Feb 24 05:37 agis_ddmendpoints.agis.ALL.json
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas    589292 Feb 24 05:37 log.43078919._091275.job.log.tgz.1
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas        95 Feb 24 05:38 pilot_heartbeat.json
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas      7790 Feb 24 05:38 heartbeat.json
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas      4215 Feb 24 05:38 pilotlog.txt
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas      8192 Feb 24 05:38 boinc_mmap_file
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas        28 Feb 24 05:38 wrapper_checkpoint.txt
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas   3292367 Feb 24 05:38 log.43078919._091275.job.log.1
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas       357 Feb 24 05:38 output.list
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas       620 Feb 24 05:38 runtime_log
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas   3901440 Feb 24 05:38 result.tar.gz
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas     11429 Feb 24 05:38 runtime_log.err
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas       665 Feb 24 05:38 ldBODm7GQ66nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmqUvKDmZ7pMln.diag
[2025-02-24 05:38:58] -rw-r--r-- 1 boincer umatlas     21650 Feb 24 05:38 stderr.txt
[2025-02-24 05:38:58] HITS file was successfully produced:
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas 334659452 Feb 24 05:34 shared/HITS.pool.root.1
[2025-02-24 05:38:58]  *** Contents of shared directory: ***
[2025-02-24 05:38:58] total 669512
[2025-02-24 05:38:58] -rw-r--r-- 2 boincer umatlas 346484582 Feb 23 21:39 ATLAS.root_0
[2025-02-24 05:38:58] -rw-r--r-- 2 boincer umatlas    503556 Feb 23 21:39 input.tar.gz
[2025-02-24 05:38:58] -rw-r--r-- 2 boincer umatlas     17569 Feb 23 21:39 start_atlas.sh
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas 334659452 Feb 24 05:34 HITS.pool.root.1
[2025-02-24 05:38:58] -rw------- 1 boincer umatlas   3901440 Feb 24 05:38 result.tar.gz
05:39:00 (101698): run_atlas exited; CPU time 88119.384239
05:39:00 (101698): called boinc_finish(0)

</stderr_txt>
]]>


©2025 CERN