Name HPILDm91ZP7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmyTcLDmhC1cdn_2
Workunit 231675765
Created 17 Apr 2025, 14:56:29 UTC
Sent 17 Apr 2025, 18:06:19 UTC
Report deadline 25 Apr 2025, 18:06:19 UTC
Received 19 Apr 2025, 4:10:41 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10687455
Run time 1 days 9 hours 5 min 54 sec
CPU time 23 hours 38 min 2 sec
Validate state Valid
Credit 1,917.57
Device peak FLOPS 33.59 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.35 GB
Peak swap size 31.90 GB
Peak disk usage 852.13 MB

Stderr output

<core_client_version>7.7.0</core_client_version>
<![CDATA[
<stderr_txt>
14:06:44 (28064): wrapper (7.7.26015): starting
14:06:44 (28064): wrapper: running run_atlas (--nthreads 10)
[2025-04-17 14:06:44] Arguments: --nthreads 10
[2025-04-17 14:06:44] Threads: 10
[2025-04-17 14:06:44] Checking for CVMFS
[2025-04-17 14:06:45] Probing /cvmfs/atlas.cern.ch... OK
[2025-04-17 14:06:46] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-04-17 14:06:46] Running cvmfs_config stat atlas.cern.ch
[2025-04-17 14:06:49] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-04-17 14:06:49] 2.11.2.0 5745 22189 278164 144974 3 13 10545448 18432000 16029 130560 0 88689024 98.808 239981842 35897 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2025-04-17 14:06:49] CVMFS is ok
[2025-04-17 14:06:49] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-04-17 14:06:49] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-04-17 14:06:49] Further information can be found at the LHC@home message board.
[2025-04-17 14:06:49] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-04-17 14:06:49] Checking for apptainer binary...
[2025-04-17 14:06:49] Using apptainer found in PATH at /usr/bin/apptainer
[2025-04-17 14:06:49] Running /usr/bin/apptainer --version
[2025-04-17 14:06:49] apptainer version 1.3.2-1.el7
[2025-04-17 14:06:49] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-04-17 14:07:33] c-210-20.aglt2.org
[2025-04-17 14:07:33] apptainer works
[2025-04-17 14:07:33] Set ATHENA_PROC_NUMBER=10
[2025-04-17 14:07:33] Set ATHENA_CORE_NUMBER=10
[2025-04-17 14:07:33] Starting ATLAS job with PandaID=6605180209
[2025-04-17 14:07:33] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
15:40:11 (28064): BOINC client no longer exists - exiting
15:40:11 (28064): timer handler: client dead, exiting
15:47:35 (22598): wrapper (7.7.26015): starting
15:47:35 (22598): wrapper: running run_atlas (--nthreads 10)
[2025-04-17 15:47:36] Arguments: --nthreads 10
[2025-04-17 15:47:36] Threads: 10
[2025-04-17 15:47:36] This job has been restarted, cleaning up previous attempt
[2025-04-17 15:47:36] Checking for CVMFS
[2025-04-17 15:47:37] Probing /cvmfs/atlas.cern.ch... OK
[2025-04-17 15:47:38] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-04-17 15:47:38] Running cvmfs_config stat atlas.cern.ch
[2025-04-17 15:47:40] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-04-17 15:47:40] 2.11.2.0 5745 22290 278624 144976 3 275 13560554 18432001 15108 130560 0 89096720 98.801 240918730 35900 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2025-04-17 15:47:40] CVMFS is ok
[2025-04-17 15:47:40] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-04-17 15:47:40] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-04-17 15:47:40] Further information can be found at the LHC@home message board.
[2025-04-17 15:47:40] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-04-17 15:47:40] Checking for apptainer binary...
[2025-04-17 15:47:40] Using apptainer found in PATH at /usr/bin/apptainer
[2025-04-17 15:47:40] Running /usr/bin/apptainer --version
[2025-04-17 15:47:40] apptainer version 1.3.2-1.el7
[2025-04-17 15:47:40] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-04-17 15:48:05] c-210-20.aglt2.org
[2025-04-17 15:48:05] apptainer works
[2025-04-17 15:48:05] Set ATHENA_PROC_NUMBER=10
[2025-04-17 15:48:05] Set ATHENA_CORE_NUMBER=10
[2025-04-17 15:48:06] Starting ATLAS job with PandaID=6605180209
[2025-04-17 15:48:06] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
21:20:09 (22598): BOINC client no longer exists - exiting
21:20:09 (22598): timer handler: client dead, exiting
21:29:43 (29332): wrapper (7.7.26015): starting
21:29:43 (29332): wrapper: running run_atlas (--nthreads 10)
[2025-04-17 21:29:43] Arguments: --nthreads 10
[2025-04-17 21:29:43] Threads: 10
[2025-04-17 21:29:43] This job has been restarted, cleaning up previous attempt
[2025-04-17 21:29:43] Checking for CVMFS
[2025-04-17 21:29:44] Probing /cvmfs/atlas.cern.ch... OK
[2025-04-17 21:29:45] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-04-17 21:29:45] Running cvmfs_config stat atlas.cern.ch
[2025-04-17 21:29:46] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-04-17 21:29:46] 2.11.2.0 5745 22632 285032 144984 1 451 11992298 18432000 13167 130560 0 90349923 98.805 243691683 35896 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2025-04-17 21:29:46] CVMFS is ok
[2025-04-17 21:29:46] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-04-17 21:29:46] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-04-17 21:29:46] Further information can be found at the LHC@home message board.
[2025-04-17 21:29:46] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-04-17 21:29:46] Checking for apptainer binary...
[2025-04-17 21:29:46] Using apptainer found in PATH at /usr/bin/apptainer
[2025-04-17 21:29:46] Running /usr/bin/apptainer --version
[2025-04-17 21:29:47] apptainer version 1.3.2-1.el7
[2025-04-17 21:29:47] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-04-17 21:30:06] c-210-20.aglt2.org
[2025-04-17 21:30:06] apptainer works
[2025-04-17 21:30:06] Set ATHENA_PROC_NUMBER=10
[2025-04-17 21:30:06] Set ATHENA_CORE_NUMBER=10
[2025-04-17 21:30:07] Starting ATLAS job with PandaID=6605180209
[2025-04-17 21:30:07] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2025-04-19 00:03:36]  *** The last 200 lines of the pilot log: ***
[2025-04-19 00:03:36] 2025-04-19 04:03:14,260 | INFO     | mean y: 2536388.669871795
[2025-04-19 00:03:36] 2025-04-19 04:03:14,261 | INFO     | -- intersect: -3660560723.3573923
[2025-04-19 00:03:36] 2025-04-19 04:03:14,261 | INFO     | intersect: -3660560723.3573923
[2025-04-19 00:03:36] 2025-04-19 04:03:14,286 | INFO     | chi2: 11.698299318276993
[2025-04-19 00:03:36] 2025-04-19 04:03:14,300 | INFO     | sum of square deviations: 1165921445355.728
[2025-04-19 00:03:36] 2025-04-19 04:03:14,494 | INFO     | sum of deviations: 2799046803177.78
[2025-04-19 00:03:36] 2025-04-19 04:03:14,495 | INFO     | mean x: 1744987555.5672026
[2025-04-19 00:03:36] 2025-04-19 04:03:14,495 | INFO     | mean y: 2540814.140836013
[2025-04-19 00:03:36] 2025-04-19 04:03:14,495 | INFO     | -- intersect: -4186679530.3783126
[2025-04-19 00:03:36] 2025-04-19 04:03:14,495 | INFO     | intersect: -4186679530.3783126
[2025-04-19 00:03:36] 2025-04-19 04:03:14,497 | INFO     | chi2: 9.18464705192603
[2025-04-19 00:03:36] 2025-04-19 04:03:14,498 | INFO     | current chi2=9.18464705192603 (change=21.48733074750212 %)
[2025-04-19 00:03:36] 2025-04-19 04:03:14,498 | INFO     | right removable region: 1554
[2025-04-19 00:03:36] 2025-04-19 04:03:14,500 | INFO     | sum of square deviations: 1165920148007.7275
[2025-04-19 00:03:36] 2025-04-19 04:03:15,124 | INFO     | sum of deviations: 1940728166783.553
[2025-04-19 00:03:36] 2025-04-19 04:03:15,151 | INFO     | mean x: 1744987860.5672026
[2025-04-19 00:03:36] 2025-04-19 04:03:15,151 | INFO     | mean y: 2543557.0186495176
[2025-04-19 00:03:36] 2025-04-19 04:03:15,151 | INFO     | -- intersect: -2902069676.987918
[2025-04-19 00:03:36] 2025-04-19 04:03:15,152 | INFO     | intersect: -2902069676.987918
[2025-04-19 00:03:36] 2025-04-19 04:03:15,157 | INFO     | chi2: 7.721692656373978
[2025-04-19 00:03:36] 2025-04-19 04:03:15,157 | INFO     | current chi2=7.721692656373978 (change=33.99303226658007 %)
[2025-04-19 00:03:36] 2025-04-19 04:03:15,160 | INFO     | sum of square deviations: 1154708692187.9155
[2025-04-19 00:03:36] 2025-04-19 04:03:15,471 | INFO     | sum of deviations: 1557401124430.9697
[2025-04-19 00:03:36] 2025-04-19 04:03:15,471 | INFO     | mean x: 1744988013.072258
[2025-04-19 00:03:36] 2025-04-19 04:03:15,472 | INFO     | mean y: 2548770.857419355
[2025-04-19 00:03:36] 2025-04-19 04:03:15,472 | INFO     | -- intersect: -2350985338.70918
[2025-04-19 00:03:36] 2025-04-19 04:03:15,472 | INFO     | intersect: -2350985338.70918
[2025-04-19 00:03:36] 2025-04-19 04:03:15,474 | INFO     | chi2: 5.723421473494149
[2025-04-19 00:03:36] 2025-04-19 04:03:15,474 | INFO     | current chi2=5.723421473494149 (change=25.87866769380323 %)
[2025-04-19 00:03:36] 2025-04-19 04:03:15,477 | INFO     | sum of square deviations: 1143569425173.1597
[2025-04-19 00:03:36] 2025-04-19 04:03:15,544 | INFO     | sum of deviations: 1219043560009.0632
[2025-04-19 00:03:36] 2025-04-19 04:03:15,545 | INFO     | mean x: 1744988165.576699
[2025-04-19 00:03:36] 2025-04-19 04:03:15,545 | INFO     | mean y: 2553403.1851132684
[2025-04-19 00:03:36] 2025-04-19 04:03:15,545 | INFO     | -- intersect: -1857601772.9785028
[2025-04-19 00:03:36] 2025-04-19 04:03:15,545 | INFO     | intersect: -1857601772.9785028
[2025-04-19 00:03:36] 2025-04-19 04:03:15,547 | INFO     | chi2: 4.188505239147767
[2025-04-19 00:03:36] 2025-04-19 04:03:15,548 | INFO     | current chi2=4.188505239147767 (change=26.818158359554044 %)
[2025-04-19 00:03:36] 2025-04-19 04:03:15,550 | INFO     | sum of square deviations: 1132501925845.692
[2025-04-19 00:03:36] 2025-04-19 04:03:15,645 | INFO     | sum of deviations: 968889025616.9268
[2025-04-19 00:03:36] 2025-04-19 04:03:15,645 | INFO     | mean x: 1744988318.081818
[2025-04-19 00:03:36] 2025-04-19 04:03:15,651 | INFO     | mean y: 2556848.468831169
[2025-04-19 00:03:36] 2025-04-19 04:03:15,652 | INFO     | -- intersect: -1490332472.6302817
[2025-04-19 00:03:36] 2025-04-19 04:03:15,652 | INFO     | intersect: -1490332472.6302817
[2025-04-19 00:03:36] 2025-04-19 04:03:15,654 | INFO     | chi2: 3.2935168490313287
[2025-04-19 00:03:36] 2025-04-19 04:03:15,654 | INFO     | current chi2=3.2935168490313287 (change=21.367727602473785 %)
[2025-04-19 00:03:36] 2025-04-19 04:03:15,654 | INFO     | left removable region: 40
[2025-04-19 00:03:36] 2025-04-19 04:03:15,656 | INFO     | sum of square deviations: 1076103343103.1337
[2025-04-19 00:03:36] 2025-04-19 04:03:15,907 | INFO     | monitor loop #4003: job 0:6605180209 is in state 'finished'
[2025-04-19 00:03:36] 2025-04-19 04:03:15,907 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2025-04-19 00:03:36] 2025-04-19 04:03:16,002 | INFO     | sum of deviations: 899319464872.8401
[2025-04-19 00:03:36] 2025-04-19 04:03:16,030 | INFO     | mean x: 1744988745.0990753
[2025-04-19 00:03:36] 2025-04-19 04:03:16,030 | INFO     | mean y: 2566980.814398943
[2025-04-19 00:03:36] 2025-04-19 04:03:16,031 | INFO     | -- intersect: -1455752384.6159408
[2025-04-19 00:03:36] 2025-04-19 04:03:16,031 | INFO     | intersect: -1455752384.6159408
[2025-04-19 00:03:36] 2025-04-19 04:03:16,033 | INFO     | chi2: 0.2461981963763137
[2025-04-19 00:03:36] 2025-04-19 04:03:16,033 | INFO     | -- intersect: -1455752384.6159408
[2025-04-19 00:03:36] 2025-04-19 04:03:16,034 | INFO     | current memory leak: 0.84 B/s (using 1514 data points, chi2=0.25)
[2025-04-19 00:03:36] 2025-04-19 04:03:16,062 | INFO     | ..............................
[2025-04-19 00:03:36] 2025-04-19 04:03:16,062 | INFO     | . Timing measurements:
[2025-04-19 00:03:36] 2025-04-19 04:03:16,062 | INFO     | . get job = 0 s
[2025-04-19 00:03:36] 2025-04-19 04:03:16,062 | INFO     | . initial setup = 6 s
[2025-04-19 00:03:36] 2025-04-19 04:03:16,062 | INFO     | . payload setup = 73 s
[2025-04-19 00:03:36] 2025-04-19 04:03:16,062 | INFO     | . stage-in = 0 s
[2025-04-19 00:03:36] 2025-04-19 04:03:16,062 | INFO     | . payload execution = 95230 s
[2025-04-19 00:03:36] 2025-04-19 04:03:16,062 | INFO     | . stage-out = 13 s
[2025-04-19 00:03:36] 2025-04-19 04:03:16,063 | INFO     | . log creation = 2 s
[2025-04-19 00:03:36] 2025-04-19 04:03:16,063 | INFO     | ..............................
[2025-04-19 00:03:36] 2025-04-19 04:03:16,251 | INFO     | 
[2025-04-19 00:03:36] 2025-04-19 04:03:16,252 | INFO     | job summary report
[2025-04-19 00:03:36] 2025-04-19 04:03:16,252 | INFO     | --------------------------------------------------
[2025-04-19 00:03:36] 2025-04-19 04:03:16,252 | INFO     | PanDA job id: 6605180209
[2025-04-19 00:03:36] 2025-04-19 04:03:16,252 | INFO     | task id: 44075483
[2025-04-19 00:03:36] 2025-04-19 04:03:16,252 | INFO     | errors: (none)
[2025-04-19 00:03:36] 2025-04-19 04:03:16,252 | INFO     | status: LOG_TRANSFER = DONE 
[2025-04-19 00:03:36] 2025-04-19 04:03:16,252 | INFO     | pilot state: finished 
[2025-04-19 00:03:36] 2025-04-19 04:03:16,253 | INFO     | transexitcode: 0
[2025-04-19 00:03:36] 2025-04-19 04:03:16,253 | INFO     | exeerrorcode: 0
[2025-04-19 00:03:36] 2025-04-19 04:03:16,253 | INFO     | exeerrordiag: 
[2025-04-19 00:03:36] 2025-04-19 04:03:16,253 | INFO     | exitcode: 0
[2025-04-19 00:03:36] 2025-04-19 04:03:16,253 | INFO     | exitmsg: OK
[2025-04-19 00:03:36] 2025-04-19 04:03:16,253 | INFO     | cpuconsumptiontime: 62107 s
[2025-04-19 00:03:36] 2025-04-19 04:03:16,253 | INFO     | nevents: 400
[2025-04-19 00:03:36] 2025-04-19 04:03:16,253 | INFO     | neventsw: 0
[2025-04-19 00:03:36] 2025-04-19 04:03:16,253 | INFO     | pid: 32720
[2025-04-19 00:03:36] 2025-04-19 04:03:16,253 | INFO     | pgrp: 32720
[2025-04-19 00:03:36] 2025-04-19 04:03:16,253 | INFO     | corecount: 10
[2025-04-19 00:03:36] 2025-04-19 04:03:16,254 | INFO     | event service: False
[2025-04-19 00:03:36] 2025-04-19 04:03:16,254 | INFO     | sizes: {0: 2426546, 1: 2426630, 2: 2426829, 14: 2426829, 25: 2426857, 36: 2426885, 40: 2427247, 47: 2427275, 95309: 2488345, 95310: 2488344, 95324: 2497341, 95328:
[2025-04-19 00:03:36] 2025-04-19 04:03:16,254 | INFO     | --------------------------------------------------
[2025-04-19 00:03:36] 2025-04-19 04:03:16,254 | INFO     | 
[2025-04-19 00:03:36] 2025-04-19 04:03:16,254 | INFO     | executing command: ls -lF /tmp/boinchome/slots/0
[2025-04-19 00:03:36] 2025-04-19 04:03:16,467 | INFO     | queue jobs had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,467 | INFO     | queue payloads had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,467 | INFO     | queue data_in had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,467 | INFO     | queue data_out had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,467 | INFO     | queue current_data_in had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,468 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,468 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,468 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,468 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,468 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,468 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,468 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,468 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,468 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,468 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,469 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,469 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,469 | INFO     | queue completed_jobids has 1 job(s)
[2025-04-19 00:03:36] 2025-04-19 04:03:16,469 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,469 | INFO     | queue messages had 0 job(s) [purged]
[2025-04-19 00:03:36] 2025-04-19 04:03:16,469 | INFO     | job 6605180209 has completed (purged errors)
[2025-04-19 00:03:36] 2025-04-19 04:03:16,469 | INFO     | overall cleanup function is called
[2025-04-19 00:03:36] 2025-04-19 04:03:17,482 | INFO     | --- collectZombieJob: --- 10, [32720]
[2025-04-19 00:03:36] 2025-04-19 04:03:17,482 | INFO     | zombie collector waiting for pid 32720
[2025-04-19 00:03:36] 2025-04-19 04:03:17,482 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2025-04-19 00:03:36] 2025-04-19 04:03:17,482 | INFO     | collected zombie processes
[2025-04-19 00:03:36] 2025-04-19 04:03:17,483 | INFO     | will attempt to kill all subprocesses of pid=32720
[2025-04-19 00:03:36] 2025-04-19 04:03:19,597 | INFO     | process IDs to be killed: [32720] (in reverse order)
[2025-04-19 00:03:36] 2025-04-19 04:03:20,793 | WARNING  | found no corresponding commands to process id(s)
[2025-04-19 00:03:36] 2025-04-19 04:03:20,794 | INFO     | Do not look for orphan processes in BOINC jobs
[2025-04-19 00:03:36] 2025-04-19 04:03:20,867 | INFO     | did not find any defunct processes belonging to 32720
[2025-04-19 00:03:36] 2025-04-19 04:03:20,963 | INFO     | did not find any defunct processes belonging to 32720
[2025-04-19 00:03:36] 2025-04-19 04:03:20,976 | INFO     | ready for new job
[2025-04-19 00:03:36] 2025-04-19 04:03:20,976 | INFO     | pilot has finished with previous job - re-establishing logging
[2025-04-19 00:03:36] 2025-04-19 04:03:21,000 | INFO     | **************************************
[2025-04-19 00:03:36] 2025-04-19 04:03:21,001 | INFO     | ***  PanDA Pilot version 3.10.2.2  ***
[2025-04-19 00:03:36] 2025-04-19 04:03:21,001 | INFO     | **************************************
[2025-04-19 00:03:36] 2025-04-19 04:03:21,001 | INFO     | 
[2025-04-19 00:03:36] 2025-04-19 04:03:21,003 | INFO     | architecture information:
[2025-04-19 00:03:36] 2025-04-19 04:03:21,017 | INFO     | executing command: cat /etc/os-release
[2025-04-19 00:03:36] 2025-04-19 04:03:21,245 | INFO     | cat /etc/os-release:
[2025-04-19 00:03:36] NAME="CentOS Linux"
[2025-04-19 00:03:36] VERSION="7 (Core)"
[2025-04-19 00:03:36] ID="centos"
[2025-04-19 00:03:36] ID_LIKE="rhel fedora"
[2025-04-19 00:03:36] VERSION_ID="7"
[2025-04-19 00:03:36] PRETTY_NAME="CentOS Linux 7 (Core)"
[2025-04-19 00:03:36] ANSI_COLOR="0;31"
[2025-04-19 00:03:36] CPE_NAME="cpe:/o:centos:centos:7"
[2025-04-19 00:03:36] HOME_URL="https://www.centos.org/"
[2025-04-19 00:03:36] BUG_REPORT_URL="https://bugs.centos.org/"
[2025-04-19 00:03:36] 
[2025-04-19 00:03:36] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2025-04-19 00:03:36] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2025-04-19 00:03:36] REDHAT_SUPPORT_PRODUCT="centos"
[2025-04-19 00:03:36] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2025-04-19 00:03:36] 
[2025-04-19 00:03:36] 2025-04-19 04:03:21,245 | INFO     | **************************************
[2025-04-19 00:03:36] 2025-04-19 04:03:21,749 | INFO     | executing command: df -mP /tmp/boinchome/slots/0
[2025-04-19 00:03:36] 2025-04-19 04:03:21,952 | INFO     | sufficient remaining disk space (57133760512 B)
[2025-04-19 00:03:36] 2025-04-19 04:03:21,953 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2025-04-19 00:03:36] 2025-04-19 04:03:21,953 | INFO     | current server update state: UPDATING_FINAL
[2025-04-19 00:03:36] 2025-04-19 04:03:21,954 | INFO     | update_server=False
[2025-04-19 00:03:36] 2025-04-19 04:03:21,954 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2025-04-19 00:03:36] 2025-04-19 04:03:21,954 | WARNING  | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2025-04-19 00:03:36] 2025-04-19 04:03:21,954 | INFO     | found 0 job(s) in 20 queues
[2025-04-19 00:03:36] 2025-04-19 04:03:21,954 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2025-04-19 00:03:36] 2025-04-19 04:03:21,954 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2025-04-19 00:03:36] 2025-04-19 04:03:21,962 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2025-04-19 00:03:36] 2025-04-19 04:03:21,962 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2025-04-19 00:03:36] 2025-04-19 04:03:21,982 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2025-04-19 00:03:36] 2025-04-19 04:03:21,982 | INFO     | aborting loop
[2025-04-19 00:03:36] 2025-04-19 04:03:21,990 | INFO     | all job control threads have been joined
[2025-04-19 00:03:36] 2025-04-19 04:03:22,502 | INFO     | all data control threads have been joined
[2025-04-19 00:03:36] 2025-04-19 04:03:22,615 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2025-04-19 00:03:36] 2025-04-19 04:03:22,812 | INFO     | all payload control threads have been joined
[2025-04-19 00:03:36] 2025-04-19 04:03:22,960 | INFO     | [job] retrieve thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:22,971 | INFO     | [job] queue monitor thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:22,988 | INFO     | [job] job monitor thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:22,996 | INFO     | [job] control thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:23,360 | INFO     | [payload] failed_post thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:23,509 | INFO     | [data] control thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:23,662 | INFO     | [job] create_data_payload thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:23,671 | INFO     | [job] validate thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:23,679 | INFO     | [payload] validate_pre thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:23,818 | INFO     | [payload] control thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:23,952 | INFO     | [payload] execute_payloads thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:23,973 | INFO     | [data] copytool_in thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:23,976 | INFO     | [data] copytool_out thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:24,082 | INFO     | [payload] run_realtimelog thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:24,223 | INFO     | [payload] validate_post thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:26,624 | INFO     | [data] queue_monitor thread has finished
[2025-04-19 00:03:36] 2025-04-19 04:03:27,726 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139915990902592)>', '<ExcThread(monitor, started 139915337660160)>']
[2025-04-19 00:03:36] 2025-04-19 04:03:27,999 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2025-04-19 00:03:36] 2025-04-19 04:03:27,999 | INFO     | [monitor] control thread has ended
[2025-04-19 00:03:36] 2025-04-19 04:03:32,752 | INFO     | all workflow threads have been joined
[2025-04-19 00:03:36] 2025-04-19 04:03:32,752 | INFO     | end of generic workflow (traces error code: 0)
[2025-04-19 00:03:36] 2025-04-19 04:03:32,753 | INFO     | traces error code: 0
[2025-04-19 00:03:36] 2025-04-19 04:03:32,753 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2025-04-19 00:03:36] 2025-04-19 04:03:34,004 [wrapper] ==== pilot stdout END ====
[2025-04-19 00:03:36] 2025-04-19 04:03:34,052 [wrapper] ==== wrapper stdout RESUME ====
[2025-04-19 00:03:36] 2025-04-19 04:03:34,102 [wrapper] pilotpid: 2914
[2025-04-19 00:03:36] 2025-04-19 04:03:34,149 [wrapper] Pilot exit status: 0
[2025-04-19 00:03:36] 2025-04-19 04:03:34,366 [wrapper] pandaids: 6605180209 6605180209 6605180209
[2025-04-19 00:03:36] 2025-04-19 04:03:34,873 [wrapper] cleanup supervisor_pilot 19334 2915
[2025-04-19 00:03:36] 2025-04-19 04:03:34,928 [wrapper] Test setup, not cleaning
[2025-04-19 00:03:36] 2025-04-19 04:03:34,974 [wrapper] apfmon messages muted
[2025-04-19 00:03:36] 2025-04-19 04:03:35,011 [wrapper] ==== wrapper stdout END ====
[2025-04-19 00:03:36] 2025-04-19 04:03:35,067 [wrapper] ==== wrapper stderr END ====
[2025-04-19 00:03:36]  *** Error codes and diagnostics ***
[2025-04-19 00:03:36]     "exeErrorCode": 0,
[2025-04-19 00:03:36]     "exeErrorDiag": "",
[2025-04-19 00:03:36]     "pilotErrorCode": 0,
[2025-04-19 00:03:36]     "pilotErrorDiag": "",
[2025-04-19 00:03:36]  *** Listing of results directory ***
[2025-04-19 00:03:36] total 648824
[2025-04-19 00:03:36] drwx------ 4 boincer umatlas      4096 Apr  3 04:00 pilot3
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas    495897 Apr 17 04:41 pilot3.tar.gz
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas      5111 Apr 17 04:42 queuedata.json
[2025-04-19 00:03:36] -rwx------ 1 boincer umatlas     37140 Apr 17 04:44 runpilot2-wrapper.sh
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas       100 Apr 17 14:06 wrapper_26015_x86_64-pc-linux-gnu
[2025-04-19 00:03:36] -rwxr-xr-x 1 boincer umatlas      7986 Apr 17 14:06 run_atlas
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas       105 Apr 17 14:06 job.xml
[2025-04-19 00:03:36] -rw-r--r-- 3 boincer umatlas 221467451 Apr 17 14:06 EVNT.44075481._002073.pool.root.1
[2025-04-19 00:03:36] -rw-r--r-- 3 boincer umatlas 221467451 Apr 17 14:06 ATLAS.root_0
[2025-04-19 00:03:36] -rw-r--r-- 2 boincer umatlas     17569 Apr 17 14:06 start_atlas.sh
[2025-04-19 00:03:36] drwxrwx--x 2 boincer umatlas      4096 Apr 17 14:06 shared
[2025-04-19 00:03:36] -rw-r--r-- 2 boincer umatlas    508894 Apr 17 14:06 input.tar.gz
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas         0 Apr 17 14:06 boinc_lockfile
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas      2578 Apr 17 21:30 pandaJob.out
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas       467 Apr 17 21:30 setup.sh.local
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas    990250 Apr 17 21:31 agis_schedconf.cvmfs.json
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas      6230 Apr 18 23:54 init_data.xml
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas 203799594 Apr 18 23:58 HITS.44075483._053188.pool.root.1
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas       532 Apr 18 23:58 boinc_task_state.xml
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas      1054 Apr 19 00:01 memory_monitor_summary.json
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas   1618536 Apr 19 00:01 agis_ddmendpoints.agis.ALL.json
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas   1008739 Apr 19 00:01 log.44075483._053188.job.log.tgz.1
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas        96 Apr 19 00:03 pilot_heartbeat.json
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas      7754 Apr 19 00:03 heartbeat.json
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas      8192 Apr 19 00:03 boinc_mmap_file
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas      4476 Apr 19 00:03 pilotlog.txt
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas        29 Apr 19 00:03 wrapper_checkpoint.txt
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas   5886141 Apr 19 00:03 log.44075483._053188.job.log.1
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas       357 Apr 19 00:03 output.list
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas       620 Apr 19 00:03 runtime_log
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas   6912000 Apr 19 00:03 result.tar.gz
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas     11506 Apr 19 00:03 runtime_log.err
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas       915 Apr 19 00:03 HPILDm91ZP7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmyTcLDmhC1cdn.diag
[2025-04-19 00:03:36] -rw-r--r-- 1 boincer umatlas     25493 Apr 19 00:03 stderr.txt
[2025-04-19 00:03:36] HITS file was successfully produced:
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas 203799594 Apr 18 23:58 shared/HITS.pool.root.1
[2025-04-19 00:03:36]  *** Contents of shared directory: ***
[2025-04-19 00:03:36] total 422580
[2025-04-19 00:03:36] -rw-r--r-- 3 boincer umatlas 221467451 Apr 17 14:06 ATLAS.root_0
[2025-04-19 00:03:36] -rw-r--r-- 2 boincer umatlas     17569 Apr 17 14:06 start_atlas.sh
[2025-04-19 00:03:36] -rw-r--r-- 2 boincer umatlas    508894 Apr 17 14:06 input.tar.gz
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas 203799594 Apr 18 23:58 HITS.pool.root.1
[2025-04-19 00:03:36] -rw------- 1 boincer umatlas   6912000 Apr 19 00:03 result.tar.gz
00:03:38 (29332): run_atlas exited; CPU time 65397.411392
00:03:38 (29332): called boinc_finish(0)

</stderr_txt>
]]>


©2025 CERN