| Name | KZrLDm98hK9n9Rq4apOajLDm4fhM0noT9bVooX4SDm0YiLDmbD2Aon_0 |
| Workunit | 239827361 |
| Created | 11 Mar 2026, 23:30:19 UTC |
| Sent | 12 Mar 2026, 4:01:24 UTC |
| Report deadline | 20 Mar 2026, 4:01:24 UTC |
| Received | 14 Mar 2026, 13:00:25 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 10878284 |
| Run time | 19 hours 48 min 29 sec |
| CPU time | 2 days 11 hours 32 min 37 sec |
| Priority | 28 |
| Validate state | Valid |
| Credit | 956.33 |
| Device peak FLOPS | 24.96 GFLOPS |
| Application version | ATLAS Simulation v3.01 (native_mt) x86_64-pc-linux-gnu |
| Peak working set size | 2.68 GB |
| Peak swap size | 31.45 GB |
| Peak disk usage | 817.88 MB |
Stderr output
<core_client_version>8.1.0</core_client_version>
<![CDATA[
<stderr_txt>
00:01:49 (3429900): wrapper (7.7.26015): starting
00:01:49 (3429900): wrapper: running run_atlas (--nthreads 8)
[2026-03-12 00:01:49] Arguments: --nthreads 8
[2026-03-12 00:01:49] Threads: 8
[2026-03-12 00:01:49] Checking for CVMFS
[2026-03-12 00:01:50] Probing /cvmfs/atlas.cern.ch... OK
[2026-03-12 00:01:51] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-03-12 00:01:51] Running cvmfs_config stat atlas.cern.ch
[2026-03-12 00:01:53] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-03-12 00:01:53] 2.13.3.0 10480 110283 400216 157181 2 550 36253156 40960000 14695 16776704 0 115471592 99.450 175874018 30207 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-03-12 00:01:53] CVMFS is ok
[2026-03-12 00:01:53] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-03-12 00:01:53] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-03-12 00:01:53] Further information can be found at the LHC@home message board.
[2026-03-12 00:01:53] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-03-12 00:01:53] Checking for apptainer binary...
[2026-03-12 00:01:53] Using apptainer found in PATH at /usr/bin/apptainer
[2026-03-12 00:01:53] Running /usr/bin/apptainer --version
[2026-03-12 00:01:53] apptainer version 1.4.5-2.el9
[2026-03-12 00:01:53] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-03-12 00:01:54] c-211-12.aglt2.org
[2026-03-12 00:01:54] apptainer works
[2026-03-12 00:01:54] Set ATHENA_PROC_NUMBER=8
[2026-03-12 00:01:54] Set ATHENA_CORE_NUMBER=8
[2026-03-12 00:01:55] Starting ATLAS job with PandaID=7050369057
[2026-03-12 00:01:55] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
06:20:12 (3429900): BOINC client no longer exists - exiting
06:20:12 (3429900): timer handler: client dead, exiting
22:37:35 (1914498): wrapper (7.7.26015): starting
22:37:35 (1914498): wrapper: running run_atlas (--nthreads 10)
[2026-03-12 22:37:35] Arguments: --nthreads 10
[2026-03-12 22:37:35] Threads: 10
[2026-03-12 22:37:35] This job has been restarted, cleaning up previous attempt
[2026-03-12 22:37:35] Checking for CVMFS
[2026-03-12 22:37:35] Probing /cvmfs/atlas.cern.ch... OK
[2026-03-12 22:37:35] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-03-12 22:37:35] Running cvmfs_config stat atlas.cern.ch
[2026-03-12 22:37:35] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-03-12 22:37:35] 2.13.3.0 10480 111639 412448 157223 2 888 34105663 40960000 11226 16776704 0 118198088 99.451 178944128 30078 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-03-12 22:37:35] CVMFS is ok
[2026-03-12 22:37:35] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-03-12 22:37:35] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-03-12 22:37:35] Further information can be found at the LHC@home message board.
[2026-03-12 22:37:35] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-03-12 22:37:35] Checking for apptainer binary...
[2026-03-12 22:37:35] Using apptainer found in PATH at /usr/bin/apptainer
[2026-03-12 22:37:35] Running /usr/bin/apptainer --version
[2026-03-12 22:37:35] apptainer version 1.4.5-2.el9
[2026-03-12 22:37:35] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-03-12 22:37:36] c-211-12.aglt2.org
[2026-03-12 22:37:36] apptainer works
[2026-03-12 22:37:36] Set ATHENA_PROC_NUMBER=10
[2026-03-12 22:37:36] Set ATHENA_CORE_NUMBER=10
[2026-03-12 22:37:36] Starting ATLAS job with PandaID=7050369057
[2026-03-12 22:37:36] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
22:47:30 (1971655): wrapper (7.7.26015): starting
22:47:30 (1971655): wrapper: running run_atlas (--nthreads 10)
[2026-03-12 22:47:30] Arguments: --nthreads 10
[2026-03-12 22:47:30] Threads: 10
[2026-03-12 22:47:30] This job has been restarted, cleaning up previous attempt
[2026-03-12 22:47:30] Checking for CVMFS
[2026-03-12 22:47:31] Probing /cvmfs/atlas.cern.ch... OK
[2026-03-12 22:47:31] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-03-12 22:47:31] Running cvmfs_config stat atlas.cern.ch
[2026-03-12 22:47:31] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-03-12 22:47:31] 2.13.3.0 10480 111649 412144 157223 0 895 34210617 40960000 12195 16776704 0 118344430 99.452 178951777 30078 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-03-12 22:47:31] CVMFS is ok
[2026-03-12 22:47:31] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-03-12 22:47:31] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-03-12 22:47:31] Further information can be found at the LHC@home message board.
[2026-03-12 22:47:31] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-03-12 22:47:31] Checking for apptainer binary...
[2026-03-12 22:47:31] Using apptainer found in PATH at /usr/bin/apptainer
[2026-03-12 22:47:31] Running /usr/bin/apptainer --version
[2026-03-12 22:47:31] apptainer version 1.4.5-2.el9
[2026-03-12 22:47:31] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-03-12 22:47:31] c-211-12.aglt2.org
[2026-03-12 22:47:31] apptainer works
[2026-03-12 22:47:31] Set ATHENA_PROC_NUMBER=10
[2026-03-12 22:47:31] Set ATHENA_CORE_NUMBER=10
[2026-03-12 22:47:31] Starting ATLAS job with PandaID=7050369057
[2026-03-12 22:47:31] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
10:30:35 (3698429): wrapper (7.7.26015): starting
10:30:35 (3698429): wrapper: running run_atlas (--nthreads 8)
[2026-03-13 10:30:35] Arguments: --nthreads 8
[2026-03-13 10:30:35] Threads: 8
[2026-03-13 10:30:35] This job has been restarted, cleaning up previous attempt
[2026-03-13 10:30:35] Checking for CVMFS
[2026-03-13 10:30:36] Probing /cvmfs/atlas.cern.ch... OK
[2026-03-13 10:30:36] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-03-13 10:30:36] Running cvmfs_config stat atlas.cern.ch
[2026-03-13 10:30:37] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-03-13 10:30:37] 2.13.3.0 10480 112352 384540 157242 2 91 24004549 40960000 12016 16776704 0 119536705 99.450 181949751 30206 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-03-13 10:30:37] CVMFS is ok
[2026-03-13 10:30:37] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-03-13 10:30:37] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-03-13 10:30:37] Further information can be found at the LHC@home message board.
[2026-03-13 10:30:37] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-03-13 10:30:37] Checking for apptainer binary...
[2026-03-13 10:30:37] Using apptainer found in PATH at /usr/bin/apptainer
[2026-03-13 10:30:37] Running /usr/bin/apptainer --version
[2026-03-13 10:30:37] apptainer version 1.4.5-2.el9
[2026-03-13 10:30:37] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-03-13 10:30:38] c-211-12.aglt2.org
[2026-03-13 10:30:38] apptainer works
[2026-03-13 10:30:38] Set ATHENA_PROC_NUMBER=8
[2026-03-13 10:30:38] Set ATHENA_CORE_NUMBER=8
[2026-03-13 10:30:38] Starting ATLAS job with PandaID=7050369057
[2026-03-13 10:30:38] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
17:01:47 (227384): wrapper (7.7.26015): starting
17:01:47 (227384): wrapper: running run_atlas (--nthreads 8)
[2026-03-13 17:01:47] Arguments: --nthreads 8
[2026-03-13 17:01:47] Threads: 8
[2026-03-13 17:01:47] This job has been restarted, cleaning up previous attempt
[2026-03-13 17:01:47] Checking for CVMFS
[2026-03-13 17:01:47] Probing /cvmfs/atlas.cern.ch... OK
[2026-03-13 17:01:48] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-03-13 17:01:48] Running cvmfs_config stat atlas.cern.ch
[2026-03-13 17:01:49] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-03-13 17:01:49] 2.13.3.0 10480 112743 385468 157253 0 231 26790858 40960001 12964 16776704 0 119874278 99.449 182393920 30197 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-03-13 17:01:49] CVMFS is ok
[2026-03-13 17:01:49] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-03-13 17:01:49] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-03-13 17:01:49] Further information can be found at the LHC@home message board.
[2026-03-13 17:01:49] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-03-13 17:01:49] Checking for apptainer binary...
[2026-03-13 17:01:49] Using apptainer found in PATH at /usr/bin/apptainer
[2026-03-13 17:01:49] Running /usr/bin/apptainer --version
[2026-03-13 17:01:49] apptainer version 1.4.5-2.el9
[2026-03-13 17:01:49] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-03-13 17:01:49] c-211-12.aglt2.org
[2026-03-13 17:01:49] apptainer works
[2026-03-13 17:01:49] Set ATHENA_PROC_NUMBER=8
[2026-03-13 17:01:49] Set ATHENA_CORE_NUMBER=8
[2026-03-13 17:01:49] Starting ATLAS job with PandaID=7050369057
[2026-03-13 17:01:49] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2026-03-14 08:58:59] *** The last 200 lines of the pilot log: ***
[2026-03-14 08:58:59] 2026-03-14 12:57:51,680 | INFO | extracted standard info from prmon json
[2026-03-14 08:58:59] 2026-03-14 12:57:51,680 | INFO | extracted standard memory fields from prmon json
[2026-03-14 08:58:59] 2026-03-14 12:57:51,700 | WARNING | GPU info not found in prmon json: 'gpu'
[2026-03-14 08:58:59] 2026-03-14 12:57:51,701 | WARNING | format EVNTtoHITS has no such key: dbData
[2026-03-14 08:58:59] 2026-03-14 12:57:51,701 | WARNING | format EVNTtoHITS has no such key: dbTime
[2026-03-14 08:58:59] 2026-03-14 12:57:51,908 | INFO | fitting pss+swap vs Time
[2026-03-14 08:58:59] 2026-03-14 12:57:51,956 | INFO | sum of square deviations: 256729713668.31366
[2026-03-14 08:58:59] 2026-03-14 12:57:52,053 | INFO | time since job start (57335s) is within the limit (345600.0s)
[2026-03-14 08:58:59] 2026-03-14 12:57:52,188 | INFO | sum of deviations: -341504456017.12463
[2026-03-14 08:58:59] 2026-03-14 12:57:52,188 | INFO | mean x: 1773464389.230032
[2026-03-14 08:58:59] 2026-03-14 12:57:52,188 | INFO | mean y: 2484779.820021299
[2026-03-14 08:58:59] 2026-03-14 12:57:52,188 | INFO | intersect: 2361565008.0331798
[2026-03-14 08:58:59] 2026-03-14 12:57:52,307 | INFO | chi2: 8.99461206635591
[2026-03-14 08:58:59] 2026-03-14 12:57:52,309 | INFO | sum of square deviations: 252650647354.15002
[2026-03-14 08:58:59] 2026-03-14 12:57:52,359 | INFO | sum of deviations: -46379150707.49908
[2026-03-14 08:58:59] 2026-03-14 12:57:52,360 | INFO | mean x: 1773464236.7344754
[2026-03-14 08:58:59] 2026-03-14 12:57:52,360 | INFO | mean y: 2495813.1552462527
[2026-03-14 08:58:59] 2026-03-14 12:57:52,360 | INFO | intersect: 328051144.0884484
[2026-03-14 08:58:59] 2026-03-14 12:57:52,442 | INFO | chi2: 5.411353864134255
[2026-03-14 08:58:59] 2026-03-14 12:57:52,442 | INFO | current chi2=5.411353864134255 (change=39.83782931144668 %)
[2026-03-14 08:58:59] 2026-03-14 12:57:52,444 | INFO | sum of square deviations: 248615137293.987
[2026-03-14 08:58:59] 2026-03-14 12:57:52,503 | INFO | sum of deviations: 252916643494.64047
[2026-03-14 08:58:59] 2026-03-14 12:57:52,503 | INFO | mean x: 1773464084.2411194
[2026-03-14 08:58:59] 2026-03-14 12:57:52,503 | INFO | mean y: 2507123.653390743
[2026-03-14 08:58:59] 2026-03-14 12:57:52,503 | INFO | intersect: -1801641201.451062
[2026-03-14 08:58:59] 2026-03-14 12:57:52,505 | INFO | chi2: 1.822419141724866
[2026-03-14 08:58:59] 2026-03-14 12:57:52,505 | INFO | current chi2=1.822419141724866 (change=66.32230699596968 %)
[2026-03-14 08:58:59] 2026-03-14 12:57:52,513 | INFO | sum of square deviations: 244622440055.6626
[2026-03-14 08:58:59] 2026-03-14 12:57:52,670 | INFO | sum of deviations: 249506414874.50647
[2026-03-14 08:58:59] 2026-03-14 12:57:52,670 | INFO | mean x: 1773463931.7402596
[2026-03-14 08:58:59] 2026-03-14 12:57:52,670 | INFO | mean y: 2506993.6396103897
[2026-03-14 08:58:59] 2026-03-14 12:57:52,670 | INFO | intersect: -1806364782.0530534
[2026-03-14 08:58:59] 2026-03-14 12:57:52,678 | INFO | chi2: 1.8221426126584424
[2026-03-14 08:58:59] 2026-03-14 12:57:52,678 | INFO | current chi2=1.8221426126584424 (change=0.015173735837848947 %)
[2026-03-14 08:58:59] 2026-03-14 12:57:52,678 | INFO | right removable region: 923
[2026-03-14 08:58:59] 2026-03-14 12:57:52,739 | INFO | sum of square deviations: 252650056993.20764
[2026-03-14 08:58:59] 2026-03-14 12:57:53,007 | INFO | monitor loop #2744: job 0:7050369057 is in state 'finished'
[2026-03-14 08:58:59] 2026-03-14 12:57:53,008 | INFO | will abort job monitoring soon since job state=finished (job is still in queue)
[2026-03-14 08:58:59] 2026-03-14 12:57:53,225 | INFO | sum of deviations: -521466828391.9336
[2026-03-14 08:58:59] 2026-03-14 12:57:53,226 | INFO | mean x: 1773464541.7366166
[2026-03-14 08:58:59] 2026-03-14 12:57:53,226 | INFO | mean y: 2491495.0653104926
[2026-03-14 08:58:59] 2026-03-14 12:57:53,226 | INFO | intersect: 3662902028.3184667
[2026-03-14 08:58:59] 2026-03-14 12:57:53,376 | INFO | chi2: 7.2608729566932695
[2026-03-14 08:58:59] 2026-03-14 12:57:53,376 | INFO | current chi2=7.2608729566932695 (change=19.275307226952474 %)
[2026-03-14 08:58:59] 2026-03-14 12:57:53,376 | INFO | left removable region: 10
[2026-03-14 08:58:59] 2026-03-14 12:57:53,377 | INFO | sum of square deviations: 235988931250.56113
[2026-03-14 08:58:59] 2026-03-14 12:57:53,980 | INFO | sum of deviations: 49589269772.59906
[2026-03-14 08:58:59] 2026-03-14 12:57:53,980 | INFO | mean x: 1773464206.248631
[2026-03-14 08:58:59] 2026-03-14 12:57:53,981 | INFO | mean y: 2514693.2792990142
[2026-03-14 08:58:59] 2026-03-14 12:57:53,981 | INFO | intersect: -370150221.5100149
[2026-03-14 08:58:59] 2026-03-14 12:57:54,113 | INFO | chi2: 0.022048455146964296
[2026-03-14 08:58:59] 2026-03-14 12:57:54,114 | INFO | current memory leak: 0.21 B/s (using 913 data points, chi2=0.02)
[2026-03-14 08:58:59] 2026-03-14 12:57:54,127 | INFO | could have reported an average CPU frequency of 2582 MHz (35 samples)
[2026-03-14 08:58:59] 2026-03-14 12:57:54,127 | INFO | ..............................
[2026-03-14 08:58:59] 2026-03-14 12:57:54,127 | INFO | . Timing measurements:
[2026-03-14 08:58:59] 2026-03-14 12:57:54,128 | INFO | . get job = 0 s
[2026-03-14 08:58:59] 2026-03-14 12:57:54,128 | INFO | . initial setup = 4 s
[2026-03-14 08:58:59] 2026-03-14 12:57:54,128 | INFO | . payload setup = 19 s
[2026-03-14 08:58:59] 2026-03-14 12:57:54,128 | INFO | . stage-in = 0 s
[2026-03-14 08:58:59] 2026-03-14 12:57:54,128 | INFO | . payload execution = 57282 s
[2026-03-14 08:58:59] 2026-03-14 12:57:54,128 | INFO | . stage-out = 17 s
[2026-03-14 08:58:59] 2026-03-14 12:57:54,128 | INFO | . log creation = 3 s
[2026-03-14 08:58:59] 2026-03-14 12:57:54,128 | INFO | ..............................
[2026-03-14 08:58:59] 2026-03-14 12:57:54,217 | INFO | time since job start (57337s) is within the limit (345600.0s)
[2026-03-14 08:58:59] 2026-03-14 12:57:56,606 | INFO | time since job start (57339s) is within the limit (345600.0s)
[2026-03-14 08:58:59] 2026-03-14 12:57:56,979 | INFO |
[2026-03-14 08:58:59] 2026-03-14 12:57:56,980 | INFO | job summary report
[2026-03-14 08:58:59] 2026-03-14 12:57:56,980 | INFO | --------------------------------------------------
[2026-03-14 08:58:59] 2026-03-14 12:57:56,980 | INFO | PanDA job id: 7050369057
[2026-03-14 08:58:59] 2026-03-14 12:57:56,980 | INFO | task id: 48967085
[2026-03-14 08:58:59] 2026-03-14 12:57:56,980 | INFO | errors: (none)
[2026-03-14 08:58:59] 2026-03-14 12:57:56,980 | INFO | status: LOG_TRANSFER = DONE
[2026-03-14 08:58:59] 2026-03-14 12:57:56,980 | INFO | pilot state: finished
[2026-03-14 08:58:59] 2026-03-14 12:57:56,980 | INFO | transexitcode: 0
[2026-03-14 08:58:59] 2026-03-14 12:57:56,980 | INFO | exeerrorcode: 0
[2026-03-14 08:58:59] 2026-03-14 12:57:56,980 | INFO | exeerrordiag:
[2026-03-14 08:58:59] 2026-03-14 12:57:56,981 | INFO | exitcode: 0
[2026-03-14 08:58:59] 2026-03-14 12:57:56,981 | INFO | exitmsg: OK
[2026-03-14 08:58:59] 2026-03-14 12:57:56,981 | INFO | cpuconsumptiontime: 68906 s
[2026-03-14 08:58:59] 2026-03-14 12:57:56,981 | INFO | nevents: 400
[2026-03-14 08:58:59] 2026-03-14 12:57:56,981 | INFO | neventsw: 0
[2026-03-14 08:58:59] 2026-03-14 12:57:56,981 | INFO | pid: 241309
[2026-03-14 08:58:59] 2026-03-14 12:57:56,981 | INFO | pgrp: 241309
[2026-03-14 08:58:59] 2026-03-14 12:57:56,981 | INFO | corecount: 8
[2026-03-14 08:58:59] 2026-03-14 12:57:56,982 | INFO | event service: False
[2026-03-14 08:58:59] 2026-03-14 12:57:56,982 | INFO | sizes: {0: 2279152, 1: 2279837, 2: 2280298, 3: 2280298, 57310: 2329274, 57328: 2338272, 57330: 2338456, 57336: 2338650}
[2026-03-14 08:58:59] 2026-03-14 12:57:56,982 | INFO | --------------------------------------------------
[2026-03-14 08:58:59] 2026-03-14 12:57:56,982 | INFO |
[2026-03-14 08:58:59] 2026-03-14 12:57:56,982 | INFO | executing command: ls -lF /tmp/boinchome/slots/5
[2026-03-14 08:58:59] 2026-03-14 12:57:57,101 | INFO | queue jobs had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,101 | INFO | queue payloads had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,101 | INFO | queue data_in had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,101 | INFO | queue data_out had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,101 | INFO | queue current_data_in had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,101 | INFO | queue validated_jobs had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,102 | INFO | queue validated_payloads had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,102 | INFO | queue monitored_payloads had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,102 | INFO | queue finished_jobs had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,102 | INFO | queue finished_payloads had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,102 | INFO | queue finished_data_in had 1 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,102 | INFO | queue finished_data_out had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,102 | INFO | queue failed_jobs had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,103 | INFO | queue failed_payloads had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,103 | INFO | queue failed_data_in had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,103 | INFO | queue failed_data_out had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,103 | INFO | queue completed_jobs had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,103 | INFO | queue completed_jobids has 1 job(s)
[2026-03-14 08:58:59] 2026-03-14 12:57:57,103 | INFO | queue realtimelog_payloads had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,103 | INFO | queue messages had 0 job(s) [purged]
[2026-03-14 08:58:59] 2026-03-14 12:57:57,104 | INFO | job 7050369057 has completed (purged errors)
[2026-03-14 08:58:59] 2026-03-14 12:57:57,104 | INFO | overall cleanup function is called
[2026-03-14 08:58:59] 2026-03-14 12:57:58,133 | INFO | --- collectZombieJob: --- 10, [241309]
[2026-03-14 08:58:59] 2026-03-14 12:57:58,134 | INFO | zombie collector waiting for pid 241309
[2026-03-14 08:58:59] 2026-03-14 12:57:58,134 | INFO | harmless exception when collecting zombies: [Errno 10] No child processes
[2026-03-14 08:58:59] 2026-03-14 12:57:58,134 | INFO | collected zombie processes
[2026-03-14 08:58:59] 2026-03-14 12:57:58,134 | INFO | will attempt to kill all subprocesses of pid=241309
[2026-03-14 08:58:59] 2026-03-14 12:58:01,959 | INFO | process IDs to be killed: [241309] (in reverse order)
[2026-03-14 08:58:59] 2026-03-14 12:58:02,639 | WARNING | found no corresponding commands to process id(s)
[2026-03-14 08:58:59] 2026-03-14 12:58:02,645 | INFO | Do not look for orphan processes in BOINC jobs
[2026-03-14 08:58:59] 2026-03-14 12:58:02,766 | INFO | did not find any defunct processes belonging to 241309
[2026-03-14 08:58:59] 2026-03-14 12:58:02,779 | INFO | did not find any defunct processes belonging to 241309
[2026-03-14 08:58:59] 2026-03-14 12:58:02,780 | INFO | ready for new job
[2026-03-14 08:58:59] 2026-03-14 12:58:02,780 | INFO | pilot has finished with previous job - re-establishing logging
[2026-03-14 08:58:59] 2026-03-14 12:58:02,783 | INFO | **************************************
[2026-03-14 08:58:59] 2026-03-14 12:58:02,784 | INFO | *** PanDA Pilot version 3.11.5.1 ***
[2026-03-14 08:58:59] 2026-03-14 12:58:02,784 | INFO | **************************************
[2026-03-14 08:58:59] 2026-03-14 12:58:02,784 | INFO |
[2026-03-14 08:58:59] 2026-03-14 12:58:02,787 | INFO | architecture information:
[2026-03-14 08:58:59] 2026-03-14 12:58:02,787 | INFO | executing command: cat /etc/os-release
[2026-03-14 08:58:59] 2026-03-14 12:58:02,949 | INFO | cat /etc/os-release:
[2026-03-14 08:58:59] NAME="CentOS Linux"
[2026-03-14 08:58:59] VERSION="7 (Core)"
[2026-03-14 08:58:59] ID="centos"
[2026-03-14 08:58:59] ID_LIKE="rhel fedora"
[2026-03-14 08:58:59] VERSION_ID="7"
[2026-03-14 08:58:59] PRETTY_NAME="CentOS Linux 7 (Core)"
[2026-03-14 08:58:59] ANSI_COLOR="0;31"
[2026-03-14 08:58:59] CPE_NAME="cpe:/o:centos:centos:7"
[2026-03-14 08:58:59] HOME_URL="https://www.centos.org/"
[2026-03-14 08:58:59] BUG_REPORT_URL="https://bugs.centos.org/"
[2026-03-14 08:58:59]
[2026-03-14 08:58:59] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2026-03-14 08:58:59] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2026-03-14 08:58:59] REDHAT_SUPPORT_PRODUCT="centos"
[2026-03-14 08:58:59] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2026-03-14 08:58:59]
[2026-03-14 08:58:59] 2026-03-14 12:58:02,949 | INFO | **************************************
[2026-03-14 08:58:59] 2026-03-14 12:58:03,498 | INFO | executing command: df -mP /tmp/boinchome/slots/5
[2026-03-14 08:58:59] 2026-03-14 12:58:03,719 | INFO | sufficient remaining disk space (59543388160 B)
[2026-03-14 08:58:59] 2026-03-14 12:58:03,719 | WARNING | since timefloor is set to 0, pilot was only allowed to run one job
[2026-03-14 08:58:59] 2026-03-14 12:58:03,719 | INFO | current server update state: UPDATING_FINAL
[2026-03-14 08:58:59] 2026-03-14 12:58:03,720 | INFO | update_server=False
[2026-03-14 08:58:59] 2026-03-14 12:58:03,720 | WARNING | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2026-03-14 08:58:59] 2026-03-14 12:58:03,969 | INFO | all payload control threads have been joined
[2026-03-14 08:58:59] 2026-03-14 12:58:04,238 | WARNING | data:copytool_out:received graceful stop - abort after this iteration
[2026-03-14 08:58:59] 2026-03-14 12:58:04,494 | INFO | all data control threads have been joined
[2026-03-14 08:58:59] 2026-03-14 12:58:04,728 | INFO | [job] retrieve thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:04,735 | WARNING | job:job_monitor:received graceful stop - abort after this iteration
[2026-03-14 08:58:59] 2026-03-14 12:58:04,736 | INFO | aborting loop
[2026-03-14 08:58:59] 2026-03-14 12:58:04,785 | INFO | all job control threads have been joined
[2026-03-14 08:58:59] 2026-03-14 12:58:04,815 | INFO | [payload] execute_payloads thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:04,826 | INFO | [job] validate thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:04,847 | INFO | [data] copytool_in thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:05,018 | INFO | [payload] control thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:05,195 | INFO | [payload] validate_pre thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:05,244 | INFO | [job] create_data_payload thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:05,448 | INFO | [payload] validate_post thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:05,500 | INFO | [data] control thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:05,597 | INFO | [payload] run_realtimelog thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:05,741 | INFO | [job] job monitor thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:05,790 | INFO | [job] control thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:06,132 | WARNING | job:queue_monitor:received graceful stop - abort after this iteration
[2026-03-14 08:58:59] 2026-03-14 12:58:06,138 | WARNING | data:queue_monitoring:received graceful stop - abort after this iteration
[2026-03-14 08:58:59] 2026-03-14 12:58:06,263 | INFO | [data] copytool_out thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:06,282 | INFO | [payload] failed_post thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:07,138 | INFO | [job] queue monitor thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:10,195 | INFO | [data] queue_monitor thread has finished
[2026-03-14 08:58:59] 2026-03-14 12:58:13,404 | INFO | [monitor] cgroup control has ended
[2026-03-14 08:58:59] 2026-03-14 12:58:14,719 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139822298097472)>', '<ExcThread(monitor, started 139821846619904)>']
[2026-03-14 08:58:59] 2026-03-14 12:58:19,745 | INFO | all workflow threads have been joined
[2026-03-14 08:58:59] 2026-03-14 12:58:19,746 | INFO | end of generic workflow (traces error code: 0)
[2026-03-14 08:58:59] 2026-03-14 12:58:19,746 | INFO | traces error code: 0
[2026-03-14 08:58:59] 2026-03-14 12:58:19,746 | INFO | pilot has finished (exit code=0, shell exit code=0)
[2026-03-14 08:58:59] 2026-03-14 12:58:51,739 | INFO | PID=235177 has CPU usage=3.8% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i PR
[2026-03-14 08:58:59] 2026-03-14 12:58:51,739 | INFO | .. there are 19 such processes running
[2026-03-14 08:58:59] 2026-03-14 12:58:51,740 | INFO | found 0 job(s) in 20 queues
[2026-03-14 08:58:59] 2026-03-14 12:58:51,740 | WARNING | pilot monitor received instruction that args.graceful_stop has been set
[2026-03-14 08:58:59] 2026-03-14 12:58:51,741 | WARNING | will wait for a maximum of 300 s for threads to finish
[2026-03-14 08:58:59] 2026-03-14 12:58:51,741 | WARNING | job_aborted has been set - aborting pilot monitoring
[2026-03-14 08:58:59] 2026-03-14 12:58:51,741 | INFO | [monitor] control thread has ended
[2026-03-14 08:58:59] 2026-03-14 12:58:56,429 [wrapper] ==== pilot stdout END ====
[2026-03-14 08:58:59] 2026-03-14 12:58:56,468 [wrapper] ==== wrapper stdout RESUME ====
[2026-03-14 08:58:59] 2026-03-14 12:58:56,540 [wrapper] pilotpid: 235177
[2026-03-14 08:58:59] 2026-03-14 12:58:56,676 [wrapper] Pilot exit status: 0
[2026-03-14 08:58:59] 2026-03-14 12:58:56,825 [wrapper] pandaids: 7050369057 7050369057 7050369057 7050369057 7050369057
[2026-03-14 08:58:59] 2026-03-14 12:58:57,847 [wrapper] cleanup supervisor_pilot 1739756 235178
[2026-03-14 08:58:59] 2026-03-14 12:58:57,887 [wrapper] Test setup, not cleaning
[2026-03-14 08:58:59] 2026-03-14 12:58:57,955 [wrapper] apfmon messages muted
[2026-03-14 08:58:59] 2026-03-14 12:58:58,011 [wrapper] ==== wrapper stdout END ====
[2026-03-14 08:58:59] 2026-03-14 12:58:58,049 [wrapper] ==== wrapper stderr END ====
[2026-03-14 08:58:59] *** Error codes and diagnostics ***
[2026-03-14 08:58:59] "exeErrorCode": 0,
[2026-03-14 08:58:59] "exeErrorDiag": "",
[2026-03-14 08:58:59] "pilotErrorCode": 0,
[2026-03-14 08:58:59] "pilotErrorDiag": "",
[2026-03-14 08:58:59] *** Listing of results directory ***
[2026-03-14 08:58:59] total 624264
[2026-03-14 08:58:59] drwx------. 5 boincer umatlas 4096 Mar 10 12:00 pilot3
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 585013 Mar 11 19:24 pilot3.tar.gz
[2026-03-14 08:58:59] -rwx------. 1 boincer umatlas 36322 Mar 11 19:27 runpilot2-wrapper.sh
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 5111 Mar 11 19:29 queuedata.json
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 100 Mar 12 00:01 wrapper_26015_x86_64-pc-linux-gnu
[2026-03-14 08:58:59] -rwxr-xr-x. 1 boincer umatlas 7986 Mar 12 00:01 run_atlas
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 105 Mar 12 00:01 job.xml
[2026-03-14 08:58:59] -rw-r--r--. 3 boincer umatlas 212380837 Mar 12 00:01 EVNT.48967083._000506.pool.root.1
[2026-03-14 08:58:59] -rw-r--r--. 3 boincer umatlas 212380837 Mar 12 00:01 ATLAS.root_0
[2026-03-14 08:58:59] -rw-r--r--. 2 boincer umatlas 15845 Mar 12 00:01 start_atlas.sh
[2026-03-14 08:58:59] drwxrwx--x. 2 boincer umatlas 4096 Mar 12 00:01 shared
[2026-03-14 08:58:59] -rw-r--r--. 2 boincer umatlas 597524 Mar 12 00:01 input.tar.gz
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 0 Mar 12 00:01 boinc_lockfile
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 0 Mar 12 22:37 wrapper_sigint_1918223
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 2563 Mar 13 17:01 pandaJob.out
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 57 Mar 13 17:01 setup.sh.local
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 1006721 Mar 13 17:02 agis_schedconf.cvmfs.json
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 435 Mar 13 17:02 workernode_map.json
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 196342380 Mar 14 08:46 HITS.48967085._012231.pool.root.1
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 532 Mar 14 08:47 boinc_task_state.xml
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 1050 Mar 14 08:57 memory_monitor_summary.json
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 1511579 Mar 14 08:57 agis_ddmendpoints.agis.ALL.json
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 924723 Mar 14 08:57 log.48967085._012231.job.log.tgz.1
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 6406 Mar 14 08:57 heartbeat.json
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 6614 Mar 14 08:58 init_data.xml
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 98 Mar 14 08:58 pilot_heartbeat.json
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 822 Mar 14 08:58 pilotlog.txt
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 6180246 Mar 14 08:58 log.48967085._012231.job.log.1
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 357 Mar 14 08:58 output.list
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 8192 Mar 14 08:58 boinc_mmap_file
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 29 Mar 14 08:58 wrapper_checkpoint.txt
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 620 Mar 14 08:58 runtime_log
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 7127040 Mar 14 08:58 result.tar.gz
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 9427 Mar 14 08:58 runtime_log.err
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 1160 Mar 14 08:58 KZrLDm98hK9n9Rq4apOajLDm4fhM0noT9bVooX4SDm0YiLDmbD2Aon.diag
[2026-03-14 08:58:59] -rw-r--r--. 1 boincer umatlas 10896 Mar 14 08:58 stderr.txt
[2026-03-14 08:58:59] HITS file was successfully produced:
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 196342380 Mar 14 08:46 shared/HITS.pool.root.1
[2026-03-14 08:58:59] *** Contents of shared directory: ***
[2026-03-14 08:58:59] total 406716
[2026-03-14 08:58:59] -rw-r--r--. 3 boincer umatlas 212380837 Mar 12 00:01 ATLAS.root_0
[2026-03-14 08:58:59] -rw-r--r--. 2 boincer umatlas 15845 Mar 12 00:01 start_atlas.sh
[2026-03-14 08:58:59] -rw-r--r--. 2 boincer umatlas 597524 Mar 12 00:01 input.tar.gz
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 196342380 Mar 14 08:46 HITS.pool.root.1
[2026-03-14 08:58:59] -rw-------. 1 boincer umatlas 7127040 Mar 14 08:58 result.tar.gz
08:59:00 (227384): run_atlas exited; CPU time 71225.448190
08:59:00 (227384): called boinc_finish(0)
</stderr_txt>
]]>
©2026 CERN