| Name | YCEODmFktF9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmzI3KDm2U4JYm_1 |
| Workunit | 239408678 |
| Created | 26 Feb 2026, 22:06:19 UTC |
| Sent | 26 Feb 2026, 22:15:03 UTC |
| Report deadline | 6 Mar 2026, 22:15:03 UTC |
| Received | 28 Feb 2026, 19:36:46 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 195 (0x000000C3) EXIT_CHILD_FAILED |
| Computer ID | 10856839 |
| Run time | 1 days 13 hours 14 min 12 sec |
| CPU time | 3 days 21 hours 15 min 12 sec |
| Priority | 28 |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 8.93 GFLOPS |
| Application version | ATLAS Simulation v3.01 (native_mt) x86_64-pc-linux-gnu |
| Peak working set size | 2.65 GB |
| Peak swap size | 31.52 GB |
| Peak disk usage | 917.89 MB |
Stderr output
<core_client_version>8.1.0</core_client_version>
<![CDATA[
<message>
process exited with code 195 (0xc3, -61)</message>
<stderr_txt>
17:15:22 (2920216): wrapper (7.7.26015): starting
17:15:22 (2920216): wrapper: running run_atlas (--nthreads 8)
[2026-02-26 17:15:22] Arguments: --nthreads 8
[2026-02-26 17:15:22] Threads: 8
[2026-02-26 17:15:22] Checking for CVMFS
[2026-02-26 17:15:23] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-26 17:15:23] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-26 17:15:23] Running cvmfs_config stat atlas.cern.ch
[2026-02-26 17:15:25] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-26 17:15:25] 2.13.3.0 16294 21775 255388 156667 1 372 31553837 32935937 30833 16776704 0 23707360 99.438 34328190 13422 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-02-26 17:15:25] CVMFS is ok
[2026-02-26 17:15:25] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-26 17:15:25] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-26 17:15:25] Further information can be found at the LHC@home message board.
[2026-02-26 17:15:25] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-26 17:15:25] Checking for apptainer binary...
[2026-02-26 17:15:25] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-26 17:15:25] Running /usr/bin/apptainer --version
[2026-02-26 17:15:25] apptainer version 1.4.5-2.el9
[2026-02-26 17:15:25] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-26 17:15:26] c6-12-25-4.aglt2.org
[2026-02-26 17:15:26] apptainer works
[2026-02-26 17:15:26] Set ATHENA_PROC_NUMBER=8
[2026-02-26 17:15:26] Set ATHENA_CORE_NUMBER=8
[2026-02-26 17:15:27] Starting ATLAS job with PandaID=7030828711
[2026-02-26 17:15:27] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
05:40:09 (2920216): BOINC client no longer exists - exiting
05:40:09 (2920216): timer handler: client dead, exiting
06:27:25 (885089): wrapper (7.7.26015): starting
06:27:25 (885089): wrapper: running run_atlas (--nthreads 8)
[2026-02-27 06:27:25] Arguments: --nthreads 8
[2026-02-27 06:27:25] Threads: 8
[2026-02-27 06:27:25] This job has been restarted, cleaning up previous attempt
[2026-02-27 06:27:25] Checking for CVMFS
[2026-02-27 06:27:27] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-27 06:27:27] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-27 06:27:27] Running cvmfs_config stat atlas.cern.ch
[2026-02-27 06:27:30] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-27 06:27:30] 2.13.3.0 16294 22567 247792 156693 0 76 30073337 32935936 30401 16776704 0 25160131 99.404 37614182 13232 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-02-27 06:27:30] CVMFS is ok
[2026-02-27 06:27:30] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-27 06:27:30] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-27 06:27:30] Further information can be found at the LHC@home message board.
[2026-02-27 06:27:30] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-27 06:27:30] Checking for apptainer binary...
[2026-02-27 06:27:30] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-27 06:27:30] Running /usr/bin/apptainer --version
[2026-02-27 06:27:30] apptainer version 1.4.5-2.el9
[2026-02-27 06:27:30] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-27 06:27:31] c6-12-25-4.aglt2.org
[2026-02-27 06:27:31] apptainer works
[2026-02-27 06:27:31] Set ATHENA_PROC_NUMBER=8
[2026-02-27 06:27:31] Set ATHENA_CORE_NUMBER=8
[2026-02-27 06:27:31] Starting ATLAS job with PandaID=7030828711
[2026-02-27 06:27:31] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
07:20:16 (885089): BOINC client no longer exists - exiting
07:20:16 (885089): timer handler: client dead, exiting
07:21:19 (1075200): wrapper (7.7.26015): starting
07:21:19 (1075200): wrapper: running run_atlas (--nthreads 8)
[2026-02-27 07:21:19] Arguments: --nthreads 8
[2026-02-27 07:21:19] Threads: 8
[2026-02-27 07:21:19] This job has been restarted, cleaning up previous attempt
[2026-02-27 07:21:19] Checking for CVMFS
[2026-02-27 07:21:20] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-27 07:21:20] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-27 07:21:20] Running cvmfs_config stat atlas.cern.ch
[2026-02-27 07:21:21] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-27 07:21:21] 2.13.3.0 16294 22621 249036 156695 2 111 30392769 32935936 30382 16776704 0 25353380 99.409 37645854 13232 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-02-27 07:21:21] CVMFS is ok
[2026-02-27 07:21:21] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-27 07:21:21] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-27 07:21:21] Further information can be found at the LHC@home message board.
[2026-02-27 07:21:21] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-27 07:21:21] Checking for apptainer binary...
[2026-02-27 07:21:21] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-27 07:21:21] Running /usr/bin/apptainer --version
[2026-02-27 07:21:21] apptainer version 1.4.5-2.el9
[2026-02-27 07:21:21] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-27 07:21:22] c6-12-25-4.aglt2.org
[2026-02-27 07:21:22] apptainer works
[2026-02-27 07:21:23] Set ATHENA_PROC_NUMBER=8
[2026-02-27 07:21:23] Set ATHENA_CORE_NUMBER=8
[2026-02-27 07:21:23] Starting ATLAS job with PandaID=7030828711
[2026-02-27 07:21:23] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
09:00:10 (1075200): BOINC client no longer exists - exiting
09:00:10 (1075200): timer handler: client dead, exiting
09:11:19 (1482501): wrapper (7.7.26015): starting
09:11:19 (1482501): wrapper: running run_atlas (--nthreads 8)
[2026-02-27 09:11:20] Arguments: --nthreads 8
[2026-02-27 09:11:20] Threads: 8
[2026-02-27 09:11:20] This job has been restarted, cleaning up previous attempt
[2026-02-27 09:11:20] Checking for CVMFS
[2026-02-27 09:11:21] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-27 09:11:21] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-27 09:11:21] Running cvmfs_config stat atlas.cern.ch
[2026-02-27 09:11:23] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-27 09:11:23] 2.13.3.0 16294 22731 259312 156696 0 429 31968150 32935936 28427 16776704 0 25817168 99.411 38073853 13199 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-02-27 09:11:23] CVMFS is ok
[2026-02-27 09:11:23] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-27 09:11:23] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-27 09:11:23] Further information can be found at the LHC@home message board.
[2026-02-27 09:11:23] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-27 09:11:23] Checking for apptainer binary...
[2026-02-27 09:11:23] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-27 09:11:23] Running /usr/bin/apptainer --version
[2026-02-27 09:11:24] apptainer version 1.4.5-2.el9
[2026-02-27 09:11:24] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-27 09:11:25] c6-12-25-4.aglt2.org
[2026-02-27 09:11:25] apptainer works
[2026-02-27 09:11:25] Set ATHENA_PROC_NUMBER=8
[2026-02-27 09:11:25] Set ATHENA_CORE_NUMBER=8
[2026-02-27 09:11:25] Starting ATLAS job with PandaID=7030828711
[2026-02-27 09:11:25] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
10:20:07 (1482501): BOINC client no longer exists - exiting
10:20:07 (1482501): timer handler: client dead, exiting
10:27:14 (1787142): wrapper (7.7.26015): starting
10:27:14 (1787142): wrapper: running run_atlas (--nthreads 8)
[2026-02-27 10:27:14] Arguments: --nthreads 8
[2026-02-27 10:27:14] Threads: 8
[2026-02-27 10:27:14] This job has been restarted, cleaning up previous attempt
[2026-02-27 10:27:14] Checking for CVMFS
[2026-02-27 10:27:15] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-27 10:27:16] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-27 10:27:16] Running cvmfs_config stat atlas.cern.ch
[2026-02-27 10:27:18] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-27 10:27:18] 2.13.3.0 16294 22807 256436 156700 1 367 32782384 32935937 28311 16776704 0 26202054 99.417 38309322 13187 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-02-27 10:27:18] CVMFS is ok
[2026-02-27 10:27:18] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-27 10:27:18] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-27 10:27:18] Further information can be found at the LHC@home message board.
[2026-02-27 10:27:18] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-27 10:27:18] Checking for apptainer binary...
[2026-02-27 10:27:18] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-27 10:27:18] Running /usr/bin/apptainer --version
[2026-02-27 10:27:18] apptainer version 1.4.5-2.el9
[2026-02-27 10:27:18] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-27 10:27:19] c6-12-25-4.aglt2.org
[2026-02-27 10:27:19] apptainer works
[2026-02-27 10:27:20] Set ATHENA_PROC_NUMBER=8
[2026-02-27 10:27:20] Set ATHENA_CORE_NUMBER=8
[2026-02-27 10:27:20] Starting ATLAS job with PandaID=7030828711
[2026-02-27 10:27:20] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
00:40:08 (1787142): BOINC client no longer exists - exiting
00:40:08 (1787142): timer handler: client dead, exiting
00:49:36 (218177): wrapper (7.7.26015): starting
00:49:36 (218177): wrapper: running run_atlas (--nthreads 8)
[2026-02-28 00:49:36] Arguments: --nthreads 8
[2026-02-28 00:49:36] Threads: 8
[2026-02-28 00:49:36] This job has been restarted, cleaning up previous attempt
[2026-02-28 00:49:36] Checking for CVMFS
[2026-02-28 00:49:38] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-28 00:49:39] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-28 00:49:39] Running cvmfs_config stat atlas.cern.ch
[2026-02-28 00:49:40] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-28 00:49:40] 2.13.3.0 16294 23669 259816 156722 1 440 26551444 32935937 32925 16776704 0 28407759 99.431 40807878 13024 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-02-28 00:49:40] CVMFS is ok
[2026-02-28 00:49:40] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-28 00:49:40] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-28 00:49:40] Further information can be found at the LHC@home message board.
[2026-02-28 00:49:40] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-28 00:49:40] Checking for apptainer binary...
[2026-02-28 00:49:40] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-28 00:49:40] Running /usr/bin/apptainer --version
[2026-02-28 00:49:41] apptainer version 1.4.5-2.el9
[2026-02-28 00:49:41] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-28 00:49:43] c6-12-25-4.aglt2.org
[2026-02-28 00:49:43] apptainer works
[2026-02-28 00:49:43] Set ATHENA_PROC_NUMBER=8
[2026-02-28 00:49:43] Set ATHENA_CORE_NUMBER=8
[2026-02-28 00:49:43] Starting ATLAS job with PandaID=7030828711
[2026-02-28 00:49:43] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
04:20:14 (218177): BOINC client no longer exists - exiting
04:20:14 (218177): timer handler: client dead, exiting
04:30:49 (948014): wrapper (7.7.26015): starting
04:30:49 (948014): wrapper: running run_atlas (--nthreads 8)
[2026-02-28 04:30:49] Arguments: --nthreads 8
[2026-02-28 04:30:49] Threads: 8
[2026-02-28 04:30:49] This job has been restarted, cleaning up previous attempt
[2026-02-28 04:30:49] Checking for CVMFS
[2026-02-28 04:30:50] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-28 04:30:51] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-28 04:30:51] Running cvmfs_config stat atlas.cern.ch
[2026-02-28 04:30:53] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-28 04:30:53] 2.13.3.0 16294 23890 256692 156727 1 264 28941835 32935936 30054 16776704 0 28988467 99.439 41392918 13096 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-02-28 04:30:53] CVMFS is ok
[2026-02-28 04:30:53] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-28 04:30:53] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-28 04:30:53] Further information can be found at the LHC@home message board.
[2026-02-28 04:30:53] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-28 04:30:53] Checking for apptainer binary...
[2026-02-28 04:30:53] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-28 04:30:53] Running /usr/bin/apptainer --version
[2026-02-28 04:30:53] apptainer version 1.4.5-2.el9
[2026-02-28 04:30:53] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-28 04:30:55] c6-12-25-4.aglt2.org
[2026-02-28 04:30:55] apptainer works
[2026-02-28 04:30:55] Set ATHENA_PROC_NUMBER=8
[2026-02-28 04:30:55] Set ATHENA_CORE_NUMBER=8
[2026-02-28 04:30:55] Starting ATLAS job with PandaID=7030828711
[2026-02-28 04:30:55] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
07:40:07 (948014): BOINC client no longer exists - exiting
07:40:07 (948014): timer handler: client dead, exiting
07:45:16 (1636213): wrapper (7.7.26015): starting
07:45:16 (1636213): wrapper: running run_atlas (--nthreads 10)
[2026-02-28 07:45:16] Arguments: --nthreads 10
[2026-02-28 07:45:16] Threads: 10
[2026-02-28 07:45:16] This job has been restarted, cleaning up previous attempt
[2026-02-28 07:45:16] Checking for CVMFS
[2026-02-28 07:45:17] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-28 07:45:17] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-28 07:45:17] Running cvmfs_config stat atlas.cern.ch
[2026-02-28 07:45:19] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-28 07:45:19] 2.13.3.0 16294 24085 275236 156733 3 773 31832459 32935936 30945 16776704 0 29657711 99.435 42890039 13251 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.239:6081 1
[2026-02-28 07:45:19] CVMFS is ok
[2026-02-28 07:45:19] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-28 07:45:19] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-28 07:45:19] Further information can be found at the LHC@home message board.
[2026-02-28 07:45:19] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-28 07:45:19] Checking for apptainer binary...
[2026-02-28 07:45:19] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-28 07:45:19] Running /usr/bin/apptainer --version
[2026-02-28 07:45:19] apptainer version 1.4.5-2.el9
[2026-02-28 07:45:19] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-28 07:45:19] c6-12-25-4.aglt2.org
[2026-02-28 07:45:19] apptainer works
[2026-02-28 07:45:20] Set ATHENA_PROC_NUMBER=10
[2026-02-28 07:45:20] Set ATHENA_CORE_NUMBER=10
[2026-02-28 07:45:20] Starting ATLAS job with PandaID=7030828711
[2026-02-28 07:45:20] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2026-02-28 14:24:49] Job failed
[2026-02-28 14:24:49] ++ pwd
[2026-02-28 14:24:49] + export RUNTIME_CONFIG_DIR=/tmp/boinchome/slots/5/
[2026-02-28 14:24:49] + RUNTIME_CONFIG_DIR=/tmp/boinchome/slots/5/
[2026-02-28 14:24:49] + mv ATLAS.root_0 EVNT.48220245._000047.pool.root.1
[2026-02-28 14:24:49] mv: ‘ATLAS.root_0’ and ‘EVNT.48220245._000047.pool.root.1’ are the same file
[2026-02-28 14:24:49] + tar --strip-components=5 -xvf input.tar.gz
[2026-02-28 14:24:49] + umask 077
[2026-02-28 14:24:49] ++ date +%s
[2026-02-28 14:24:49] + ACCOUNTING_STARTTIME=1772282720
[2026-02-28 14:24:49] + echo 'Detecting resource accounting method available for the job.'
[2026-02-28 14:24:49] Detecting resource accounting method available for the job.
[2026-02-28 14:24:49] + JOB_ACCOUNTING=
[2026-02-28 14:24:49] + command -v arc-job-cgroup
[2026-02-28 14:24:49] + '[' -z '' ']'
[2026-02-28 14:24:49] + GNU_TIME=/usr/bin/time
[2026-02-28 14:24:49] + echo 'Looking for /usr/bin/time tool for accounting measurements'
[2026-02-28 14:24:49] Looking for /usr/bin/time tool for accounting measurements
[2026-02-28 14:24:49] + '[' '!' -z /usr/bin/time ']'
[2026-02-28 14:24:49] + /usr/bin/time --version
[2026-02-28 14:24:49] + echo 'GNU time found and will be used for job accounting.'
[2026-02-28 14:24:49] GNU time found and will be used for job accounting.
[2026-02-28 14:24:49] + JOB_ACCOUNTING=gnutime
[2026-02-28 14:24:49] + '[' -z gnutime ']'
[2026-02-28 14:24:49] + export PANDA_JSID=harvester-CERN_central_ACTA
[2026-02-28 14:24:49] + PANDA_JSID=harvester-CERN_central_ACTA
[2026-02-28 14:24:49] + export GTAG=http://aipanda403.cern.ch/data/jobs/2026-02-26/BOINC_MCORE/7030828711.out
[2026-02-28 14:24:49] + GTAG=http://aipanda403.cern.ch/data/jobs/2026-02-26/BOINC_MCORE/7030828711.out
[2026-02-28 14:24:49] + export PILOT_NOKILL=YES
[2026-02-28 14:24:49] + PILOT_NOKILL=YES
[2026-02-28 14:24:49] + export GRID_GLOBAL_JOBID=YCEODmFktF9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmzI3KDm2U4JYm
[2026-02-28 14:24:49] + GRID_GLOBAL_JOBID=YCEODmFktF9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmzI3KDm2U4JYm
[2026-02-28 14:24:49] + export GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/YCEODmFktF9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmzI3KDm2U4JYm
[2026-02-28 14:24:49] + GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/YCEODmFktF9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmzI3KDm2U4JYm
[2026-02-28 14:24:49] + export GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2026-02-28 14:24:49] + GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2026-02-28 14:24:49] + export GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2026-02-28 14:24:49] + GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2026-02-28 14:24:49] ++ pwd
[2026-02-28 14:24:49] + RUNTIME_JOB_DIR=/tmp/boinchome/slots/5
[2026-02-28 14:24:49] + RUNTIME_JOB_STDIN=/dev/null
[2026-02-28 14:24:49] ++ pwd
[2026-02-28 14:24:49] + RUNTIME_JOB_STDOUT=/tmp/boinchome/slots/5/log.48838600._001068.job.log.1
[2026-02-28 14:24:49] ++ pwd
[2026-02-28 14:24:49] + RUNTIME_JOB_STDERR=/tmp/boinchome/slots/5/log.48838600._001068.job.log.1
[2026-02-28 14:24:49] ++ pwd
[2026-02-28 14:24:49] + RUNTIME_JOB_DIAG=/tmp/boinchome/slots/5.diag
[2026-02-28 14:24:49] + '[' '!' -z '' ']'
[2026-02-28 14:24:49] + RUNTIME_LOCAL_SCRATCH_DIR=
[2026-02-28 14:24:49] + RUNTIME_LOCAL_SCRATCH_MOVE_TOOL=mv
[2026-02-28 14:24:49] + RUNTIME_FRONTEND_SEES_NODE=
[2026-02-28 14:24:49] + RUNTIME_NODE_SEES_FRONTEND=yes
[2026-02-28 14:24:49] + '[' '!' -z '' ']'
[2026-02-28 14:24:49] + '[' -z yes ']'
[2026-02-28 14:24:49] ++ pwd
[2026-02-28 14:24:49] + RUNTIME_JOB_DIAG=/tmp/boinchome/slots/5/YCEODmFktF9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmzI3KDm2U4JYm.diag
[2026-02-28 14:24:49] + runtimeenvironments=
[2026-02-28 14:24:49] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2026-02-28 14:24:49] + RTE_function_0 1
[2026-02-28 14:24:49] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-28 14:24:49] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-28 14:24:49] + export BOINC_APP=ATLAS
[2026-02-28 14:24:49] + BOINC_APP=ATLAS
[2026-02-28 14:24:49] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-28 14:24:49] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-28 14:24:49] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-28 14:24:49] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-28 14:24:49] + '[' -z 1 ']'
[2026-02-28 14:24:49] + '[' 1 == 1 ']'
[2026-02-28 14:24:49] + shift
[2026-02-28 14:24:49] + export SITE_NAME=BOINC
[2026-02-28 14:24:49] + SITE_NAME=BOINC
[2026-02-28 14:24:49] + export ATLAS_LOCAL_AREA=/tmp/boinchome/slots/5/
[2026-02-28 14:24:49] + ATLAS_LOCAL_AREA=/tmp/boinchome/slots/5/
[2026-02-28 14:24:49] + '[' -e /tmp/boinchome/slots/5/init_data.xml ']'
[2026-02-28 14:24:49] + grep '<use_http_proxy/>' /tmp/boinchome/slots/5/init_data.xml
[2026-02-28 14:24:49] ++ sed -e '/<proxy_info>/,/<\/proxy_info>/ s/^.*<http_server_name>\([^<]*\).*/\1/p' -n /tmp/boinchome/slots/5/init_data.xml
[2026-02-28 14:24:49] + PROXY_HOST=sl-um-es2.slateci.io
[2026-02-28 14:24:49] ++ sed -e '/<proxy_info>/,/<\/proxy_info>/ s/^.*<http_server_port>\([^<]*\).*/\1/p' -n /tmp/boinchome/slots/5/init_data.xml
[2026-02-28 14:24:49] + PROXY_PORT=6081
[2026-02-28 14:24:49] + '[' -n sl-um-es2.slateci.io ']'
[2026-02-28 14:24:49] + '[' -n 6081 ']'
[2026-02-28 14:24:49] + export FRONTIER_PROXY=http://sl-um-es2.slateci.io:6081
[2026-02-28 14:24:49] + FRONTIER_PROXY=http://sl-um-es2.slateci.io:6081
[2026-02-28 14:24:49] + echo 'export FRONTIER_PROXY="http://sl-um-es2.slateci.io:6081"'
[2026-02-28 14:24:49] + '[' 0 -ne 0 ']'
[2026-02-28 14:24:49] + echo 'runtimeenvironments=APPS/HEP/ATLAS-SITE;'
[2026-02-28 14:24:49] + '[' -f /etc/os-release ']'
[2026-02-28 14:24:49] +++ cat /etc/os-release
[2026-02-28 14:24:49] ++ eval 'NAME="CentOS' 'Linux"' 'VERSION="7' '(Core)"' 'ID="centos"' 'ID_LIKE="rhel' 'fedora"' 'VERSION_ID="7"' 'PRETTY_NAME="CentOS' Linux 7 '(Core)"' 'ANSI_COLOR="0;31"' 'CPE_NAME="cpe:/o:centos:centos:7"' 'HOME_URL="https://www.centos.org/"' 'BUG_REPORT_URL="https://bugs.centos.org/"' 'CENTOS_MANTISBT_PROJECT="CentOS-7"' 'CENTOS_MANTISBT_PROJECT_VERSION="7"' 'REDHAT_SUPPORT_PRODUCT="centos"' 'REDHAT_SUPPORT_PRODUCT_VERSION="7"'
[2026-02-28 14:24:49] +++ NAME='CentOS Linux'
[2026-02-28 14:24:49] +++ VERSION='7 (Core)'
[2026-02-28 14:24:49] +++ ID=centos
[2026-02-28 14:24:49] +++ ID_LIKE='rhel fedora'
[2026-02-28 14:24:49] +++ VERSION_ID=7
[2026-02-28 14:24:49] +++ PRETTY_NAME='CentOS Linux 7 (Core)'
[2026-02-28 14:24:49] +++ ANSI_COLOR='0;31'
[2026-02-28 14:24:49] +++ CPE_NAME=cpe:/o:centos:centos:7
[2026-02-28 14:24:49] +++ HOME_URL=https://www.centos.org/
[2026-02-28 14:24:49] +++ BUG_REPORT_URL=https://bugs.centos.org/
[2026-02-28 14:24:49] +++ CENTOS_MANTISBT_PROJECT=CentOS-7
[2026-02-28 14:24:49] +++ CENTOS_MANTISBT_PROJECT_VERSION=7
[2026-02-28 14:24:49] +++ REDHAT_SUPPORT_PRODUCT=centos
[2026-02-28 14:24:49] +++ REDHAT_SUPPORT_PRODUCT_VERSION=7
[2026-02-28 14:24:49] ++ echo 'CentOS Linux 7 (Core)'
[2026-02-28 14:24:49] + SYSTEM_SOFTWARE='CentOS Linux 7 (Core)'
[2026-02-28 14:24:49] + '[' -n 'CentOS Linux 7 (Core)' ']'
[2026-02-28 14:24:49] + echo 'systemsoftware=CentOS Linux 7 (Core)'
[2026-02-28 14:24:49] + HOME=/tmp/boinchome/slots/5
[2026-02-28 14:24:49] + export HOME
[2026-02-28 14:24:49] + cd /tmp/boinchome/slots/5
[2026-02-28 14:24:49] + '[' '!' -z '' ']'
[2026-02-28 14:24:49] + '[' -z '' ']'
[2026-02-28 14:24:49] ++ /bin/hostname -f
[2026-02-28 14:24:49] + nodename=c6-12-25-4.aglt2.org
[2026-02-28 14:24:49] + echo nodename=c6-12-25-4.aglt2.org
[2026-02-28 14:24:49] + echo Processors=2
[2026-02-28 14:24:49] + echo Nodecount=1
[2026-02-28 14:24:49] + echo Benchmark=HEPSPEC:1.0
[2026-02-28 14:24:49] + executable=./runpilot2-wrapper.sh
[2026-02-28 14:24:49] + '[' '!' -f ./runpilot2-wrapper.sh ']'
[2026-02-28 14:24:49] ++ dd if=./runpilot2-wrapper.sh count=1
[2026-02-28 14:24:49] ++ tr -d '\0'
[2026-02-28 14:24:49] ++ head -n 1
[2026-02-28 14:24:49] + line1='#!/bin/bash'
[2026-02-28 14:24:49] ++ echo '#!/bin/bash'
[2026-02-28 14:24:49] ++ sed -n 's/^#! *//p'
[2026-02-28 14:24:49] + shebang=/bin/bash
[2026-02-28 14:24:49] ++ echo /bin/bash
[2026-02-28 14:24:49] ++ awk '{print $1}'
[2026-02-28 14:24:49] + interpreter=/bin/bash
[2026-02-28 14:24:49] + '[' /bin/bash = /usr/bin/env ']'
[2026-02-28 14:24:49] + '[' x/bin/bash = x ']'
[2026-02-28 14:24:49] + type /bin/bash
[2026-02-28 14:24:49] + '[' xgnutime = xgnutime ']'
[2026-02-28 14:24:49] + /usr/bin/time -o /tmp/boinchome/slots/5/YCEODmFktF9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmzI3KDm2U4JYm.diag -a -f 'WallTime=%es\nKernelTime=%Ss\nUserTime=%Us\nCPUUsage=%P\nMaxResidentMemory=%MkB\nAverageResidentMemory=%tkB\nAverageTotalMemory=%KkB\nAverageUnsharedMemory=%DkB\nAverageUnsharedStack=%pkB\nAverageSharedMemory=%XkB\nPageSize=%ZB\nMajorPageFaults=%F\nMinorPageFaults=%R\nSwaps=%W\nForcedSwitches=%c\nWaitSwitches=%w\nInputs=%I\nOutputs=%O\nSocketReceived=%r\nSocketSent=%s\nSignals=%k\n' ./runpilot2-wrapper.sh -q BOINC_MCORE -j managed --pilot-user ATLAS --harvester-submit-mode PUSH -w generic --job-type managed --resource-type MCORE --pilotversion 3.11.4.1 -z -t --piloturl local --mute --container
[2026-02-28 14:24:49] + RESULT=1
[2026-02-28 14:24:49] + sed -i -e /nodename=/d /tmp/boinchome/slots/5/YCEODmFktF9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmzI3KDm2U4JYm.diag
[2026-02-28 14:24:49] ++ awk -F '>' '{print $2}'
[2026-02-28 14:24:49] ++ awk -F '<' '{print $1}'
[2026-02-28 14:24:49] ++ grep domain_name init_data.xml
[2026-02-28 14:24:49] ++ sed -e 's# #_#g'
[2026-02-28 14:24:49] + hostname=c6-12-25-4.aglt2.org
[2026-02-28 14:24:49] ++ grep user_name init_data.xml
[2026-02-28 14:24:49] ++ awk -F '<' '{print $1}'
[2026-02-28 14:24:49] ++ sed -e 's# #_#g'
[2026-02-28 14:24:49] ++ awk -F '>' '{print $2}'
[2026-02-28 14:24:49] + username=AGLT2
[2026-02-28 14:24:49] + nodename=AGLT2@c6-12-25-4.aglt2.org
[2026-02-28 14:24:49] + echo nodename=AGLT2@c6-12-25-4.aglt2.org
[2026-02-28 14:24:49] + '[' -n 10 ']'
[2026-02-28 14:24:49] + sed -i -e s/Processors=1/Processors=10/ /tmp/boinchome/slots/5/YCEODmFktF9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmzI3KDm2U4JYm.diag
[2026-02-28 14:24:49] + echo exitcode=1
[2026-02-28 14:24:49] + runtimeenvironments=
[2026-02-28 14:24:49] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2026-02-28 14:24:49] + RTE_function_0 2
[2026-02-28 14:24:49] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-28 14:24:49] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-28 14:24:49] + export BOINC_APP=ATLAS
[2026-02-28 14:24:49] + BOINC_APP=ATLAS
[2026-02-28 14:24:49] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-28 14:24:49] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-28 14:24:49] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-28 14:24:49] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-28 14:24:49] + '[' -z 2 ']'
[2026-02-28 14:24:49] + '[' 2 == 1 ']'
[2026-02-28 14:24:49] + '[' 0 -ne 0 ']'
[2026-02-28 14:24:49] + echo 'zip all output files'
[2026-02-28 14:24:49] + flist='*.diag '
[2026-02-28 14:24:49] + for f in ./heartbeat.json ./output.list ./log.48838600._001068.job.log.1 ./log.48838600._001068.job.log.1 ./gmlog/
[2026-02-28 14:24:49] + '[' -e ./heartbeat.json ']'
[2026-02-28 14:24:49] + flist='*.diag ./heartbeat.json'
[2026-02-28 14:24:49] + for f in ./heartbeat.json ./output.list ./log.48838600._001068.job.log.1 ./log.48838600._001068.job.log.1 ./gmlog/
[2026-02-28 14:24:49] + '[' -e ./output.list ']'
[2026-02-28 14:24:49] + flist='*.diag ./heartbeat.json ./output.list'
[2026-02-28 14:24:49] + for f in ./heartbeat.json ./output.list ./log.48838600._001068.job.log.1 ./log.48838600._001068.job.log.1 ./gmlog/
[2026-02-28 14:24:49] + '[' -e ./log.48838600._001068.job.log.1 ']'
[2026-02-28 14:24:49] + flist='*.diag ./heartbeat.json ./output.list ./log.48838600._001068.job.log.1'
[2026-02-28 14:24:49] + for f in ./heartbeat.json ./output.list ./log.48838600._001068.job.log.1 ./log.48838600._001068.job.log.1 ./gmlog/
[2026-02-28 14:24:49] + '[' -e ./log.48838600._001068.job.log.1 ']'
[2026-02-28 14:24:49] + flist='*.diag ./heartbeat.json ./output.list ./log.48838600._001068.job.log.1 ./log.48838600._001068.job.log.1'
[2026-02-28 14:24:49] + for f in ./heartbeat.json ./output.list ./log.48838600._001068.job.log.1 ./log.48838600._001068.job.log.1 ./gmlog/
[2026-02-28 14:24:49] + '[' -e ./gmlog/ ']'
[2026-02-28 14:24:49] + '[' -f output.list ']'
[2026-02-28 14:24:49] ++ awk '{print $1}' output.list
[2026-02-28 14:24:49] + ol=log.48838600._001068.job.log.tgz.1
[2026-02-28 14:24:49] + for i in '$ol'
[2026-02-28 14:24:49] + [[ -f log.48838600._001068.job.log.tgz.1 ]]
[2026-02-28 14:24:49] + [[ ! log.48838600._001068.job.log.tgz.1 =~ HITS.* ]]
[2026-02-28 14:24:49] + flist='*.diag ./heartbeat.json ./output.list ./log.48838600._001068.job.log.1 ./log.48838600._001068.job.log.1 log.48838600._001068.job.log.tgz.1'
[2026-02-28 14:24:49] + sed -i -e 's/HITS.* /HITS.pool.root.1 /' output.list
[2026-02-28 14:24:49] + tar cvf result.tar.gz YCEODmFktF9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmzI3KDm2U4JYm.diag ./heartbeat.json ./output.list ./log.48838600._001068.job.log.1 ./log.48838600._001068.job.log.1 log.48838600._001068.job.log.tgz.1
[2026-02-28 14:24:49] + '[' xgnutime = xcgroup ']'
[2026-02-28 14:24:49] + '[' -n '' ']'
[2026-02-28 14:24:49] + '[' -n '' ']'
[2026-02-28 14:24:49] ++ date +%s
[2026-02-28 14:24:49] + ACCOUNTING_ENDTIME=1772306689
[2026-02-28 14:24:49] ++ date -d '1970-01-01 UTC 1772282720 seconds' +%Y%m%d%H%M%SZ
[2026-02-28 14:24:49] + echo LRMSStartTime=20260228074520Z
[2026-02-28 14:24:49] ++ date -d '1970-01-01 UTC 1772306689 seconds' +%Y%m%d%H%M%SZ
[2026-02-28 14:24:49] + echo LRMSEndTime=20260228142449Z
[2026-02-28 14:24:49] + echo walltime=23969
[2026-02-28 14:24:49] + echo exitcode=1
[2026-02-28 14:24:49] + exit 1
[2026-02-28 14:24:49] ./pilotlog.txt
[2026-02-28 14:24:49] ./runtime_log.err
[2026-02-28 14:24:49] ./log.48838600._001068.job.log.tgz.1
[2026-02-28 14:24:49] ./pilot3/pilot/util/lokirealtimelogger.py
[2026-02-28 14:24:49] ./pilot3/pilot/util/loggingsupport.py
[2026-02-28 14:24:49] ./pilot3/pilot/util/__pycache__/lokirealtimelogger.cpython-39.pyc
[2026-02-28 14:24:49] ./pilot3/pilot/util/__pycache__/loggingsupport.cpython-39.pyc
[2026-02-28 14:24:49] ./pilot3/pilot/util/__pycache__/realtimelogger.cpython-39.pyc
[2026-02-28 14:24:49] ./pilot3/pilot/util/realtimelogger.py
[2026-02-28 14:24:49] ./runtime_log
[2026-02-28 14:24:49] ./log.48838600._001068.job.log.1
14:34:49 (1636213): run_atlas exited; CPU time 2578.806257
14:34:49 (1636213): app exit status: 0x1
14:34:49 (1636213): called boinc_finish(195)
</stderr_txt>
]]>
©2026 CERN