Name zr7NDmbrcq7nsSi4ap6QjLDmwznN0nGgGQJmUXzaDmMr5KDmop6nzn_0
Workunit 233360436
Created 30 Jun 2025, 23:14:01 UTC
Sent 30 Jun 2025, 23:14:24 UTC
Report deadline 8 Jul 2025, 23:14:24 UTC
Received 4 Jul 2025, 12:15:12 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 195 (0x000000C3) EXIT_CHILD_FAILED
Computer ID 10855909
Run time 1 hours 7 min 13 sec
CPU time 2 hours 47 min 2 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 20.53 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.51 GB
Peak swap size 38.17 GB
Peak disk usage 862.01 MB

Stderr output

<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 195 (0xc3, -61)</message>
<stderr_txt>
00:21:40 (3770331): wrapper (7.7.26015): starting
00:21:40 (3770331): wrapper: running run_atlas (--nthreads 4)
[2025-07-04 00:21:40] Arguments: --nthreads 4
[2025-07-04 00:21:40] Threads: 4
[2025-07-04 00:21:40] Checking for CVMFS
[2025-07-04 00:21:40] No cvmfs_config command found, will try listing directly
[2025-07-04 00:21:40] CVMFS is ok
[2025-07-04 00:21:40] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-07-04 00:21:40] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-07-04 00:21:40] Further information can be found at the LHC@home message board.
[2025-07-04 00:21:40] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-07-04 00:21:40] Checking for apptainer binary...
[2025-07-04 00:21:40] which: no apptainer in ((null))
[2025-07-04 00:21:40] apptainer is not installed, using version from CVMFS
[2025-07-04 00:21:40] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-07-04 00:21:40] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot8/slots/0/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut11.grid.cesnet.cz
[2025-07-04 00:21:40] apptainer works
[2025-07-04 00:21:40] Set ATHENA_PROC_NUMBER=4
[2025-07-04 00:21:40] Set ATHENA_CORE_NUMBER=4
[2025-07-04 00:21:40] Starting ATLAS job with PandaID=6715029988
[2025-07-04 00:21:40] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot8/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
01:38:05 (3905340): wrapper (7.7.26015): starting
01:38:05 (3905340): wrapper: running run_atlas (--nthreads 4)
[2025-07-04 01:38:05] Arguments: --nthreads 4
[2025-07-04 01:38:05] Threads: 4
[2025-07-04 01:38:05] This job has been restarted, cleaning up previous attempt
[2025-07-04 01:38:05] Checking for CVMFS
[2025-07-04 01:38:05] No cvmfs_config command found, will try listing directly
[2025-07-04 01:38:05] CVMFS is ok
[2025-07-04 01:38:05] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-07-04 01:38:05] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-07-04 01:38:05] Further information can be found at the LHC@home message board.
[2025-07-04 01:38:05] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-07-04 01:38:05] Checking for apptainer binary...
[2025-07-04 01:38:05] which: no apptainer in ((null))
[2025-07-04 01:38:05] apptainer is not installed, using version from CVMFS
[2025-07-04 01:38:05] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-07-04 01:38:05] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot8/slots/0/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut11.grid.cesnet.cz
[2025-07-04 01:38:05] apptainer works
[2025-07-04 01:38:05] Set ATHENA_PROC_NUMBER=4
[2025-07-04 01:38:05] Set ATHENA_CORE_NUMBER=4
[2025-07-04 01:38:05] Starting ATLAS job with PandaID=6715029988
[2025-07-04 01:38:05] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot8/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
04:48:22 (171034): wrapper (7.7.26015): starting
04:48:22 (171034): wrapper: running run_atlas (--nthreads 4)
[2025-07-04 04:48:22] Arguments: --nthreads 4
[2025-07-04 04:48:22] Threads: 4
[2025-07-04 04:48:22] This job has been restarted, cleaning up previous attempt
[2025-07-04 04:48:22] Checking for CVMFS
[2025-07-04 04:48:22] No cvmfs_config command found, will try listing directly
[2025-07-04 04:48:22] CVMFS is ok
[2025-07-04 04:48:22] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-07-04 04:48:22] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-07-04 04:48:22] Further information can be found at the LHC@home message board.
[2025-07-04 04:48:22] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-07-04 04:48:22] Checking for apptainer binary...
[2025-07-04 04:48:22] which: no apptainer in ((null))
[2025-07-04 04:48:22] apptainer is not installed, using version from CVMFS
[2025-07-04 04:48:22] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-07-04 04:48:23] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot8/slots/0/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut11.grid.cesnet.cz
[2025-07-04 04:48:23] apptainer works
[2025-07-04 04:48:23] Set ATHENA_PROC_NUMBER=4
[2025-07-04 04:48:23] Set ATHENA_CORE_NUMBER=4
[2025-07-04 04:48:23] Starting ATLAS job with PandaID=6715029988
[2025-07-04 04:48:23] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot8/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
10:58:46 (949534): wrapper (7.7.26015): starting
10:58:46 (949534): wrapper: running run_atlas (--nthreads 4)
[2025-07-04 10:58:46] Arguments: --nthreads 4
[2025-07-04 10:58:46] Threads: 4
[2025-07-04 10:58:46] This job has been restarted, cleaning up previous attempt
[2025-07-04 10:58:46] Checking for CVMFS
[2025-07-04 10:58:46] No cvmfs_config command found, will try listing directly
[2025-07-04 10:58:46] CVMFS is ok
[2025-07-04 10:58:46] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-07-04 10:58:46] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-07-04 10:58:46] Further information can be found at the LHC@home message board.
[2025-07-04 10:58:46] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-07-04 10:58:46] Checking for apptainer binary...
[2025-07-04 10:58:46] which: no apptainer in ((null))
[2025-07-04 10:58:46] apptainer is not installed, using version from CVMFS
[2025-07-04 10:58:46] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-07-04 10:58:46] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot8/slots/0/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut11.grid.cesnet.cz
[2025-07-04 10:58:46] apptainer works
[2025-07-04 10:58:46] Set ATHENA_PROC_NUMBER=4
[2025-07-04 10:58:46] Set ATHENA_CORE_NUMBER=4
[2025-07-04 10:58:46] Starting ATLAS job with PandaID=6715029988
[2025-07-04 10:58:46] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot8/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
11:49:43 (1022038): wrapper (7.7.26015): starting
11:49:43 (1022038): wrapper: running run_atlas (--nthreads 4)
[2025-07-04 11:49:43] Arguments: --nthreads 4
[2025-07-04 11:49:43] Threads: 4
[2025-07-04 11:49:43] This job has been restarted, cleaning up previous attempt
[2025-07-04 11:49:43] Checking for CVMFS
[2025-07-04 11:49:43] No cvmfs_config command found, will try listing directly
[2025-07-04 11:49:43] CVMFS is ok
[2025-07-04 11:49:43] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-07-04 11:49:43] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-07-04 11:49:43] Further information can be found at the LHC@home message board.
[2025-07-04 11:49:43] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-07-04 11:49:43] Checking for apptainer binary...
[2025-07-04 11:49:43] which: no apptainer in ((null))
[2025-07-04 11:49:43] apptainer is not installed, using version from CVMFS
[2025-07-04 11:49:43] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-07-04 11:49:43] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot8/slots/0/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut11.grid.cesnet.cz
[2025-07-04 11:49:43] apptainer works
[2025-07-04 11:49:43] Set ATHENA_PROC_NUMBER=4
[2025-07-04 11:49:43] Set ATHENA_CORE_NUMBER=4
[2025-07-04 11:49:43] Starting ATLAS job with PandaID=6715029988
[2025-07-04 11:49:43] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot8/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
13:12:54 (16391): wrapper (7.7.26015): starting
13:12:54 (16391): wrapper: running run_atlas (--nthreads 4)
[2025-07-04 13:12:54] Arguments: --nthreads 4
[2025-07-04 13:12:54] Threads: 4
[2025-07-04 13:12:54] This job has been restarted, cleaning up previous attempt
[2025-07-04 13:12:54] Checking for CVMFS
[2025-07-04 13:12:54] No cvmfs_config command found, will try listing directly
[2025-07-04 13:13:20] CVMFS is ok
[2025-07-04 13:13:20] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-07-04 13:13:20] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-07-04 13:13:20] Further information can be found at the LHC@home message board.
[2025-07-04 13:13:20] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-07-04 13:13:20] Checking for apptainer binary...
[2025-07-04 13:13:20] which: no apptainer in ((null))
[2025-07-04 13:13:20] apptainer is not installed, using version from CVMFS
[2025-07-04 13:13:20] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-07-04 13:13:20] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot8/slots/0/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut11.grid.cesnet.cz
[2025-07-04 13:13:20] apptainer works
[2025-07-04 13:13:20] Set ATHENA_PROC_NUMBER=4
[2025-07-04 13:13:20] Set ATHENA_CORE_NUMBER=4
[2025-07-04 13:13:20] Starting ATLAS job with PandaID=6715029988
[2025-07-04 13:13:20] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot8/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
13:51:04 (10818): wrapper (7.7.26015): starting
13:51:04 (10818): wrapper: running run_atlas (--nthreads 4)
[2025-07-04 13:51:04] Arguments: --nthreads 4
[2025-07-04 13:51:04] Threads: 4
[2025-07-04 13:51:04] This job has been restarted, cleaning up previous attempt
[2025-07-04 13:51:04] Checking for CVMFS
[2025-07-04 13:51:04] No cvmfs_config command found, will try listing directly
[2025-07-04 13:51:31] CVMFS is ok
[2025-07-04 13:51:31] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-07-04 13:51:31] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-07-04 13:51:31] Further information can be found at the LHC@home message board.
[2025-07-04 13:51:31] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-07-04 13:51:31] Checking for apptainer binary...
[2025-07-04 13:51:31] which: no apptainer in ((null))
[2025-07-04 13:51:31] apptainer is not installed, using version from CVMFS
[2025-07-04 13:51:31] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-07-04 13:51:31] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot8/slots/0/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut11.grid.cesnet.cz
[2025-07-04 13:51:31] apptainer works
[2025-07-04 13:51:31] Set ATHENA_PROC_NUMBER=4
[2025-07-04 13:51:31] Set ATHENA_CORE_NUMBER=4
[2025-07-04 13:51:31] Starting ATLAS job with PandaID=6715029988
[2025-07-04 13:51:31] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot8/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
14:03:05 (12588): wrapper (7.7.26015): starting
14:03:05 (12588): wrapper: running run_atlas (--nthreads 4)
[2025-07-04 14:03:05] Arguments: --nthreads 4
[2025-07-04 14:03:05] Threads: 4
[2025-07-04 14:03:05] This job has been restarted, cleaning up previous attempt
[2025-07-04 14:03:05] Checking for CVMFS
[2025-07-04 14:03:05] No cvmfs_config command found, will try listing directly
[2025-07-04 14:03:26] CVMFS is ok
[2025-07-04 14:03:26] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-07-04 14:03:26] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-07-04 14:03:26] Further information can be found at the LHC@home message board.
[2025-07-04 14:03:26] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-07-04 14:03:26] Checking for apptainer binary...
[2025-07-04 14:03:26] which: no apptainer in ((null))
[2025-07-04 14:03:26] apptainer is not installed, using version from CVMFS
[2025-07-04 14:03:26] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-07-04 14:03:30] apptainer isnt working: WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot8/slots/0/.apptainertmp], will not forward new value [/tmp] from parent process environment
[2025-07-04 14:03:30] FATAL:   while opening capability config file: open /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/1.2.2/etc/apptainer/capability.json: input/output error
[2025-07-04 14:03:30] which: no singularity in ((null))
[2025-07-04 14:03:30] ./pilotlog.txt
[2025-07-04 14:03:30] ./log.45417318._000067.job.log.1
[2025-07-04 14:03:30] ./pilot3/pilot/util/loggingsupport.py
[2025-07-04 14:03:30] ./pilot3/pilot/util/lokirealtimelogger.py
[2025-07-04 14:03:30] ./pilot3/pilot/util/realtimelogger.py
[2025-07-04 14:03:30] ./pilot3/pilot/util/__pycache__/loggingsupport.cpython-39.pyc
[2025-07-04 14:03:30] ./pilot3/pilot/util/__pycache__/lokirealtimelogger.cpython-39.pyc
[2025-07-04 14:03:30] ./pilot3/pilot/util/__pycache__/realtimelogger.cpython-39.pyc
[2025-07-04 14:03:30] ./runtime_log
[2025-07-04 14:03:30] ./runtime_log.err
14:13:30 (12588): run_atlas exited; CPU time 0.038957
14:13:30 (12588): app exit status: 0x1
14:13:30 (12588): called boinc_finish(195)

</stderr_txt>
]]>


©2025 CERN