| Name | qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm_0 |
| Workunit | 238958122 |
| Created | 6 Feb 2026, 4:36:44 UTC |
| Sent | 6 Feb 2026, 5:00:39 UTC |
| Report deadline | 14 Feb 2026, 5:00:39 UTC |
| Received | 9 Feb 2026, 22:45:25 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 195 (0x000000C3) EXIT_CHILD_FAILED |
| Computer ID | 10878600 |
| Run time | 1 days 3 hours 21 min 3 sec |
| CPU time | 4 days 16 hours 44 min 52 sec |
| Priority | 28 |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 23.81 GFLOPS |
| Application version | ATLAS Simulation v3.01 (native_mt) x86_64-pc-linux-gnu |
| Peak working set size | 2.83 GB |
| Peak swap size | 31.65 GB |
| Peak disk usage | 2.11 GB |
Stderr output
<core_client_version>8.1.0</core_client_version>
<![CDATA[
<message>
process exited with code 195 (0xc3, -61)</message>
<stderr_txt>
00:01:41 (2957139): wrapper (7.7.26015): starting
00:01:41 (2957139): wrapper: running run_atlas (--nthreads 8)
[2026-02-06 00:01:41] Arguments: --nthreads 8
[2026-02-06 00:01:41] Threads: 8
[2026-02-06 00:01:41] Checking for CVMFS
[2026-02-06 00:01:42] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-06 00:01:42] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-06 00:01:42] Running cvmfs_config stat atlas.cern.ch
[2026-02-06 00:01:45] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-06 00:01:45] 2.13.3.0 8707 61380 379064 155928 3 495 30455861 39288832 13607 16776704 0 79086752 99.539 96797206 32660 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-02-06 00:01:45] CVMFS is ok
[2026-02-06 00:01:45] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-06 00:01:45] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-06 00:01:45] Further information can be found at the LHC@home message board.
[2026-02-06 00:01:45] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-06 00:01:45] Checking for apptainer binary...
[2026-02-06 00:01:45] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-06 00:01:45] Running /usr/bin/apptainer --version
[2026-02-06 00:01:45] apptainer version 1.4.5-2.el9
[2026-02-06 00:01:45] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-06 00:01:46] c-211-20.aglt2.org
[2026-02-06 00:01:46] apptainer works
[2026-02-06 00:01:46] Set ATHENA_PROC_NUMBER=8
[2026-02-06 00:01:46] Set ATHENA_CORE_NUMBER=8
[2026-02-06 00:01:46] Starting ATLAS job with PandaID=7000923103
[2026-02-06 00:01:46] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/4 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
09:40:06 (2957139): BOINC client no longer exists - exiting
09:40:06 (2957139): timer handler: client dead, exiting
13:35:20 (2361726): wrapper (7.7.26015): starting
13:35:20 (2361726): wrapper: running run_atlas (--nthreads 8)
[2026-02-07 13:35:20] Arguments: --nthreads 8
[2026-02-07 13:35:20] Threads: 8
[2026-02-07 13:35:20] This job has been restarted, cleaning up previous attempt
[2026-02-07 13:35:20] Checking for CVMFS
[2026-02-07 13:35:21] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-07 13:35:21] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-07 13:35:21] Running cvmfs_config stat atlas.cern.ch
[2026-02-07 13:35:23] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-07 13:35:23] 2.13.3.0 8707 63633 375784 155992 1 294 34184731 39288833 16656 16776704 0 84931899 99.530 106585766 32746 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-02-07 13:35:23] CVMFS is ok
[2026-02-07 13:35:23] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-07 13:35:23] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-07 13:35:23] Further information can be found at the LHC@home message board.
[2026-02-07 13:35:23] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-07 13:35:23] Checking for apptainer binary...
[2026-02-07 13:35:23] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-07 13:35:23] Running /usr/bin/apptainer --version
[2026-02-07 13:35:23] apptainer version 1.4.5-2.el9
[2026-02-07 13:35:23] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-07 13:35:24] c-211-20.aglt2.org
[2026-02-07 13:35:24] apptainer works
[2026-02-07 13:35:24] Set ATHENA_PROC_NUMBER=8
[2026-02-07 13:35:24] Set ATHENA_CORE_NUMBER=8
[2026-02-07 13:35:24] Starting ATLAS job with PandaID=7000923103
[2026-02-07 13:35:24] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/4 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2026-02-07 13:39:47] Job failed
[2026-02-07 13:39:47] ++ pwd
[2026-02-07 13:39:47] + export RUNTIME_CONFIG_DIR=/tmp/boinchome/slots/4/
[2026-02-07 13:39:47] + RUNTIME_CONFIG_DIR=/tmp/boinchome/slots/4/
[2026-02-07 13:39:47] + mv ATLAS.root_0 EVNT.48431094._000268.pool.root.1
[2026-02-07 13:39:47] mv: ‘ATLAS.root_0’ and ‘EVNT.48431094._000268.pool.root.1’ are the same file
[2026-02-07 13:39:47] + tar --strip-components=5 -xvf input.tar.gz
[2026-02-07 13:39:47] + umask 077
[2026-02-07 13:39:47] ++ date +%s
[2026-02-07 13:39:47] + ACCOUNTING_STARTTIME=1770489325
[2026-02-07 13:39:47] + echo 'Detecting resource accounting method available for the job.'
[2026-02-07 13:39:47] Detecting resource accounting method available for the job.
[2026-02-07 13:39:47] + JOB_ACCOUNTING=
[2026-02-07 13:39:47] + command -v arc-job-cgroup
[2026-02-07 13:39:47] + '[' -z '' ']'
[2026-02-07 13:39:47] + GNU_TIME=/usr/bin/time
[2026-02-07 13:39:47] + echo 'Looking for /usr/bin/time tool for accounting measurements'
[2026-02-07 13:39:47] Looking for /usr/bin/time tool for accounting measurements
[2026-02-07 13:39:47] + '[' '!' -z /usr/bin/time ']'
[2026-02-07 13:39:47] + /usr/bin/time --version
[2026-02-07 13:39:47] + echo 'GNU time found and will be used for job accounting.'
[2026-02-07 13:39:47] GNU time found and will be used for job accounting.
[2026-02-07 13:39:47] + JOB_ACCOUNTING=gnutime
[2026-02-07 13:39:47] + '[' -z gnutime ']'
[2026-02-07 13:39:47] + export PANDA_JSID=harvester-CERN_central_ACTA
[2026-02-07 13:39:47] + PANDA_JSID=harvester-CERN_central_ACTA
[2026-02-07 13:39:47] + export GTAG=http://aipanda404.cern.ch/data/jobs/2026-02-06/BOINC_MCORE/7000923103.out
[2026-02-07 13:39:47] + GTAG=http://aipanda404.cern.ch/data/jobs/2026-02-06/BOINC_MCORE/7000923103.out
[2026-02-07 13:39:47] + export PILOT_NOKILL=YES
[2026-02-07 13:39:47] + PILOT_NOKILL=YES
[2026-02-07 13:39:47] + export GRID_GLOBAL_JOBID=qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-07 13:39:47] + GRID_GLOBAL_JOBID=qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-07 13:39:47] + export GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-07 13:39:47] + GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-07 13:39:47] + export GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2026-02-07 13:39:47] + GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2026-02-07 13:39:47] + export GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2026-02-07 13:39:47] + GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2026-02-07 13:39:47] ++ pwd
[2026-02-07 13:39:47] + RUNTIME_JOB_DIR=/tmp/boinchome/slots/4
[2026-02-07 13:39:47] + RUNTIME_JOB_STDIN=/dev/null
[2026-02-07 13:39:47] ++ pwd
[2026-02-07 13:39:47] + RUNTIME_JOB_STDOUT=/tmp/boinchome/slots/4/log.48431096._005829.job.log.1
[2026-02-07 13:39:47] ++ pwd
[2026-02-07 13:39:47] + RUNTIME_JOB_STDERR=/tmp/boinchome/slots/4/log.48431096._005829.job.log.1
[2026-02-07 13:39:47] ++ pwd
[2026-02-07 13:39:47] + RUNTIME_JOB_DIAG=/tmp/boinchome/slots/4.diag
[2026-02-07 13:39:47] + '[' '!' -z '' ']'
[2026-02-07 13:39:47] + RUNTIME_LOCAL_SCRATCH_DIR=
[2026-02-07 13:39:47] + RUNTIME_LOCAL_SCRATCH_MOVE_TOOL=mv
[2026-02-07 13:39:47] + RUNTIME_FRONTEND_SEES_NODE=
[2026-02-07 13:39:47] + RUNTIME_NODE_SEES_FRONTEND=yes
[2026-02-07 13:39:47] + '[' '!' -z '' ']'
[2026-02-07 13:39:47] + '[' -z yes ']'
[2026-02-07 13:39:47] ++ pwd
[2026-02-07 13:39:47] + RUNTIME_JOB_DIAG=/tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag
[2026-02-07 13:39:47] + runtimeenvironments=
[2026-02-07 13:39:47] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2026-02-07 13:39:47] + RTE_function_0 1
[2026-02-07 13:39:47] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-07 13:39:47] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-07 13:39:47] + export BOINC_APP=ATLAS
[2026-02-07 13:39:47] + BOINC_APP=ATLAS
[2026-02-07 13:39:47] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-07 13:39:47] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-07 13:39:47] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-07 13:39:47] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-07 13:39:47] + '[' -z 1 ']'
[2026-02-07 13:39:47] + '[' 1 == 1 ']'
[2026-02-07 13:39:47] + shift
[2026-02-07 13:39:47] + export SITE_NAME=BOINC
[2026-02-07 13:39:47] + SITE_NAME=BOINC
[2026-02-07 13:39:47] + export ATLAS_LOCAL_AREA=/tmp/boinchome/slots/4/
[2026-02-07 13:39:47] + ATLAS_LOCAL_AREA=/tmp/boinchome/slots/4/
[2026-02-07 13:39:47] + '[' -e /tmp/boinchome/slots/4/init_data.xml ']'
[2026-02-07 13:39:47] + grep '<use_http_proxy/>' /tmp/boinchome/slots/4/init_data.xml
[2026-02-07 13:39:47] ++ sed -e '/<proxy_info>/,/<\/proxy_info>/ s/^.*<http_server_name>\([^<]*\).*/\1/p' -n /tmp/boinchome/slots/4/init_data.xml
[2026-02-07 13:39:47] + PROXY_HOST=sl-um-es2.slateci.io
[2026-02-07 13:39:47] ++ sed -e '/<proxy_info>/,/<\/proxy_info>/ s/^.*<http_server_port>\([^<]*\).*/\1/p' -n /tmp/boinchome/slots/4/init_data.xml
[2026-02-07 13:39:47] + PROXY_PORT=6081
[2026-02-07 13:39:47] + '[' -n sl-um-es2.slateci.io ']'
[2026-02-07 13:39:47] + '[' -n 6081 ']'
[2026-02-07 13:39:47] + export FRONTIER_PROXY=http://sl-um-es2.slateci.io:6081
[2026-02-07 13:39:47] + FRONTIER_PROXY=http://sl-um-es2.slateci.io:6081
[2026-02-07 13:39:47] + echo 'export FRONTIER_PROXY="http://sl-um-es2.slateci.io:6081"'
[2026-02-07 13:39:47] + '[' 0 -ne 0 ']'
[2026-02-07 13:39:47] + echo 'runtimeenvironments=APPS/HEP/ATLAS-SITE;'
[2026-02-07 13:39:47] + '[' -f /etc/os-release ']'
[2026-02-07 13:39:47] +++ cat /etc/os-release
[2026-02-07 13:39:47] ++ eval 'NAME="CentOS' 'Linux"' 'VERSION="7' '(Core)"' 'ID="centos"' 'ID_LIKE="rhel' 'fedora"' 'VERSION_ID="7"' 'PRETTY_NAME="CentOS' Linux 7 '(Core)"' 'ANSI_COLOR="0;31"' 'CPE_NAME="cpe:/o:centos:centos:7"' 'HOME_URL="https://www.centos.org/"' 'BUG_REPORT_URL="https://bugs.centos.org/"' 'CENTOS_MANTISBT_PROJECT="CentOS-7"' 'CENTOS_MANTISBT_PROJECT_VERSION="7"' 'REDHAT_SUPPORT_PRODUCT="centos"' 'REDHAT_SUPPORT_PRODUCT_VERSION="7"'
[2026-02-07 13:39:47] +++ NAME='CentOS Linux'
[2026-02-07 13:39:47] +++ VERSION='7 (Core)'
[2026-02-07 13:39:47] +++ ID=centos
[2026-02-07 13:39:47] +++ ID_LIKE='rhel fedora'
[2026-02-07 13:39:47] +++ VERSION_ID=7
[2026-02-07 13:39:47] +++ PRETTY_NAME='CentOS Linux 7 (Core)'
[2026-02-07 13:39:47] +++ ANSI_COLOR='0;31'
[2026-02-07 13:39:47] +++ CPE_NAME=cpe:/o:centos:centos:7
[2026-02-07 13:39:47] +++ HOME_URL=https://www.centos.org/
[2026-02-07 13:39:47] +++ BUG_REPORT_URL=https://bugs.centos.org/
[2026-02-07 13:39:47] +++ CENTOS_MANTISBT_PROJECT=CentOS-7
[2026-02-07 13:39:47] +++ CENTOS_MANTISBT_PROJECT_VERSION=7
[2026-02-07 13:39:47] +++ REDHAT_SUPPORT_PRODUCT=centos
[2026-02-07 13:39:47] +++ REDHAT_SUPPORT_PRODUCT_VERSION=7
[2026-02-07 13:39:47] ++ echo 'CentOS Linux 7 (Core)'
[2026-02-07 13:39:47] + SYSTEM_SOFTWARE='CentOS Linux 7 (Core)'
[2026-02-07 13:39:47] + '[' -n 'CentOS Linux 7 (Core)' ']'
[2026-02-07 13:39:47] + echo 'systemsoftware=CentOS Linux 7 (Core)'
[2026-02-07 13:39:47] + HOME=/tmp/boinchome/slots/4
[2026-02-07 13:39:47] + export HOME
[2026-02-07 13:39:47] + cd /tmp/boinchome/slots/4
[2026-02-07 13:39:47] + '[' '!' -z '' ']'
[2026-02-07 13:39:47] + '[' -z '' ']'
[2026-02-07 13:39:47] ++ /bin/hostname -f
[2026-02-07 13:39:47] + nodename=c-211-20.aglt2.org
[2026-02-07 13:39:47] + echo nodename=c-211-20.aglt2.org
[2026-02-07 13:39:47] + echo Processors=2
[2026-02-07 13:39:47] + echo Nodecount=1
[2026-02-07 13:39:47] + echo Benchmark=HEPSPEC:1.0
[2026-02-07 13:39:47] + executable=./runpilot2-wrapper.sh
[2026-02-07 13:39:47] + '[' '!' -f ./runpilot2-wrapper.sh ']'
[2026-02-07 13:39:47] ++ dd if=./runpilot2-wrapper.sh count=1
[2026-02-07 13:39:47] ++ tr -d '\0'
[2026-02-07 13:39:47] ++ head -n 1
[2026-02-07 13:39:47] + line1='#!/bin/bash'
[2026-02-07 13:39:47] ++ sed -n 's/^#! *//p'
[2026-02-07 13:39:47] ++ echo '#!/bin/bash'
[2026-02-07 13:39:47] + shebang=/bin/bash
[2026-02-07 13:39:47] ++ echo /bin/bash
[2026-02-07 13:39:47] ++ awk '{print $1}'
[2026-02-07 13:39:47] + interpreter=/bin/bash
[2026-02-07 13:39:47] + '[' /bin/bash = /usr/bin/env ']'
[2026-02-07 13:39:47] + '[' x/bin/bash = x ']'
[2026-02-07 13:39:47] + type /bin/bash
[2026-02-07 13:39:47] + '[' xgnutime = xgnutime ']'
[2026-02-07 13:39:47] + /usr/bin/time -o /tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag -a -f 'WallTime=%es\nKernelTime=%Ss\nUserTime=%Us\nCPUUsage=%P\nMaxResidentMemory=%MkB\nAverageResidentMemory=%tkB\nAverageTotalMemory=%KkB\nAverageUnsharedMemory=%DkB\nAverageUnsharedStack=%pkB\nAverageSharedMemory=%XkB\nPageSize=%ZB\nMajorPageFaults=%F\nMinorPageFaults=%R\nSwaps=%W\nForcedSwitches=%c\nWaitSwitches=%w\nInputs=%I\nOutputs=%O\nSocketReceived=%r\nSocketSent=%s\nSignals=%k\n' ./runpilot2-wrapper.sh -q BOINC_MCORE -j managed --pilot-user ATLAS --harvester-submit-mode PUSH -w generic --job-type managed --resource-type MCORE --pilotversion 3.11.4.1 -z -t --piloturl local --mute --container
[2026-02-07 13:39:47] + RESULT=2
[2026-02-07 13:39:47] + sed -i -e /nodename=/d /tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag
[2026-02-07 13:39:47] ++ grep domain_name init_data.xml
[2026-02-07 13:39:47] ++ awk -F '>' '{print $2}'
[2026-02-07 13:39:47] ++ awk -F '<' '{print $1}'
[2026-02-07 13:39:47] ++ sed -e 's# #_#g'
[2026-02-07 13:39:47] + hostname=c-211-20.aglt2.org
[2026-02-07 13:39:47] ++ awk -F '>' '{print $2}'
[2026-02-07 13:39:47] ++ sed -e 's# #_#g'
[2026-02-07 13:39:47] ++ awk -F '<' '{print $1}'
[2026-02-07 13:39:47] ++ grep user_name init_data.xml
[2026-02-07 13:39:47] + username=AGLT2
[2026-02-07 13:39:47] + nodename=AGLT2@c-211-20.aglt2.org
[2026-02-07 13:39:47] + echo nodename=AGLT2@c-211-20.aglt2.org
[2026-02-07 13:39:47] + '[' -n 8 ']'
[2026-02-07 13:39:47] + sed -i -e s/Processors=1/Processors=8/ /tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag
[2026-02-07 13:39:47] + echo exitcode=2
[2026-02-07 13:39:47] + runtimeenvironments=
[2026-02-07 13:39:47] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2026-02-07 13:39:47] + RTE_function_0 2
[2026-02-07 13:39:47] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-07 13:39:47] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-07 13:39:47] + export BOINC_APP=ATLAS
[2026-02-07 13:39:47] + BOINC_APP=ATLAS
[2026-02-07 13:39:47] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-07 13:39:47] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-07 13:39:47] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-07 13:39:47] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-07 13:39:47] + '[' -z 2 ']'
[2026-02-07 13:39:47] + '[' 2 == 1 ']'
[2026-02-07 13:39:47] + '[' 0 -ne 0 ']'
[2026-02-07 13:39:47] + echo 'zip all output files'
[2026-02-07 13:39:47] + flist='*.diag '
[2026-02-07 13:39:47] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-07 13:39:47] + '[' -e ./heartbeat.json ']'
[2026-02-07 13:39:47] + flist='*.diag ./heartbeat.json'
[2026-02-07 13:39:47] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-07 13:39:47] + '[' -e ./output.list ']'
[2026-02-07 13:39:47] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-07 13:39:47] + '[' -e ./log.48431096._005829.job.log.1 ']'
[2026-02-07 13:39:47] + flist='*.diag ./heartbeat.json ./log.48431096._005829.job.log.1'
[2026-02-07 13:39:47] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-07 13:39:47] + '[' -e ./log.48431096._005829.job.log.1 ']'
[2026-02-07 13:39:47] + flist='*.diag ./heartbeat.json ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1'
[2026-02-07 13:39:47] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-07 13:39:47] + '[' -e ./gmlog/ ']'
[2026-02-07 13:39:47] + '[' -f output.list ']'
[2026-02-07 13:39:47] + tar cvf result.tar.gz qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag ./heartbeat.json ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1
[2026-02-07 13:39:47] + '[' xgnutime = xcgroup ']'
[2026-02-07 13:39:47] + '[' -n '' ']'
[2026-02-07 13:39:47] + '[' -n '' ']'
[2026-02-07 13:39:47] ++ date +%s
[2026-02-07 13:39:47] + ACCOUNTING_ENDTIME=1770489587
[2026-02-07 13:39:47] ++ date -d '1970-01-01 UTC 1770489325 seconds' +%Y%m%d%H%M%SZ
[2026-02-07 13:39:47] + echo LRMSStartTime=20260207133525Z
[2026-02-07 13:39:47] ++ date -d '1970-01-01 UTC 1770489587 seconds' +%Y%m%d%H%M%SZ
[2026-02-07 13:39:47] + echo LRMSEndTime=20260207133947Z
[2026-02-07 13:39:47] + echo walltime=262
[2026-02-07 13:39:47] + echo exitcode=2
[2026-02-07 13:39:47] + exit 2
[2026-02-07 13:39:47] ./pilot3/pilot/util/loggingsupport.py
[2026-02-07 13:39:47] ./pilot3/pilot/util/lokirealtimelogger.py
[2026-02-07 13:39:47] ./pilot3/pilot/util/realtimelogger.py
[2026-02-07 13:39:47] ./pilot3/pilot/util/__pycache__/lokirealtimelogger.cpython-39.pyc
[2026-02-07 13:39:47] ./pilot3/pilot/util/__pycache__/realtimelogger.cpython-39.pyc
[2026-02-07 13:39:47] ./pilot3/pilot/util/__pycache__/loggingsupport.cpython-39.pyc
[2026-02-07 13:39:47] ./runtime_log
[2026-02-07 13:39:47] ./pilotlog.txt
[2026-02-07 13:39:47] ./runtime_log.err
[2026-02-07 13:39:47] ./PanDA_Pilot-7000923103/PoolFileCatalog.xml
[2026-02-07 13:39:47] ./PanDA_Pilot-7000923103/pilotlog.txt
[2026-02-07 13:39:47] ./PanDA_Pilot-7000923103/prmon.log
[2026-02-07 13:39:47] ./log.48431096._005829.job.log.1
13:45:04 (2445400): wrapper (7.7.26015): starting
13:45:04 (2445400): wrapper: running run_atlas (--nthreads 8)
[2026-02-07 13:45:04] Arguments: --nthreads 8
[2026-02-07 13:45:04] Threads: 8
[2026-02-07 13:45:04] This job has been restarted, cleaning up previous attempt
[2026-02-07 13:45:04] Checking for CVMFS
[2026-02-07 13:45:04] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-07 13:45:04] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-07 13:45:04] Running cvmfs_config stat atlas.cern.ch
[2026-02-07 13:45:04] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-07 13:45:04] 2.13.3.0 8707 63643 374524 155992 0 296 34209858 39288833 13313 16776704 0 84989658 99.531 106585767 32746 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-02-07 13:45:04] CVMFS is ok
[2026-02-07 13:45:04] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-07 13:45:04] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-07 13:45:04] Further information can be found at the LHC@home message board.
[2026-02-07 13:45:04] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-07 13:45:04] Checking for apptainer binary...
[2026-02-07 13:45:04] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-07 13:45:04] Running /usr/bin/apptainer --version
[2026-02-07 13:45:04] apptainer version 1.4.5-2.el9
[2026-02-07 13:45:04] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-07 13:45:05] c-211-20.aglt2.org
[2026-02-07 13:45:05] apptainer works
[2026-02-07 13:45:05] Set ATHENA_PROC_NUMBER=8
[2026-02-07 13:45:05] Set ATHENA_CORE_NUMBER=8
[2026-02-07 13:45:05] Starting ATLAS job with PandaID=7000923103
[2026-02-07 13:45:05] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/4 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
21:20:11 (2445400): BOINC client no longer exists - exiting
21:20:11 (2445400): timer handler: client dead, exiting
21:31:00 (115108): wrapper (7.7.26015): starting
21:31:00 (115108): wrapper: running run_atlas (--nthreads 11)
[2026-02-07 21:31:00] Arguments: --nthreads 11
[2026-02-07 21:31:00] Threads: 11
[2026-02-07 21:31:00] This job has been restarted, cleaning up previous attempt
[2026-02-07 21:31:01] Checking for CVMFS
[2026-02-07 21:31:02] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-07 21:31:02] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-07 21:31:02] Running cvmfs_config stat atlas.cern.ch
[2026-02-07 21:31:04] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-07 21:31:04] 2.13.3.0 8707 64109 388356 156003 2 604 37515305 39288833 15305 16776704 0 85886784 99.535 106714794 32737 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-02-07 21:31:04] CVMFS is ok
[2026-02-07 21:31:04] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-07 21:31:04] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-07 21:31:04] Further information can be found at the LHC@home message board.
[2026-02-07 21:31:04] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-07 21:31:04] Checking for apptainer binary...
[2026-02-07 21:31:04] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-07 21:31:04] Running /usr/bin/apptainer --version
[2026-02-07 21:31:04] apptainer version 1.4.5-2.el9
[2026-02-07 21:31:04] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-07 21:31:05] c-211-20.aglt2.org
[2026-02-07 21:31:05] apptainer works
[2026-02-07 21:31:05] Set ATHENA_PROC_NUMBER=11
[2026-02-07 21:31:05] Set ATHENA_CORE_NUMBER=11
[2026-02-07 21:31:05] Starting ATLAS job with PandaID=7000923103
[2026-02-07 21:31:05] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/4 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
00:20:05 (115108): BOINC client no longer exists - exiting
00:20:05 (115108): timer handler: client dead, exiting
00:27:19 (1150866): wrapper (7.7.26015): starting
00:27:19 (1150866): wrapper: running run_atlas (--nthreads 8)
[2026-02-08 00:27:19] Arguments: --nthreads 8
[2026-02-08 00:27:19] Threads: 8
[2026-02-08 00:27:19] This job has been restarted, cleaning up previous attempt
[2026-02-08 00:27:19] Checking for CVMFS
[2026-02-08 00:27:20] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-08 00:27:20] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-08 00:27:20] Running cvmfs_config stat atlas.cern.ch
[2026-02-08 00:27:21] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-08 00:27:21] 2.13.3.0 8707 64285 378256 156009 2 343 38952651 39288832 18690 16776704 0 87008120 99.540 107131498 32746 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-02-08 00:27:21] CVMFS is ok
[2026-02-08 00:27:21] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-08 00:27:21] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-08 00:27:21] Further information can be found at the LHC@home message board.
[2026-02-08 00:27:21] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-08 00:27:21] Checking for apptainer binary...
[2026-02-08 00:27:21] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-08 00:27:21] Running /usr/bin/apptainer --version
[2026-02-08 00:27:21] apptainer version 1.4.5-2.el9
[2026-02-08 00:27:22] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-08 00:27:23] c-211-20.aglt2.org
[2026-02-08 00:27:23] apptainer works
[2026-02-08 00:27:23] Set ATHENA_PROC_NUMBER=8
[2026-02-08 00:27:23] Set ATHENA_CORE_NUMBER=8
[2026-02-08 00:27:23] Starting ATLAS job with PandaID=7000923103
[2026-02-08 00:27:23] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/4 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
13:30:40 (1055126): wrapper (7.7.26015): starting
13:30:40 (1055126): wrapper: running run_atlas (--nthreads 8)
[2026-02-08 13:30:41] Arguments: --nthreads 8
[2026-02-08 13:30:41] Threads: 8
[2026-02-08 13:30:41] This job has been restarted, cleaning up previous attempt
[2026-02-08 13:30:41] Checking for CVMFS
[2026-02-08 13:30:41] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-08 13:30:41] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-08 13:30:41] Running cvmfs_config stat atlas.cern.ch
[2026-02-08 13:30:43] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-08 13:30:43] 2.13.3.0 8707 65069 375688 156029 0 271 30793466 39288832 20303 16776704 0 91656320 99.554 108849906 32716 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-02-08 13:30:43] CVMFS is ok
[2026-02-08 13:30:43] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-08 13:30:43] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-08 13:30:43] Further information can be found at the LHC@home message board.
[2026-02-08 13:30:43] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-08 13:30:43] Checking for apptainer binary...
[2026-02-08 13:30:43] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-08 13:30:43] Running /usr/bin/apptainer --version
[2026-02-08 13:30:43] apptainer version 1.4.5-2.el9
[2026-02-08 13:30:43] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-08 13:30:43] c-211-20.aglt2.org
[2026-02-08 13:30:43] apptainer works
[2026-02-08 13:30:44] Set ATHENA_PROC_NUMBER=8
[2026-02-08 13:30:44] Set ATHENA_CORE_NUMBER=8
[2026-02-08 13:30:44] Starting ATLAS job with PandaID=7000923103
[2026-02-08 13:30:44] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/4 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2026-02-08 13:34:26] Job failed
[2026-02-08 13:34:26] ++ pwd
[2026-02-08 13:34:26] + export RUNTIME_CONFIG_DIR=/tmp/boinchome/slots/4/
[2026-02-08 13:34:26] + RUNTIME_CONFIG_DIR=/tmp/boinchome/slots/4/
[2026-02-08 13:34:26] + mv ATLAS.root_0 EVNT.48431094._000268.pool.root.1
[2026-02-08 13:34:26] mv: ‘ATLAS.root_0’ and ‘EVNT.48431094._000268.pool.root.1’ are the same file
[2026-02-08 13:34:26] + tar --strip-components=5 -xvf input.tar.gz
[2026-02-08 13:34:26] + umask 077
[2026-02-08 13:34:26] ++ date +%s
[2026-02-08 13:34:26] + ACCOUNTING_STARTTIME=1770575445
[2026-02-08 13:34:26] + echo 'Detecting resource accounting method available for the job.'
[2026-02-08 13:34:26] Detecting resource accounting method available for the job.
[2026-02-08 13:34:26] + JOB_ACCOUNTING=
[2026-02-08 13:34:26] + command -v arc-job-cgroup
[2026-02-08 13:34:26] + '[' -z '' ']'
[2026-02-08 13:34:26] + GNU_TIME=/usr/bin/time
[2026-02-08 13:34:26] + echo 'Looking for /usr/bin/time tool for accounting measurements'
[2026-02-08 13:34:26] Looking for /usr/bin/time tool for accounting measurements
[2026-02-08 13:34:26] + '[' '!' -z /usr/bin/time ']'
[2026-02-08 13:34:26] + /usr/bin/time --version
[2026-02-08 13:34:26] + echo 'GNU time found and will be used for job accounting.'
[2026-02-08 13:34:26] GNU time found and will be used for job accounting.
[2026-02-08 13:34:26] + JOB_ACCOUNTING=gnutime
[2026-02-08 13:34:26] + '[' -z gnutime ']'
[2026-02-08 13:34:26] + export PANDA_JSID=harvester-CERN_central_ACTA
[2026-02-08 13:34:26] + PANDA_JSID=harvester-CERN_central_ACTA
[2026-02-08 13:34:26] + export GTAG=http://aipanda404.cern.ch/data/jobs/2026-02-06/BOINC_MCORE/7000923103.out
[2026-02-08 13:34:26] + GTAG=http://aipanda404.cern.ch/data/jobs/2026-02-06/BOINC_MCORE/7000923103.out
[2026-02-08 13:34:26] + export PILOT_NOKILL=YES
[2026-02-08 13:34:26] + PILOT_NOKILL=YES
[2026-02-08 13:34:26] + export GRID_GLOBAL_JOBID=qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-08 13:34:26] + GRID_GLOBAL_JOBID=qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-08 13:34:26] + export GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-08 13:34:26] + GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-08 13:34:26] + export GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2026-02-08 13:34:26] + GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2026-02-08 13:34:26] + export GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2026-02-08 13:34:26] + GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2026-02-08 13:34:26] ++ pwd
[2026-02-08 13:34:26] + RUNTIME_JOB_DIR=/tmp/boinchome/slots/4
[2026-02-08 13:34:26] + RUNTIME_JOB_STDIN=/dev/null
[2026-02-08 13:34:26] ++ pwd
[2026-02-08 13:34:26] + RUNTIME_JOB_STDOUT=/tmp/boinchome/slots/4/log.48431096._005829.job.log.1
[2026-02-08 13:34:26] ++ pwd
[2026-02-08 13:34:26] + RUNTIME_JOB_STDERR=/tmp/boinchome/slots/4/log.48431096._005829.job.log.1
[2026-02-08 13:34:26] ++ pwd
[2026-02-08 13:34:26] + RUNTIME_JOB_DIAG=/tmp/boinchome/slots/4.diag
[2026-02-08 13:34:26] + '[' '!' -z '' ']'
[2026-02-08 13:34:26] + RUNTIME_LOCAL_SCRATCH_DIR=
[2026-02-08 13:34:26] + RUNTIME_LOCAL_SCRATCH_MOVE_TOOL=mv
[2026-02-08 13:34:26] + RUNTIME_FRONTEND_SEES_NODE=
[2026-02-08 13:34:26] + RUNTIME_NODE_SEES_FRONTEND=yes
[2026-02-08 13:34:26] + '[' '!' -z '' ']'
[2026-02-08 13:34:26] + '[' -z yes ']'
[2026-02-08 13:34:26] ++ pwd
[2026-02-08 13:34:26] + RUNTIME_JOB_DIAG=/tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag
[2026-02-08 13:34:26] + runtimeenvironments=
[2026-02-08 13:34:26] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2026-02-08 13:34:26] + RTE_function_0 1
[2026-02-08 13:34:26] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-08 13:34:26] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-08 13:34:26] + export BOINC_APP=ATLAS
[2026-02-08 13:34:26] + BOINC_APP=ATLAS
[2026-02-08 13:34:26] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-08 13:34:26] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-08 13:34:26] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-08 13:34:26] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-08 13:34:26] + '[' -z 1 ']'
[2026-02-08 13:34:26] + '[' 1 == 1 ']'
[2026-02-08 13:34:26] + shift
[2026-02-08 13:34:26] + export SITE_NAME=BOINC
[2026-02-08 13:34:26] + SITE_NAME=BOINC
[2026-02-08 13:34:26] + export ATLAS_LOCAL_AREA=/tmp/boinchome/slots/4/
[2026-02-08 13:34:26] + ATLAS_LOCAL_AREA=/tmp/boinchome/slots/4/
[2026-02-08 13:34:26] + '[' -e /tmp/boinchome/slots/4/init_data.xml ']'
[2026-02-08 13:34:26] + grep '<use_http_proxy/>' /tmp/boinchome/slots/4/init_data.xml
[2026-02-08 13:34:26] ++ sed -e '/<proxy_info>/,/<\/proxy_info>/ s/^.*<http_server_name>\([^<]*\).*/\1/p' -n /tmp/boinchome/slots/4/init_data.xml
[2026-02-08 13:34:26] + PROXY_HOST=sl-um-es2.slateci.io
[2026-02-08 13:34:26] ++ sed -e '/<proxy_info>/,/<\/proxy_info>/ s/^.*<http_server_port>\([^<]*\).*/\1/p' -n /tmp/boinchome/slots/4/init_data.xml
[2026-02-08 13:34:26] + PROXY_PORT=6081
[2026-02-08 13:34:26] + '[' -n sl-um-es2.slateci.io ']'
[2026-02-08 13:34:26] + '[' -n 6081 ']'
[2026-02-08 13:34:26] + export FRONTIER_PROXY=http://sl-um-es2.slateci.io:6081
[2026-02-08 13:34:26] + FRONTIER_PROXY=http://sl-um-es2.slateci.io:6081
[2026-02-08 13:34:26] + echo 'export FRONTIER_PROXY="http://sl-um-es2.slateci.io:6081"'
[2026-02-08 13:34:26] + '[' 0 -ne 0 ']'
[2026-02-08 13:34:26] + echo 'runtimeenvironments=APPS/HEP/ATLAS-SITE;'
[2026-02-08 13:34:26] + '[' -f /etc/os-release ']'
[2026-02-08 13:34:26] +++ cat /etc/os-release
[2026-02-08 13:34:26] ++ eval 'NAME="CentOS' 'Linux"' 'VERSION="7' '(Core)"' 'ID="centos"' 'ID_LIKE="rhel' 'fedora"' 'VERSION_ID="7"' 'PRETTY_NAME="CentOS' Linux 7 '(Core)"' 'ANSI_COLOR="0;31"' 'CPE_NAME="cpe:/o:centos:centos:7"' 'HOME_URL="https://www.centos.org/"' 'BUG_REPORT_URL="https://bugs.centos.org/"' 'CENTOS_MANTISBT_PROJECT="CentOS-7"' 'CENTOS_MANTISBT_PROJECT_VERSION="7"' 'REDHAT_SUPPORT_PRODUCT="centos"' 'REDHAT_SUPPORT_PRODUCT_VERSION="7"'
[2026-02-08 13:34:26] +++ NAME='CentOS Linux'
[2026-02-08 13:34:26] +++ VERSION='7 (Core)'
[2026-02-08 13:34:26] +++ ID=centos
[2026-02-08 13:34:26] +++ ID_LIKE='rhel fedora'
[2026-02-08 13:34:26] +++ VERSION_ID=7
[2026-02-08 13:34:26] +++ PRETTY_NAME='CentOS Linux 7 (Core)'
[2026-02-08 13:34:26] +++ ANSI_COLOR='0;31'
[2026-02-08 13:34:26] +++ CPE_NAME=cpe:/o:centos:centos:7
[2026-02-08 13:34:26] +++ HOME_URL=https://www.centos.org/
[2026-02-08 13:34:26] +++ BUG_REPORT_URL=https://bugs.centos.org/
[2026-02-08 13:34:26] +++ CENTOS_MANTISBT_PROJECT=CentOS-7
[2026-02-08 13:34:26] +++ CENTOS_MANTISBT_PROJECT_VERSION=7
[2026-02-08 13:34:26] +++ REDHAT_SUPPORT_PRODUCT=centos
[2026-02-08 13:34:26] +++ REDHAT_SUPPORT_PRODUCT_VERSION=7
[2026-02-08 13:34:26] ++ echo 'CentOS Linux 7 (Core)'
[2026-02-08 13:34:26] + SYSTEM_SOFTWARE='CentOS Linux 7 (Core)'
[2026-02-08 13:34:26] + '[' -n 'CentOS Linux 7 (Core)' ']'
[2026-02-08 13:34:26] + echo 'systemsoftware=CentOS Linux 7 (Core)'
[2026-02-08 13:34:26] + HOME=/tmp/boinchome/slots/4
[2026-02-08 13:34:26] + export HOME
[2026-02-08 13:34:26] + cd /tmp/boinchome/slots/4
[2026-02-08 13:34:26] + '[' '!' -z '' ']'
[2026-02-08 13:34:26] + '[' -z '' ']'
[2026-02-08 13:34:26] ++ /bin/hostname -f
[2026-02-08 13:34:26] + nodename=c-211-20.aglt2.org
[2026-02-08 13:34:26] + echo nodename=c-211-20.aglt2.org
[2026-02-08 13:34:26] + echo Processors=2
[2026-02-08 13:34:26] + echo Nodecount=1
[2026-02-08 13:34:26] + echo Benchmark=HEPSPEC:1.0
[2026-02-08 13:34:26] + executable=./runpilot2-wrapper.sh
[2026-02-08 13:34:26] + '[' '!' -f ./runpilot2-wrapper.sh ']'
[2026-02-08 13:34:26] ++ head -n 1
[2026-02-08 13:34:26] ++ dd if=./runpilot2-wrapper.sh count=1
[2026-02-08 13:34:26] ++ tr -d '\0'
[2026-02-08 13:34:26] + line1='#!/bin/bash'
[2026-02-08 13:34:26] ++ sed -n 's/^#! *//p'
[2026-02-08 13:34:26] ++ echo '#!/bin/bash'
[2026-02-08 13:34:26] + shebang=/bin/bash
[2026-02-08 13:34:26] ++ echo /bin/bash
[2026-02-08 13:34:26] ++ awk '{print $1}'
[2026-02-08 13:34:26] + interpreter=/bin/bash
[2026-02-08 13:34:26] + '[' /bin/bash = /usr/bin/env ']'
[2026-02-08 13:34:26] + '[' x/bin/bash = x ']'
[2026-02-08 13:34:26] + type /bin/bash
[2026-02-08 13:34:26] + '[' xgnutime = xgnutime ']'
[2026-02-08 13:34:26] + /usr/bin/time -o /tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag -a -f 'WallTime=%es\nKernelTime=%Ss\nUserTime=%Us\nCPUUsage=%P\nMaxResidentMemory=%MkB\nAverageResidentMemory=%tkB\nAverageTotalMemory=%KkB\nAverageUnsharedMemory=%DkB\nAverageUnsharedStack=%pkB\nAverageSharedMemory=%XkB\nPageSize=%ZB\nMajorPageFaults=%F\nMinorPageFaults=%R\nSwaps=%W\nForcedSwitches=%c\nWaitSwitches=%w\nInputs=%I\nOutputs=%O\nSocketReceived=%r\nSocketSent=%s\nSignals=%k\n' ./runpilot2-wrapper.sh -q BOINC_MCORE -j managed --pilot-user ATLAS --harvester-submit-mode PUSH -w generic --job-type managed --resource-type MCORE --pilotversion 3.11.4.1 -z -t --piloturl local --mute --container
[2026-02-08 13:34:26] + RESULT=2
[2026-02-08 13:34:26] + sed -i -e /nodename=/d /tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag
[2026-02-08 13:34:26] ++ sed -e 's# #_#g'
[2026-02-08 13:34:26] ++ awk -F '<' '{print $1}'
[2026-02-08 13:34:26] ++ awk -F '>' '{print $2}'
[2026-02-08 13:34:26] ++ grep domain_name init_data.xml
[2026-02-08 13:34:26] + hostname=c-211-20.aglt2.org
[2026-02-08 13:34:26] ++ sed -e 's# #_#g'
[2026-02-08 13:34:26] ++ awk -F '<' '{print $1}'
[2026-02-08 13:34:26] ++ awk -F '>' '{print $2}'
[2026-02-08 13:34:26] ++ grep user_name init_data.xml
[2026-02-08 13:34:26] + username=AGLT2
[2026-02-08 13:34:26] + nodename=AGLT2@c-211-20.aglt2.org
[2026-02-08 13:34:26] + echo nodename=AGLT2@c-211-20.aglt2.org
[2026-02-08 13:34:26] + '[' -n 8 ']'
[2026-02-08 13:34:26] + sed -i -e s/Processors=1/Processors=8/ /tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag
[2026-02-08 13:34:26] + echo exitcode=2
[2026-02-08 13:34:26] + runtimeenvironments=
[2026-02-08 13:34:26] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2026-02-08 13:34:26] + RTE_function_0 2
[2026-02-08 13:34:26] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-08 13:34:26] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-08 13:34:26] + export BOINC_APP=ATLAS
[2026-02-08 13:34:26] + BOINC_APP=ATLAS
[2026-02-08 13:34:26] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-08 13:34:26] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-08 13:34:26] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-08 13:34:26] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-08 13:34:26] + '[' -z 2 ']'
[2026-02-08 13:34:26] + '[' 2 == 1 ']'
[2026-02-08 13:34:26] + '[' 0 -ne 0 ']'
[2026-02-08 13:34:26] + echo 'zip all output files'
[2026-02-08 13:34:26] + flist='*.diag '
[2026-02-08 13:34:26] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-08 13:34:26] + '[' -e ./heartbeat.json ']'
[2026-02-08 13:34:26] + flist='*.diag ./heartbeat.json'
[2026-02-08 13:34:26] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-08 13:34:26] + '[' -e ./output.list ']'
[2026-02-08 13:34:26] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-08 13:34:26] + '[' -e ./log.48431096._005829.job.log.1 ']'
[2026-02-08 13:34:26] + flist='*.diag ./heartbeat.json ./log.48431096._005829.job.log.1'
[2026-02-08 13:34:26] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-08 13:34:26] + '[' -e ./log.48431096._005829.job.log.1 ']'
[2026-02-08 13:34:26] + flist='*.diag ./heartbeat.json ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1'
[2026-02-08 13:34:26] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-08 13:34:26] + '[' -e ./gmlog/ ']'
[2026-02-08 13:34:26] + '[' -f output.list ']'
[2026-02-08 13:34:26] + tar cvf result.tar.gz qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag ./heartbeat.json ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1
[2026-02-08 13:34:26] + '[' xgnutime = xcgroup ']'
[2026-02-08 13:34:26] + '[' -n '' ']'
[2026-02-08 13:34:26] + '[' -n '' ']'
[2026-02-08 13:34:26] ++ date +%s
[2026-02-08 13:34:26] + ACCOUNTING_ENDTIME=1770575666
[2026-02-08 13:34:26] ++ date -d '1970-01-01 UTC 1770575445 seconds' +%Y%m%d%H%M%SZ
[2026-02-08 13:34:26] + echo LRMSStartTime=20260208133045Z
[2026-02-08 13:34:26] ++ date -d '1970-01-01 UTC 1770575666 seconds' +%Y%m%d%H%M%SZ
[2026-02-08 13:34:26] + echo LRMSEndTime=20260208133426Z
[2026-02-08 13:34:26] + echo walltime=221
[2026-02-08 13:34:26] + echo exitcode=2
[2026-02-08 13:34:26] + exit 2
[2026-02-08 13:34:27] ./pilot3/pilot/util/loggingsupport.py
[2026-02-08 13:34:27] ./pilot3/pilot/util/lokirealtimelogger.py
[2026-02-08 13:34:27] ./pilot3/pilot/util/realtimelogger.py
[2026-02-08 13:34:27] ./pilot3/pilot/util/__pycache__/lokirealtimelogger.cpython-39.pyc
[2026-02-08 13:34:27] ./pilot3/pilot/util/__pycache__/realtimelogger.cpython-39.pyc
[2026-02-08 13:34:27] ./pilot3/pilot/util/__pycache__/loggingsupport.cpython-39.pyc
[2026-02-08 13:34:27] ./runtime_log
[2026-02-08 13:34:27] ./pilotlog.txt
[2026-02-08 13:34:27] ./runtime_log.err
[2026-02-08 13:34:27] ./PanDA_Pilot-7000923103/PoolFileCatalog.xml
[2026-02-08 13:34:27] ./PanDA_Pilot-7000923103/pilotlog.txt
[2026-02-08 13:34:27] ./PanDA_Pilot-7000923103/log.EVNTtoHITS
[2026-02-08 13:34:27] ./PanDA_Pilot-7000923103/prmon.log
[2026-02-08 13:34:27] ./log.48431096._005829.job.log.1
13:40:10 (1055126): BOINC client no longer exists - exiting
13:40:10 (1055126): timer handler: client dead, exiting
13:48:17 (1139043): wrapper (7.7.26015): starting
13:48:17 (1139043): wrapper: running run_atlas (--nthreads 8)
[2026-02-08 13:48:17] Arguments: --nthreads 8
[2026-02-08 13:48:17] Threads: 8
[2026-02-08 13:48:17] This job has been restarted, cleaning up previous attempt
[2026-02-08 13:48:17] Checking for CVMFS
[2026-02-08 13:48:17] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-08 13:48:17] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-08 13:48:17] Running cvmfs_config stat atlas.cern.ch
[2026-02-08 13:48:17] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-08 13:48:17] 2.13.3.0 8707 65086 380260 156029 3 436 30814673 39288833 20018 16776704 0 91745868 99.555 108849909 32716 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-02-08 13:48:17] CVMFS is ok
[2026-02-08 13:48:17] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-08 13:48:17] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-08 13:48:17] Further information can be found at the LHC@home message board.
[2026-02-08 13:48:17] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-08 13:48:17] Checking for apptainer binary...
[2026-02-08 13:48:17] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-08 13:48:17] Running /usr/bin/apptainer --version
[2026-02-08 13:48:17] apptainer version 1.4.5-2.el9
[2026-02-08 13:48:17] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-08 13:48:17] c-211-20.aglt2.org
[2026-02-08 13:48:17] apptainer works
[2026-02-08 13:48:17] Set ATHENA_PROC_NUMBER=8
[2026-02-08 13:48:17] Set ATHENA_CORE_NUMBER=8
[2026-02-08 13:48:17] Starting ATLAS job with PandaID=7000923103
[2026-02-08 13:48:17] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/4 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
00:30:55 (3734735): wrapper (7.7.26015): starting
00:30:55 (3734735): wrapper: running run_atlas (--nthreads 8)
[2026-02-09 00:30:55] Arguments: --nthreads 8
[2026-02-09 00:30:55] Threads: 8
[2026-02-09 00:30:55] This job has been restarted, cleaning up previous attempt
[2026-02-09 00:30:55] Checking for CVMFS
[2026-02-09 00:30:55] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-09 00:30:56] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-09 00:30:56] Running cvmfs_config stat atlas.cern.ch
[2026-02-09 00:30:56] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-09 00:30:56] 2.13.3.0 8707 65729 372600 156045 1 196 33141736 39288832 22770 16776704 0 92750079 99.559 108912850 32719 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-02-09 00:30:56] CVMFS is ok
[2026-02-09 00:30:56] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-09 00:30:56] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-09 00:30:56] Further information can be found at the LHC@home message board.
[2026-02-09 00:30:56] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-09 00:30:56] Checking for apptainer binary...
[2026-02-09 00:30:56] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-09 00:30:56] Running /usr/bin/apptainer --version
[2026-02-09 00:30:56] apptainer version 1.4.5-2.el9
[2026-02-09 00:30:56] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-09 00:30:57] c-211-20.aglt2.org
[2026-02-09 00:30:57] apptainer works
[2026-02-09 00:30:57] Set ATHENA_PROC_NUMBER=8
[2026-02-09 00:30:57] Set ATHENA_CORE_NUMBER=8
[2026-02-09 00:30:57] Starting ATLAS job with PandaID=7000923103
[2026-02-09 00:30:57] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/4 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
17:22:44 (4061438): wrapper (7.7.26015): starting
17:22:44 (4061438): wrapper: running run_atlas (--nthreads 9)
[2026-02-09 17:22:44] Arguments: --nthreads 9
[2026-02-09 17:22:44] Threads: 9
[2026-02-09 17:22:44] This job has been restarted, cleaning up previous attempt
[2026-02-09 17:22:44] Checking for CVMFS
[2026-02-09 17:22:44] Probing /cvmfs/atlas.cern.ch... OK
[2026-02-09 17:22:44] Probing /cvmfs/atlas-condb.cern.ch... OK
[2026-02-09 17:22:44] Running cvmfs_config stat atlas.cern.ch
[2026-02-09 17:22:45] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2026-02-09 17:22:45] 2.13.3.0 8707 66741 372372 156067 2 98 21293997 39288832 18398 16776704 0 94166032 99.562 110158194 32744 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2026-02-09 17:22:45] CVMFS is ok
[2026-02-09 17:22:45] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2026-02-09 17:22:45] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2026-02-09 17:22:45] Further information can be found at the LHC@home message board.
[2026-02-09 17:22:45] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2026-02-09 17:22:45] Checking for apptainer binary...
[2026-02-09 17:22:45] Using apptainer found in PATH at /usr/bin/apptainer
[2026-02-09 17:22:45] Running /usr/bin/apptainer --version
[2026-02-09 17:22:45] apptainer version 1.4.5-2.el9
[2026-02-09 17:22:45] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2026-02-09 17:22:45] c-211-20.aglt2.org
[2026-02-09 17:22:45] apptainer works
[2026-02-09 17:22:45] Set ATHENA_PROC_NUMBER=9
[2026-02-09 17:22:45] Set ATHENA_CORE_NUMBER=9
[2026-02-09 17:22:45] Starting ATLAS job with PandaID=7000923103
[2026-02-09 17:22:45] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/4 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2026-02-09 17:25:59] Job failed
[2026-02-09 17:25:59] ++ pwd
[2026-02-09 17:25:59] + export RUNTIME_CONFIG_DIR=/tmp/boinchome/slots/4/
[2026-02-09 17:25:59] + RUNTIME_CONFIG_DIR=/tmp/boinchome/slots/4/
[2026-02-09 17:25:59] + mv ATLAS.root_0 EVNT.48431094._000268.pool.root.1
[2026-02-09 17:25:59] mv: ‘ATLAS.root_0’ and ‘EVNT.48431094._000268.pool.root.1’ are the same file
[2026-02-09 17:25:59] + tar --strip-components=5 -xvf input.tar.gz
[2026-02-09 17:25:59] + umask 077
[2026-02-09 17:25:59] ++ date +%s
[2026-02-09 17:25:59] + ACCOUNTING_STARTTIME=1770675765
[2026-02-09 17:25:59] + echo 'Detecting resource accounting method available for the job.'
[2026-02-09 17:25:59] Detecting resource accounting method available for the job.
[2026-02-09 17:25:59] + JOB_ACCOUNTING=
[2026-02-09 17:25:59] + command -v arc-job-cgroup
[2026-02-09 17:25:59] + '[' -z '' ']'
[2026-02-09 17:25:59] + GNU_TIME=/usr/bin/time
[2026-02-09 17:25:59] + echo 'Looking for /usr/bin/time tool for accounting measurements'
[2026-02-09 17:25:59] Looking for /usr/bin/time tool for accounting measurements
[2026-02-09 17:25:59] + '[' '!' -z /usr/bin/time ']'
[2026-02-09 17:25:59] + /usr/bin/time --version
[2026-02-09 17:25:59] + echo 'GNU time found and will be used for job accounting.'
[2026-02-09 17:25:59] GNU time found and will be used for job accounting.
[2026-02-09 17:25:59] + JOB_ACCOUNTING=gnutime
[2026-02-09 17:25:59] + '[' -z gnutime ']'
[2026-02-09 17:25:59] + export PANDA_JSID=harvester-CERN_central_ACTA
[2026-02-09 17:25:59] + PANDA_JSID=harvester-CERN_central_ACTA
[2026-02-09 17:25:59] + export GTAG=http://aipanda404.cern.ch/data/jobs/2026-02-06/BOINC_MCORE/7000923103.out
[2026-02-09 17:25:59] + GTAG=http://aipanda404.cern.ch/data/jobs/2026-02-06/BOINC_MCORE/7000923103.out
[2026-02-09 17:25:59] + export PILOT_NOKILL=YES
[2026-02-09 17:25:59] + PILOT_NOKILL=YES
[2026-02-09 17:25:59] + export GRID_GLOBAL_JOBID=qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-09 17:25:59] + GRID_GLOBAL_JOBID=qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-09 17:25:59] + export GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-09 17:25:59] + GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm
[2026-02-09 17:25:59] + export GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2026-02-09 17:25:59] + GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2026-02-09 17:25:59] + export GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2026-02-09 17:25:59] + GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2026-02-09 17:25:59] ++ pwd
[2026-02-09 17:25:59] + RUNTIME_JOB_DIR=/tmp/boinchome/slots/4
[2026-02-09 17:25:59] + RUNTIME_JOB_STDIN=/dev/null
[2026-02-09 17:25:59] ++ pwd
[2026-02-09 17:25:59] + RUNTIME_JOB_STDOUT=/tmp/boinchome/slots/4/log.48431096._005829.job.log.1
[2026-02-09 17:25:59] ++ pwd
[2026-02-09 17:25:59] + RUNTIME_JOB_STDERR=/tmp/boinchome/slots/4/log.48431096._005829.job.log.1
[2026-02-09 17:25:59] ++ pwd
[2026-02-09 17:25:59] + RUNTIME_JOB_DIAG=/tmp/boinchome/slots/4.diag
[2026-02-09 17:25:59] + '[' '!' -z '' ']'
[2026-02-09 17:25:59] + RUNTIME_LOCAL_SCRATCH_DIR=
[2026-02-09 17:25:59] + RUNTIME_LOCAL_SCRATCH_MOVE_TOOL=mv
[2026-02-09 17:25:59] + RUNTIME_FRONTEND_SEES_NODE=
[2026-02-09 17:25:59] + RUNTIME_NODE_SEES_FRONTEND=yes
[2026-02-09 17:25:59] + '[' '!' -z '' ']'
[2026-02-09 17:25:59] + '[' -z yes ']'
[2026-02-09 17:25:59] ++ pwd
[2026-02-09 17:25:59] + RUNTIME_JOB_DIAG=/tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag
[2026-02-09 17:25:59] + runtimeenvironments=
[2026-02-09 17:25:59] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2026-02-09 17:25:59] + RTE_function_0 1
[2026-02-09 17:25:59] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-09 17:25:59] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-09 17:25:59] + export BOINC_APP=ATLAS
[2026-02-09 17:25:59] + BOINC_APP=ATLAS
[2026-02-09 17:25:59] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-09 17:25:59] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-09 17:25:59] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-09 17:25:59] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-09 17:25:59] + '[' -z 1 ']'
[2026-02-09 17:25:59] + '[' 1 == 1 ']'
[2026-02-09 17:25:59] + shift
[2026-02-09 17:25:59] + export SITE_NAME=BOINC
[2026-02-09 17:25:59] + SITE_NAME=BOINC
[2026-02-09 17:25:59] + export ATLAS_LOCAL_AREA=/tmp/boinchome/slots/4/
[2026-02-09 17:25:59] + ATLAS_LOCAL_AREA=/tmp/boinchome/slots/4/
[2026-02-09 17:25:59] + '[' -e /tmp/boinchome/slots/4/init_data.xml ']'
[2026-02-09 17:25:59] + grep '<use_http_proxy/>' /tmp/boinchome/slots/4/init_data.xml
[2026-02-09 17:25:59] ++ sed -e '/<proxy_info>/,/<\/proxy_info>/ s/^.*<http_server_name>\([^<]*\).*/\1/p' -n /tmp/boinchome/slots/4/init_data.xml
[2026-02-09 17:25:59] + PROXY_HOST=sl-um-es2.slateci.io
[2026-02-09 17:25:59] ++ sed -e '/<proxy_info>/,/<\/proxy_info>/ s/^.*<http_server_port>\([^<]*\).*/\1/p' -n /tmp/boinchome/slots/4/init_data.xml
[2026-02-09 17:25:59] + PROXY_PORT=6081
[2026-02-09 17:25:59] + '[' -n sl-um-es2.slateci.io ']'
[2026-02-09 17:25:59] + '[' -n 6081 ']'
[2026-02-09 17:25:59] + export FRONTIER_PROXY=http://sl-um-es2.slateci.io:6081
[2026-02-09 17:25:59] + FRONTIER_PROXY=http://sl-um-es2.slateci.io:6081
[2026-02-09 17:25:59] + echo 'export FRONTIER_PROXY="http://sl-um-es2.slateci.io:6081"'
[2026-02-09 17:25:59] + '[' 0 -ne 0 ']'
[2026-02-09 17:25:59] + echo 'runtimeenvironments=APPS/HEP/ATLAS-SITE;'
[2026-02-09 17:25:59] + '[' -f /etc/os-release ']'
[2026-02-09 17:25:59] +++ cat /etc/os-release
[2026-02-09 17:25:59] ++ eval 'NAME="CentOS' 'Linux"' 'VERSION="7' '(Core)"' 'ID="centos"' 'ID_LIKE="rhel' 'fedora"' 'VERSION_ID="7"' 'PRETTY_NAME="CentOS' Linux 7 '(Core)"' 'ANSI_COLOR="0;31"' 'CPE_NAME="cpe:/o:centos:centos:7"' 'HOME_URL="https://www.centos.org/"' 'BUG_REPORT_URL="https://bugs.centos.org/"' 'CENTOS_MANTISBT_PROJECT="CentOS-7"' 'CENTOS_MANTISBT_PROJECT_VERSION="7"' 'REDHAT_SUPPORT_PRODUCT="centos"' 'REDHAT_SUPPORT_PRODUCT_VERSION="7"'
[2026-02-09 17:25:59] +++ NAME='CentOS Linux'
[2026-02-09 17:25:59] +++ VERSION='7 (Core)'
[2026-02-09 17:25:59] +++ ID=centos
[2026-02-09 17:25:59] +++ ID_LIKE='rhel fedora'
[2026-02-09 17:25:59] +++ VERSION_ID=7
[2026-02-09 17:25:59] +++ PRETTY_NAME='CentOS Linux 7 (Core)'
[2026-02-09 17:25:59] +++ ANSI_COLOR='0;31'
[2026-02-09 17:25:59] +++ CPE_NAME=cpe:/o:centos:centos:7
[2026-02-09 17:25:59] +++ HOME_URL=https://www.centos.org/
[2026-02-09 17:25:59] +++ BUG_REPORT_URL=https://bugs.centos.org/
[2026-02-09 17:25:59] +++ CENTOS_MANTISBT_PROJECT=CentOS-7
[2026-02-09 17:25:59] +++ CENTOS_MANTISBT_PROJECT_VERSION=7
[2026-02-09 17:25:59] +++ REDHAT_SUPPORT_PRODUCT=centos
[2026-02-09 17:25:59] +++ REDHAT_SUPPORT_PRODUCT_VERSION=7
[2026-02-09 17:25:59] ++ echo 'CentOS Linux 7 (Core)'
[2026-02-09 17:25:59] + SYSTEM_SOFTWARE='CentOS Linux 7 (Core)'
[2026-02-09 17:25:59] + '[' -n 'CentOS Linux 7 (Core)' ']'
[2026-02-09 17:25:59] + echo 'systemsoftware=CentOS Linux 7 (Core)'
[2026-02-09 17:25:59] + HOME=/tmp/boinchome/slots/4
[2026-02-09 17:25:59] + export HOME
[2026-02-09 17:25:59] + cd /tmp/boinchome/slots/4
[2026-02-09 17:25:59] + '[' '!' -z '' ']'
[2026-02-09 17:25:59] + '[' -z '' ']'
[2026-02-09 17:25:59] ++ /bin/hostname -f
[2026-02-09 17:25:59] + nodename=c-211-20.aglt2.org
[2026-02-09 17:25:59] + echo nodename=c-211-20.aglt2.org
[2026-02-09 17:25:59] + echo Processors=2
[2026-02-09 17:25:59] + echo Nodecount=1
[2026-02-09 17:25:59] + echo Benchmark=HEPSPEC:1.0
[2026-02-09 17:25:59] + executable=./runpilot2-wrapper.sh
[2026-02-09 17:25:59] + '[' '!' -f ./runpilot2-wrapper.sh ']'
[2026-02-09 17:25:59] ++ head -n 1
[2026-02-09 17:25:59] ++ tr -d '\0'
[2026-02-09 17:25:59] ++ dd if=./runpilot2-wrapper.sh count=1
[2026-02-09 17:25:59] + line1='#!/bin/bash'
[2026-02-09 17:25:59] ++ echo '#!/bin/bash'
[2026-02-09 17:25:59] ++ sed -n 's/^#! *//p'
[2026-02-09 17:25:59] + shebang=/bin/bash
[2026-02-09 17:25:59] ++ echo /bin/bash
[2026-02-09 17:25:59] ++ awk '{print $1}'
[2026-02-09 17:25:59] + interpreter=/bin/bash
[2026-02-09 17:25:59] + '[' /bin/bash = /usr/bin/env ']'
[2026-02-09 17:25:59] + '[' x/bin/bash = x ']'
[2026-02-09 17:25:59] + type /bin/bash
[2026-02-09 17:25:59] + '[' xgnutime = xgnutime ']'
[2026-02-09 17:25:59] + /usr/bin/time -o /tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag -a -f 'WallTime=%es\nKernelTime=%Ss\nUserTime=%Us\nCPUUsage=%P\nMaxResidentMemory=%MkB\nAverageResidentMemory=%tkB\nAverageTotalMemory=%KkB\nAverageUnsharedMemory=%DkB\nAverageUnsharedStack=%pkB\nAverageSharedMemory=%XkB\nPageSize=%ZB\nMajorPageFaults=%F\nMinorPageFaults=%R\nSwaps=%W\nForcedSwitches=%c\nWaitSwitches=%w\nInputs=%I\nOutputs=%O\nSocketReceived=%r\nSocketSent=%s\nSignals=%k\n' ./runpilot2-wrapper.sh -q BOINC_MCORE -j managed --pilot-user ATLAS --harvester-submit-mode PUSH -w generic --job-type managed --resource-type MCORE --pilotversion 3.11.4.1 -z -t --piloturl local --mute --container
[2026-02-09 17:25:59] + RESULT=2
[2026-02-09 17:25:59] + sed -i -e /nodename=/d /tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag
[2026-02-09 17:25:59] ++ sed -e 's# #_#g'
[2026-02-09 17:25:59] ++ awk -F '<' '{print $1}'
[2026-02-09 17:25:59] ++ grep domain_name init_data.xml
[2026-02-09 17:25:59] ++ awk -F '>' '{print $2}'
[2026-02-09 17:25:59] + hostname=c-211-20.aglt2.org
[2026-02-09 17:25:59] ++ grep user_name init_data.xml
[2026-02-09 17:25:59] ++ awk -F '>' '{print $2}'
[2026-02-09 17:25:59] ++ awk -F '<' '{print $1}'
[2026-02-09 17:25:59] ++ sed -e 's# #_#g'
[2026-02-09 17:25:59] + username=AGLT2
[2026-02-09 17:25:59] + nodename=AGLT2@c-211-20.aglt2.org
[2026-02-09 17:25:59] + echo nodename=AGLT2@c-211-20.aglt2.org
[2026-02-09 17:25:59] + '[' -n 9 ']'
[2026-02-09 17:25:59] + sed -i -e s/Processors=1/Processors=9/ /tmp/boinchome/slots/4/qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag
[2026-02-09 17:25:59] + echo exitcode=2
[2026-02-09 17:25:59] + runtimeenvironments=
[2026-02-09 17:25:59] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2026-02-09 17:25:59] + RTE_function_0 2
[2026-02-09 17:25:59] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-09 17:25:59] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2026-02-09 17:25:59] + export BOINC_APP=ATLAS
[2026-02-09 17:25:59] + BOINC_APP=ATLAS
[2026-02-09 17:25:59] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-09 17:25:59] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2026-02-09 17:25:59] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-09 17:25:59] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2026-02-09 17:25:59] + '[' -z 2 ']'
[2026-02-09 17:25:59] + '[' 2 == 1 ']'
[2026-02-09 17:25:59] + '[' 0 -ne 0 ']'
[2026-02-09 17:25:59] + echo 'zip all output files'
[2026-02-09 17:25:59] + flist='*.diag '
[2026-02-09 17:25:59] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-09 17:25:59] + '[' -e ./heartbeat.json ']'
[2026-02-09 17:25:59] + flist='*.diag ./heartbeat.json'
[2026-02-09 17:25:59] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-09 17:25:59] + '[' -e ./output.list ']'
[2026-02-09 17:25:59] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-09 17:25:59] + '[' -e ./log.48431096._005829.job.log.1 ']'
[2026-02-09 17:25:59] + flist='*.diag ./heartbeat.json ./log.48431096._005829.job.log.1'
[2026-02-09 17:25:59] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-09 17:25:59] + '[' -e ./log.48431096._005829.job.log.1 ']'
[2026-02-09 17:25:59] + flist='*.diag ./heartbeat.json ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1'
[2026-02-09 17:25:59] + for f in ./heartbeat.json ./output.list ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1 ./gmlog/
[2026-02-09 17:25:59] + '[' -e ./gmlog/ ']'
[2026-02-09 17:25:59] + '[' -f output.list ']'
[2026-02-09 17:25:59] + tar cvf result.tar.gz qInKDmZgS88nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmiXXKDmkMpERm.diag ./heartbeat.json ./log.48431096._005829.job.log.1 ./log.48431096._005829.job.log.1
[2026-02-09 17:25:59] + '[' xgnutime = xcgroup ']'
[2026-02-09 17:25:59] + '[' -n '' ']'
[2026-02-09 17:25:59] + '[' -n '' ']'
[2026-02-09 17:25:59] ++ date +%s
[2026-02-09 17:25:59] + ACCOUNTING_ENDTIME=1770675959
[2026-02-09 17:25:59] ++ date -d '1970-01-01 UTC 1770675765 seconds' +%Y%m%d%H%M%SZ
[2026-02-09 17:25:59] + echo LRMSStartTime=20260209172245Z
[2026-02-09 17:25:59] ++ date -d '1970-01-01 UTC 1770675959 seconds' +%Y%m%d%H%M%SZ
[2026-02-09 17:25:59] + echo LRMSEndTime=20260209172559Z
[2026-02-09 17:25:59] + echo walltime=194
[2026-02-09 17:25:59] + echo exitcode=2
[2026-02-09 17:25:59] + exit 2
[2026-02-09 17:25:59] ./pilot3/pilot/util/loggingsupport.py
[2026-02-09 17:25:59] ./pilot3/pilot/util/lokirealtimelogger.py
[2026-02-09 17:25:59] ./pilot3/pilot/util/realtimelogger.py
[2026-02-09 17:25:59] ./pilot3/pilot/util/__pycache__/lokirealtimelogger.cpython-39.pyc
[2026-02-09 17:25:59] ./pilot3/pilot/util/__pycache__/realtimelogger.cpython-39.pyc
[2026-02-09 17:25:59] ./pilot3/pilot/util/__pycache__/loggingsupport.cpython-39.pyc
[2026-02-09 17:25:59] ./runtime_log
[2026-02-09 17:25:59] ./pilotlog.txt
[2026-02-09 17:25:59] ./runtime_log.err
[2026-02-09 17:25:59] ./PanDA_Pilot-7000923103/PoolFileCatalog.xml
[2026-02-09 17:25:59] ./PanDA_Pilot-7000923103/pilotlog.txt
[2026-02-09 17:25:59] ./PanDA_Pilot-7000923103/log.EVNTtoHITS
[2026-02-09 17:25:59] ./PanDA_Pilot-7000923103/prmon.log
[2026-02-09 17:25:59] ./log.48431096._005829.job.log.1
17:36:00 (4061438): run_atlas exited; CPU time 17.632816
17:36:00 (4061438): app exit status: 0x1
17:36:00 (4061438): called boinc_finish(195)
</stderr_txt>
]]>
©2026 CERN