Name j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m_0
Workunit 222973029
Created 13 May 2024, 9:59:57 UTC
Sent 13 May 2024, 11:38:20 UTC
Report deadline 25 May 2024, 11:23:18 UTC
Received 18 May 2024, 15:18:54 UTC
Server state Over
Outcome No reply
Client state Compute error
Exit status 195 (0x000000C3) EXIT_CHILD_FAILED
Computer ID 10691382
Run time 33 min 34 sec
CPU time 12 min 39 sec
Validate state Initial
Credit 0.00
Device peak FLOPS 11.73 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.33 GB
Peak swap size 2.86 GB
Peak disk usage 1.73 GB

Stderr output

<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 195 (0xc3, -61)</message>
<stderr_txt>
21:26:27 (1858347): wrapper (7.7.26015): starting
21:26:27 (1858347): wrapper: running run_atlas (--nthreads 4)
[2024-05-17 21:26:27] Arguments: --nthreads 4
[2024-05-17 21:26:27] Threads: 4
[2024-05-17 21:26:27] Checking for CVMFS
[2024-05-17 21:26:27] No cvmfs_config command found, will try listing directly
[2024-05-17 21:26:27] CVMFS is ok
[2024-05-17 21:26:27] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-05-17 21:26:27] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-05-17 21:26:27] Further information can be found at the LHC@home message board.
[2024-05-17 21:26:27] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-05-17 21:26:27] Checking for apptainer binary...
[2024-05-17 21:26:27] which: no apptainer in ((null))
[2024-05-17 21:26:27] apptainer is not installed, using version from CVMFS
[2024-05-17 21:26:27] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-05-17 21:26:27] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot28/slots/1/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut30.grid.cesnet.cz
[2024-05-17 21:26:27] apptainer works
[2024-05-17 21:26:27] Set ATHENA_PROC_NUMBER=4
[2024-05-17 21:26:27] Set ATHENA_CORE_NUMBER=4
[2024-05-17 21:26:27] Starting ATLAS job with PandaID=6205826598
[2024-05-17 21:26:27] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot28/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
04:03:25 (2261493): wrapper (7.7.26015): starting
04:03:25 (2261493): wrapper: running run_atlas (--nthreads 4)
[2024-05-18 04:03:25] Arguments: --nthreads 4
[2024-05-18 04:03:25] Threads: 4
[2024-05-18 04:03:25] This job has been restarted, cleaning up previous attempt
[2024-05-18 04:03:25] Checking for CVMFS
[2024-05-18 04:03:25] No cvmfs_config command found, will try listing directly
[2024-05-18 04:03:25] CVMFS is ok
[2024-05-18 04:03:25] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-05-18 04:03:25] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-05-18 04:03:25] Further information can be found at the LHC@home message board.
[2024-05-18 04:03:25] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-05-18 04:03:25] Checking for apptainer binary...
[2024-05-18 04:03:25] which: no apptainer in ((null))
[2024-05-18 04:03:25] apptainer is not installed, using version from CVMFS
[2024-05-18 04:03:25] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-05-18 04:03:25] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot28/slots/1/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut30.grid.cesnet.cz
[2024-05-18 04:03:25] apptainer works
[2024-05-18 04:03:25] Set ATHENA_PROC_NUMBER=4
[2024-05-18 04:03:25] Set ATHENA_CORE_NUMBER=4
[2024-05-18 04:03:25] Starting ATLAS job with PandaID=6205826598
[2024-05-18 04:03:25] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot28/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-05-18 04:06:34] Job failed
[2024-05-18 04:06:34] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot28/slots/1/.apptainertmp], will not forward new value [/tmp] from parent process environment
[2024-05-18 04:06:34] ++ pwd
[2024-05-18 04:06:34] + export RUNTIME_CONFIG_DIR=/scratch/boinc/var/slot28/slots/1/
[2024-05-18 04:06:34] + RUNTIME_CONFIG_DIR=/scratch/boinc/var/slot28/slots/1/
[2024-05-18 04:06:34] + mv ATLAS.root_0 EVNT.38776140._000163.pool.root.1
[2024-05-18 04:06:34] mv: 'ATLAS.root_0' and 'EVNT.38776140._000163.pool.root.1' are the same file
[2024-05-18 04:06:34] + tar --strip-components=5 -xvf input.tar.gz
[2024-05-18 04:06:34] + umask 077
[2024-05-18 04:06:34] ++ date +%s
[2024-05-18 04:06:34] + ACCOUNTING_STARTTIME=1715997806
[2024-05-18 04:06:34] + echo 'Detecting resource accounting method available for the job.'
[2024-05-18 04:06:34] Detecting resource accounting method available for the job.
[2024-05-18 04:06:34] + JOB_ACCOUNTING=
[2024-05-18 04:06:34] + command -v arc-job-cgroup
[2024-05-18 04:06:34] + '[' -z '' ']'
[2024-05-18 04:06:34] + GNU_TIME=/usr/bin/time
[2024-05-18 04:06:34] + echo 'Looking for /usr/bin/time tool for accounting measurements'
[2024-05-18 04:06:34] Looking for /usr/bin/time tool for accounting measurements
[2024-05-18 04:06:34] + '[' '!' -z /usr/bin/time ']'
[2024-05-18 04:06:34] + /usr/bin/time --version
[2024-05-18 04:06:34] + echo 'GNU time found and will be used for job accounting.'
[2024-05-18 04:06:34] GNU time found and will be used for job accounting.
[2024-05-18 04:06:34] + JOB_ACCOUNTING=gnutime
[2024-05-18 04:06:34] + '[' -z gnutime ']'
[2024-05-18 04:06:34] + export PANDA_JSID=harvester-CERN_central_ACTA
[2024-05-18 04:06:34] + PANDA_JSID=harvester-CERN_central_ACTA
[2024-05-18 04:06:34] + export GTAG=http://aipanda404.cern.ch/data/jobs/2024-05-13/BOINC_MCORE/6205826598.out
[2024-05-18 04:06:34] + GTAG=http://aipanda404.cern.ch/data/jobs/2024-05-13/BOINC_MCORE/6205826598.out
[2024-05-18 04:06:34] + export PILOT_NOKILL=YES
[2024-05-18 04:06:34] + PILOT_NOKILL=YES
[2024-05-18 04:06:34] + export GRID_GLOBAL_JOBID=j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m
[2024-05-18 04:06:34] + GRID_GLOBAL_JOBID=j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m
[2024-05-18 04:06:34] + export GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m
[2024-05-18 04:06:34] + GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m
[2024-05-18 04:06:34] + export GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2024-05-18 04:06:34] + GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2024-05-18 04:06:34] + export GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2024-05-18 04:06:34] + GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2024-05-18 04:06:34] ++ pwd
[2024-05-18 04:06:34] + RUNTIME_JOB_DIR=/scratch/boinc/var/slot28/slots/1
[2024-05-18 04:06:34] + RUNTIME_JOB_STDIN=/dev/null
[2024-05-18 04:06:34] ++ pwd
[2024-05-18 04:06:34] + RUNTIME_JOB_STDOUT=/scratch/boinc/var/slot28/slots/1/log.38776146._004076.job.log.1
[2024-05-18 04:06:34] ++ pwd
[2024-05-18 04:06:34] + RUNTIME_JOB_STDERR=/scratch/boinc/var/slot28/slots/1/log.38776146._004076.job.log.1
[2024-05-18 04:06:34] ++ pwd
[2024-05-18 04:06:34] + RUNTIME_JOB_DIAG=/scratch/boinc/var/slot28/slots/1.diag
[2024-05-18 04:06:34] + '[' '!' -z '' ']'
[2024-05-18 04:06:34] + RUNTIME_LOCAL_SCRATCH_DIR=
[2024-05-18 04:06:34] + RUNTIME_LOCAL_SCRATCH_MOVE_TOOL=mv
[2024-05-18 04:06:34] + RUNTIME_FRONTEND_SEES_NODE=
[2024-05-18 04:06:34] + RUNTIME_NODE_SEES_FRONTEND=yes
[2024-05-18 04:06:34] + '[' '!' -z '' ']'
[2024-05-18 04:06:34] + '[' -z yes ']'
[2024-05-18 04:06:34] ++ pwd
[2024-05-18 04:06:34] + RUNTIME_JOB_DIAG=/scratch/boinc/var/slot28/slots/1/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m.diag
[2024-05-18 04:06:34] + runtimeenvironments=
[2024-05-18 04:06:34] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2024-05-18 04:06:34] + RTE_function_0 1
[2024-05-18 04:06:34] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2024-05-18 04:06:34] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2024-05-18 04:06:34] + export BOINC_APP=ATLAS
[2024-05-18 04:06:34] + BOINC_APP=ATLAS
[2024-05-18 04:06:34] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2024-05-18 04:06:34] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2024-05-18 04:06:34] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2024-05-18 04:06:34] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2024-05-18 04:06:34] + '[' -z 1 ']'
[2024-05-18 04:06:34] + '[' 1 == 1 ']'
[2024-05-18 04:06:34] + shift
[2024-05-18 04:06:34] + FRONTIER_SQUID_NDGF='(proxyurl=http://db-atlas-squid.ndgf.org:3128)(proxyurl=http://squid.vega.izum.si:3128)(proxyurl=http://grid-proxy.ijs.si:3128)(proxyurl=http://atlas-db-squid1.grid.uiocloud.no:3128)'
[2024-05-18 04:06:34] + FRONTIER_BACKUP='(backupproxyurl=http://atlasbpfrontier.cern.ch:3127)(backupproxyurl=http://atlasbpfrontier.fnal.gov:3127)'
[2024-05-18 04:06:34] + FRONTIER_WPAD='(proxyconfigurl=http://grid-wpad/wpad.dat)'
[2024-05-18 04:06:34] + export ATLAS_LOCAL_AREA=/scratch/boinc/var/slot28/slots/1/
[2024-05-18 04:06:34] + ATLAS_LOCAL_AREA=/scratch/boinc/var/slot28/slots/1/
[2024-05-18 04:06:34] + '[' -e /scratch/boinc/var/slot28/slots/1/init_data.xml ']'
[2024-05-18 04:06:34] + grep '<use_http_proxy/>' /scratch/boinc/var/slot28/slots/1/init_data.xml
[2024-05-18 04:06:34] + '[' -e /scratch/boinc/var/slot28/slots/1/init_data.xml ']'
[2024-05-18 04:06:34] + grep '.cern.ch</domain_name>' /scratch/boinc/var/slot28/slots/1/init_data.xml
[2024-05-18 04:06:34] + FRONTIER_SERVER_URLS='(serverurl=http://atlascern-frontier.openhtc.io:8080/atlr)(serverurl=http://atlasfrontier-ai.cern.ch:8000/atlr)'
[2024-05-18 04:06:34] + FRONTIER_PROXY_URLS='(proxyurl=http://db-atlas-squid.ndgf.org:3128)(proxyurl=http://squid.vega.izum.si:3128)(proxyurl=http://grid-proxy.ijs.si:3128)(proxyurl=http://atlas-db-squid1.grid.uiocloud.no:3128)(backupproxyurl=http://atlasbpfrontier.cern.ch:3127)(backupproxyurl=http://atlasbpfrontier.fnal.gov:3127)'
[2024-05-18 04:06:34] + echo 'export FRONTIER_SERVER="(serverurl=http://atlascern-frontier.openhtc.io:8080/atlr)(serverurl=http://atlasfrontier-ai.cern.ch:8000/atlr)(proxyurl=http://db-atlas-squid.ndgf.org:3128)(proxyurl=http://squid.vega.izum.si:3128)(proxyurl=http://grid-proxy.ijs.si:3128)(proxyurl=http://atlas-db-squid1.grid.uiocloud.no:3128)(backupproxyurl=http://atlasbpfrontier.cern.ch:3127)(backupproxyurl=http://atlasbpfrontier.fnal.gov:3127)"'
[2024-05-18 04:06:34] + export 'FRONTIER_SERVER=(serverurl=http://atlascern-frontier.openhtc.io:8080/atlr)(serverurl=http://atlasfrontier-ai.cern.ch:8000/atlr)(proxyurl=http://db-atlas-squid.ndgf.org:3128)(proxyurl=http://squid.vega.izum.si:3128)(proxyurl=http://grid-proxy.ijs.si:3128)(proxyurl=http://atlas-db-squid1.grid.uiocloud.no:3128)(backupproxyurl=http://atlasbpfrontier.cern.ch:3127)(backupproxyurl=http://atlasbpfrontier.fnal.gov:3127)'
[2024-05-18 04:06:34] + FRONTIER_SERVER='(serverurl=http://atlascern-frontier.openhtc.io:8080/atlr)(serverurl=http://atlasfrontier-ai.cern.ch:8000/atlr)(proxyurl=http://db-atlas-squid.ndgf.org:3128)(proxyurl=http://squid.vega.izum.si:3128)(proxyurl=http://grid-proxy.ijs.si:3128)(proxyurl=http://atlas-db-squid1.grid.uiocloud.no:3128)(backupproxyurl=http://atlasbpfrontier.cern.ch:3127)(backupproxyurl=http://atlasbpfrontier.fnal.gov:3127)'
[2024-05-18 04:06:34] + '[' 0 -ne 0 ']'
[2024-05-18 04:06:34] + echo 'runtimeenvironments=APPS/HEP/ATLAS-SITE;'
[2024-05-18 04:06:34] + '[' -f /etc/os-release ']'
[2024-05-18 04:06:34] +++ cat /etc/os-release
[2024-05-18 04:06:34] ++ eval 'NAME="CentOS' 'Linux"' 'VERSION="7' '(Core)"' 'ID="centos"' 'ID_LIKE="rhel' 'fedora"' 'VERSION_ID="7"' 'PRETTY_NAME="CentOS' Linux 7 '(Core)"' 'ANSI_COLOR="0;31"' 'CPE_NAME="cpe:/o:centos:centos:7"' 'HOME_URL="https://www.centos.org/"' 'BUG_REPORT_URL="https://bugs.centos.org/"' 'CENTOS_MANTISBT_PROJECT="CentOS-7"' 'CENTOS_MANTISBT_PROJECT_VERSION="7"' 'REDHAT_SUPPORT_PRODUCT="centos"' 'REDHAT_SUPPORT_PRODUCT_VERSION="7"'
[2024-05-18 04:06:34] +++ NAME='CentOS Linux'
[2024-05-18 04:06:34] +++ VERSION='7 (Core)'
[2024-05-18 04:06:34] +++ ID=centos
[2024-05-18 04:06:34] +++ ID_LIKE='rhel fedora'
[2024-05-18 04:06:34] +++ VERSION_ID=7
[2024-05-18 04:06:34] +++ PRETTY_NAME='CentOS Linux 7 (Core)'
[2024-05-18 04:06:34] +++ ANSI_COLOR='0;31'
[2024-05-18 04:06:34] +++ CPE_NAME=cpe:/o:centos:centos:7
[2024-05-18 04:06:34] +++ HOME_URL=https://www.centos.org/
[2024-05-18 04:06:34] +++ BUG_REPORT_URL=https://bugs.centos.org/
[2024-05-18 04:06:34] +++ CENTOS_MANTISBT_PROJECT=CentOS-7
[2024-05-18 04:06:34] +++ CENTOS_MANTISBT_PROJECT_VERSION=7
[2024-05-18 04:06:34] +++ REDHAT_SUPPORT_PRODUCT=centos
[2024-05-18 04:06:34] +++ REDHAT_SUPPORT_PRODUCT_VERSION=7
[2024-05-18 04:06:34] ++ echo 'CentOS Linux 7 (Core)'
[2024-05-18 04:06:34] + SYSTEM_SOFTWARE='CentOS Linux 7 (Core)'
[2024-05-18 04:06:34] + '[' -n 'CentOS Linux 7 (Core)' ']'
[2024-05-18 04:06:34] + echo 'systemsoftware=CentOS Linux 7 (Core)'
[2024-05-18 04:06:34] + HOME=/scratch/boinc/var/slot28/slots/1
[2024-05-18 04:06:34] + export HOME
[2024-05-18 04:06:34] + cd /scratch/boinc/var/slot28/slots/1
[2024-05-18 04:06:34] + '[' '!' -z '' ']'
[2024-05-18 04:06:34] + '[' -z '' ']'
[2024-05-18 04:06:34] ++ /bin/hostname -f
[2024-05-18 04:06:34] + nodename=skurut30.grid.cesnet.cz
[2024-05-18 04:06:34] + echo nodename=skurut30.grid.cesnet.cz
[2024-05-18 04:06:34] + echo Processors=1
[2024-05-18 04:06:34] + echo Benchmark=HEPSPEC:1.0
[2024-05-18 04:06:34] + executable=./runpilot2-wrapper.sh
[2024-05-18 04:06:34] + '[' '!' -f ./runpilot2-wrapper.sh ']'
[2024-05-18 04:06:34] ++ dd if=./runpilot2-wrapper.sh count=1
[2024-05-18 04:06:34] ++ head -n 1
[2024-05-18 04:06:34] ++ tr -d '\0'
[2024-05-18 04:06:34] + line1='#!/bin/bash'
[2024-05-18 04:06:34] ++ echo '#!/bin/bash'
[2024-05-18 04:06:34] ++ sed -n 's/^#! *//p'
[2024-05-18 04:06:34] + shebang=/bin/bash
[2024-05-18 04:06:34] ++ echo /bin/bash
[2024-05-18 04:06:34] ++ awk '{print $1}'
[2024-05-18 04:06:34] + interpreter=/bin/bash
[2024-05-18 04:06:34] + '[' /bin/bash = /usr/bin/env ']'
[2024-05-18 04:06:34] + '[' x/bin/bash = x ']'
[2024-05-18 04:06:34] + type /bin/bash
[2024-05-18 04:06:34] + '[' xgnutime = xgnutime ']'
[2024-05-18 04:06:34] + /usr/bin/time -o /scratch/boinc/var/slot28/slots/1/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m.diag -a -f 'WallTime=%es\nKernelTime=%Ss\nUserTime=%Us\nCPUUsage=%P\nMaxResidentMemory=%MkB\nAverageResidentMemory=%tkB\nAverageTotalMemory=%KkB\nAverageUnsharedMemory=%DkB\nAverageUnsharedStack=%pkB\nAverageSharedMemory=%XkB\nPageSize=%ZB\nMajorPageFaults=%F\nMinorPageFaults=%R\nSwaps=%W\nForcedSwitches=%c\nWaitSwitches=%w\nInputs=%I\nOutputs=%O\nSocketReceived=%r\nSocketSent=%s\nSignals=%k\n' ./runpilot2-wrapper.sh -q BOINC_MCORE -j managed --pilot-user ATLAS --harvester-submit-mode PUSH -w generic --job-type managed --resource-type SCORE_HIMEM --pilotversion 3.7.5.4 -z -t --piloturl local --mute --container
[2024-05-18 04:06:34] + RESULT=2
[2024-05-18 04:06:34] + sed -i -e /nodename=/d /scratch/boinc/var/slot28/slots/1/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m.diag
[2024-05-18 04:06:34] ++ grep domain_name init_data.xml
[2024-05-18 04:06:34] ++ awk -F '>' '{print $2}'
[2024-05-18 04:06:34] ++ awk -F '<' '{print $1}'
[2024-05-18 04:06:34] ++ sed -e 's# #_#g'
[2024-05-18 04:06:34] + hostname=skurut30.grid.cesnet.cz
[2024-05-18 04:06:34] ++ grep user_name init_data.xml
[2024-05-18 04:06:34] ++ awk -F '>' '{print $2}'
[2024-05-18 04:06:34] ++ awk -F '<' '{print $1}'
[2024-05-18 04:06:34] ++ sed -e 's# #_#g'
[2024-05-18 04:06:34] + username=praguelcg2
[2024-05-18 04:06:34] + nodename=praguelcg2@skurut30.grid.cesnet.cz
[2024-05-18 04:06:34] + echo nodename=praguelcg2@skurut30.grid.cesnet.cz
[2024-05-18 04:06:34] + '[' -n 4 ']'
[2024-05-18 04:06:34] + sed -i -e s/Processors=1/Processors=4/ /scratch/boinc/var/slot28/slots/1/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m.diag
[2024-05-18 04:06:34] + echo exitcode=2
[2024-05-18 04:06:34] + runtimeenvironments=
[2024-05-18 04:06:34] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2024-05-18 04:06:34] + RTE_function_0 2
[2024-05-18 04:06:34] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2024-05-18 04:06:34] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2024-05-18 04:06:34] + export BOINC_APP=ATLAS
[2024-05-18 04:06:34] + BOINC_APP=ATLAS
[2024-05-18 04:06:34] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2024-05-18 04:06:34] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2024-05-18 04:06:34] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2024-05-18 04:06:34] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2024-05-18 04:06:34] + '[' -z 2 ']'
[2024-05-18 04:06:34] + '[' 2 == 1 ']'
[2024-05-18 04:06:34] + '[' 0 -ne 0 ']'
[2024-05-18 04:06:34] + echo 'zip all output files'
[2024-05-18 04:06:34] + flist='*.diag '
[2024-05-18 04:06:34] + for f in ./heartbeat.json ./output.list ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1 ./gmlog/
[2024-05-18 04:06:34] + '[' -e ./heartbeat.json ']'
[2024-05-18 04:06:34] + flist='*.diag  ./heartbeat.json'
[2024-05-18 04:06:34] + for f in ./heartbeat.json ./output.list ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1 ./gmlog/
[2024-05-18 04:06:34] + '[' -e ./output.list ']'
[2024-05-18 04:06:34] + for f in ./heartbeat.json ./output.list ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1 ./gmlog/
[2024-05-18 04:06:34] + '[' -e ./log.38776146._004076.job.log.1 ']'
[2024-05-18 04:06:34] + flist='*.diag  ./heartbeat.json ./log.38776146._004076.job.log.1'
[2024-05-18 04:06:34] + for f in ./heartbeat.json ./output.list ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1 ./gmlog/
[2024-05-18 04:06:34] + '[' -e ./log.38776146._004076.job.log.1 ']'
[2024-05-18 04:06:34] + flist='*.diag  ./heartbeat.json ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1'
[2024-05-18 04:06:34] + for f in ./heartbeat.json ./output.list ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1 ./gmlog/
[2024-05-18 04:06:34] + '[' -e ./gmlog/ ']'
[2024-05-18 04:06:34] + '[' -f output.list ']'
[2024-05-18 04:06:34] + tar cvf result.tar.gz j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m.diag ./heartbeat.json ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1
[2024-05-18 04:06:34] + '[' xgnutime = xcgroup ']'
[2024-05-18 04:06:34] + '[' -n '' ']'
[2024-05-18 04:06:34] + '[' -n '' ']'
[2024-05-18 04:06:34] ++ date +%s
[2024-05-18 04:06:34] + ACCOUNTING_ENDTIME=1715997993
[2024-05-18 04:06:34] ++ date -d '1970-01-01 UTC 1715997806 seconds' +%Y%m%d%H%M%SZ
[2024-05-18 04:06:34] + echo LRMSStartTime=20240518040326Z
[2024-05-18 04:06:34] ++ date -d '1970-01-01 UTC 1715997993 seconds' +%Y%m%d%H%M%SZ
[2024-05-18 04:06:34] + echo LRMSEndTime=20240518040633Z
[2024-05-18 04:06:34] + echo walltime=187
[2024-05-18 04:06:34] + echo exitcode=2
[2024-05-18 04:06:34] + exit 2
[2024-05-18 04:06:34] ./pilot3/pilot/util/loggingsupport.py
[2024-05-18 04:06:34] ./pilot3/pilot/util/realtimelogger.py
[2024-05-18 04:06:34] ./pilot3/pilot/util/__pycache__/loggingsupport.cpython-39.pyc
[2024-05-18 04:06:34] ./pilot3/pilot/util/__pycache__/realtimelogger.cpython-39.pyc
[2024-05-18 04:06:34] ./runtime_log.err
[2024-05-18 04:06:34] ./log.38776146._004076.job.log.1
[2024-05-18 04:06:34] ./PanDA_Pilot-6205826598/PoolFileCatalog.xml
[2024-05-18 04:06:34] ./PanDA_Pilot-6205826598/log.EVNTtoHITS
[2024-05-18 04:06:34] ./PanDA_Pilot-6205826598/pilotlog.txt
[2024-05-18 04:06:34] ./PanDA_Pilot-6205826598/prmon.log
[2024-05-18 04:06:34] ./runtime_log
[2024-05-18 04:06:34] ./pilotlog.txt
07:43:34 (2472530): wrapper (7.7.26015): starting
07:43:34 (2472530): wrapper: running run_atlas (--nthreads 4)
[2024-05-18 07:43:34] Arguments: --nthreads 4
[2024-05-18 07:43:34] Threads: 4
[2024-05-18 07:43:34] This job has been restarted, cleaning up previous attempt
[2024-05-18 07:43:34] Checking for CVMFS
[2024-05-18 07:43:34] No cvmfs_config command found, will try listing directly
[2024-05-18 07:43:34] CVMFS is ok
[2024-05-18 07:43:34] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-05-18 07:43:34] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-05-18 07:43:34] Further information can be found at the LHC@home message board.
[2024-05-18 07:43:34] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-05-18 07:43:34] Checking for apptainer binary...
[2024-05-18 07:43:34] which: no apptainer in ((null))
[2024-05-18 07:43:34] apptainer is not installed, using version from CVMFS
[2024-05-18 07:43:34] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-05-18 07:43:34] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot28/slots/1/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut30.grid.cesnet.cz
[2024-05-18 07:43:34] apptainer works
[2024-05-18 07:43:34] Set ATHENA_PROC_NUMBER=4
[2024-05-18 07:43:34] Set ATHENA_CORE_NUMBER=4
[2024-05-18 07:43:34] Starting ATLAS job with PandaID=6205826598
[2024-05-18 07:43:34] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot28/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
12:23:47 (2707998): wrapper (7.7.26015): starting
12:23:47 (2707998): wrapper: running run_atlas (--nthreads 4)
[2024-05-18 12:23:47] Arguments: --nthreads 4
[2024-05-18 12:23:47] Threads: 4
[2024-05-18 12:23:47] This job has been restarted, cleaning up previous attempt
[2024-05-18 12:23:47] Checking for CVMFS
[2024-05-18 12:23:47] No cvmfs_config command found, will try listing directly
[2024-05-18 12:23:47] CVMFS is ok
[2024-05-18 12:23:47] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-05-18 12:23:47] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-05-18 12:23:47] Further information can be found at the LHC@home message board.
[2024-05-18 12:23:47] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-05-18 12:23:47] Checking for apptainer binary...
[2024-05-18 12:23:47] which: no apptainer in ((null))
[2024-05-18 12:23:47] apptainer is not installed, using version from CVMFS
[2024-05-18 12:23:47] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-05-18 12:23:47] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot28/slots/1/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut30.grid.cesnet.cz
[2024-05-18 12:23:47] apptainer works
[2024-05-18 12:23:47] Set ATHENA_PROC_NUMBER=4
[2024-05-18 12:23:47] Set ATHENA_CORE_NUMBER=4
[2024-05-18 12:23:47] Starting ATLAS job with PandaID=6205826598
[2024-05-18 12:23:47] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot28/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
17:04:00 (2925895): wrapper (7.7.26015): starting
17:04:00 (2925895): wrapper: running run_atlas (--nthreads 4)
[2024-05-18 17:04:00] Arguments: --nthreads 4
[2024-05-18 17:04:00] Threads: 4
[2024-05-18 17:04:00] This job has been restarted, cleaning up previous attempt
[2024-05-18 17:04:00] Checking for CVMFS
[2024-05-18 17:04:00] No cvmfs_config command found, will try listing directly
[2024-05-18 17:04:00] CVMFS is ok
[2024-05-18 17:04:00] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-05-18 17:04:00] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-05-18 17:04:00] Further information can be found at the LHC@home message board.
[2024-05-18 17:04:00] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-05-18 17:04:00] Checking for apptainer binary...
[2024-05-18 17:04:00] which: no apptainer in ((null))
[2024-05-18 17:04:00] apptainer is not installed, using version from CVMFS
[2024-05-18 17:04:00] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-05-18 17:04:00] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot28/slots/1/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut30.grid.cesnet.cz
[2024-05-18 17:04:00] apptainer works
[2024-05-18 17:04:00] Set ATHENA_PROC_NUMBER=4
[2024-05-18 17:04:00] Set ATHENA_CORE_NUMBER=4
[2024-05-18 17:04:00] Starting ATLAS job with PandaID=6205826598
[2024-05-18 17:04:00] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot28/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-05-18 17:07:09] Job failed
[2024-05-18 17:07:09] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot28/slots/1/.apptainertmp], will not forward new value [/tmp] from parent process environment
[2024-05-18 17:07:09] ++ pwd
[2024-05-18 17:07:09] + export RUNTIME_CONFIG_DIR=/scratch/boinc/var/slot28/slots/1/
[2024-05-18 17:07:09] + RUNTIME_CONFIG_DIR=/scratch/boinc/var/slot28/slots/1/
[2024-05-18 17:07:09] + mv ATLAS.root_0 EVNT.38776140._000163.pool.root.1
[2024-05-18 17:07:09] mv: 'ATLAS.root_0' and 'EVNT.38776140._000163.pool.root.1' are the same file
[2024-05-18 17:07:09] + tar --strip-components=5 -xvf input.tar.gz
[2024-05-18 17:07:09] + umask 077
[2024-05-18 17:07:09] ++ date +%s
[2024-05-18 17:07:09] + ACCOUNTING_STARTTIME=1716044641
[2024-05-18 17:07:09] + echo 'Detecting resource accounting method available for the job.'
[2024-05-18 17:07:09] Detecting resource accounting method available for the job.
[2024-05-18 17:07:09] + JOB_ACCOUNTING=
[2024-05-18 17:07:09] + command -v arc-job-cgroup
[2024-05-18 17:07:09] + '[' -z '' ']'
[2024-05-18 17:07:09] + GNU_TIME=/usr/bin/time
[2024-05-18 17:07:09] + echo 'Looking for /usr/bin/time tool for accounting measurements'
[2024-05-18 17:07:09] Looking for /usr/bin/time tool for accounting measurements
[2024-05-18 17:07:09] + '[' '!' -z /usr/bin/time ']'
[2024-05-18 17:07:09] + /usr/bin/time --version
[2024-05-18 17:07:09] + echo 'GNU time found and will be used for job accounting.'
[2024-05-18 17:07:09] GNU time found and will be used for job accounting.
[2024-05-18 17:07:09] + JOB_ACCOUNTING=gnutime
[2024-05-18 17:07:09] + '[' -z gnutime ']'
[2024-05-18 17:07:09] + export PANDA_JSID=harvester-CERN_central_ACTA
[2024-05-18 17:07:09] + PANDA_JSID=harvester-CERN_central_ACTA
[2024-05-18 17:07:09] + export GTAG=http://aipanda404.cern.ch/data/jobs/2024-05-13/BOINC_MCORE/6205826598.out
[2024-05-18 17:07:09] + GTAG=http://aipanda404.cern.ch/data/jobs/2024-05-13/BOINC_MCORE/6205826598.out
[2024-05-18 17:07:09] + export PILOT_NOKILL=YES
[2024-05-18 17:07:09] + PILOT_NOKILL=YES
[2024-05-18 17:07:09] + export GRID_GLOBAL_JOBID=j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m
[2024-05-18 17:07:09] + GRID_GLOBAL_JOBID=j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m
[2024-05-18 17:07:09] + export GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m
[2024-05-18 17:07:09] + GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m
[2024-05-18 17:07:09] + export GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2024-05-18 17:07:09] + GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
[2024-05-18 17:07:09] + export GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2024-05-18 17:07:09] + GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
[2024-05-18 17:07:09] ++ pwd
[2024-05-18 17:07:09] + RUNTIME_JOB_DIR=/scratch/boinc/var/slot28/slots/1
[2024-05-18 17:07:09] + RUNTIME_JOB_STDIN=/dev/null
[2024-05-18 17:07:09] ++ pwd
[2024-05-18 17:07:09] + RUNTIME_JOB_STDOUT=/scratch/boinc/var/slot28/slots/1/log.38776146._004076.job.log.1
[2024-05-18 17:07:09] ++ pwd
[2024-05-18 17:07:09] + RUNTIME_JOB_STDERR=/scratch/boinc/var/slot28/slots/1/log.38776146._004076.job.log.1
[2024-05-18 17:07:09] ++ pwd
[2024-05-18 17:07:09] + RUNTIME_JOB_DIAG=/scratch/boinc/var/slot28/slots/1.diag
[2024-05-18 17:07:09] + '[' '!' -z '' ']'
[2024-05-18 17:07:09] + RUNTIME_LOCAL_SCRATCH_DIR=
[2024-05-18 17:07:09] + RUNTIME_LOCAL_SCRATCH_MOVE_TOOL=mv
[2024-05-18 17:07:09] + RUNTIME_FRONTEND_SEES_NODE=
[2024-05-18 17:07:09] + RUNTIME_NODE_SEES_FRONTEND=yes
[2024-05-18 17:07:09] + '[' '!' -z '' ']'
[2024-05-18 17:07:09] + '[' -z yes ']'
[2024-05-18 17:07:09] ++ pwd
[2024-05-18 17:07:09] + RUNTIME_JOB_DIAG=/scratch/boinc/var/slot28/slots/1/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m.diag
[2024-05-18 17:07:09] + runtimeenvironments=
[2024-05-18 17:07:09] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2024-05-18 17:07:09] + RTE_function_0 1
[2024-05-18 17:07:09] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2024-05-18 17:07:09] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2024-05-18 17:07:09] + export BOINC_APP=ATLAS
[2024-05-18 17:07:09] + BOINC_APP=ATLAS
[2024-05-18 17:07:09] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2024-05-18 17:07:09] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2024-05-18 17:07:09] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2024-05-18 17:07:09] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2024-05-18 17:07:09] + '[' -z 1 ']'
[2024-05-18 17:07:09] + '[' 1 == 1 ']'
[2024-05-18 17:07:09] + shift
[2024-05-18 17:07:09] + FRONTIER_SQUID_NDGF='(proxyurl=http://db-atlas-squid.ndgf.org:3128)(proxyurl=http://squid.vega.izum.si:3128)(proxyurl=http://grid-proxy.ijs.si:3128)(proxyurl=http://atlas-db-squid1.grid.uiocloud.no:3128)'
[2024-05-18 17:07:09] + FRONTIER_BACKUP='(backupproxyurl=http://atlasbpfrontier.cern.ch:3127)(backupproxyurl=http://atlasbpfrontier.fnal.gov:3127)'
[2024-05-18 17:07:09] + FRONTIER_WPAD='(proxyconfigurl=http://grid-wpad/wpad.dat)'
[2024-05-18 17:07:09] + export ATLAS_LOCAL_AREA=/scratch/boinc/var/slot28/slots/1/
[2024-05-18 17:07:09] + ATLAS_LOCAL_AREA=/scratch/boinc/var/slot28/slots/1/
[2024-05-18 17:07:09] + '[' -e /scratch/boinc/var/slot28/slots/1/init_data.xml ']'
[2024-05-18 17:07:09] + grep '<use_http_proxy/>' /scratch/boinc/var/slot28/slots/1/init_data.xml
[2024-05-18 17:07:09] + '[' -e /scratch/boinc/var/slot28/slots/1/init_data.xml ']'
[2024-05-18 17:07:09] + grep '.cern.ch</domain_name>' /scratch/boinc/var/slot28/slots/1/init_data.xml
[2024-05-18 17:07:09] + FRONTIER_SERVER_URLS='(serverurl=http://atlascern-frontier.openhtc.io:8080/atlr)(serverurl=http://atlasfrontier-ai.cern.ch:8000/atlr)'
[2024-05-18 17:07:09] + FRONTIER_PROXY_URLS='(proxyurl=http://db-atlas-squid.ndgf.org:3128)(proxyurl=http://squid.vega.izum.si:3128)(proxyurl=http://grid-proxy.ijs.si:3128)(proxyurl=http://atlas-db-squid1.grid.uiocloud.no:3128)(backupproxyurl=http://atlasbpfrontier.cern.ch:3127)(backupproxyurl=http://atlasbpfrontier.fnal.gov:3127)'
[2024-05-18 17:07:09] + echo 'export FRONTIER_SERVER="(serverurl=http://atlascern-frontier.openhtc.io:8080/atlr)(serverurl=http://atlasfrontier-ai.cern.ch:8000/atlr)(proxyurl=http://db-atlas-squid.ndgf.org:3128)(proxyurl=http://squid.vega.izum.si:3128)(proxyurl=http://grid-proxy.ijs.si:3128)(proxyurl=http://atlas-db-squid1.grid.uiocloud.no:3128)(backupproxyurl=http://atlasbpfrontier.cern.ch:3127)(backupproxyurl=http://atlasbpfrontier.fnal.gov:3127)"'
[2024-05-18 17:07:09] + export 'FRONTIER_SERVER=(serverurl=http://atlascern-frontier.openhtc.io:8080/atlr)(serverurl=http://atlasfrontier-ai.cern.ch:8000/atlr)(proxyurl=http://db-atlas-squid.ndgf.org:3128)(proxyurl=http://squid.vega.izum.si:3128)(proxyurl=http://grid-proxy.ijs.si:3128)(proxyurl=http://atlas-db-squid1.grid.uiocloud.no:3128)(backupproxyurl=http://atlasbpfrontier.cern.ch:3127)(backupproxyurl=http://atlasbpfrontier.fnal.gov:3127)'
[2024-05-18 17:07:09] + FRONTIER_SERVER='(serverurl=http://atlascern-frontier.openhtc.io:8080/atlr)(serverurl=http://atlasfrontier-ai.cern.ch:8000/atlr)(proxyurl=http://db-atlas-squid.ndgf.org:3128)(proxyurl=http://squid.vega.izum.si:3128)(proxyurl=http://grid-proxy.ijs.si:3128)(proxyurl=http://atlas-db-squid1.grid.uiocloud.no:3128)(backupproxyurl=http://atlasbpfrontier.cern.ch:3127)(backupproxyurl=http://atlasbpfrontier.fnal.gov:3127)'
[2024-05-18 17:07:09] + '[' 0 -ne 0 ']'
[2024-05-18 17:07:09] + echo 'runtimeenvironments=APPS/HEP/ATLAS-SITE;'
[2024-05-18 17:07:09] + '[' -f /etc/os-release ']'
[2024-05-18 17:07:09] +++ cat /etc/os-release
[2024-05-18 17:07:09] ++ eval 'NAME="CentOS' 'Linux"' 'VERSION="7' '(Core)"' 'ID="centos"' 'ID_LIKE="rhel' 'fedora"' 'VERSION_ID="7"' 'PRETTY_NAME="CentOS' Linux 7 '(Core)"' 'ANSI_COLOR="0;31"' 'CPE_NAME="cpe:/o:centos:centos:7"' 'HOME_URL="https://www.centos.org/"' 'BUG_REPORT_URL="https://bugs.centos.org/"' 'CENTOS_MANTISBT_PROJECT="CentOS-7"' 'CENTOS_MANTISBT_PROJECT_VERSION="7"' 'REDHAT_SUPPORT_PRODUCT="centos"' 'REDHAT_SUPPORT_PRODUCT_VERSION="7"'
[2024-05-18 17:07:09] +++ NAME='CentOS Linux'
[2024-05-18 17:07:09] +++ VERSION='7 (Core)'
[2024-05-18 17:07:09] +++ ID=centos
[2024-05-18 17:07:09] +++ ID_LIKE='rhel fedora'
[2024-05-18 17:07:09] +++ VERSION_ID=7
[2024-05-18 17:07:09] +++ PRETTY_NAME='CentOS Linux 7 (Core)'
[2024-05-18 17:07:09] +++ ANSI_COLOR='0;31'
[2024-05-18 17:07:09] +++ CPE_NAME=cpe:/o:centos:centos:7
[2024-05-18 17:07:09] +++ HOME_URL=https://www.centos.org/
[2024-05-18 17:07:09] +++ BUG_REPORT_URL=https://bugs.centos.org/
[2024-05-18 17:07:09] +++ CENTOS_MANTISBT_PROJECT=CentOS-7
[2024-05-18 17:07:09] +++ CENTOS_MANTISBT_PROJECT_VERSION=7
[2024-05-18 17:07:09] +++ REDHAT_SUPPORT_PRODUCT=centos
[2024-05-18 17:07:09] +++ REDHAT_SUPPORT_PRODUCT_VERSION=7
[2024-05-18 17:07:09] ++ echo 'CentOS Linux 7 (Core)'
[2024-05-18 17:07:09] + SYSTEM_SOFTWARE='CentOS Linux 7 (Core)'
[2024-05-18 17:07:09] + '[' -n 'CentOS Linux 7 (Core)' ']'
[2024-05-18 17:07:09] + echo 'systemsoftware=CentOS Linux 7 (Core)'
[2024-05-18 17:07:09] + HOME=/scratch/boinc/var/slot28/slots/1
[2024-05-18 17:07:09] + export HOME
[2024-05-18 17:07:09] + cd /scratch/boinc/var/slot28/slots/1
[2024-05-18 17:07:09] + '[' '!' -z '' ']'
[2024-05-18 17:07:09] + '[' -z '' ']'
[2024-05-18 17:07:09] ++ /bin/hostname -f
[2024-05-18 17:07:09] + nodename=skurut30.grid.cesnet.cz
[2024-05-18 17:07:09] + echo nodename=skurut30.grid.cesnet.cz
[2024-05-18 17:07:09] + echo Processors=1
[2024-05-18 17:07:09] + echo Benchmark=HEPSPEC:1.0
[2024-05-18 17:07:09] + executable=./runpilot2-wrapper.sh
[2024-05-18 17:07:09] + '[' '!' -f ./runpilot2-wrapper.sh ']'
[2024-05-18 17:07:09] ++ dd if=./runpilot2-wrapper.sh count=1
[2024-05-18 17:07:09] ++ head -n 1
[2024-05-18 17:07:09] ++ tr -d '\0'
[2024-05-18 17:07:09] + line1='#!/bin/bash'
[2024-05-18 17:07:09] ++ echo '#!/bin/bash'
[2024-05-18 17:07:09] ++ sed -n 's/^#! *//p'
[2024-05-18 17:07:09] + shebang=/bin/bash
[2024-05-18 17:07:09] ++ echo /bin/bash
[2024-05-18 17:07:09] ++ awk '{print $1}'
[2024-05-18 17:07:09] + interpreter=/bin/bash
[2024-05-18 17:07:09] + '[' /bin/bash = /usr/bin/env ']'
[2024-05-18 17:07:09] + '[' x/bin/bash = x ']'
[2024-05-18 17:07:09] + type /bin/bash
[2024-05-18 17:07:09] + '[' xgnutime = xgnutime ']'
[2024-05-18 17:07:09] + /usr/bin/time -o /scratch/boinc/var/slot28/slots/1/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m.diag -a -f 'WallTime=%es\nKernelTime=%Ss\nUserTime=%Us\nCPUUsage=%P\nMaxResidentMemory=%MkB\nAverageResidentMemory=%tkB\nAverageTotalMemory=%KkB\nAverageUnsharedMemory=%DkB\nAverageUnsharedStack=%pkB\nAverageSharedMemory=%XkB\nPageSize=%ZB\nMajorPageFaults=%F\nMinorPageFaults=%R\nSwaps=%W\nForcedSwitches=%c\nWaitSwitches=%w\nInputs=%I\nOutputs=%O\nSocketReceived=%r\nSocketSent=%s\nSignals=%k\n' ./runpilot2-wrapper.sh -q BOINC_MCORE -j managed --pilot-user ATLAS --harvester-submit-mode PUSH -w generic --job-type managed --resource-type SCORE_HIMEM --pilotversion 3.7.5.4 -z -t --piloturl local --mute --container
[2024-05-18 17:07:09] + RESULT=2
[2024-05-18 17:07:09] + sed -i -e /nodename=/d /scratch/boinc/var/slot28/slots/1/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m.diag
[2024-05-18 17:07:09] ++ grep domain_name init_data.xml
[2024-05-18 17:07:09] ++ awk -F '>' '{print $2}'
[2024-05-18 17:07:09] ++ awk -F '<' '{print $1}'
[2024-05-18 17:07:09] ++ sed -e 's# #_#g'
[2024-05-18 17:07:09] + hostname=skurut30.grid.cesnet.cz
[2024-05-18 17:07:09] ++ grep user_name init_data.xml
[2024-05-18 17:07:09] ++ awk -F '>' '{print $2}'
[2024-05-18 17:07:09] ++ awk -F '<' '{print $1}'
[2024-05-18 17:07:09] ++ sed -e 's# #_#g'
[2024-05-18 17:07:09] + username=praguelcg2
[2024-05-18 17:07:09] + nodename=praguelcg2@skurut30.grid.cesnet.cz
[2024-05-18 17:07:09] + echo nodename=praguelcg2@skurut30.grid.cesnet.cz
[2024-05-18 17:07:09] + '[' -n 4 ']'
[2024-05-18 17:07:09] + sed -i -e s/Processors=1/Processors=4/ /scratch/boinc/var/slot28/slots/1/j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m.diag
[2024-05-18 17:07:09] + echo exitcode=2
[2024-05-18 17:07:09] + runtimeenvironments=
[2024-05-18 17:07:09] + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
[2024-05-18 17:07:09] + RTE_function_0 2
[2024-05-18 17:07:09] + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2024-05-18 17:07:09] + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
[2024-05-18 17:07:09] + export BOINC_APP=ATLAS
[2024-05-18 17:07:09] + BOINC_APP=ATLAS
[2024-05-18 17:07:09] + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2024-05-18 17:07:09] + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
[2024-05-18 17:07:09] + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2024-05-18 17:07:09] + RESULT_TEMPLATE=templates/ATLAS_OUT_2
[2024-05-18 17:07:09] + '[' -z 2 ']'
[2024-05-18 17:07:09] + '[' 2 == 1 ']'
[2024-05-18 17:07:09] + '[' 0 -ne 0 ']'
[2024-05-18 17:07:09] + echo 'zip all output files'
[2024-05-18 17:07:09] + flist='*.diag '
[2024-05-18 17:07:09] + for f in ./heartbeat.json ./output.list ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1 ./gmlog/
[2024-05-18 17:07:09] + '[' -e ./heartbeat.json ']'
[2024-05-18 17:07:09] + flist='*.diag  ./heartbeat.json'
[2024-05-18 17:07:09] + for f in ./heartbeat.json ./output.list ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1 ./gmlog/
[2024-05-18 17:07:09] + '[' -e ./output.list ']'
[2024-05-18 17:07:09] + for f in ./heartbeat.json ./output.list ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1 ./gmlog/
[2024-05-18 17:07:09] + '[' -e ./log.38776146._004076.job.log.1 ']'
[2024-05-18 17:07:09] + flist='*.diag  ./heartbeat.json ./log.38776146._004076.job.log.1'
[2024-05-18 17:07:09] + for f in ./heartbeat.json ./output.list ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1 ./gmlog/
[2024-05-18 17:07:09] + '[' -e ./log.38776146._004076.job.log.1 ']'
[2024-05-18 17:07:09] + flist='*.diag  ./heartbeat.json ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1'
[2024-05-18 17:07:09] + for f in ./heartbeat.json ./output.list ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1 ./gmlog/
[2024-05-18 17:07:09] + '[' -e ./gmlog/ ']'
[2024-05-18 17:07:09] + '[' -f output.list ']'
[2024-05-18 17:07:09] + tar cvf result.tar.gz j5OMDmGehQ5nsSi4apGgGQJmABFKDmABFKDm4ySLDmZHKKDmt9dJ9m.diag ./heartbeat.json ./log.38776146._004076.job.log.1 ./log.38776146._004076.job.log.1
[2024-05-18 17:07:09] + '[' xgnutime = xcgroup ']'
[2024-05-18 17:07:09] + '[' -n '' ']'
[2024-05-18 17:07:09] + '[' -n '' ']'
[2024-05-18 17:07:09] ++ date +%s
[2024-05-18 17:07:09] + ACCOUNTING_ENDTIME=1716044829
[2024-05-18 17:07:09] ++ date -d '1970-01-01 UTC 1716044641 seconds' +%Y%m%d%H%M%SZ
[2024-05-18 17:07:09] + echo LRMSStartTime=20240518170401Z
[2024-05-18 17:07:09] ++ date -d '1970-01-01 UTC 1716044829 seconds' +%Y%m%d%H%M%SZ
[2024-05-18 17:07:09] + echo LRMSEndTime=20240518170709Z
[2024-05-18 17:07:09] + echo walltime=188
[2024-05-18 17:07:09] + echo exitcode=2
[2024-05-18 17:07:09] + exit 2
[2024-05-18 17:07:09] ./pilot3/pilot/util/loggingsupport.py
[2024-05-18 17:07:09] ./pilot3/pilot/util/realtimelogger.py
[2024-05-18 17:07:09] ./pilot3/pilot/util/__pycache__/loggingsupport.cpython-39.pyc
[2024-05-18 17:07:09] ./pilot3/pilot/util/__pycache__/realtimelogger.cpython-39.pyc
[2024-05-18 17:07:09] ./runtime_log.err
[2024-05-18 17:07:09] ./log.38776146._004076.job.log.1
[2024-05-18 17:07:09] ./PanDA_Pilot-6205826598/PoolFileCatalog.xml
[2024-05-18 17:07:09] ./PanDA_Pilot-6205826598/log.EVNTtoHITS
[2024-05-18 17:07:09] ./PanDA_Pilot-6205826598/pilotlog.txt
[2024-05-18 17:07:09] ./PanDA_Pilot-6205826598/prmon.log
[2024-05-18 17:07:09] ./runtime_log
[2024-05-18 17:07:09] ./pilotlog.txt
17:17:10 (2925895): run_atlas exited; CPU time 13.378017
17:17:10 (2925895): app exit status: 0x1
17:17:10 (2925895): called boinc_finish(195)

</stderr_txt>
]]>


©2024 CERN