| Name | 0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn_1 |
| Workunit | 240006460 |
| Created | 26 Mar 2026, 20:44:39 UTC |
| Sent | 26 Mar 2026, 20:44:48 UTC |
| Report deadline | 3 Apr 2026, 20:44:48 UTC |
| Received | 28 Mar 2026, 5:08:12 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 10856935 |
| Run time | 7 hours 56 min 18 sec |
| CPU time | 1 days 13 hours 21 min 37 sec |
| Priority | 28 |
| Validate state | Valid |
| Credit | 1,968.39 |
| Device peak FLOPS | 26.01 GFLOPS |
| Application version | ATLAS Simulation v3.03 (vbox64_mt_mcore_atlas) x86_64-pc-linux-gnu |
| Peak working set size | 1.39 GB |
| Peak swap size | 5.32 GB |
| Peak disk usage | 3.46 GB |
Stderr output
<core_client_version>8.2.9</core_client_version>
<![CDATA[
<stderr_txt>
6): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2026-03-26 21:45:25 (8736): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2026-03-26 21:45:32 (8736): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2026-03-26 21:45:32 (8736): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2026-03-26 21:45:38 (8736): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2026-03-26 21:45:38 (8736): Guest Log: 00:00:00.000241 main Log opened 2026-03-26T20:45:36.632280000Z
2026-03-26 21:45:38 (8736): Guest Log: 00:00:00.000360 main OS Product: Linux
2026-03-26 21:45:38 (8736): Guest Log: 00:00:00.000389 main OS Release: 3.10.0-957.27.2.el7.x86_64
2026-03-26 21:45:38 (8736): Guest Log: 00:00:00.000408 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2026-03-26 21:45:38 (8736): Guest Log: 00:00:00.000427 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2026-03-26 21:45:38 (8736): Guest Log: 00:00:00.000428 main Process ID: 1316
2026-03-26 21:45:38 (8736): Guest Log: 00:00:00.000429 main Package type: LINUX_64BITS_GENERIC
2026-03-26 21:45:38 (8736): Guest Log: 00:00:00.001551 main 5.2.32 r132073 started. Verbose level = 0
2026-03-26 21:45:38 (8736): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2026-03-26 21:45:38 (8736): Guest Log: [INFO] Mounting shared directory
2026-03-26 21:45:39 (8736): Guest Log: [INFO] Checking for init_data.xml
2026-03-26 21:46:31 (8736): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2026-03-26 21:46:31 (8736): Guest Log: [INFO] Detected branch: prod
2026-03-26 21:46:31 (8736): Guest Log: This is the prod version of the ATLAS job wrapper
2026-03-26 21:46:31 (8736): Guest Log: Copying input files
2026-03-26 21:46:33 (8736): Guest Log: Copied input files into RunAtlas.
2026-03-26 21:46:33 (8736): Guest Log: This VM did not configure a local http proxy via BOINC.
2026-03-26 21:46:33 (8736): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2026-03-26 21:46:33 (8736): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2026-03-26 21:46:33 (8736): Guest Log: Further information can be found at the LHC@home message board.
2026-03-26 21:46:44 (8736): Guest Log: Running cvmfs_config stat atlas.cern.ch
2026-03-26 21:46:45 (8736): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2026-03-26 21:46:45 (8736): Guest Log: 2.6.3.0 1615 0 30184 157733 4 1 3117755 4096001 0 65024 0 0 n/a 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
2026-03-26 21:46:46 (8736): Guest Log: copied the webapp to /var/www
2026-03-26 21:46:46 (8736): Guest Log: ATHENA_PROC_NUMBER=5
2026-03-26 21:46:46 (8736): Guest Log: ATHENA_CORE_NUMBER=5
2026-03-26 21:46:47 (8736): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
2026-03-26 21:46:47 (8736): Guest Log: *** Starting ATLAS job. (PandaID=7058965792 taskID=49182303) ***
2026-03-26 22:21:32 (8736): Guest Log: *** Job finished ***
2026-03-26 22:21:32 (8736): Guest Log: Failed to produce a result! Shutting down the machine.
2026-03-26 22:21:32 (8736): Guest Log: ++ pwd
2026-03-26 22:21:32 (8736): Guest Log: + export RUNTIME_CONFIG_DIR=/home/atlas/RunAtlas/
2026-03-26 22:21:32 (8736): Guest Log: + RUNTIME_CONFIG_DIR=/home/atlas/RunAtlas/
2026-03-26 22:21:32 (8736): Guest Log: + mv ATLAS.root_0 EVNT.49136696._000003.pool.root.1
2026-03-26 22:21:32 (8736): Guest Log: + tar --strip-components=5 -xvf input.tar.gz
2026-03-26 22:21:32 (8736): Guest Log: + umask 077
2026-03-26 22:21:32 (8736): Guest Log: ++ date +%s
2026-03-26 22:21:32 (8736): Guest Log: + ACCOUNTING_STARTTIME=1774558013
2026-03-26 22:21:32 (8736): Guest Log: + echo 'Detecting resource accounting method available for the job.'
2026-03-26 22:21:32 (8736): Guest Log: Detecting resource accounting method available for the job.
2026-03-26 22:21:32 (8736): Guest Log: + JOB_ACCOUNTING=
2026-03-26 22:21:32 (8736): Guest Log: + command -v arc-job-cgroup
2026-03-26 22:21:32 (8736): Guest Log: + '[' -z '' ']'
2026-03-26 22:21:32 (8736): Guest Log: + GNU_TIME=/usr/bin/time
2026-03-26 22:21:32 (8736): Guest Log: + echo 'Looking for /usr/bin/time tool for accounting measurements'
2026-03-26 22:21:32 (8736): Guest Log: Looking for /usr/bin/time tool for accounting measurements
2026-03-26 22:21:32 (8736): Guest Log: + '[' '!' -z /usr/bin/time ']'
2026-03-26 22:21:32 (8736): Guest Log: + /usr/bin/time --version
2026-03-26 22:21:32 (8736): Guest Log: + echo 'GNU time found and will be used for job accounting.'
2026-03-26 22:21:32 (8736): Guest Log: GNU time found and will be used for job accounting.
2026-03-26 22:21:32 (8736): Guest Log: + JOB_ACCOUNTING=gnutime
2026-03-26 22:21:32 (8736): Guest Log: + '[' -z gnutime ']'
2026-03-26 22:21:32 (8736): Guest Log: + export PANDA_JSID=harvester-CERN_central_ACTA
2026-03-26 22:21:32 (8736): Guest Log: + PANDA_JSID=harvester-CERN_central_ACTA
2026-03-26 22:21:32 (8736): Guest Log: + export GTAG=http://aipanda403.cern.ch/data/jobs/2026-03-18/BOINC_MCORE/7058965792.out
2026-03-26 22:21:32 (8736): Guest Log: + GTAG=http://aipanda403.cern.ch/data/jobs/2026-03-18/BOINC_MCORE/7058965792.out
2026-03-26 22:21:32 (8736): Guest Log: + export PILOT_NOKILL=YES
2026-03-26 22:21:32 (8736): Guest Log: + PILOT_NOKILL=YES
2026-03-26 22:21:32 (8736): Guest Log: + export GRID_GLOBAL_JOBID=0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn
2026-03-26 22:21:32 (8736): Guest Log: + GRID_GLOBAL_JOBID=0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn
2026-03-26 22:21:32 (8736): Guest Log: + export GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn
2026-03-26 22:21:32 (8736): Guest Log: + GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn
2026-03-26 22:21:32 (8736): Guest Log: + export GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
2026-03-26 22:21:32 (8736): Guest Log: + GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
2026-03-26 22:21:32 (8736): Guest Log: + export GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
2026-03-26 22:21:32 (8736): Guest Log: + GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
2026-03-26 22:21:32 (8736): Guest Log: ++ pwd
2026-03-26 22:21:32 (8736): Guest Log: + RUNTIME_JOB_DIR=/home/atlas/RunAtlas
2026-03-26 22:21:32 (8736): Guest Log: + RUNTIME_JOB_STDIN=/dev/null
2026-03-26 22:21:32 (8736): Guest Log: ++ pwd
2026-03-26 22:21:32 (8736): Guest Log: + RUNTIME_JOB_STDOUT=/home/atlas/RunAtlas/log.49182303._000062.job.log.1
2026-03-26 22:21:32 (8736): Guest Log: ++ pwd
2026-03-26 22:21:32 (8736): Guest Log: + RUNTIME_JOB_STDERR=/home/atlas/RunAtlas/log.49182303._000062.job.log.1
2026-03-26 22:21:32 (8736): Guest Log: ++ pwd
2026-03-26 22:21:32 (8736): Guest Log: + RUNTIME_JOB_DIAG=/home/atlas/RunAtlas.diag
2026-03-26 22:21:32 (8736): Guest Log: + '[' '!' -z '' ']'
2026-03-26 22:21:32 (8736): Guest Log: + RUNTIME_LOCAL_SCRATCH_DIR=
2026-03-26 22:21:32 (8736): Guest Log: + RUNTIME_LOCAL_SCRATCH_MOVE_TOOL=mv
2026-03-26 22:21:32 (8736): Guest Log: + RUNTIME_FRONTEND_SEES_NODE=
2026-03-26 22:21:32 (8736): Guest Log: + RUNTIME_NODE_SEES_FRONTEND=yes
2026-03-26 22:21:32 (8736): Guest Log: + '[' '!' -z '' ']'
2026-03-26 22:21:32 (8736): Guest Log: + '[' -z yes ']'
2026-03-26 22:21:32 (8736): Guest Log: ++ pwd
2026-03-26 22:21:32 (8736): Guest Log: + RUNTIME_JOB_DIAG=/home/atlas/RunAtlas/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn.diag
2026-03-26 22:21:32 (8736): Guest Log: + runtimeenvironments=
2026-03-26 22:21:32 (8736): Guest Log: + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
2026-03-26 22:21:32 (8736): Guest Log: + RTE_function_0 1
2026-03-26 22:21:32 (8736): Guest Log: + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
2026-03-26 22:21:32 (8736): Guest Log: + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
2026-03-26 22:21:32 (8736): Guest Log: + export BOINC_APP=ATLAS
2026-03-26 22:21:32 (8736): Guest Log: + BOINC_APP=ATLAS
2026-03-26 22:21:32 (8736): Guest Log: + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
2026-03-26 22:21:32 (8736): Guest Log: + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
2026-03-26 22:21:32 (8736): Guest Log: + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
2026-03-26 22:21:32 (8736): Guest Log: + RESULT_TEMPLATE=templates/ATLAS_OUT_2
2026-03-26 22:21:32 (8736): Guest Log: + '[' -z 1 ']'
2026-03-26 22:21:32 (8736): Guest Log: + '[' 1 == 1 ']'
2026-03-26 22:21:32 (8736): Guest Log: + shift
2026-03-26 22:21:32 (8736): Guest Log: + export SITE_NAME=BOINC
2026-03-26 22:21:32 (8736): Guest Log: + SITE_NAME=BOINC
2026-03-26 22:21:32 (8736): Guest Log: + export ATLAS_LOCAL_AREA=/home/atlas/RunAtlas/
2026-03-26 22:21:32 (8736): Guest Log: + ATLAS_LOCAL_AREA=/home/atlas/RunAtlas/
2026-03-26 22:21:32 (8736): Guest Log: + '[' -e /home/atlas/RunAtlas/init_data.xml ']'
2026-03-26 22:21:32 (8736): Guest Log: + grep '<use_http_proxy/>' /home/atlas/RunAtlas/init_data.xml
2026-03-26 22:21:32 (8736): Guest Log: + '[' 0 -ne 0 ']'
2026-03-26 22:21:32 (8736): Guest Log: + echo 'runtimeenvironments=APPS/HEP/ATLAS-SITE;'
2026-03-26 22:21:32 (8736): Guest Log: + '[' -f /etc/os-release ']'
2026-03-26 22:21:32 (8736): Guest Log: +++ cat /etc/os-release
2026-03-26 22:21:32 (8736): Guest Log: ++ eval 'NAME="CentOS' 'Linux"' 'VERSION="7' '(Core)"' 'ID="centos"' 'ID_LIKE="rhel' 'fedora"' 'VERSION_ID="7"' 'PRETTY_NAME="CentOS' Linux 7 '(Core)"' 'ANSI_COLOR="0;31"' 'CPE_NAME="cpe:/o:centos:centos:7"' 'HOME_URL="https://www.centos.org/"' 'BUG_REPORT_URL="https://bugs.centos.org/"' 'CENTOS_MANTISBT_PROJECT="CentOS-7"' 'CENTOS_MANTISBT_PROJECT_VERSION="7"' 'REDHAT_SUPPORT_PRODUCT="centos"' 'REDHAT_SUPPORT_PRODUCT_VERSION="7"'
2026-03-26 22:21:32 (8736): Guest Log: +++ NAME='CentOS Linux'
2026-03-26 22:21:32 (8736): Guest Log: +++ VERSION='7 (Core)'
2026-03-26 22:21:32 (8736): Guest Log: +++ ID=centos
2026-03-26 22:21:32 (8736): Guest Log: +++ ID_LIKE='rhel fedora'
2026-03-26 22:21:32 (8736): Guest Log: +++ VERSION_ID=7
2026-03-26 22:21:32 (8736): Guest Log: +++ PRETTY_NAME='CentOS Linux 7 (Core)'
2026-03-26 22:21:32 (8736): Guest Log: +++ ANSI_COLOR='0;31'
2026-03-26 22:21:32 (8736): Guest Log: +++ CPE_NAME=cpe:/o:centos:centos:7
2026-03-26 22:21:32 (8736): Guest Log: +++ HOME_URL=https://www.centos.org/
2026-03-26 22:21:32 (8736): Guest Log: +++ BUG_REPORT_URL=https://bugs.centos.org/
2026-03-26 22:21:32 (8736): Guest Log: +++ CENTOS_MANTISBT_PROJECT=CentOS-7
2026-03-26 22:21:32 (8736): Guest Log: +++ CENTOS_MANTISBT_PROJECT_VERSION=7
2026-03-26 22:21:32 (8736): Guest Log: +++ REDHAT_SUPPORT_PRODUCT=centos
2026-03-26 22:21:32 (8736): Guest Log: +++ REDHAT_SUPPORT_PRODUCT_VERSION=7
2026-03-26 22:21:32 (8736): Guest Log: ++ echo 'CentOS Linux 7 (Core)'
2026-03-26 22:21:32 (8736): Guest Log: + SYSTEM_SOFTWARE='CentOS Linux 7 (Core)'
2026-03-26 22:21:32 (8736): Guest Log: + '[' -n 'CentOS Linux 7 (Core)' ']'
2026-03-26 22:21:32 (8736): Guest Log: + echo 'systemsoftware=CentOS Linux 7 (Core)'
2026-03-26 22:21:32 (8736): Guest Log: + HOME=/home/atlas/RunAtlas
2026-03-26 22:21:32 (8736): Guest Log: + export HOME
2026-03-26 22:21:32 (8736): Guest Log: + cd /home/atlas/RunAtlas
2026-03-26 22:21:32 (8736): Guest Log: + '[' '!' -z '' ']'
2026-03-26 22:21:32 (8736): Guest Log: + '[' -z '' ']'
2026-03-26 22:21:32 (8736): Guest Log: ++ /bin/hostname -f
2026-03-26 22:21:32 (8736): Guest Log: + nodename=localhost
2026-03-26 22:21:32 (8736): Guest Log: + echo nodename=localhost
2026-03-26 22:21:32 (8736): Guest Log: + echo Processors=2
2026-03-26 22:21:32 (8736): Guest Log: + echo Nodecount=1
2026-03-26 22:21:32 (8736): Guest Log: + echo Benchmark=HEPSPEC:1.0
2026-03-26 22:21:32 (8736): Guest Log: + executable=./runpilot2-wrapper.sh
2026-03-26 22:21:32 (8736): Guest Log: + '[' '!' -f ./runpilot2-wrapper.sh ']'
2026-03-26 22:21:32 (8736): Guest Log: ++ dd if=./runpilot2-wrapper.sh count=1
2026-03-26 22:21:32 (8736): Guest Log: ++ head -n 1
2026-03-26 22:21:32 (8736): Guest Log: ++ tr -d '\0'
2026-03-26 22:21:32 (8736): Guest Log: + line1='#!/bin/bash'
2026-03-26 22:21:32 (8736): Guest Log: ++ echo '#!/bin/bash'
2026-03-26 22:21:32 (8736): Guest Log: ++ sed -n 's/^#! *//p'
2026-03-26 22:21:32 (8736): Guest Log: + shebang=/bin/bash
2026-03-26 22:21:32 (8736): Guest Log: ++ echo /bin/bash
2026-03-26 22:21:32 (8736): Guest Log: ++ awk '{print $1}'
2026-03-26 22:21:32 (8736): Guest Log: + interpreter=/bin/bash
2026-03-26 22:21:32 (8736): Guest Log: + '[' /bin/bash = /usr/bin/env ']'
2026-03-26 22:21:32 (8736): Guest Log: + '[' x/bin/bash = x ']'
2026-03-26 22:21:32 (8736): Guest Log: + type /bin/bash
2026-03-26 22:21:32 (8736): Guest Log: + '[' xgnutime = xgnutime ']'
2026-03-26 22:21:33 (8736): Guest Log: + /usr/bin/time -o /home/atlas/RunAtlas/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn.diag -a -f 'WallTime=%es\nKernelTime=%Ss\nUserTime=%Us\nCPUUsage=%P\nMaxResidentMemory=%MkB\nAverageResidentMemory=%tkB\nAverageTotalMemory=%KkB\nAverageUnsharedMemory=%DkB\nAverageUnsharedStack=%pkB\nAverageSharedMemory=%XkB\nPageSize=%ZB\nMajorPageFaults=%F\nMinorPageFaults=%R\nSwaps=%W\nForcedSwitches=%c\nWaitSwitches=%w\nInputs=%I\nOutputs=%O\nSocketReceived=%r\nSocketSent=%s\nSignals=%k\n' ./runpilot2-wrappe
2026-03-26 22:21:33 (8736): Guest Log: r.sh -q BOINC_MCORE -j managed --pilot-user ATLAS --harvester-submit-mode PUSH -w generic --job-type managed --resource-type MCORE --pilotversion 3.11.5.1 -z -t --piloturl local --mute --container
2026-03-26 22:21:33 (8736): Guest Log: start_atlas.sh: line 242: 2205 Bus error $GNU_TIME -o "$RUNTIME_JOB_DIAG" -a -f 'WallTime=%es\nKernelTime=%Ss\nUserTime=%Us\nCPUUsage=%P\nMaxResidentMemory=%MkB\nAverageResidentMemory=%tkB\nAverageTotalMemory=%KkB\nAverageUnsharedMemory=%DkB\nAverageUnsharedStack=%pkB\nAverageSharedMemory=%XkB\nPageSize=%ZB\nMajorPageFaults=%F\nMinorPageFaults=%R\nSwaps=%W\nForcedSwitches=%c\nWaitSwitches=%w\nInputs=%I\nOutputs=%O\nSocketReceived=%r\nSocketSent=%s\nSignals=%k\n' "./runpilot2-wrapper.sh" "-q"
2026-03-26 22:21:33 (8736): Guest Log: "BOINC_MCORE" "-j" "managed" "--pilot-user" "ATLAS" "--harvester-submit-mode" "PUSH" "-w" "generic" "--job-type" "managed" "--resource-type" "MCORE" "--pilotversion" "3.11.5.1" "-z" "-t" "--piloturl" "local" "--mute" "--container" < $RUNTIME_JOB_STDIN > $RUNTIME_JOB_STDOUT 2>&1
2026-03-26 22:21:33 (8736): Guest Log: + RESULT=135
2026-03-26 22:21:33 (8736): Guest Log: + sed -i -e /nodename=/d /home/atlas/RunAtlas/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn.diag
2026-03-26 22:21:33 (8736): Guest Log: start_atlas.sh: line 245: sed: command not found
2026-03-26 22:21:33 (8736): Guest Log: ++ grep domain_name init_data.xml
2026-03-26 22:21:33 (8736): Guest Log: start_atlas.sh: line 246: grep: command not found
2026-03-26 22:21:33 (8736): Guest Log: ++ awk -F '<' '{print $1}'
2026-03-26 22:21:33 (8736): Guest Log: start_atlas.sh: line 246: awk: command not found
2026-03-26 22:21:33 (8736): Guest Log: ++ sed -e 's# #_#g'
2026-03-26 22:21:33 (8736): Guest Log: start_atlas.sh: line 246: sed: command not found
2026-03-26 22:21:33 (8736): Guest Log: ++ awk -F '>' '{print $2}'
2026-03-26 22:21:33 (8736): Guest Log: start_atlas.sh: line 246: awk: command not found
2026-03-26 22:21:33 (8736): Guest Log: + hostname=
2026-03-26 22:21:33 (8736): Guest Log: ++ awk -F '<' '{print $1}'
2026-03-26 22:21:33 (8736): Guest Log: ++ grep user_name init_data.xml
2026-03-26 22:21:33 (8736): Guest Log: start_atlas.sh: line 247: awk: command not found
2026-03-26 22:21:33 (8736): Guest Log: start_atlas.sh: line 247: grep: command not found
2026-03-26 22:21:33 (8736): Guest Log: ++ sed -e 's# #_#g'
2026-03-26 22:21:33 (8736): Guest Log: start_atlas.sh: line 247: sed: command not found
2026-03-26 22:21:33 (8736): Guest Log: ++ awk -F '>' '{print $2}'
2026-03-26 22:21:33 (8736): Guest Log: start_atlas.sh: line 247: awk: command not found
2026-03-26 22:21:33 (8736): Guest Log: + username=
2026-03-26 22:21:33 (8736): Guest Log: unexpected fault address 0x559b5ec8a120
2026-03-26 22:21:33 (8736): Guest Log: fatal error: fault
2026-03-26 22:21:33 (8736): Guest Log: [signal SIGBUS: bus error code=0x2 addr=0x559b5ec8a120 pc=0x559b5ec8a120]
2026-03-26 22:21:33 (8736): Guest Log: goroutine 5 [running]:
2026-03-26 22:21:33 (8736): Guest Log: boincdata/boinc/ATLAS/session/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn/pandaJobData.out
2026-03-26 22:21:33 (8736): Guest Log: boincdata/boinc/ATLAS/session/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn/pilot3.tar.gz
2026-03-26 22:21:33 (8736): Guest Log: boincdata/boinc/ATLAS/session/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn/queuedata.json
2026-03-26 22:21:33 (8736): Guest Log: boincdata/boinc/ATLAS/session/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn/runpilot2-wrapper.sh
2026-03-27 18:04:51 (43471): vboxwrapper version 26210
2026-03-27 18:04:51 (43471): BOINC client version: 8.2.9
2026-03-27 18:04:52 (43471): Detected: VirtualBox VboxManage Interface (Version: 7.0.16)
2026-03-27 18:04:52 (43471): Register VM. (boinc_a6558f5893f980b8, slot#0)
2026-03-27 18:04:52 (43471): Guest Log: BIOS: VirtualBox 7.0.16
2026-03-27 18:04:52 (43471): Guest Log: CPUID EDX: 0x178bfbff
2026-03-27 18:04:52 (43471): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2026-03-27 18:04:52 (43471): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2026-03-27 18:04:52 (43471): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2026-03-27 18:04:52 (43471): Guest Log: BIOS: Booting from Hard Disk...
2026-03-27 18:04:52 (43471): Guest Log: BIOS: KBD: unsupported int 16h function 03
2026-03-27 18:04:52 (43471): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2026-03-27 18:04:52 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2026-03-27 18:04:52 (43471): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2026-03-27 18:04:52 (43471): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2026-03-27 18:04:52 (43471): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2026-03-27 18:04:52 (43471): Guest Log: 00:00:00.000241 main Log opened 2026-03-26T20:45:36.632280000Z
2026-03-27 18:04:52 (43471): Guest Log: 00:00:00.000360 main OS Product: Linux
2026-03-27 18:04:52 (43471): Guest Log: 00:00:00.000389 main OS Release: 3.10.0-957.27.2.el7.x86_64
2026-03-27 18:04:52 (43471): Guest Log: 00:00:00.000408 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2026-03-27 18:04:52 (43471): Guest Log: 00:00:00.000427 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2026-03-27 18:04:52 (43471): Guest Log: 00:00:00.000428 main Process ID: 1316
2026-03-27 18:04:52 (43471): Guest Log: 00:00:00.000429 main Package type: LINUX_64BITS_GENERIC
2026-03-27 18:04:52 (43471): Guest Log: 00:00:00.001551 main 5.2.32 r132073 started. Verbose level = 0
2026-03-27 18:04:52 (43471): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2026-03-27 18:04:52 (43471): Guest Log: [INFO] Mounting shared directory
2026-03-27 18:04:52 (43471): Guest Log: [INFO] Checking for init_data.xml
2026-03-27 18:04:52 (43471): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2026-03-27 18:04:52 (43471): Guest Log: [INFO] Detected branch: prod
2026-03-27 18:04:52 (43471): Guest Log: This is the prod version of the ATLAS job wrapper
2026-03-27 18:04:52 (43471): Guest Log: Copying input files
2026-03-27 18:04:52 (43471): Guest Log: Copied input files into RunAtlas.
2026-03-27 18:04:52 (43471): Guest Log: This VM did not configure a local http proxy via BOINC.
2026-03-27 18:04:52 (43471): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2026-03-27 18:04:52 (43471): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2026-03-27 18:04:52 (43471): Guest Log: Further information can be found at the LHC@home message board.
2026-03-27 18:04:52 (43471): Guest Log: Running cvmfs_config stat atlas.cern.ch
2026-03-27 18:04:52 (43471): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2026-03-27 18:04:52 (43471): Guest Log: 2.6.3.0 1615 0 30184 157733 4 1 3117755 4096001 0 65024 0 0 n/a 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
2026-03-27 18:04:52 (43471): Guest Log: copied the webapp to /var/www
2026-03-27 18:04:52 (43471): Guest Log: ATHENA_PROC_NUMBER=5
2026-03-27 18:04:52 (43471): Guest Log: ATHENA_CORE_NUMBER=5
2026-03-27 18:04:52 (43471): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
2026-03-27 18:04:52 (43471): Guest Log: *** Starting ATLAS job. (PandaID=7058965792 taskID=49182303) ***
2026-03-27 18:04:52 (43471): Guest Log: *** Job finished ***
2026-03-27 18:04:52 (43471): Guest Log: Failed to produce a result! Shutting down the machine.
2026-03-27 18:04:52 (43471): Guest Log: ++ pwd
2026-03-27 18:04:52 (43471): Guest Log: + export RUNTIME_CONFIG_DIR=/home/atlas/RunAtlas/
2026-03-27 18:04:52 (43471): Guest Log: + RUNTIME_CONFIG_DIR=/home/atlas/RunAtlas/
2026-03-27 18:04:52 (43471): Guest Log: + mv ATLAS.root_0 EVNT.49136696._000003.pool.root.1
2026-03-27 18:04:52 (43471): Guest Log: + tar --strip-components=5 -xvf input.tar.gz
2026-03-27 18:04:52 (43471): Guest Log: + umask 077
2026-03-27 18:04:52 (43471): Guest Log: ++ date +%s
2026-03-27 18:04:52 (43471): Guest Log: + ACCOUNTING_STARTTIME=1774558013
2026-03-27 18:04:52 (43471): Guest Log: + echo 'Detecting resource accounting method available for the job.'
2026-03-27 18:04:52 (43471): Guest Log: Detecting resource accounting method available for the job.
2026-03-27 18:04:52 (43471): Guest Log: + JOB_ACCOUNTING=
2026-03-27 18:04:52 (43471): Guest Log: + command -v arc-job-cgroup
2026-03-27 18:04:52 (43471): Guest Log: + '[' -z '' ']'
2026-03-27 18:04:52 (43471): Guest Log: + GNU_TIME=/usr/bin/time
2026-03-27 18:04:52 (43471): Guest Log: + echo 'Looking for /usr/bin/time tool for accounting measurements'
2026-03-27 18:04:52 (43471): Guest Log: Looking for /usr/bin/time tool for accounting measurements
2026-03-27 18:04:52 (43471): Guest Log: + '[' '!' -z /usr/bin/time ']'
2026-03-27 18:04:52 (43471): Guest Log: + /usr/bin/time --version
2026-03-27 18:04:52 (43471): Guest Log: + echo 'GNU time found and will be used for job accounting.'
2026-03-27 18:04:52 (43471): Guest Log: GNU time found and will be used for job accounting.
2026-03-27 18:04:52 (43471): Guest Log: + JOB_ACCOUNTING=gnutime
2026-03-27 18:04:52 (43471): Guest Log: + '[' -z gnutime ']'
2026-03-27 18:04:52 (43471): Guest Log: + export PANDA_JSID=harvester-CERN_central_ACTA
2026-03-27 18:04:52 (43471): Guest Log: + PANDA_JSID=harvester-CERN_central_ACTA
2026-03-27 18:04:52 (43471): Guest Log: + export GTAG=http://aipanda403.cern.ch/data/jobs/2026-03-18/BOINC_MCORE/7058965792.out
2026-03-27 18:04:52 (43471): Guest Log: + GTAG=http://aipanda403.cern.ch/data/jobs/2026-03-18/BOINC_MCORE/7058965792.out
2026-03-27 18:04:52 (43471): Guest Log: + export PILOT_NOKILL=YES
2026-03-27 18:04:52 (43471): Guest Log: + PILOT_NOKILL=YES
2026-03-27 18:04:52 (43471): Guest Log: + export GRID_GLOBAL_JOBID=0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn
2026-03-27 18:04:52 (43471): Guest Log: + GRID_GLOBAL_JOBID=0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn
2026-03-27 18:04:52 (43471): Guest Log: + export GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn
2026-03-27 18:04:52 (43471): Guest Log: + GRID_GLOBAL_JOBURL=https://arc-boinc-01.cern.ch:443/arex/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn
2026-03-27 18:04:52 (43471): Guest Log: + export GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
2026-03-27 18:04:52 (43471): Guest Log: + GRID_GLOBAL_JOBINTERFACE=org.nordugrid.arcrest
2026-03-27 18:04:52 (43471): Guest Log: + export GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
2026-03-27 18:04:52 (43471): Guest Log: + GRID_GLOBAL_JOBHOST=arc-boinc-01.cern.ch
2026-03-27 18:04:52 (43471): Guest Log: ++ pwd
2026-03-27 18:04:52 (43471): Guest Log: + RUNTIME_JOB_DIR=/home/atlas/RunAtlas
2026-03-27 18:04:52 (43471): Guest Log: + RUNTIME_JOB_STDIN=/dev/null
2026-03-27 18:04:52 (43471): Guest Log: ++ pwd
2026-03-27 18:04:52 (43471): Guest Log: + RUNTIME_JOB_STDOUT=/home/atlas/RunAtlas/log.49182303._000062.job.log.1
2026-03-27 18:04:52 (43471): Guest Log: ++ pwd
2026-03-27 18:04:52 (43471): Guest Log: + RUNTIME_JOB_STDERR=/home/atlas/RunAtlas/log.49182303._000062.job.log.1
2026-03-27 18:04:52 (43471): Guest Log: ++ pwd
2026-03-27 18:04:52 (43471): Guest Log: + RUNTIME_JOB_DIAG=/home/atlas/RunAtlas.diag
2026-03-27 18:04:52 (43471): Guest Log: + '[' '!' -z '' ']'
2026-03-27 18:04:52 (43471): Guest Log: + RUNTIME_LOCAL_SCRATCH_DIR=
2026-03-27 18:04:52 (43471): Guest Log: + RUNTIME_LOCAL_SCRATCH_MOVE_TOOL=mv
2026-03-27 18:04:52 (43471): Guest Log: + RUNTIME_FRONTEND_SEES_NODE=
2026-03-27 18:04:52 (43471): Guest Log: + RUNTIME_NODE_SEES_FRONTEND=yes
2026-03-27 18:04:52 (43471): Guest Log: + '[' '!' -z '' ']'
2026-03-27 18:04:52 (43471): Guest Log: + '[' -z yes ']'
2026-03-27 18:04:52 (43471): Guest Log: ++ pwd
2026-03-27 18:04:52 (43471): Guest Log: + RUNTIME_JOB_DIAG=/home/atlas/RunAtlas/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn.diag
2026-03-27 18:04:52 (43471): Guest Log: + runtimeenvironments=
2026-03-27 18:04:52 (43471): Guest Log: + runtimeenvironments='APPS/HEP/ATLAS-SITE;'
2026-03-27 18:04:52 (43471): Guest Log: + RTE_function_0 1
2026-03-27 18:04:52 (43471): Guest Log: + export PROJECT_ROOT=/boincdata/boinc/project/lhcathome
2026-03-27 18:04:52 (43471): Guest Log: + PROJECT_ROOT=/boincdata/boinc/project/lhcathome
2026-03-27 18:04:52 (43471): Guest Log: + export BOINC_APP=ATLAS
2026-03-27 18:04:52 (43471): Guest Log: + BOINC_APP=ATLAS
2026-03-27 18:04:52 (43471): Guest Log: + export WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
2026-03-27 18:04:52 (43471): Guest Log: + WU_TEMPLATE=templates/ATLAS_IN_DYNAMIC
2026-03-27 18:04:52 (43471): Guest Log: + export RESULT_TEMPLATE=templates/ATLAS_OUT_2
2026-03-27 18:04:52 (43471): Guest Log: + RESULT_TEMPLATE=templates/ATLAS_OUT_2
2026-03-27 18:04:52 (43471): Guest Log: + '[' -z 1 ']'
2026-03-27 18:04:52 (43471): Guest Log: + '[' 1 == 1 ']'
2026-03-27 18:04:52 (43471): Guest Log: + shift
2026-03-27 18:04:52 (43471): Guest Log: + export SITE_NAME=BOINC
2026-03-27 18:04:52 (43471): Guest Log: + SITE_NAME=BOINC
2026-03-27 18:04:52 (43471): Guest Log: + export ATLAS_LOCAL_AREA=/home/atlas/RunAtlas/
2026-03-27 18:04:52 (43471): Guest Log: + ATLAS_LOCAL_AREA=/home/atlas/RunAtlas/
2026-03-27 18:04:52 (43471): Guest Log: + '[' -e /home/atlas/RunAtlas/init_data.xml ']'
2026-03-27 18:04:52 (43471): Guest Log: + grep '<use_http_proxy/>' /home/atlas/RunAtlas/init_data.xml
2026-03-27 18:04:52 (43471): Guest Log: + '[' 0 -ne 0 ']'
2026-03-27 18:04:52 (43471): Guest Log: + echo 'runtimeenvironments=APPS/HEP/ATLAS-SITE;'
2026-03-27 18:04:52 (43471): Guest Log: + '[' -f /etc/os-release ']'
2026-03-27 18:04:52 (43471): Guest Log: +++ cat /etc/os-release
2026-03-27 18:04:52 (43471): Guest Log: ++ eval 'NAME="CentOS' 'Linux"' 'VERSION="7' '(Core)"' 'ID="centos"' 'ID_LIKE="rhel' 'fedora"' 'VERSION_ID="7"' 'PRETTY_NAME="CentOS' Linux 7 '(Core)"' 'ANSI_COLOR="0;31"' 'CPE_NAME="cpe:/o:centos:centos:7"' 'HOME_URL="https://www.centos.org/"' 'BUG_REPORT_URL="https://bugs.centos.org/"' 'CENTOS_MANTISBT_PROJECT="CentOS-7"' 'CENTOS_MANTISBT_PROJECT_VERSION="7"' 'REDHAT_SUPPORT_PRODUCT="centos"' 'REDHAT_SUPPORT_PRODUCT_VERSION="7"'
2026-03-27 18:04:52 (43471): Guest Log: +++ NAME='CentOS Linux'
2026-03-27 18:04:52 (43471): Guest Log: +++ VERSION='7 (Core)'
2026-03-27 18:04:52 (43471): Guest Log: +++ ID=centos
2026-03-27 18:04:52 (43471): Guest Log: +++ ID_LIKE='rhel fedora'
2026-03-27 18:04:52 (43471): Guest Log: +++ VERSION_ID=7
2026-03-27 18:04:52 (43471): Guest Log: +++ PRETTY_NAME='CentOS Linux 7 (Core)'
2026-03-27 18:04:52 (43471): Guest Log: +++ ANSI_COLOR='0;31'
2026-03-27 18:04:52 (43471): Guest Log: +++ CPE_NAME=cpe:/o:centos:centos:7
2026-03-27 18:04:52 (43471): Guest Log: +++ HOME_URL=https://www.centos.org/
2026-03-27 18:04:52 (43471): Guest Log: +++ BUG_REPORT_URL=https://bugs.centos.org/
2026-03-27 18:04:52 (43471): Guest Log: +++ CENTOS_MANTISBT_PROJECT=CentOS-7
2026-03-27 18:04:52 (43471): Guest Log: +++ CENTOS_MANTISBT_PROJECT_VERSION=7
2026-03-27 18:04:52 (43471): Guest Log: +++ REDHAT_SUPPORT_PRODUCT=centos
2026-03-27 18:04:52 (43471): Guest Log: +++ REDHAT_SUPPORT_PRODUCT_VERSION=7
2026-03-27 18:04:52 (43471): Guest Log: ++ echo 'CentOS Linux 7 (Core)'
2026-03-27 18:04:52 (43471): Guest Log: + SYSTEM_SOFTWARE='CentOS Linux 7 (Core)'
2026-03-27 18:04:52 (43471): Guest Log: + '[' -n 'CentOS Linux 7 (Core)' ']'
2026-03-27 18:04:52 (43471): Guest Log: + echo 'systemsoftware=CentOS Linux 7 (Core)'
2026-03-27 18:04:52 (43471): Guest Log: + HOME=/home/atlas/RunAtlas
2026-03-27 18:04:52 (43471): Guest Log: + export HOME
2026-03-27 18:04:52 (43471): Guest Log: + cd /home/atlas/RunAtlas
2026-03-27 18:04:52 (43471): Guest Log: + '[' '!' -z '' ']'
2026-03-27 18:04:52 (43471): Guest Log: + '[' -z '' ']'
2026-03-27 18:04:52 (43471): Guest Log: ++ /bin/hostname -f
2026-03-27 18:04:52 (43471): Guest Log: + nodename=localhost
2026-03-27 18:04:52 (43471): Guest Log: + echo nodename=localhost
2026-03-27 18:04:52 (43471): Guest Log: + echo Processors=2
2026-03-27 18:04:52 (43471): Guest Log: + echo Nodecount=1
2026-03-27 18:04:52 (43471): Guest Log: + echo Benchmark=HEPSPEC:1.0
2026-03-27 18:04:52 (43471): Guest Log: + executable=./runpilot2-wrapper.sh
2026-03-27 18:04:52 (43471): Guest Log: + '[' '!' -f ./runpilot2-wrapper.sh ']'
2026-03-27 18:04:52 (43471): Guest Log: ++ dd if=./runpilot2-wrapper.sh count=1
2026-03-27 18:04:52 (43471): Guest Log: ++ head -n 1
2026-03-27 18:04:52 (43471): Guest Log: ++ tr -d '\0'
2026-03-27 18:04:52 (43471): Guest Log: + line1='#!/bin/bash'
2026-03-27 18:04:52 (43471): Guest Log: ++ echo '#!/bin/bash'
2026-03-27 18:04:52 (43471): Guest Log: ++ sed -n 's/^#! *//p'
2026-03-27 18:04:52 (43471): Guest Log: + shebang=/bin/bash
2026-03-27 18:04:52 (43471): Guest Log: ++ echo /bin/bash
2026-03-27 18:04:52 (43471): Guest Log: ++ awk '{print $1}'
2026-03-27 18:04:52 (43471): Guest Log: + interpreter=/bin/bash
2026-03-27 18:04:52 (43471): Guest Log: + '[' /bin/bash = /usr/bin/env ']'
2026-03-27 18:04:52 (43471): Guest Log: + '[' x/bin/bash = x ']'
2026-03-27 18:04:52 (43471): Guest Log: + type /bin/bash
2026-03-27 18:04:52 (43471): Guest Log: + '[' xgnutime = xgnutime ']'
2026-03-27 18:04:52 (43471): Guest Log: + /usr/bin/time -o /home/atlas/RunAtlas/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn.diag -a -f 'WallTime=%es\nKernelTime=%Ss\nUserTime=%Us\nCPUUsage=%P\nMaxResidentMemory=%MkB\nAverageResidentMemory=%tkB\nAverageTotalMemory=%KkB\nAverageUnsharedMemory=%DkB\nAverageUnsharedStack=%pkB\nAverageSharedMemory=%XkB\nPageSize=%ZB\nMajorPageFaults=%F\nMinorPageFaults=%R\nSwaps=%W\nForcedSwitches=%c\nWaitSwitches=%w\nInputs=%I\nOutputs=%O\nSocketReceived=%r\nSocketSent=%s\nSignals=%k\n' ./runpilot2-wrappe
2026-03-27 18:04:52 (43471): Guest Log: r.sh -q BOINC_MCORE -j managed --pilot-user ATLAS --harvester-submit-mode PUSH -w generic --job-type managed --resource-type MCORE --pilotversion 3.11.5.1 -z -t --piloturl local --mute --container
2026-03-27 18:04:52 (43471): Guest Log: start_atlas.sh: line 242: 2205 Bus error $GNU_TIME -o "$RUNTIME_JOB_DIAG" -a -f 'WallTime=%es\nKernelTime=%Ss\nUserTime=%Us\nCPUUsage=%P\nMaxResidentMemory=%MkB\nAverageResidentMemory=%tkB\nAverageTotalMemory=%KkB\nAverageUnsharedMemory=%DkB\nAverageUnsharedStack=%pkB\nAverageSharedMemory=%XkB\nPageSize=%ZB\nMajorPageFaults=%F\nMinorPageFaults=%R\nSwaps=%W\nForcedSwitches=%c\nWaitSwitches=%w\nInputs=%I\nOutputs=%O\nSocketReceived=%r\nSocketSent=%s\nSignals=%k\n' "./runpilot2-wrapper.sh" "-q"
2026-03-27 18:04:52 (43471): Guest Log: "BOINC_MCORE" "-j" "managed" "--pilot-user" "ATLAS" "--harvester-submit-mode" "PUSH" "-w" "generic" "--job-type" "managed" "--resource-type" "MCORE" "--pilotversion" "3.11.5.1" "-z" "-t" "--piloturl" "local" "--mute" "--container" < $RUNTIME_JOB_STDIN > $RUNTIME_JOB_STDOUT 2>&1
2026-03-27 18:04:52 (43471): Guest Log: + RESULT=135
2026-03-27 18:04:52 (43471): Guest Log: + sed -i -e /nodename=/d /home/atlas/RunAtlas/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn.diag
2026-03-27 18:04:52 (43471): Guest Log: start_atlas.sh: line 245: sed: command not found
2026-03-27 18:04:52 (43471): Guest Log: ++ grep domain_name init_data.xml
2026-03-27 18:04:52 (43471): Guest Log: start_atlas.sh: line 246: grep: command not found
2026-03-27 18:04:52 (43471): Guest Log: ++ awk -F '<' '{print $1}'
2026-03-27 18:04:52 (43471): Guest Log: start_atlas.sh: line 246: awk: command not found
2026-03-27 18:04:52 (43471): Guest Log: ++ sed -e 's# #_#g'
2026-03-27 18:04:52 (43471): Guest Log: start_atlas.sh: line 246: sed: command not found
2026-03-27 18:04:52 (43471): Guest Log: ++ awk -F '>' '{print $2}'
2026-03-27 18:04:52 (43471): Guest Log: start_atlas.sh: line 246: awk: command not found
2026-03-27 18:04:52 (43471): Guest Log: + hostname=
2026-03-27 18:04:52 (43471): Guest Log: ++ awk -F '<' '{print $1}'
2026-03-27 18:04:52 (43471): Guest Log: ++ grep user_name init_data.xml
2026-03-27 18:04:52 (43471): Guest Log: start_atlas.sh: line 247: awk: command not found
2026-03-27 18:04:52 (43471): Guest Log: start_atlas.sh: line 247: grep: command not found
2026-03-27 18:04:52 (43471): Guest Log: ++ sed -e 's# #_#g'
2026-03-27 18:04:52 (43471): Guest Log: start_atlas.sh: line 247: sed: command not found
2026-03-27 18:04:52 (43471): Guest Log: ++ awk -F '>' '{print $2}'
2026-03-27 18:04:52 (43471): Guest Log: start_atlas.sh: line 247: awk: command not found
2026-03-27 18:04:52 (43471): Guest Log: + username=
2026-03-27 18:04:52 (43471): Guest Log: unexpected fault address 0x559b5ec8a120
2026-03-27 18:04:52 (43471): Guest Log: fatal error: fault
2026-03-27 18:04:52 (43471): Guest Log: [signal SIGBUS: bus error code=0x2 addr=0x559b5ec8a120 pc=0x559b5ec8a120]
2026-03-27 18:04:52 (43471): Guest Log: goroutine 5 [running]:
2026-03-27 18:04:52 (43471): Guest Log: boincdata/boinc/ATLAS/session/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn/pandaJobData.out
2026-03-27 18:04:52 (43471): Guest Log: boincdata/boinc/ATLAS/session/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn/pilot3.tar.gz
2026-03-27 18:04:52 (43471): Guest Log: boincdata/boinc/ATLAS/session/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn/queuedata.json
2026-03-27 18:04:52 (43471): Guest Log: boincdata/boinc/ATLAS/session/0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn/runpilot2-wrapper.sh
2026-03-27 18:04:52 (43471): Starting VM using VBoxManage interface. (boinc_a6558f5893f980b8, slot#0)
2026-03-27 18:04:53 (43471): Successfully started VM. (PID = '43587')
2026-03-27 18:04:53 (43471): Reporting VM Process ID to BOINC.
2026-03-27 18:04:53 (43471): Guest Log: BIOS: VirtualBox 7.0.16
2026-03-27 18:04:53 (43471): Guest Log: CPUID EDX: 0x178bfbff
2026-03-27 18:04:53 (43471): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2026-03-27 18:04:53 (43471): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2026-03-27 18:04:53 (43471): VM state change detected. (old = 'poweredoff', new = 'running')
2026-03-27 18:04:53 (43471): Detected: Web Application Enabled (http://localhost:34793)
2026-03-27 18:04:53 (43471): Preference change detected
2026-03-27 18:04:53 (43471): Setting CPU throttle for VM. (100%)
2026-03-27 18:04:53 (43471): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-03-27 18:04:55 (43471): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2026-03-27 18:04:55 (43471): Guest Log: BIOS: Booting from Hard Disk...
2026-03-27 18:04:58 (43471): Guest Log: BIOS: KBD: unsupported int 16h function 03
2026-03-27 18:04:58 (43471): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2026-03-27 18:04:58 (43471): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2026-03-27 18:05:07 (43471): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2026-03-27 18:05:07 (43471): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2026-03-27 18:05:14 (43471): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2026-03-27 18:05:14 (43471): Guest Log: 00:00:00.000255 main Log opened 2026-03-27T17:05:12.431063000Z
2026-03-27 18:05:14 (43471): Guest Log: 00:00:00.000415 main OS Product: Linux
2026-03-27 18:05:14 (43471): Guest Log: 00:00:00.000447 main OS Release: 3.10.0-957.27.2.el7.x86_64
2026-03-27 18:05:14 (43471): Guest Log: 00:00:00.000470 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2026-03-27 18:05:14 (43471): Guest Log: 00:00:00.000492 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2026-03-27 18:05:14 (43471): Guest Log: 00:00:00.000493 main Process ID: 1319
2026-03-27 18:05:14 (43471): Guest Log: 00:00:00.000494 main Package type: LINUX_64BITS_GENERIC
2026-03-27 18:05:14 (43471): Guest Log: 00:00:00.001365 main 5.2.32 r132073 started. Verbose level = 0
2026-03-27 18:05:14 (43471): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2026-03-27 18:05:14 (43471): Guest Log: [INFO] Mounting shared directory
2026-03-27 18:05:15 (43471): Guest Log: [INFO] Checking for init_data.xml
2026-03-27 18:05:20 (43471): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2026-03-27 18:05:20 (43471): Guest Log: [INFO] Detected branch: prod
2026-03-27 18:05:21 (43471): Guest Log: This is the prod version of the ATLAS job wrapper
2026-03-27 18:05:21 (43471): Guest Log: Copying input files
2026-03-27 18:05:22 (43471): Guest Log: Copied input files into RunAtlas.
2026-03-27 18:05:22 (43471): Guest Log: This VM did not configure a local http proxy via BOINC.
2026-03-27 18:05:22 (43471): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2026-03-27 18:05:22 (43471): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2026-03-27 18:05:22 (43471): Guest Log: Further information can be found at the LHC@home message board.
2026-03-27 18:05:31 (43471): Guest Log: Running cvmfs_config stat atlas.cern.ch
2026-03-27 18:05:31 (43471): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2026-03-27 18:05:31 (43471): Guest Log: 2.6.3.0 1596 0 30012 157765 4 1 3846946 4096001 0 65024 0 0 n/a 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
2026-03-27 18:05:32 (43471): Guest Log: copied the webapp to /var/www
2026-03-27 18:05:32 (43471): Guest Log: ATHENA_PROC_NUMBER=5
2026-03-27 18:05:32 (43471): Guest Log: ATHENA_CORE_NUMBER=5
2026-03-27 18:05:32 (43471): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
2026-03-27 18:05:32 (43471): Guest Log: *** Starting ATLAS job. (PandaID=7058965792 taskID=49182303) ***
2026-03-27 18:06:54 (43471): Stopping VM.
2026-03-27 18:07:04 (43471): Successfully stopped VM.
2026-03-27 18:27:48 (4372): vboxwrapper version 26210
2026-03-27 18:27:48 (4372): BOINC client version: 8.2.9
2026-03-27 18:27:48 (4372): Detected: VirtualBox VboxManage Interface (Version: 7.0.16)
2026-03-27 18:27:49 (4372): Guest Log: BIOS: VirtualBox 7.0.16
2026-03-27 18:27:49 (4372): Guest Log: CPUID EDX: 0x178bfbff
2026-03-27 18:27:49 (4372): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2026-03-27 18:27:49 (4372): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2026-03-27 18:27:49 (4372): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2026-03-27 18:27:49 (4372): Guest Log: BIOS: Booting from Hard Disk...
2026-03-27 18:27:49 (4372): Guest Log: BIOS: KBD: unsupported int 16h function 03
2026-03-27 18:27:49 (4372): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2026-03-27 18:27:49 (4372): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2026-03-27 18:27:49 (4372): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2026-03-27 18:27:49 (4372): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2026-03-27 18:27:49 (4372): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2026-03-27 18:27:49 (4372): Guest Log: 00:00:00.000255 main Log opened 2026-03-27T17:05:12.431063000Z
2026-03-27 18:27:49 (4372): Guest Log: 00:00:00.000415 main OS Product: Linux
2026-03-27 18:27:49 (4372): Guest Log: 00:00:00.000447 main OS Release: 3.10.0-957.27.2.el7.x86_64
2026-03-27 18:27:49 (4372): Guest Log: 00:00:00.000470 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2026-03-27 18:27:49 (4372): Guest Log: 00:00:00.000492 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2026-03-27 18:27:49 (4372): Guest Log: 00:00:00.000493 main Process ID: 1319
2026-03-27 18:27:49 (4372): Guest Log: 00:00:00.000494 main Package type: LINUX_64BITS_GENERIC
2026-03-27 18:27:49 (4372): Guest Log: 00:00:00.001365 main 5.2.32 r132073 started. Verbose level = 0
2026-03-27 18:27:49 (4372): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2026-03-27 18:27:49 (4372): Guest Log: [INFO] Mounting shared directory
2026-03-27 18:27:49 (4372): Guest Log: [INFO] Checking for init_data.xml
2026-03-27 18:27:49 (4372): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2026-03-27 18:27:49 (4372): Guest Log: [INFO] Detected branch: prod
2026-03-27 18:27:49 (4372): Guest Log: This is the prod version of the ATLAS job wrapper
2026-03-27 18:27:49 (4372): Guest Log: Copying input files
2026-03-27 18:27:49 (4372): Guest Log: Copied input files into RunAtlas.
2026-03-27 18:27:49 (4372): Guest Log: This VM did not configure a local http proxy via BOINC.
2026-03-27 18:27:49 (4372): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2026-03-27 18:27:49 (4372): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2026-03-27 18:27:49 (4372): Guest Log: Further information can be found at the LHC@home message board.
2026-03-27 18:27:49 (4372): Guest Log: Running cvmfs_config stat atlas.cern.ch
2026-03-27 18:27:49 (4372): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2026-03-27 18:27:49 (4372): Guest Log: 2.6.3.0 1596 0 30012 157765 4 1 3846946 4096001 0 65024 0 0 n/a 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
2026-03-27 18:27:49 (4372): Guest Log: copied the webapp to /var/www
2026-03-27 18:27:49 (4372): Guest Log: ATHENA_PROC_NUMBER=5
2026-03-27 18:27:49 (4372): Guest Log: ATHENA_CORE_NUMBER=5
2026-03-27 18:27:49 (4372): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
2026-03-27 18:27:49 (4372): Guest Log: *** Starting ATLAS job. (PandaID=7058965792 taskID=49182303) ***
2026-03-27 18:27:49 (4372): Starting VM using VBoxManage interface. (boinc_a6558f5893f980b8, slot#0)
2026-03-27 18:27:54 (4372): Successfully started VM. (PID = '4475')
2026-03-27 18:27:54 (4372): Reporting VM Process ID to BOINC.
2026-03-27 18:27:54 (4372): VM state change detected. (old = 'poweredoff', new = 'running')
2026-03-27 18:27:54 (4372): Detected: Web Application Enabled (http://localhost:34793)
2026-03-27 18:27:54 (4372): Preference change detected
2026-03-27 18:27:54 (4372): Setting CPU throttle for VM. (100%)
2026-03-27 18:27:55 (4372): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-03-27 18:35:18 (4372): VM state change detected. (old = 'running', new = 'paused')
2026-03-27 18:35:24 (4372): VM state change detected. (old = 'paused', new = 'running')
2026-03-27 18:35:45 (4372): Preference change detected
2026-03-27 18:35:45 (4372): Setting CPU throttle for VM. (100%)
2026-03-27 18:35:45 (4372): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-03-27 18:41:03 (4372): VM state change detected. (old = 'running', new = 'paused')
2026-03-27 18:41:40 (4372): VM state change detected. (old = 'paused', new = 'running')
2026-03-27 18:42:45 (4372): Preference change detected
2026-03-27 18:42:45 (4372): Setting CPU throttle for VM. (100%)
2026-03-27 18:42:45 (4372): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-03-27 18:45:33 (4372): VM state change detected. (old = 'running', new = 'paused')
2026-03-27 21:52:19 (4372): VM state change detected. (old = 'paused', new = 'running')
2026-03-27 21:52:23 (4372): Guest Log: 00:18:40.614717 timesync vgsvcTimeSyncWorker: Radical host time change: 11 216 142 000 000ns (HostNow=1 774 644 743 378 000 000 ns HostLast=1 774 633 527 236 000 000 ns)
2026-03-27 21:52:33 (4372): Guest Log: 00:18:50.616448 timesync vgsvcTimeSyncWorker: Radical guest time change: 11 259 142 989 000ns (GuestNow=1 774 644 753 397 947 000 ns GuestLast=1 774 633 494 254 958 000 ns fSetTimeLastLoop=true )
2026-03-27 22:45:25 (4372): Status Report: Elapsed Time: '6000.536020'
2026-03-27 22:45:25 (4372): Status Report: CPU Time: '20957.010000'
2026-03-28 00:24:25 (4372): Status Report: Elapsed Time: '12000.536020'
2026-03-28 00:24:25 (4372): Status Report: CPU Time: '50607.630000'
2026-03-28 02:03:26 (4372): Status Report: Elapsed Time: '18000.536020'
2026-03-28 02:03:26 (4372): Status Report: CPU Time: '80261.700000'
2026-03-28 03:42:26 (4372): Status Report: Elapsed Time: '24000.536020'
2026-03-28 03:42:26 (4372): Status Report: CPU Time: '109911.300000'
2026-03-28 05:07:15 (4372): Guest Log: *** Job finished ***
2026-03-28 05:07:15 (4372): Guest Log: *** The last 20 lines of the pilot log: ***
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:06:57,824 | WARNING | pilot monitor received instruction that args.graceful_stop has been set
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:06:57,824 | WARNING | will wait for a maximum of 300 s for threads to finish
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:07,330 | INFO | [monitor] cgroup control has ended
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:09,152 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140279351793472)>', '<ExcThread(monitor, started 140278312720128)>']
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:09,952 | WARNING | job_aborted has been set - aborting pilot monitoring
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:09,952 | INFO | [monitor] control thread has ended
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,157 | INFO | all workflow threads have been joined
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,157 | INFO | end of generic workflow (traces error code: 0)
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,158 | INFO | traces error code: 0
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,158 | INFO | pilot has finished (exit code=0, shell exit code=0)
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,317 [wrapper] ==== pilot stdout END ====
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,322 [wrapper] ==== wrapper stdout RESUME ====
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,328 [wrapper] pilotpid: 5993
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,334 [wrapper] Pilot exit status: 0
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,776 [wrapper] pandaids: 7058965792
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,816 [wrapper] cleanup supervisor_pilot 496 5994
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,829 [wrapper] Test setup, not cleaning
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,835 [wrapper] apfmon messages muted
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,843 [wrapper] ==== wrapper stdout END ====
2026-03-28 05:07:15 (4372): Guest Log: 2026-03-28 04:07:14,849 [wrapper] ==== wrapper stderr END ====
2026-03-28 05:07:15 (4372): Guest Log: *** Error codes and diagnostics ***
2026-03-28 05:07:15 (4372): Guest Log: "exeErrorCode": 0,
2026-03-28 05:07:15 (4372): Guest Log: "exeErrorDiag": "",
2026-03-28 05:07:15 (4372): Guest Log: "pilotErrorCode": 0,
2026-03-28 05:07:15 (4372): Guest Log: "pilotErrorDiag": "",
2026-03-28 05:07:15 (4372): Guest Log: *** Listing of results directory ***
2026-03-28 05:07:15 (4372): Guest Log: total 243796
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 atlas atlas 585013 Mar 18 13:20 pilot3.tar.gz
2026-03-28 05:07:15 (4372): Guest Log: -rwx------. 1 atlas atlas 36322 Mar 18 13:21 runpilot2-wrapper.sh
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 atlas atlas 5111 Mar 18 13:22 queuedata.json
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 atlas atlas 8949 Mar 27 17:05 init_data.xml
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 atlas atlas 15845 Mar 27 17:05 start_atlas.sh
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 atlas atlas 597536 Mar 27 17:05 input.tar.gz
2026-03-28 05:07:15 (4372): Guest Log: lrwxrwxrwx. 1 atlas atlas 20 Mar 27 17:05 EVNT.49136696._000003.pool.root.1 -> /data/./ATLAS.root_0
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 atlas atlas 2620 Mar 27 17:05 pandaJob.out
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 1005169 Mar 27 17:06 agis_schedconf.cvmfs.json
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 428 Mar 27 17:06 workernode_map.json
2026-03-28 05:07:15 (4372): Guest Log: drwx------. 5 atlas atlas 4096 Mar 27 17:06 pilot3
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 237134884 Mar 28 04:05 HITS.49182303._000062.pool.root.1
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 1027 Mar 28 04:06 memory_monitor_summary.json
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 1511579 Mar 28 04:06 agis_ddmendpoints.agis.ALL.json
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 589512 Mar 28 04:06 log.49182303._000062.job.log.tgz.1
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 98 Mar 28 04:06 pilot_heartbeat.json
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 6367 Mar 28 04:06 heartbeat.json
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 4801 Mar 28 04:07 pilotlog.txt
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 3734706 Mar 28 04:07 log.49182303._000062.job.log.1
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 357 Mar 28 04:07 output.list
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 atlas atlas 620 Mar 28 04:07 runtime_log
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 4341760 Mar 28 04:07 result.tar.gz
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 atlas atlas 8755 Mar 28 04:07 runtime_log.err
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 661 Mar 28 04:07 0XANDmG15M9nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmeD2LDmYv4BVn.diag
2026-03-28 05:07:15 (4372): Guest Log: Looking for outputfile HITS.49182303._000062.pool.root.1
2026-03-28 05:07:15 (4372): Guest Log: HITS file was successfully produced
2026-03-28 05:07:15 (4372): Guest Log: -rw-------. 1 atlas atlas 237134884 Mar 28 04:05 /home/atlas/RunAtlas/HITS.49182303._000062.pool.root.1
2026-03-28 05:07:15 (4372): Guest Log: Successfully finished the ATLAS job!
2026-03-28 05:07:15 (4372): Guest Log: Copying the results back to the shared directory!
2026-03-28 05:07:15 (4372): Guest Log: *** Contents of shared directory: ***
2026-03-28 05:07:15 (4372): Guest Log: total 233372
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 root root 234003488 Mar 26 20:45 ATLAS.root_0
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 root root 8949 Mar 26 20:45 init_data.xml
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 root root 597536 Mar 26 20:45 input.tar.gz
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 root root 4341760 Mar 28 04:07 result.tar.gz
2026-03-28 05:07:15 (4372): Guest Log: -rw-r--r--. 1 root root 15845 Mar 26 20:45 start_atlas.sh
2026-03-28 05:07:15 (4372): Guest Log: *** Success! Shutting down the machine. ***
2026-03-28 05:07:15 (4372): VM Completion File Detected.
2026-03-28 05:07:15 (4372): Powering off VM.
2026-03-28 05:07:15 (4372): Successfully stopped VM.
2026-03-28 05:07:15 (4372): Deregistering VM. (boinc_a6558f5893f980b8, slot#0)
2026-03-28 05:07:16 (4372): Removing network bandwidth throttle group from VM.
2026-03-28 05:07:16 (4372): Removing VM from VirtualBox.
2026-03-28 05:07:21 (4372): called boinc_finish(0)
</stderr_txt>
]]>
©2026 CERN