Name vrbNDmbO0x8n9Rq4apOajLDm4fhM0noT9bVo0NGKDmbqeKDmajU9Em_0
Workunit 238408269
Created 8 Jan 2026, 8:27:09 UTC
Sent 8 Jan 2026, 12:06:23 UTC
Report deadline 16 Jan 2026, 12:06:23 UTC
Received 10 Jan 2026, 0:07:46 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 10937742
Run time 9 hours 43 min 54 sec
CPU time 2 days 14 hours 53 min 36 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 45.19 GFLOPS
Application version ATLAS Simulation v3.03 (vbox64_mt_mcore_atlas)
x86_64-apple-darwin
Peak working set size 9.54 GB
Peak swap size 78.43 GB
Peak disk usage 396.52 MB

Stderr output

<core_client_version>8.2.5</core_client_version>
<![CDATA[
<message>
Process still present 5 min after writing finish file; aborting</message>
<stderr_txt>
2026-01-09 01:36:11 (10038): vboxwrapper version 26210
2026-01-09 01:36:11 (10038): BOINC client version: 8.2.5
2026-01-09 01:36:11 (10038): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 01:36:11 (10038): Detected: Sandbox Configuration Enabled
2026-01-09 01:36:11 (10038): Successfully copied 'init_data.xml' to the shared directory.
2026-01-09 01:36:11 (10038): Create VM. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 01:36:11 (10038): Setting Memory Size for VM. (4800MB)
2026-01-09 01:36:11 (10038): Setting CPU Count for VM. (8)
2026-01-09 01:36:11 (10038): Setting Chipset Options for VM.
2026-01-09 01:36:12 (10038): Setting Graphics Controller Options for VM. (Driver: VBoxVGA, 16MB)
2026-01-09 01:36:12 (10038): Setting Boot Options for VM.
2026-01-09 01:36:12 (10038): Setting Network Configuration for NAT. (Driver: virtio)
2026-01-09 01:36:12 (10038): Enabling VM Network Access.
2026-01-09 01:36:12 (10038): Disabling USB Support for VM.
2026-01-09 01:36:12 (10038): Disabling COM Port Support for VM.
2026-01-09 01:36:12 (10038): Disabling Audio Support for VM.
2026-01-09 01:36:12 (10038): Disabling Clipboard Support for VM.
2026-01-09 01:36:12 (10038): Disabling Drag and Drop Support for VM.
2026-01-09 01:36:12 (10038): Adding storage controller(s) to VM.
2026-01-09 01:36:12 (10038): Adding virtual disk drive to VM. (ATLAS_vbox_3.03_image.vdi)
2026-01-09 01:36:12 (10038): Adding VirtualBox Guest Additions to VM.
2026-01-09 01:36:12 (10038): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB)
2026-01-09 01:36:12 (10038): forwarding host port 54040 to guest port 80
2026-01-09 01:36:12 (10038): Enabling remote desktop for VM.
2026-01-09 01:36:12 (10038): Required extension pack not installed, remote desktop not enabled.
2026-01-09 01:36:12 (10038): Enabling shared directory for VM.
2026-01-09 01:36:13 (10038): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 01:36:17 (10038): Successfully started VM. (PID = '10106')
2026-01-09 01:36:17 (10038): Reporting VM Process ID to BOINC.
2026-01-09 01:36:17 (10038): Guest Log: BIOS: VirtualBox 7.2.4
2026-01-09 01:36:17 (10038): Guest Log: CPUID EDX: 0x178bfbff
2026-01-09 01:36:17 (10038): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2026-01-09 01:36:17 (10038): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2026-01-09 01:36:17 (10038): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 01:36:17 (10038): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 01:36:18 (10038): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 01:36:32 (10038): Preference change detected
2026-01-09 01:36:32 (10038): Setting CPU throttle for VM. (100%)
2026-01-09 01:36:32 (10038): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 01:36:33 (10038): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 01:36:35 (10038): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2026-01-09 01:36:35 (10038): Guest Log: BIOS: Booting from Hard Disk...
2026-01-09 01:36:41 (10038): Guest Log: BIOS: KBD: unsupported int 16h function 03
2026-01-09 01:36:41 (10038): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2026-01-09 01:36:41 (10038): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2026-01-09 01:36:56 (10038): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2026-01-09 01:36:56 (10038): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2026-01-09 01:37:16 (10038): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2026-01-09 01:37:16 (10038): Guest Log: 00:00:00.000240 main     Log opened 2026-01-09T08:36:59.821404000Z
2026-01-09 01:37:16 (10038): Guest Log: 00:00:00.000436 main     OS Product: Linux
2026-01-09 01:37:16 (10038): Guest Log: 00:00:00.000510 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2026-01-09 01:37:16 (10038): Guest Log: 00:00:00.000567 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2026-01-09 01:37:16 (10038): Guest Log: 00:00:00.000627 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2026-01-09 01:37:16 (10038): Guest Log: 00:00:00.000628 main     Process ID: 1374
2026-01-09 01:37:16 (10038): Guest Log: 00:00:00.000629 main     Package type: LINUX_64BITS_GENERIC
2026-01-09 01:37:16 (10038): Guest Log: 00:00:00.005266 main     5.2.32 r132073 started. Verbose level = 0
2026-01-09 01:37:17 (10038): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2026-01-09 01:37:17 (10038): Guest Log: [INFO] Mounting shared directory
2026-01-09 01:37:17 (10038): Guest Log: [INFO] Checking for init_data.xml
2026-01-09 01:37:27 (10038): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2026-01-09 01:37:27 (10038): Guest Log: [INFO] Detected branch: prod
2026-01-09 01:37:29 (10038): Guest Log: This is the prod version of the ATLAS job wrapper
2026-01-09 01:37:29 (10038): Guest Log: Copying input files
2026-01-09 01:37:38 (10038): Guest Log: Copied input files into RunAtlas.
2026-01-09 01:37:38 (10038): Guest Log: This VM did not configure a local http proxy via BOINC.
2026-01-09 01:37:38 (10038): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2026-01-09 01:37:38 (10038): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2026-01-09 01:37:39 (10038): Guest Log: Further information can be found at the LHC@home message board.
2026-01-09 01:37:50 (10038): Guest Log: Running cvmfs_config stat atlas.cern.ch
2026-01-09 01:37:50 (10038): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2026-01-09 01:37:50 (10038): Guest Log: 2.6.3.0 1671 0 32032 154937 4 1 3117737 4096000 0 65024 0 0 n/a 0 0 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1
2026-01-09 01:37:53 (10038): Guest Log: copied the webapp to /var/www
2026-01-09 01:37:53 (10038): Guest Log: ATHENA_PROC_NUMBER=8
2026-01-09 01:37:53 (10038): Guest Log: ATHENA_CORE_NUMBER=8
2026-01-09 01:37:53 (10038): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2026-01-09 01:37:53 (10038): Guest Log:  *** Starting ATLAS job. (PandaID=6962931365 taskID=47961985) ***
2026-01-09 02:00:06 (10038): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 02:00:26 (10038): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 02:07:56 (10038): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 02:08:15 (10038): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 02:21:40 (10038): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 02:22:00 (10038): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 02:31:12 (10038): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 02:31:32 (10038): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 03:17:55 (10038): Status Report: Elapsed Time: '6000.000000'
2026-01-09 03:17:55 (10038): Status Report: CPU Time: '34756.080000'
2026-01-09 03:31:36 (10038): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 03:31:56 (10038): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 04:28:58 (10038): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 04:29:19 (10038): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 04:58:38 (10038): Status Report: Elapsed Time: '12000.000000'
2026-01-09 04:58:38 (10038): Status Report: CPU Time: '74022.870000'
2026-01-09 05:24:16 (10038): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 05:24:37 (10038): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 06:06:22 (10038): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 06:06:43 (10038): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 06:13:58 (10038): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 06:14:18 (10038): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 06:39:43 (10038): Status Report: Elapsed Time: '18000.000000'
2026-01-09 06:39:43 (10038): Status Report: CPU Time: '113515.340000'
2026-01-09 06:49:16 (10038): Stopping VM.
2026-01-09 06:49:34 (10038): Successfully stopped VM.
2026-01-09 06:55:28 (22763): vboxwrapper version 26210
2026-01-09 06:55:28 (22763): BOINC client version: 8.2.5
2026-01-09 06:55:28 (22763): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 06:55:28 (22763): Detected: Sandbox Configuration Enabled
2026-01-09 06:55:29 (22763): Guest Log: BIOS: VirtualBox 7.2.4
2026-01-09 06:55:29 (22763): Guest Log: CPUID EDX: 0x178bfbff
2026-01-09 06:55:29 (22763): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2026-01-09 06:55:29 (22763): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2026-01-09 06:55:29 (22763): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2026-01-09 06:55:29 (22763): Guest Log: BIOS: Booting from Hard Disk...
2026-01-09 06:55:29 (22763): Guest Log: BIOS: KBD: unsupported int 16h function 03
2026-01-09 06:55:29 (22763): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2026-01-09 06:55:29 (22763): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2026-01-09 06:55:29 (22763): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2026-01-09 06:55:29 (22763): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2026-01-09 06:55:29 (22763): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2026-01-09 06:55:29 (22763): Guest Log: 00:00:00.000240 main     Log opened 2026-01-09T08:36:59.821404000Z
2026-01-09 06:55:29 (22763): Guest Log: 00:00:00.000436 main     OS Product: Linux
2026-01-09 06:55:29 (22763): Guest Log: 00:00:00.000510 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2026-01-09 06:55:29 (22763): Guest Log: 00:00:00.000567 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2026-01-09 06:55:29 (22763): Guest Log: 00:00:00.000627 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2026-01-09 06:55:29 (22763): Guest Log: 00:00:00.000628 main     Process ID: 1374
2026-01-09 06:55:29 (22763): Guest Log: 00:00:00.000629 main     Package type: LINUX_64BITS_GENERIC
2026-01-09 06:55:29 (22763): Guest Log: 00:00:00.005266 main     5.2.32 r132073 started. Verbose level = 0
2026-01-09 06:55:29 (22763): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2026-01-09 06:55:29 (22763): Guest Log: [INFO] Mounting shared directory
2026-01-09 06:55:29 (22763): Guest Log: [INFO] Checking for init_data.xml
2026-01-09 06:55:29 (22763): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2026-01-09 06:55:29 (22763): Guest Log: [INFO] Detected branch: prod
2026-01-09 06:55:29 (22763): Guest Log: This is the prod version of the ATLAS job wrapper
2026-01-09 06:55:29 (22763): Guest Log: Copying input files
2026-01-09 06:55:29 (22763): Guest Log: Copied input files into RunAtlas.
2026-01-09 06:55:29 (22763): Guest Log: This VM did not configure a local http proxy via BOINC.
2026-01-09 06:55:29 (22763): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2026-01-09 06:55:29 (22763): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2026-01-09 06:55:29 (22763): Guest Log: Further information can be found at the LHC@home message board.
2026-01-09 06:55:29 (22763): Guest Log: Running cvmfs_config stat atlas.cern.ch
2026-01-09 06:55:29 (22763): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2026-01-09 06:55:29 (22763): Guest Log: 2.6.3.0 1671 0 32032 154937 4 1 3117737 4096000 0 65024 0 0 n/a 0 0 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1
2026-01-09 06:55:29 (22763): Guest Log: copied the webapp to /var/www
2026-01-09 06:55:29 (22763): Guest Log: ATHENA_PROC_NUMBER=8
2026-01-09 06:55:29 (22763): Guest Log: ATHENA_CORE_NUMBER=8
2026-01-09 06:55:29 (22763): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2026-01-09 06:55:29 (22763): Guest Log:  *** Starting ATLAS job. (PandaID=6962931365 taskID=47961985) ***
2026-01-09 06:55:29 (22763): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 06:55:38 (22763): Successfully started VM. (PID = '22832')
2026-01-09 06:55:38 (22763): Reporting VM Process ID to BOINC.
2026-01-09 06:55:38 (22763): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 06:55:38 (22763): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 06:55:38 (22763): Status Report: Elapsed Time: '18573.000000'
2026-01-09 06:55:38 (22763): Status Report: CPU Time: '117240.690000'
2026-01-09 06:55:38 (22763): Preference change detected
2026-01-09 06:55:38 (22763): Setting CPU throttle for VM. (100%)
2026-01-09 06:55:38 (22763): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 06:58:56 (22763): Stopping VM.
2026-01-09 06:59:10 (22763): Successfully stopped VM.
2026-01-09 08:22:41 (23748): vboxwrapper version 26210
2026-01-09 08:22:41 (23748): BOINC client version: 8.2.5
2026-01-09 08:22:42 (23748): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 08:22:42 (23748): Detected: Sandbox Configuration Enabled
2026-01-09 08:22:42 (23748): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 08:22:52 (23748): Successfully started VM. (PID = '23822')
2026-01-09 08:22:52 (23748): Reporting VM Process ID to BOINC.
2026-01-09 08:22:52 (23748): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 08:22:52 (23748): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 08:22:52 (23748): Status Report: Elapsed Time: '18771.000000'
2026-01-09 08:22:52 (23748): Status Report: CPU Time: '118394.590000'
2026-01-09 08:22:52 (23748): Preference change detected
2026-01-09 08:22:52 (23748): Setting CPU throttle for VM. (100%)
2026-01-09 08:22:52 (23748): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 08:22:59 (23748): Guest Log: 05:13:17.065252 timesync vgsvcTimeSyncWorker: Radical host time change: 5 044 803 000 000ns (HostNow=1 767 972 178 202 000 000 ns HostLast=1 767 967 133 399 000 000 ns)
2026-01-09 08:23:09 (23748): Guest Log: 05:13:27.111743 timesync vgsvcTimeSyncWorker: Radical guest time change: 5 044 814 881 000ns (GuestNow=1 767 972 188 440 450 000 ns GuestLast=1 767 967 143 625 569 000 ns fSetTimeLastLoop=true )
2026-01-09 08:39:18 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 08:39:39 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 08:43:16 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 08:43:36 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 09:01:33 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 09:01:52 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 09:28:44 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 09:29:04 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 09:57:10 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 09:57:30 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 10:04:37 (23748): Status Report: Elapsed Time: '24771.552128'
2026-01-09 10:04:37 (23748): Status Report: CPU Time: '157392.370000'
2026-01-09 10:19:45 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 10:20:06 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 10:25:22 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 10:25:43 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 11:11:28 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 11:11:48 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 11:22:57 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 11:23:17 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 11:45:26 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 11:45:45 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 11:46:23 (23748): Status Report: Elapsed Time: '30771.552128'
2026-01-09 11:46:23 (23748): Status Report: CPU Time: '197188.280000'
2026-01-09 12:02:43 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 12:03:04 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 12:23:30 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 12:23:50 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 12:43:43 (23748): VM state change detected. (old = 'running', new = 'paused')
2026-01-09 12:44:02 (23748): VM state change detected. (old = 'paused', new = 'running')
2026-01-09 12:45:45 (23748): Stopping VM.
2026-01-09 12:46:05 (23748): Successfully stopped VM.
2026-01-09 12:51:22 (40456): vboxwrapper version 26210
2026-01-09 12:51:22 (40456): BOINC client version: 8.2.5
2026-01-09 12:51:22 (40456): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 12:51:22 (40456): Detected: Sandbox Configuration Enabled
2026-01-09 12:51:23 (40456): Guest Log: 05:13:17.065252 timesync vgsvcTimeSyncWorker: Radical host time change: 5 044 803 000 000ns (HostNow=1 767 972 178 202 000 000 ns HostLast=1 767 967 133 399 000 000 ns)
2026-01-09 12:51:23 (40456): Guest Log: 05:13:27.111743 timesync vgsvcTimeSyncWorker: Radical guest time change: 5 044 814 881 000ns (GuestNow=1 767 972 188 440 450 000 ns GuestLast=1 767 967 143 625 569 000 ns fSetTimeLastLoop=true )
2026-01-09 12:51:23 (40456): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 12:51:33 (40456): Successfully started VM. (PID = '40534')
2026-01-09 12:51:33 (40456): Reporting VM Process ID to BOINC.
2026-01-09 12:51:33 (40456): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 12:51:33 (40456): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 12:51:33 (40456): Status Report: Elapsed Time: '34270.657557'
2026-01-09 12:51:33 (40456): Status Report: CPU Time: '220532.240000'
2026-01-09 12:51:33 (40456): Preference change detected
2026-01-09 12:51:33 (40456): Setting CPU throttle for VM. (100%)
2026-01-09 12:51:33 (40456): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 12:55:20 (40456): Stopping VM.
2026-01-09 12:55:35 (40456): Successfully stopped VM.
2026-01-09 13:05:52 (40853): vboxwrapper version 26210
2026-01-09 13:05:52 (40853): BOINC client version: 8.2.5
2026-01-09 13:05:52 (40853): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 13:05:52 (40853): Detected: Sandbox Configuration Enabled
2026-01-09 13:05:52 (40853): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 13:06:02 (40853): Successfully started VM. (PID = '40935')
2026-01-09 13:06:02 (40853): Reporting VM Process ID to BOINC.
2026-01-09 13:06:02 (40853): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 13:06:02 (40853): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 13:06:02 (40853): Status Report: Elapsed Time: '34497.657557'
2026-01-09 13:06:02 (40853): Status Report: CPU Time: '221958.790000'
2026-01-09 13:06:02 (40853): Preference change detected
2026-01-09 13:06:02 (40853): Setting CPU throttle for VM. (100%)
2026-01-09 13:06:02 (40853): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 13:06:17 (40853): Stopping VM.
2026-01-09 13:06:31 (40853): Successfully stopped VM.
2026-01-09 13:10:41 (41033): vboxwrapper version 26210
2026-01-09 13:10:41 (41033): BOINC client version: 8.2.5
2026-01-09 13:10:41 (41033): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 13:10:41 (41033): Detected: Sandbox Configuration Enabled
2026-01-09 13:10:41 (41033): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 13:10:51 (41033): Successfully started VM. (PID = '41115')
2026-01-09 13:10:51 (41033): Reporting VM Process ID to BOINC.
2026-01-09 13:10:51 (41033): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 13:10:51 (41033): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 13:10:51 (41033): Status Report: Elapsed Time: '34512.657557'
2026-01-09 13:10:51 (41033): Status Report: CPU Time: '222032.900000'
2026-01-09 13:10:51 (41033): Preference change detected
2026-01-09 13:10:51 (41033): Setting CPU throttle for VM. (100%)
2026-01-09 13:10:51 (41033): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 13:11:54 (41033): Stopping VM.
2026-01-09 13:12:11 (41033): Successfully stopped VM.
2026-01-09 13:14:05 (41234): vboxwrapper version 26210
2026-01-09 13:14:05 (41234): BOINC client version: 8.2.5
2026-01-09 13:14:05 (41234): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 13:14:05 (41234): Detected: Sandbox Configuration Enabled
2026-01-09 13:14:05 (41234): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 13:14:15 (41234): Successfully started VM. (PID = '41316')
2026-01-09 13:14:15 (41234): Reporting VM Process ID to BOINC.
2026-01-09 13:14:15 (41234): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 13:14:15 (41234): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 13:14:15 (41234): Stopping VM.
2026-01-09 13:14:29 (41234): Successfully stopped VM.
2026-01-09 13:15:52 (41375): vboxwrapper version 26210
2026-01-09 13:15:52 (41375): BOINC client version: 8.2.5
2026-01-09 13:15:53 (41375): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 13:15:53 (41375): Detected: Sandbox Configuration Enabled
2026-01-09 13:15:53 (41375): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 13:16:03 (41375): Successfully started VM. (PID = '41457')
2026-01-09 13:16:03 (41375): Reporting VM Process ID to BOINC.
2026-01-09 13:16:03 (41375): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 13:16:03 (41375): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 13:16:03 (41375): Status Report: Elapsed Time: '34575.657557'
2026-01-09 13:16:03 (41375): Status Report: CPU Time: '222427.190000'
2026-01-09 13:16:03 (41375): Preference change detected
2026-01-09 13:16:03 (41375): Setting CPU throttle for VM. (100%)
2026-01-09 13:16:03 (41375): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 13:16:28 (41375): Stopping VM.
2026-01-09 13:16:42 (41375): Successfully stopped VM.
2026-01-09 13:18:41 (41541): vboxwrapper version 26210
2026-01-09 13:18:41 (41541): BOINC client version: 8.2.5
2026-01-09 13:18:41 (41541): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 13:18:41 (41541): Detected: Sandbox Configuration Enabled
2026-01-09 13:18:42 (41541): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 13:18:51 (41541): Successfully started VM. (PID = '41624')
2026-01-09 13:18:51 (41541): Reporting VM Process ID to BOINC.
2026-01-09 13:18:51 (41541): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 13:18:51 (41541): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 13:18:51 (41541): Status Report: Elapsed Time: '34600.657557'
2026-01-09 13:18:51 (41541): Status Report: CPU Time: '222566.840000'
2026-01-09 13:18:51 (41541): Preference change detected
2026-01-09 13:18:51 (41541): Setting CPU throttle for VM. (100%)
2026-01-09 13:18:52 (41541): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 13:20:40 (41541): Stopping VM.
2026-01-09 13:20:55 (41541): Successfully stopped VM.
2026-01-09 13:27:18 (41810): vboxwrapper version 26210
2026-01-09 13:27:18 (41810): BOINC client version: 8.2.5
2026-01-09 13:27:18 (41810): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 13:27:18 (41810): Detected: Sandbox Configuration Enabled
2026-01-09 13:27:18 (41810): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 13:27:28 (41810): Successfully started VM. (PID = '41892')
2026-01-09 13:27:28 (41810): Reporting VM Process ID to BOINC.
2026-01-09 13:27:28 (41810): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 13:27:28 (41810): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 13:27:28 (41810): Status Report: Elapsed Time: '34709.657557'
2026-01-09 13:27:28 (41810): Status Report: CPU Time: '223218.490000'
2026-01-09 13:27:28 (41810): Preference change detected
2026-01-09 13:27:28 (41810): Setting CPU throttle for VM. (100%)
2026-01-09 13:27:28 (41810): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 13:27:54 (41810): Stopping VM.
2026-01-09 13:28:08 (41810): Successfully stopped VM.
2026-01-09 13:34:38 (42013): vboxwrapper version 26210
2026-01-09 13:34:38 (42013): BOINC client version: 8.2.5
2026-01-09 13:34:38 (42013): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 13:34:38 (42013): Detected: Sandbox Configuration Enabled
2026-01-09 13:34:39 (42013): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 13:34:49 (42013): Successfully started VM. (PID = '42095')
2026-01-09 13:34:49 (42013): Reporting VM Process ID to BOINC.
2026-01-09 13:34:49 (42013): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 13:34:49 (42013): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 13:34:49 (42013): Status Report: Elapsed Time: '34735.657557'
2026-01-09 13:34:49 (42013): Status Report: CPU Time: '223356.260000'
2026-01-09 13:34:49 (42013): Preference change detected
2026-01-09 13:34:49 (42013): Setting CPU throttle for VM. (100%)
2026-01-09 13:34:49 (42013): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 13:36:31 (42013): Stopping VM.
2026-01-09 13:36:45 (42013): Successfully stopped VM.
2026-01-09 14:00:15 (42455): vboxwrapper version 26210
2026-01-09 14:00:15 (42455): BOINC client version: 8.2.5
2026-01-09 14:00:15 (42455): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 14:00:15 (42455): Detected: Sandbox Configuration Enabled
2026-01-09 14:00:16 (42455): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 14:00:26 (42455): Successfully started VM. (PID = '42537')
2026-01-09 14:00:26 (42455): Reporting VM Process ID to BOINC.
2026-01-09 14:00:26 (42455): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 14:00:26 (42455): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 14:00:26 (42455): Status Report: Elapsed Time: '34837.657557'
2026-01-09 14:00:26 (42455): Status Report: CPU Time: '224008.400000'
2026-01-09 14:00:26 (42455): Preference change detected
2026-01-09 14:00:26 (42455): Setting CPU throttle for VM. (100%)
2026-01-09 14:00:26 (42455): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 14:02:51 (42455): Stopping VM.
2026-01-09 14:03:05 (42455): Successfully stopped VM.
2026-01-09 14:31:49 (42975): vboxwrapper version 26210
2026-01-09 14:31:49 (42975): BOINC client version: 8.2.5
2026-01-09 14:31:50 (42975): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 14:31:50 (42975): Detected: Sandbox Configuration Enabled
2026-01-09 14:31:50 (42975): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 14:32:00 (42975): Successfully started VM. (PID = '43059')
2026-01-09 14:32:00 (42975): Reporting VM Process ID to BOINC.
2026-01-09 14:32:00 (42975): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 14:32:00 (42975): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 14:32:00 (42975): Status Report: Elapsed Time: '34982.657557'
2026-01-09 14:32:00 (42975): Status Report: CPU Time: '224910.600000'
2026-01-09 14:32:00 (42975): Preference change detected
2026-01-09 14:32:00 (42975): Setting CPU throttle for VM. (100%)
2026-01-09 14:32:00 (42975): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 14:32:04 (42975): Stopping VM.
2026-01-09 14:32:19 (42975): Successfully stopped VM.
2026-01-09 14:48:35 (43294): vboxwrapper version 26210
2026-01-09 14:48:35 (43294): BOINC client version: 8.2.5
2026-01-09 14:48:35 (43294): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 14:48:35 (43294): Detected: Sandbox Configuration Enabled
2026-01-09 14:48:35 (43294): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 14:48:45 (43294): Successfully started VM. (PID = '43375')
2026-01-09 14:48:45 (43294): Reporting VM Process ID to BOINC.
2026-01-09 14:48:45 (43294): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 14:48:45 (43294): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 14:48:45 (43294): Status Report: Elapsed Time: '34986.657557'
2026-01-09 14:48:45 (43294): Status Report: CPU Time: '224910.600000'
2026-01-09 14:48:45 (43294): Preference change detected
2026-01-09 14:48:45 (43294): Setting CPU throttle for VM. (100%)
2026-01-09 14:48:45 (43294): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 14:48:46 (43294): Guest Log: 09:44:36.080516 timesync vgsvcTimeSyncWorker: Radical host time change: 2 758 580 000 000ns (HostNow=1 767 995 326 422 000 000 ns HostLast=1 767 992 567 842 000 000 ns)
2026-01-09 14:48:56 (43294): Guest Log: 09:44:46.086757 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 758 270 160 000ns (GuestNow=1 767 995 336 439 072 000 ns GuestLast=1 767 992 578 168 912 000 ns fSetTimeLastLoop=true )
2026-01-09 14:50:23 (43294): Stopping VM.
2026-01-09 14:50:37 (43294): Successfully stopped VM.
2026-01-09 15:06:04 (43633): vboxwrapper version 26210
2026-01-09 15:06:04 (43633): BOINC client version: 8.2.5
2026-01-09 15:06:05 (43633): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 15:06:05 (43633): Detected: Sandbox Configuration Enabled
2026-01-09 15:06:05 (43633): Guest Log: 09:44:36.080516 timesync vgsvcTimeSyncWorker: Radical host time change: 2 758 580 000 000ns (HostNow=1 767 995 326 422 000 000 ns HostLast=1 767 992 567 842 000 000 ns)
2026-01-09 15:06:05 (43633): Guest Log: 09:44:46.086757 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 758 270 160 000ns (GuestNow=1 767 995 336 439 072 000 ns GuestLast=1 767 992 578 168 912 000 ns fSetTimeLastLoop=true )
2026-01-09 15:06:05 (43633): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 15:06:15 (43633): Successfully started VM. (PID = '43715')
2026-01-09 15:06:15 (43633): Reporting VM Process ID to BOINC.
2026-01-09 15:06:15 (43633): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 15:06:15 (43633): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 15:06:15 (43633): Status Report: Elapsed Time: '35084.657557'
2026-01-09 15:06:15 (43633): Status Report: CPU Time: '225493.940000'
2026-01-09 15:06:15 (43633): Preference change detected
2026-01-09 15:06:15 (43633): Setting CPU throttle for VM. (100%)
2026-01-09 15:06:15 (43633): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 15:10:34 (43633): Stopping VM.
2026-01-09 15:10:49 (43633): Successfully stopped VM.
2026-01-09 15:12:34 (44018): vboxwrapper version 26210
2026-01-09 15:12:34 (44018): BOINC client version: 8.2.5
2026-01-09 15:12:35 (44018): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 15:12:35 (44018): Detected: Sandbox Configuration Enabled
2026-01-09 15:12:35 (44018): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 15:12:45 (44018): Successfully started VM. (PID = '44100')
2026-01-09 15:12:45 (44018): Reporting VM Process ID to BOINC.
2026-01-09 15:12:45 (44018): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 15:12:45 (44018): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 15:12:45 (44018): Stopping VM.
2026-01-09 15:12:59 (44018): Successfully stopped VM.
2026-01-09 15:28:05 (44286): vboxwrapper version 26210
2026-01-09 15:28:05 (44286): BOINC client version: 8.2.5
2026-01-09 15:28:05 (44286): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 15:28:05 (44286): Detected: Sandbox Configuration Enabled
2026-01-09 15:28:05 (44286): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 15:28:15 (44286): Successfully started VM. (PID = '44368')
2026-01-09 15:28:15 (44286): Reporting VM Process ID to BOINC.
2026-01-09 15:28:15 (44286): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 15:28:15 (44286): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 15:28:15 (44286): Status Report: Elapsed Time: '35343.657557'
2026-01-09 15:28:15 (44286): Status Report: CPU Time: '226416.520000'
2026-01-09 15:28:15 (44286): Preference change detected
2026-01-09 15:28:15 (44286): Setting CPU throttle for VM. (100%)
2026-01-09 15:28:15 (44286): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 15:28:23 (44286): Stopping VM.
2026-01-09 15:28:37 (44286): Successfully stopped VM.
2026-01-09 15:42:59 (44561): vboxwrapper version 26210
2026-01-09 15:42:59 (44561): BOINC client version: 8.2.5
2026-01-09 15:42:59 (44561): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 15:42:59 (44561): Detected: Sandbox Configuration Enabled
2026-01-09 15:43:00 (44561): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 15:43:10 (44561): Successfully started VM. (PID = '44636')
2026-01-09 15:43:10 (44561): Reporting VM Process ID to BOINC.
2026-01-09 15:43:10 (44561): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 15:43:10 (44561): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 15:43:10 (44561): Status Report: Elapsed Time: '35351.657557'
2026-01-09 15:43:10 (44561): Status Report: CPU Time: '226416.520000'
2026-01-09 15:43:10 (44561): Preference change detected
2026-01-09 15:43:10 (44561): Setting CPU throttle for VM. (100%)
2026-01-09 15:43:10 (44561): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2026-01-09 15:43:45 (44561): Guest Log:  *** Job finished ***
2026-01-09 15:43:45 (44561): Guest Log:  *** The last 20 lines of the pilot log: ***
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:31,603 | INFO     | [monitor] cgroup control has ended
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:32,618 | INFO     | caller=run is remaining thread - safe to abort (names=['<_MainThread(MainThread, started 139663408289600)>'])
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:37,641 | INFO     | all workflow threads have been joined
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:37,641 | INFO     | end of generic workflow (traces error code: 1150)
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:37,642 | INFO     | traces error code: 1150
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:37,642 | INFO     | an exit code was already set: 1150 (will be converted to a standard shell code)
2026-01-09 15:43:45 (44561): Guest Log: no translation to shell exit code for error code 1150
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:37,643 | INFO     | pilot has finished (exit code=1150, shell exit code=1)
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:38,099 [wrapper] ==== pilot stdout END ====
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:38,157 [wrapper] ==== wrapper stdout RESUME ====
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:38,213 [wrapper] pilotpid: 6117
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:38,256 [wrapper] Pilot exit status: 1
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:38,522 [wrapper] pandaids: 6962931365
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:38,565 [wrapper] WARNING: pilot exitcode non-zero: 1
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:38,616 [wrapper] WARNING: pilot exitcode non-zero: 1
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:39,070 [wrapper] cleanup supervisor_pilot 11156 6118
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:39,152 [wrapper] Test setup, not cleaning
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:39,197 [wrapper] apfmon messages muted
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:39,234 [wrapper] ==== wrapper stdout END ====
2026-01-09 15:43:45 (44561): Guest Log: 2026-01-09 22:43:39,298 [wrapper] ==== wrapper stderr END ====
2026-01-09 15:43:45 (44561): Guest Log:  *** Error codes and diagnostics ***
2026-01-09 15:43:45 (44561): Guest Log:     "exeErrorCode": 0,
2026-01-09 15:43:45 (44561): Guest Log:     "exeErrorDiag": "",
2026-01-09 15:43:45 (44561): Guest Log:     "pilotErrorCode": 1150,
2026-01-09 15:43:45 (44561): Guest Log:     "pilotErrorDiag": "Looping job killed by pilot",
2026-01-09 15:43:45 (44561): Guest Log:  *** Listing of results directory ***
2026-01-09 15:43:45 (44561): Guest Log: total 12328
2026-01-09 15:43:45 (44561): Guest Log: -rwx------. 1 atlas atlas   36322 Jan  8 08:17 runpilot2-wrapper.sh
2026-01-09 15:43:45 (44561): Guest Log: -rw-r--r--. 1 atlas atlas    5112 Jan  8 08:23 queuedata.json
2026-01-09 15:43:45 (44561): Guest Log: -rw-r--r--. 1 atlas atlas  579449 Jan  8 08:23 pilot3.tar.gz
2026-01-09 15:43:45 (44561): Guest Log: -rw-r-----. 1 atlas atlas   15847 Jan  9 08:37 start_atlas.sh
2026-01-09 15:43:45 (44561): Guest Log: -rw-r-----. 1 atlas atlas  592605 Jan  9 08:37 input.tar.gz
2026-01-09 15:43:45 (44561): Guest Log: -rw-r--r--. 1 atlas atlas    8055 Jan  9 08:37 init_data.xml
2026-01-09 15:43:45 (44561): Guest Log: lrwxrwxrwx. 1 atlas atlas      20 Jan  9 08:37 EVNT.47961981._000022.pool.root.1 -> /data/./ATLAS.root_0
2026-01-09 15:43:45 (44561): Guest Log: -rw-r--r--. 1 atlas atlas    2875 Jan  9 08:37 pandaJob.out
2026-01-09 15:43:45 (44561): Guest Log: -rw-------. 1 atlas atlas  989759 Jan  9 08:39 agis_schedconf.cvmfs.json
2026-01-09 15:43:45 (44561): Guest Log: drwx------. 5 atlas atlas    4096 Jan  9 08:39 pilot3
2026-01-09 15:43:45 (44561): Guest Log: -rw-------. 1 atlas atlas    1038 Jan  9 22:07 memory_monitor_summary.json
2026-01-09 15:43:45 (44561): Guest Log: -rw-------. 1 atlas atlas  774089 Jan  9 22:07 log.47961985._000497.job.log.tgz.1
2026-01-09 15:43:45 (44561): Guest Log: -rw-------. 1 atlas atlas 1516240 Jan  9 22:07 agis_ddmendpoints.agis.ALL.json
2026-01-09 15:43:45 (44561): Guest Log: -rw-------. 1 atlas atlas    2794 Jan  9 22:10 heartbeat.json
2026-01-09 15:43:45 (44561): Guest Log: -rw-------. 1 atlas atlas     114 Jan  9 22:28 pilot_heartbeat.json
2026-01-09 15:43:45 (44561): Guest Log: -rw-------. 1 atlas atlas    5676 Jan  9 22:43 pilotlog.txt
2026-01-09 15:43:45 (44561): Guest Log: -rw-------. 1 atlas atlas 3621400 Jan  9 22:43 log.47961985._000497.job.log.1
2026-01-09 15:43:45 (44561): Guest Log: -rw-------. 1 atlas atlas     186 Jan  9 22:43 output.list
2026-01-09 15:43:45 (44561): Guest Log: -rw-r--r--. 1 atlas atlas     620 Jan  9 22:43 runtime_log
2026-01-09 15:43:45 (44561): Guest Log: -rw-------. 1 atlas atlas 4413440 Jan  9 22:43 result.tar.gz
2026-01-09 15:43:45 (44561): Guest Log: -rw-------. 1 atlas atlas     685 Jan  9 22:43 vrbNDmbO0x8n9Rq4apOajLDm4fhM0noT9bVo0NGKDmbqeKDmajU9Em.diag
2026-01-09 15:43:45 (44561): Guest Log: -rw-r--r--. 1 atlas atlas    8694 Jan  9 22:43 runtime_log.err
2026-01-09 15:43:45 (44561): Guest Log: Looking for outputfile HITS.47961985._000497.pool.root.1
2026-01-09 15:43:45 (44561): Guest Log: No HITS file was produced
2026-01-09 15:43:45 (44561): Guest Log: Successfully finished the ATLAS job!
2026-01-09 15:43:45 (44561): Guest Log: Copying the results back to the shared directory!
2026-01-09 15:43:47 (44561): Guest Log:  *** Contents of shared directory: ***
2026-01-09 15:43:47 (44561): Guest Log: total 410096
2026-01-09 15:43:47 (44561): Guest Log: -rw-rw----. 1 root root 414901083 Jan  9 08:36 ATLAS.root_0
2026-01-09 15:43:47 (44561): Guest Log: -rw-rw-r--. 1 root root      8055 Jan  9 08:36 init_data.xml
2026-01-09 15:43:47 (44561): Guest Log: -rw-rw----. 1 root root    592605 Jan  9 08:36 input.tar.gz
2026-01-09 15:43:47 (44561): Guest Log: -rw-r--r--. 1 root root   4413440 Jan  9 22:43 result.tar.gz
2026-01-09 15:43:47 (44561): Guest Log: -rw-rw----. 1 root root     15847 Jan  9 08:36 start_atlas.sh
2026-01-09 15:43:47 (44561): Guest Log:  *** Success! Shutting down the machine. ***
2026-01-09 15:43:47 (44561): VM Completion File Detected.
2026-01-09 15:43:47 (44561): Powering off VM.
2026-01-09 15:43:47 (44561): Successfully stopped VM.
2026-01-09 15:43:47 (44561): Deregistering VM. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 15:43:47 (44561): Removing network bandwidth throttle group from VM.
2026-01-09 15:43:47 (44561): Removing VM from VirtualBox.
2026-01-09 15:43:52 (44561): called boinc_finish(0)
2026-01-09 16:06:39 (45007): vboxwrapper version 26210
2026-01-09 16:06:39 (45007): BOINC client version: 8.2.5
2026-01-09 16:06:40 (45007): Detected: VirtualBox VboxManage Interface (Version: 7.2.4)
2026-01-09 16:06:40 (45007): Detected: Sandbox Configuration Enabled
2026-01-09 16:06:40 (45007): Create VM. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 16:06:40 (45007): Setting Memory Size for VM. (4800MB)
2026-01-09 16:06:40 (45007): Setting CPU Count for VM. (8)
2026-01-09 16:06:40 (45007): Setting Chipset Options for VM.
2026-01-09 16:06:40 (45007): Setting Graphics Controller Options for VM. (Driver: VBoxVGA, 16MB)
2026-01-09 16:06:40 (45007): Setting Boot Options for VM.
2026-01-09 16:06:40 (45007): Setting Network Configuration for NAT. (Driver: virtio)
2026-01-09 16:06:40 (45007): Enabling VM Network Access.
2026-01-09 16:06:40 (45007): Disabling USB Support for VM.
2026-01-09 16:06:40 (45007): Disabling COM Port Support for VM.
2026-01-09 16:06:41 (45007): Disabling Audio Support for VM.
2026-01-09 16:06:41 (45007): Disabling Clipboard Support for VM.
2026-01-09 16:06:41 (45007): Disabling Drag and Drop Support for VM.
2026-01-09 16:06:41 (45007): Adding storage controller(s) to VM.
2026-01-09 16:06:41 (45007): Adding virtual disk drive to VM. (ATLAS_vbox_3.03_image.vdi)
2026-01-09 16:06:41 (45007): Adding VirtualBox Guest Additions to VM.
2026-01-09 16:06:41 (45007): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB)
2026-01-09 16:06:41 (45007): forwarding host port 54040 to guest port 80
2026-01-09 16:06:41 (45007): Enabling remote desktop for VM.
2026-01-09 16:06:41 (45007): Required extension pack not installed, remote desktop not enabled.
2026-01-09 16:06:41 (45007): Enabling shared directory for VM.
2026-01-09 16:06:41 (45007): Starting VM using VBoxManage interface. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 16:06:46 (45007): Successfully started VM. (PID = '45083')
2026-01-09 16:06:46 (45007): Reporting VM Process ID to BOINC.
2026-01-09 16:06:46 (45007): Guest Log: BIOS: VirtualBox 7.2.4
2026-01-09 16:06:46 (45007): Guest Log: CPUID EDX: 0x178bfbff
2026-01-09 16:06:46 (45007): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2026-01-09 16:06:46 (45007): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2026-01-09 16:06:46 (45007): VM state change detected. (old = 'poweredoff', new = 'running')
2026-01-09 16:06:46 (45007): Detected: Web Application Enabled (http://localhost:54040)
2026-01-09 16:06:46 (45007): VM Completion File Detected.
2026-01-09 16:06:46 (45007): Powering off VM.
2026-01-09 16:06:46 (45007): Successfully stopped VM.
2026-01-09 16:06:46 (45007): Deregistering VM. (boinc_3a1ce1f879f7913e, slot#9)
2026-01-09 16:06:46 (45007): Removing network bandwidth throttle group from VM.
2026-01-09 16:06:46 (45007): Removing VM from VirtualBox.
2026-01-09 16:06:51 (45007): called boinc_finish(0)

</stderr_txt>
]]>


©2026 CERN