| Name | ETmMDm8IY56n9Rq4apOajLDm4fhM0noT9bVoFjIUDmFncKDmzYjFZm_0 |
| Workunit | 230486691 |
| Created | 21 Feb 2025, 2:51:14 UTC |
| Sent | 21 Feb 2025, 6:21:47 UTC |
| Report deadline | 1 Mar 2025, 6:21:47 UTC |
| Received | 22 Feb 2025, 4:58:02 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 10862817 |
| Run time | 3 hours 19 min 59 sec |
| CPU time | 51 min 47 sec |
| Validate state | Valid |
| Credit | 563.91 |
| Device peak FLOPS | 2.81 GFLOPS |
| Application version | ATLAS Simulation v3.01 (vbox64_mt_mcore_atlas) windows_x86_64 |
| Peak working set size | 76.38 MB |
| Peak swap size | 82.81 MB |
| Peak disk usage | 1.89 GB |
Stderr output
<core_client_version>8.0.2</core_client_version> <![CDATA[ <stderr_txt> 2025-02-21 07:23:07 (9136): Detected: vboxwrapper 26206 2025-02-21 07:23:08 (9136): Detected: BOINC client v8.0.2 2025-02-21 07:23:16 (9136): Detected: VirtualBox VboxManage Interface (Version: 7.0.6) 2025-02-21 07:23:17 (9136): Successfully copied 'init_data.xml' to the shared directory. 2025-02-21 07:23:17 (9136): Create VM. (boinc_c7fe0ae52a32ece3, slot#3) 2025-02-21 07:23:18 (9136): Setting Memory Size for VM. (4200MB) 2025-02-21 07:23:19 (9136): Setting CPU Count for VM. (2) 2025-02-21 07:23:19 (9136): Setting Chipset Options for VM. 2025-02-21 07:23:20 (9136): Setting Graphics Controller Options for VM. 2025-02-21 07:23:21 (9136): Setting Boot Options for VM. 2025-02-21 07:23:21 (9136): Setting Network Configuration for NAT. 2025-02-21 07:23:22 (9136): Enabling VM Network Access. 2025-02-21 07:23:22 (9136): Disabling USB Support for VM. 2025-02-21 07:23:22 (9136): Disabling COM Port Support for VM. 2025-02-21 07:23:23 (9136): Disabling LPT Port Support for VM. 2025-02-21 07:23:23 (9136): Disabling Audio Support for VM. 2025-02-21 07:23:23 (9136): Disabling Clipboard Support for VM. 2025-02-21 07:23:24 (9136): Disabling Drag and Drop Support for VM. 2025-02-21 07:23:24 (9136): Adding storage controller(s) to VM. 2025-02-21 07:23:25 (9136): Adding virtual disk drive to VM. (ATLAS_vbox_3.01_image.vdi) 2025-02-21 07:23:29 (9136): Adding VirtualBox Guest Additions to VM. 2025-02-21 07:23:29 (9136): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2025-02-21 07:23:29 (9136): forwarding host port 55600 to guest port 80 2025-02-21 07:23:30 (9136): Enabling remote desktop for VM. 2025-02-21 07:23:30 (9136): Enabling shared directory for VM. 2025-02-21 07:23:31 (9136): Starting VM using VBoxManage interface. (boinc_c7fe0ae52a32ece3, slot#3) 2025-02-21 07:23:54 (9136): Successfully started VM. (PID = '8472') 2025-02-21 07:23:54 (9136): Reporting VM Process ID to BOINC. 2025-02-21 07:23:54 (9136): Guest Log: BIOS: VirtualBox 7.0.6 2025-02-21 07:23:54 (9136): Guest Log: CPUID EDX: 0x178bfbff 2025-02-21 07:23:54 (9136): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2025-02-21 07:23:54 (9136): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2025-02-21 07:23:54 (9136): VM state change detected. (old = 'poweredoff', new = 'running') 2025-02-21 07:23:54 (9136): Detected: Web Application Enabled (http://localhost:55600) 2025-02-21 07:23:54 (9136): Detected: Remote Desktop Enabled (localhost:55601) 2025-02-21 07:23:55 (9136): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 07:24:14 (9136): Preference change detected 2025-02-21 07:24:14 (9136): Setting CPU throttle for VM. (1%) 2025-02-21 07:24:15 (9136): Setting checkpoint interval to 3600 seconds. (Higher value of (Preference: 3600 seconds) or (Vbox_job.xml: 900 seconds)) 2025-02-21 07:24:15 (9136): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 07:24:18 (9136): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2025-02-21 07:24:18 (9136): Guest Log: BIOS: Booting from Hard Disk... 2025-02-21 07:24:47 (9136): Guest Log: BIOS: KBD: unsupported int 16h function 03 2025-02-21 07:24:47 (9136): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2025-02-21 07:24:47 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2025-02-21 07:24:47 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2025-02-21 07:24:47 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2025-02-21 07:24:47 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2025-02-21 07:24:47 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2025-02-21 07:24:48 (9136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2025-02-21 07:26:56 (9136): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 07:27:16 (9136): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 07:28:05 (9136): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2025-02-21 07:28:05 (9136): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2025-02-21 07:31:15 (9136): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 07:31:36 (9136): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 07:34:31 (9136): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2025-02-21 07:34:31 (9136): Guest Log: 00:00:00.001664 main Log opened 2025-02-21T07:33:27.249027000Z 2025-02-21 07:34:31 (9136): Guest Log: 00:00:00.003411 main OS Product: Linux 2025-02-21 07:34:31 (9136): Guest Log: 00:00:00.003921 main OS Release: 3.10.0-957.27.2.el7.x86_64 2025-02-21 07:34:31 (9136): Guest Log: 00:00:00.004175 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2025-02-21 07:34:31 (9136): Guest Log: 00:00:00.004483 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2025-02-21 07:34:31 (9136): Guest Log: 00:00:00.004491 main Process ID: 1282 2025-02-21 07:34:31 (9136): Guest Log: 00:00:00.004494 main Package type: LINUX_64BITS_GENERIC 2025-02-21 07:34:31 (9136): Guest Log: 00:00:00.011288 main 5.2.32 r132073 started. Verbose level = 0 2025-02-21 07:34:39 (9136): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2025-02-21 07:34:39 (9136): Guest Log: [INFO] Mounting shared directory 2025-02-21 07:34:41 (9136): Guest Log: 00:00:10.958177 timesync vgsvcTimeSyncWorker: Radical guest time change: -3 526 913 108 000ns (GuestNow=1 740 119 681 020 182 000 ns GuestLast=1 740 123 207 933 290 000 ns fSetTimeLastLoop=true ) 2025-02-21 07:34:47 (9136): Guest Log: [INFO] Checking for init_data.xml 2025-02-21 07:35:51 (9136): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2025-02-21 07:35:51 (9136): Guest Log: [INFO] Detected branch: prod 2025-02-21 07:35:59 (9136): Guest Log: This is the prod version of the ATLAS job wrapper 2025-02-21 07:35:59 (9136): Guest Log: Copying input files 2025-02-21 07:38:02 (9136): Guest Log: Copied input files into RunAtlas. 2025-02-21 07:38:07 (9136): Guest Log: This VM did not configure a local http proxy via BOINC. 2025-02-21 07:38:08 (9136): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2025-02-21 07:38:08 (9136): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2025-02-21 07:38:08 (9136): Guest Log: Further information can be found at the LHC@home message board. 2025-02-21 07:38:52 (9136): Guest Log: Running cvmfs_config stat atlas.cern.ch 2025-02-21 07:39:05 (9136): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2025-02-21 07:39:05 (9136): Guest Log: 2.6.3.0 1578 3 30072 142892 3 1 3117296 4096000 0 65024 0 0 n/a 0 0 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1 2025-02-21 07:39:46 (9136): Guest Log: copied the webapp to /var/www 2025-02-21 07:39:49 (9136): Guest Log: ATHENA_PROC_NUMBER=2 2025-02-21 07:39:49 (9136): Guest Log: ATHENA_CORE_NUMBER=2 2025-02-21 07:39:55 (9136): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2025-02-21 07:39:57 (9136): Guest Log: *** Starting ATLAS job. (PandaID=6521686918 taskID=43205094) *** 2025-02-21 07:41:58 (9136): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 07:44:38 (9136): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 07:44:47 (9136): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 07:45:07 (9136): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 07:45:17 (9136): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 07:45:38 (9136): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 07:45:48 (9136): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 07:47:48 (9136): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 07:47:58 (9136): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 07:48:18 (9136): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 07:48:59 (9136): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 14:57:19 (9112): Detected: vboxwrapper 26206 2025-02-21 14:57:19 (9112): Detected: BOINC client v8.0.2 2025-02-21 14:57:31 (9112): Detected: VirtualBox VboxManage Interface (Version: 7.0.6) 2025-02-21 14:57:36 (9112): Guest Log: BIOS: VirtualBox 7.0.6 2025-02-21 14:57:36 (9112): Guest Log: CPUID EDX: 0x178bfbff 2025-02-21 14:57:36 (9112): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2025-02-21 14:57:36 (9112): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2025-02-21 14:57:36 (9112): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2025-02-21 14:57:36 (9112): Guest Log: BIOS: Booting from Hard Disk... 2025-02-21 14:57:36 (9112): Guest Log: BIOS: KBD: unsupported int 16h function 03 2025-02-21 14:57:36 (9112): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2025-02-21 14:57:36 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2025-02-21 14:57:36 (9112): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2025-02-21 14:57:36 (9112): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2025-02-21 14:57:36 (9112): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2025-02-21 14:57:36 (9112): Guest Log: 00:00:00.001664 main Log opened 2025-02-21T07:33:27.249027000Z 2025-02-21 14:57:36 (9112): Guest Log: 00:00:00.003411 main OS Product: Linux 2025-02-21 14:57:36 (9112): Guest Log: 00:00:00.003921 main OS Release: 3.10.0-957.27.2.el7.x86_64 2025-02-21 14:57:36 (9112): Guest Log: 00:00:00.004175 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2025-02-21 14:57:36 (9112): Guest Log: 00:00:00.004483 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2025-02-21 14:57:36 (9112): Guest Log: 00:00:00.004491 main Process ID: 1282 2025-02-21 14:57:36 (9112): Guest Log: 00:00:00.004494 main Package type: LINUX_64BITS_GENERIC 2025-02-21 14:57:36 (9112): Guest Log: 00:00:00.011288 main 5.2.32 r132073 started. Verbose level = 0 2025-02-21 14:57:36 (9112): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2025-02-21 14:57:36 (9112): Guest Log: [INFO] Mounting shared directory 2025-02-21 14:57:36 (9112): Guest Log: 00:00:10.958177 timesync vgsvcTimeSyncWorker: Radical guest time change: -3 526 913 108 000ns (GuestNow=1 740 119 681 020 182 000 ns GuestLast=1 740 123 207 933 290 000 ns fSetTimeLastLoop=true ) 2025-02-21 14:57:36 (9112): Guest Log: [INFO] Checking for init_data.xml 2025-02-21 14:57:36 (9112): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2025-02-21 14:57:36 (9112): Guest Log: [INFO] Detected branch: prod 2025-02-21 14:57:36 (9112): Guest Log: This is the prod version of the ATLAS job wrapper 2025-02-21 14:57:36 (9112): Guest Log: Copying input files 2025-02-21 14:57:36 (9112): Guest Log: Copied input files into RunAtlas. 2025-02-21 14:57:36 (9112): Guest Log: This VM did not configure a local http proxy via BOINC. 2025-02-21 14:57:36 (9112): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2025-02-21 14:57:36 (9112): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2025-02-21 14:57:36 (9112): Guest Log: Further information can be found at the LHC@home message board. 2025-02-21 14:57:36 (9112): Guest Log: Running cvmfs_config stat atlas.cern.ch 2025-02-21 14:57:36 (9112): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2025-02-21 14:57:36 (9112): Guest Log: 2.6.3.0 1578 3 30072 142892 3 1 3117296 4096000 0 65024 0 0 n/a 0 0 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1 2025-02-21 14:57:36 (9112): Guest Log: copied the webapp to /var/www 2025-02-21 14:57:36 (9112): Guest Log: ATHENA_PROC_NUMBER=2 2025-02-21 14:57:36 (9112): Guest Log: ATHENA_CORE_NUMBER=2 2025-02-21 14:57:36 (9112): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2025-02-21 14:57:36 (9112): Guest Log: *** Starting ATLAS job. (PandaID=6521686918 taskID=43205094) *** 2025-02-21 14:57:36 (9112): Starting VM using VBoxManage interface. (boinc_c7fe0ae52a32ece3, slot#3) 2025-02-21 14:58:16 (9112): Successfully started VM. (PID = '8644') 2025-02-21 14:58:16 (9112): Reporting VM Process ID to BOINC. 2025-02-21 14:58:17 (9112): Guest Log: BIOS: VirtualBox 7.0.6 2025-02-21 14:58:17 (9112): Guest Log: CPUID EDX: 0x178bfbff 2025-02-21 14:58:17 (9112): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2025-02-21 14:58:17 (9112): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2025-02-21 14:58:17 (9112): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2025-02-21 14:58:17 (9112): Guest Log: BIOS: Booting from Hard Disk... 2025-02-21 14:58:17 (9112): VM state change detected. (old = 'poweredoff', new = 'running') 2025-02-21 14:58:17 (9112): Detected: Web Application Enabled (http://localhost:55600) 2025-02-21 14:58:17 (9112): Detected: Remote Desktop Enabled (localhost:55601) 2025-02-21 14:58:18 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 14:58:55 (9112): Preference change detected 2025-02-21 14:58:55 (9112): Setting CPU throttle for VM. (1%) 2025-02-21 14:58:55 (9112): Setting checkpoint interval to 3600 seconds. (Higher value of (Preference: 3600 seconds) or (Vbox_job.xml: 900 seconds)) 2025-02-21 14:58:55 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 14:59:06 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 14:59:26 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 15:00:04 (9112): Guest Log: BIOS: KBD: unsupported int 16h function 03 2025-02-21 15:00:04 (9112): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2025-02-21 15:00:04 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2025-02-21 15:00:05 (9112): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2025-02-21 15:00:15 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 15:00:36 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 15:01:33 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 15:03:26 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 15:04:21 (9112): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2025-02-21 15:04:23 (9112): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2025-02-21 15:08:00 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 15:08:27 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 15:09:44 (9112): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2025-02-21 15:09:44 (9112): Guest Log: 00:00:00.000546 main Log opened 2025-02-21T15:06:00.394461000Z 2025-02-21 15:09:44 (9112): Guest Log: 00:00:00.099094 main OS Product: Linux 2025-02-21 15:09:44 (9112): Guest Log: 00:00:00.099440 main OS Release: 3.10.0-957.27.2.el7.x86_64 2025-02-21 15:09:44 (9112): Guest Log: 00:00:00.099560 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2025-02-21 15:09:44 (9112): Guest Log: 00:00:00.099678 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2025-02-21 15:09:44 (9112): Guest Log: 00:00:00.099681 main Process ID: 1327 2025-02-21 15:09:44 (9112): Guest Log: 00:00:00.099684 main Package type: LINUX_64BITS_GENERIC 2025-02-21 15:09:44 (9112): Guest Log: 00:00:00.104188 main 5.2.32 r132073 started. Verbose level = 0 2025-02-21 15:09:48 (9112): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2025-02-21 15:09:48 (9112): Guest Log: [INFO] Mounting shared directory 2025-02-21 15:09:51 (9112): Guest Log: [INFO] Checking for init_data.xml 2025-02-21 15:09:54 (9112): Guest Log: 00:00:10.208318 timesync vgsvcTimeSyncWorker: Radical guest time change: -3 366 347 523 000ns (GuestNow=1 740 146 994 165 236 000 ns GuestLast=1 740 150 360 512 759 000 ns fSetTimeLastLoop=true ) 2025-02-21 15:11:19 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 16:42:23 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 16:42:28 (9112): Guest Log: 00:01:40.588201 timesync vgsvcTimeSyncWorker: Radical host time change: 5 473 053 000 000ns (HostNow=1 740 152 547 474 000 000 ns HostLast=1 740 147 074 421 000 000 ns) 2025-02-21 16:42:30 (9112): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2025-02-21 16:42:31 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 16:42:51 (9112): Guest Log: [INFO] Detected branch: prod 2025-02-21 16:42:51 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 16:42:55 (9112): Guest Log: This is the prod version of the ATLAS job wrapper 2025-02-21 16:42:55 (9112): Guest Log: Copying input files 2025-02-21 16:42:58 (9112): Guest Log: 00:01:50.619277 timesync vgsvcTimeSyncWorker: Radical guest time change: 5 472 964 854 000ns (GuestNow=1 740 152 557 505 556 000 ns GuestLast=1 740 147 084 540 702 000 ns fSetTimeLastLoop=true ) 2025-02-21 16:44:27 (9112): Guest Log: Copied input files into RunAtlas. 2025-02-21 16:44:31 (9112): Guest Log: This VM did not configure a local http proxy via BOINC. 2025-02-21 16:44:31 (9112): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2025-02-21 16:44:31 (9112): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2025-02-21 16:44:31 (9112): Guest Log: Further information can be found at the LHC@home message board. 2025-02-21 16:45:06 (9112): Guest Log: Running cvmfs_config stat atlas.cern.ch 2025-02-21 16:45:14 (9112): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2025-02-21 16:45:15 (9112): Guest Log: 2.6.3.0 1648 93 32072 142907 3 1 3196688 4096001 0 65024 0 0 n/a 0 0 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1 2025-02-21 16:45:39 (9112): Guest Log: copied the webapp to /var/www 2025-02-21 16:45:41 (9112): Guest Log: ATHENA_PROC_NUMBER=2 2025-02-21 16:45:41 (9112): Guest Log: ATHENA_CORE_NUMBER=2 2025-02-21 16:45:44 (9112): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2025-02-21 16:45:47 (9112): Guest Log: *** Starting ATLAS job. (PandaID=6521686918 taskID=43205094) *** 2025-02-21 16:48:31 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 16:49:51 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 16:54:03 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 16:57:03 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 16:57:12 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 16:58:32 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 16:58:42 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 16:59:02 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 16:59:33 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 17:05:54 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 17:06:14 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 17:31:36 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 17:31:47 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 17:47:09 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 17:47:16 (9112): Guest Log: 00:13:03.373217 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 293 384 484 000ns (GuestNow=1 740 155 513 643 496 000 ns GuestLast=1 740 153 220 259 012 000 ns fSetTimeLastLoop=true ) 2025-02-21 17:47:19 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 17:54:20 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 17:54:51 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 17:55:12 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 17:55:21 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 17:55:43 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 17:55:51 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 17:56:11 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 17:56:30 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 17:56:50 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 17:57:00 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 17:57:21 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 17:57:31 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 17:57:51 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 17:58:01 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 17:58:56 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 18:02:04 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 18:05:02 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 18:05:12 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 18:06:13 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 18:06:42 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 18:07:02 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 18:07:33 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 18:13:54 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 18:14:04 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 18:32:26 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 18:32:35 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 18:52:58 (9112): Guest Log: 00:19:24.944483 timesync vgsvcTimeSyncWorker: Radical guest time change: 1 926 848 652 000ns (GuestNow=1 740 159 155 278 244 000 ns GuestLast=1 740 157 228 429 592 000 ns fSetTimeLastLoop=true ) 2025-02-21 18:52:58 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 18:53:18 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 18:54:18 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 18:54:28 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 18:55:49 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 18:56:09 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:02:09 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:03:50 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:04:38 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:08:01 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:09:41 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:09:51 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:10:11 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:11:10 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:11:31 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:11:41 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:12:01 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:12:20 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:12:40 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:12:51 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:13:51 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:17:11 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:17:32 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:17:51 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:22:32 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:26:42 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:29:50 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:30:03 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:30:23 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:30:33 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:30:54 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:31:03 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:32:03 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:33:23 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:33:43 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:33:54 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:39:14 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:39:25 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:42:05 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:42:15 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:43:35 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:43:45 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:45:45 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:45:56 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:47:35 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:50:00 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:50:20 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:56:06 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 19:59:19 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 19:59:33 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:01:33 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:01:43 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:11:24 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:12:55 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:13:14 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:15:14 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:18:23 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:18:35 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:37:57 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:38:08 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:38:28 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:38:31 (9112): Guest Log: 00:50:14.840662 timesync vgsvcTimeSyncWorker: Radical guest time change: 1 961 175 674 000ns (GuestNow=1 740 166 690 252 504 000 ns GuestLast=1 740 164 729 076 830 000 ns fSetTimeLastLoop=true ) 2025-02-21 20:38:38 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:38:58 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:39:07 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:39:47 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:39:57 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:41:18 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:41:28 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:50:08 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:51:59 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:52:20 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:54:09 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:57:21 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:57:31 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 20:59:31 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 20:59:50 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 21:18:14 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 21:18:27 (9112): Guest Log: 00:55:16.418457 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 125 917 019 000ns (GuestNow=1 740 169 107 589 656 000 ns GuestLast=1 740 166 981 672 637 000 ns fSetTimeLastLoop=true ) 2025-02-21 21:24:54 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 21:28:01 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 21:28:14 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 21:29:35 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 21:31:15 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 21:31:35 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 21:33:35 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 21:36:39 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 21:36:45 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 21:38:46 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 21:38:56 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:30:22 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:30:31 (9112): Guest Log: 01:06:00.425180 timesync vgsvcTimeSyncWorker: Radical host time change: 3 096 198 000 000ns (HostNow=1 740 173 430 714 000 000 ns HostLast=1 740 170 334 516 000 000 ns) 2025-02-21 22:30:32 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:30:52 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:31:01 (9112): Guest Log: 01:06:10.458192 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 689 773 919 000ns (GuestNow=1 740 173 441 058 653 000 ns GuestLast=1 740 169 751 284 734 000 ns fSetTimeLastLoop=true ) 2025-02-21 22:31:02 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:31:42 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:32:02 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:33:42 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:33:52 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:34:12 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:34:33 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:34:53 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:36:02 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:36:22 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:37:43 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:38:03 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:39:22 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:39:42 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:40:02 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:40:22 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:50:04 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:53:25 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:53:34 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 22:55:35 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 22:55:45 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-21 23:06:46 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-21 23:11:37 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 00:11:44 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 00:11:48 (9112): Guest Log: 01:26:07.584146 timesync vgsvcTimeSyncWorker: Radical host time change: 3 617 154 000 000ns (HostNow=1 740 179 508 226 000 000 ns HostLast=1 740 175 891 072 000 000 ns) 2025-02-22 00:11:59 (9112): Guest Log: 01:26:17.717276 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 617 292 053 000ns (GuestNow=1 740 179 518 359 324 000 ns GuestLast=1 740 175 901 067 271 000 ns fSetTimeLastLoop=true ) 2025-02-22 00:15:55 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 00:16:15 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 00:20:15 (9112): Status Report: Elapsed Time: '6000.448513' 2025-02-22 00:20:15 (9112): Status Report: CPU Time: '1637.234375' 2025-02-22 00:57:09 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 00:57:29 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 00:58:03 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 00:58:23 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 00:58:34 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 00:58:54 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 00:59:04 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 00:59:44 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 00:59:54 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:00:14 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:01:14 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:16:16 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:18:26 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:18:46 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:22:36 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:22:56 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:23:07 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:23:47 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:23:56 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:24:16 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:24:27 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:25:27 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:25:37 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:44:19 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:48:10 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:48:30 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:48:39 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:49:19 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:49:29 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:50:09 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:50:19 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:51:00 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:51:10 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 01:51:30 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 01:51:40 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 02:48:07 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 02:48:12 (9112): Guest Log: 02:24:40.633553 timesync vgsvcTimeSyncWorker: Radical host time change: 3 397 686 000 000ns (HostNow=1 740 188 891 861 000 000 ns HostLast=1 740 185 494 175 000 000 ns) 2025-02-22 02:48:22 (9112): Guest Log: 02:24:50.634599 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 458 632 265 000ns (GuestNow=1 740 188 902 076 515 000 ns GuestLast=1 740 185 443 444 250 000 ns fSetTimeLastLoop=true ) 2025-02-22 02:50:17 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 02:50:57 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 02:51:07 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 02:51:27 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 02:51:36 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 02:51:56 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 02:52:06 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 02:52:46 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 02:52:57 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 02:53:17 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 02:53:27 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 02:53:48 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 02:53:57 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 03:27:21 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 03:27:28 (9112): Guest Log: 02:27:51.598737 timesync vgsvcTimeSyncWorker: Radical host time change: 2 013 817 000 000ns (HostNow=1 740 191 248 468 000 000 ns HostLast=1 740 189 234 651 000 000 ns) 2025-02-22 03:27:38 (9112): Guest Log: 02:28:01.627334 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 175 456 891 000ns (GuestNow=1 740 191 258 497 072 000 ns GuestLast=1 740 189 083 040 181 000 ns fSetTimeLastLoop=true ) 2025-02-22 03:31:02 (9112): Error in pause VM for VM: -2135228414 Command: VBoxManage -q controlvm "boinc_c7fe0ae52a32ece3" pause Output: VBoxManage.exe: error: Already paused VBoxManage.exe: error: Details: code VBOX_E_INVALID_VM_STATE (0x80bb0002), component ConsoleWrap, interface IConsole, callee IUnknown VBoxManage.exe: error: Context: "Pause()" at line 390 of file VBoxManageControlVM.cpp 2025-02-22 03:31:03 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 03:31:23 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 03:47:46 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 03:48:06 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 03:48:16 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 03:50:36 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 03:51:17 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 04:06:38 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 04:08:09 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 04:08:29 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 04:10:49 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 04:11:09 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 04:11:18 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 04:11:38 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 04:11:48 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 04:12:29 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 04:12:39 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 04:13:20 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 04:13:29 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 04:13:49 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 04:13:59 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 04:19:20 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 04:23:10 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 04:25:11 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 04:25:22 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 04:26:21 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 04:27:52 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 05:23:17 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 05:23:26 (9112): Guest Log: 02:57:50.152167 timesync vgsvcTimeSyncWorker: Radical host time change: 3 335 200 000 000ns (HostNow=1 740 198 205 827 000 000 ns HostLast=1 740 194 870 627 000 000 ns) 2025-02-22 05:23:27 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 05:23:47 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 05:23:57 (9112): Guest Log: 02:58:00.188412 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 957 325 285 000ns (GuestNow=1 740 198 216 006 723 000 ns GuestLast=1 740 194 258 681 438 000 ns fSetTimeLastLoop=true ) 2025-02-22 05:34:09 (9112): VM state change detected. (old = 'running', new = 'paused') 2025-02-22 05:34:30 (9112): VM state change detected. (old = 'paused', new = 'running') 2025-02-22 05:37:15 (9112): Guest Log: *** Job finished *** 2025-02-22 05:37:15 (9112): Guest Log: *** The last 20 lines of the pilot log: *** 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:35:55,578 | INFO | [payload] failed_post thread has finished 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:35:56,557 | INFO | [job] queue monitor thread has finished 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:35:58,049 | INFO | [data] queue_monitor thread has finished 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:35:59,062 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140402773911360)>', '<ExcThread(monitor, started 140401608488704)>'] 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:35:59,599 | WARNING | job_aborted has been set - aborting pilot monitoring 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:35:59,601 | INFO | [monitor] control thread has ended 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:04,070 | INFO | all workflow threads have been joined 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:04,071 | INFO | end of generic workflow (traces error code: 0) 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:04,150 | INFO | traces error code: 0 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:04,254 | INFO | pilot has finished (exit code=0, shell exit code=0) 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:13,126 [wrapper] ==== pilot stdout END ==== 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:13,432 [wrapper] ==== wrapper stdout RESUME ==== 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:13,684 [wrapper] pilotpid: 6235 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:14,370 [wrapper] Pilot exit status: 0 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:16,140 [wrapper] pandaids: 6521686918 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:20,717 [wrapper] cleanup supervisor_pilot 14975 6236 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:21,248 [wrapper] Test setup, not cleaning 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:21,748 [wrapper] apfmon messages muted 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:22,160 [wrapper] ==== wrapper stdout END ==== 2025-02-22 05:37:16 (9112): Guest Log: 2025-02-22 04:36:22,888 [wrapper] ==== wrapper stderr END ==== 2025-02-22 05:37:16 (9112): Guest Log: *** Error codes and diagnostics *** 2025-02-22 05:37:17 (9112): Guest Log: "exeErrorCode": 65, 2025-02-22 05:37:17 (9112): Guest Log: "exeErrorDiag": "Non-zero return code from EVNTtoHITS (1); Logfile error in log.EVNTtoHITS: \"ToolSvc ERROR Cannot create tool InDetDD::BCM_Builder (No factory found)\"", 2025-02-22 05:37:17 (9112): Guest Log: "pilotErrorCode": 1305, 2025-02-22 05:37:17 (9112): Guest Log: "pilotErrorDiag": "Failed to execute payload:PyJobTransforms.transform.execute 2025-02-22 03:11:47,013 CRITICAL Transform executor raised TransformValidationException: Non-zero return code from EVNTtoHITS (1); Logfile error in log.EVNTtoHITS: \"ToolSvc ERROR Cannot creat", 2025-02-22 05:37:18 (9112): Guest Log: *** Listing of results directory *** 2025-02-22 05:37:18 (9112): Guest Log: total 4472 2025-02-22 05:37:18 (9112): Guest Log: -rw-r--r--. 1 atlas atlas 491065 Feb 21 02:25 pilot3.tar.gz 2025-02-22 05:37:18 (9112): Guest Log: -rwx------. 1 atlas atlas 35865 Feb 21 02:50 runpilot2-wrapper.sh 2025-02-22 05:37:18 (9112): Guest Log: -rw-r--r--. 1 atlas atlas 5118 Feb 21 02:50 queuedata.json 2025-02-22 05:37:18 (9112): Guest Log: -rwxr-xr-x. 1 atlas atlas 8885 Feb 21 15:43 init_data.xml 2025-02-22 05:37:18 (9112): Guest Log: -rwxr-xr-x. 1 atlas atlas 503549 Feb 21 15:43 input.tar.gz 2025-02-22 05:37:18 (9112): Guest Log: -rwxr-xr-x. 1 atlas atlas 17569 Feb 21 15:43 start_atlas.sh 2025-02-22 05:37:18 (9112): Guest Log: lrwxrwxrwx. 1 atlas atlas 20 Feb 21 15:44 EVNT.43092757._001922.pool.root.1 -> /data/./ATLAS.root_0 2025-02-22 05:37:18 (9112): Guest Log: -rw-r--r--. 1 atlas atlas 2544 Feb 21 15:45 pandaJob.out 2025-02-22 05:37:18 (9112): Guest Log: -rw-------. 1 atlas atlas 424 Feb 21 15:45 setup.sh.local 2025-02-22 05:37:18 (9112): Guest Log: -rw-------. 1 atlas atlas 987293 Feb 21 17:55 agis_schedconf.cvmfs.json 2025-02-22 05:37:19 (9112): Guest Log: drwx------. 4 atlas atlas 4096 Feb 21 17:57 pilot3 2025-02-22 05:37:19 (9112): Guest Log: -rw-------. 1 atlas atlas 1017 Feb 22 03:12 memory_monitor_summary.json 2025-02-22 05:37:19 (9112): Guest Log: -rw-------. 1 atlas atlas 82234 Feb 22 03:13 log.43205094._029473.job.log.tgz.1 2025-02-22 05:37:19 (9112): Guest Log: -rw-------. 1 atlas atlas 0 Feb 22 03:14 agis_ddmendpoints.agis.ALL.json 2025-02-22 05:37:19 (9112): Guest Log: -rw-------. 1 atlas atlas 1318726 Feb 22 03:17 cric_ddmendpoints.json 2025-02-22 05:37:19 (9112): Guest Log: -rw-------. 1 atlas atlas 97 Feb 22 04:35 pilot_heartbeat.json 2025-02-22 05:37:19 (9112): Guest Log: -rw-------. 1 atlas atlas 11033 Feb 22 04:35 heartbeat.json 2025-02-22 05:37:19 (9112): Guest Log: -rw-------. 1 atlas atlas 4461 Feb 22 04:36 pilotlog.txt 2025-02-22 05:37:19 (9112): Guest Log: -rw-------. 1 atlas atlas 469676 Feb 22 04:36 log.43205094._029473.job.log.1 2025-02-22 05:37:19 (9112): Guest Log: -rw-------. 1 atlas atlas 188 Feb 22 04:36 output.list 2025-02-22 05:37:19 (9112): Guest Log: -rw-r--r--. 1 atlas atlas 620 Feb 22 04:36 runtime_log 2025-02-22 05:37:19 (9112): Guest Log: -rw-------. 1 atlas atlas 573440 Feb 22 04:36 result.tar.gz 2025-02-22 05:37:19 (9112): Guest Log: -rw-r--r--. 1 atlas atlas 10862 Feb 22 04:36 runtime_log.err 2025-02-22 05:37:20 (9112): Guest Log: -rw-------. 1 atlas atlas 677 Feb 22 04:36 ETmMDm8IY56n9Rq4apOajLDm4fhM0noT9bVoFjIUDmFncKDmzYjFZm.diag 2025-02-22 05:37:20 (9112): Guest Log: Looking for outputfile HITS.43205094._029473.pool.root.1 2025-02-22 05:37:20 (9112): Guest Log: No HITS file was produced 2025-02-22 05:37:20 (9112): Guest Log: Successfully finished the ATLAS job! 2025-02-22 05:37:20 (9112): Guest Log: Copying the results back to the shared directory! 2025-02-22 05:37:27 (9112): Guest Log: *** Contents of shared directory: *** 2025-02-22 05:37:30 (9112): Guest Log: total 340736 2025-02-22 05:37:30 (9112): Guest Log: -rwxrwxrwx. 1 root root 347803050 Feb 21 06:23 ATLAS.root_0 2025-02-22 05:37:30 (9112): Guest Log: -rwxrwxrwx. 1 root root 8885 Feb 21 06:23 init_data.xml 2025-02-22 05:37:30 (9112): Guest Log: -rwxrwxrwx. 1 root root 503549 Feb 21 06:21 input.tar.gz 2025-02-22 05:37:30 (9112): Guest Log: -rwxrwxrwx. 1 root root 573440 Feb 22 2025 result.tar.gz 2025-02-22 05:37:30 (9112): Guest Log: -rwxrwxrwx. 1 root root 17569 Feb 21 06:21 start_atlas.sh 2025-02-22 05:37:30 (9112): Guest Log: *** Success! Shutting down the machine. *** 2025-02-22 05:37:32 (9112): VM Completion File Detected. 2025-02-22 05:37:32 (9112): Powering off VM. 2025-02-22 05:37:35 (9112): Successfully stopped VM. 2025-02-22 05:37:35 (9112): Deregistering VM. (boinc_c7fe0ae52a32ece3, slot#3) 2025-02-22 05:37:36 (9112): Removing network bandwidth throttle group from VM. 2025-02-22 05:37:36 (9112): Removing VM from VirtualBox. 05:37:42 (9112): called boinc_finish(0) </stderr_txt> ]]>
©2025 CERN