| Name | dZOODmJxMy7nsSi4ap6QjLDmwznN0nGgGQJmUXzaDmlsILDmyFSFQn_2 |
| Workunit | 233731898 |
| Created | 22 Jul 2025, 16:20:10 UTC |
| Sent | 22 Jul 2025, 19:34:48 UTC |
| Report deadline | 30 Jul 2025, 19:34:48 UTC |
| Received | 25 Jul 2025, 1:44:16 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 10692264 |
| Run time | 1 hours 7 min 24 sec |
| CPU time | 10 hours 58 min 12 sec |
| Validate state | Valid |
| Credit | 439.97 |
| Device peak FLOPS | 35.42 GFLOPS |
| Application version | ATLAS Simulation v3.01 (vbox64_mt_mcore_atlas) windows_x86_64 |
| Peak working set size | 78.44 MB |
| Peak swap size | 75.24 MB |
| Peak disk usage | 1.90 GB |
Stderr output
<core_client_version>8.0.2</core_client_version> <![CDATA[ <stderr_txt> 2025-07-24 12:58:24 (29628): Detected: vboxwrapper 26206 2025-07-24 12:58:24 (29628): Detected: BOINC client v8.0.2 2025-07-24 12:58:25 (29628): Detected: VirtualBox VboxManage Interface (Version: 7.1.8) 2025-07-24 12:58:25 (29628): Successfully copied 'init_data.xml' to the shared directory. 2025-07-24 12:58:25 (29628): Create VM. (boinc_0324e921c17d098a, slot#1) 2025-07-24 12:58:26 (29628): Setting Memory Size for VM. (4800MB) 2025-07-24 12:58:26 (29628): Setting CPU Count for VM. (8) 2025-07-24 12:58:26 (29628): Setting Chipset Options for VM. 2025-07-24 12:58:27 (29628): Setting Graphics Controller Options for VM. 2025-07-24 12:58:27 (29628): Setting Boot Options for VM. 2025-07-24 12:58:27 (29628): Setting Network Configuration for NAT. 2025-07-24 12:58:27 (29628): Enabling VM Network Access. 2025-07-24 12:58:28 (29628): Disabling USB Support for VM. 2025-07-24 12:58:28 (29628): Disabling COM Port Support for VM. 2025-07-24 12:58:28 (29628): Disabling LPT Port Support for VM. 2025-07-24 12:58:29 (29628): Disabling Audio Support for VM. 2025-07-24 12:58:29 (29628): Disabling Clipboard Support for VM. 2025-07-24 12:58:29 (29628): Disabling Drag and Drop Support for VM. 2025-07-24 12:58:29 (29628): Adding storage controller(s) to VM. 2025-07-24 12:58:30 (29628): Adding virtual disk drive to VM. (ATLAS_vbox_3.01_image.vdi) 2025-07-24 12:58:32 (29628): Adding VirtualBox Guest Additions to VM. 2025-07-24 12:58:33 (29628): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2025-07-24 12:58:33 (29628): forwarding host port 50094 to guest port 80 2025-07-24 12:58:33 (29628): Enabling remote desktop for VM. 2025-07-24 12:58:33 (29628): Required extension pack not installed, remote desktop not enabled. 2025-07-24 12:58:33 (29628): Enabling shared directory for VM. 2025-07-24 12:58:34 (29628): Starting VM using VBoxManage interface. (boinc_0324e921c17d098a, slot#1) 2025-07-24 12:58:40 (29628): Successfully started VM. (PID = '20020') 2025-07-24 12:58:40 (29628): Reporting VM Process ID to BOINC. 2025-07-24 12:58:40 (29628): Guest Log: BIOS: VirtualBox 7.1.8 2025-07-24 12:58:40 (29628): Guest Log: CPUID EDX: 0x178bfbff 2025-07-24 12:58:40 (29628): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2025-07-24 12:58:40 (29628): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2025-07-24 12:58:40 (29628): VM state change detected. (old = 'poweredoff', new = 'running') 2025-07-24 12:58:40 (29628): Detected: Web Application Enabled (http://localhost:50094) 2025-07-24 12:58:41 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 12:58:56 (29628): Preference change detected 2025-07-24 12:58:56 (29628): Setting CPU throttle for VM. (50%) 2025-07-24 12:58:56 (29628): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds)) 2025-07-24 12:58:57 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 12:58:58 (29628): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2025-07-24 12:58:58 (29628): Guest Log: BIOS: Booting from Hard Disk... 2025-07-24 12:59:01 (29628): Guest Log: BIOS: KBD: unsupported int 16h function 03 2025-07-24 12:59:01 (29628): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2025-07-24 12:59:01 (29628): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2025-07-24 12:59:07 (29628): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2025-07-24 12:59:07 (29628): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2025-07-24 12:59:13 (29628): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2025-07-24 12:59:13 (29628): Guest Log: 00:00:00.000122 main Log opened 2025-07-24T12:58:55.144172000Z 2025-07-24 12:59:13 (29628): Guest Log: 00:00:00.000193 main OS Product: Linux 2025-07-24 12:59:13 (29628): Guest Log: 00:00:00.000223 main OS Release: 3.10.0-957.27.2.el7.x86_64 2025-07-24 12:59:13 (29628): Guest Log: 00:00:00.000245 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2025-07-24 12:59:13 (29628): Guest Log: 00:00:00.000266 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2025-07-24 12:59:13 (29628): Guest Log: 00:00:00.000267 main Process ID: 1375 2025-07-24 12:59:13 (29628): Guest Log: 00:00:00.000267 main Package type: LINUX_64BITS_GENERIC 2025-07-24 12:59:13 (29628): Guest Log: 00:00:00.001174 main 5.2.32 r132073 started. Verbose level = 0 2025-07-24 12:59:13 (29628): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2025-07-24 12:59:13 (29628): Guest Log: [INFO] Mounting shared directory 2025-07-24 12:59:13 (29628): Guest Log: [INFO] Checking for init_data.xml 2025-07-24 12:59:21 (29628): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2025-07-24 12:59:21 (29628): Guest Log: [INFO] Detected branch: prod 2025-07-24 12:59:21 (29628): Guest Log: This is the prod version of the ATLAS job wrapper 2025-07-24 12:59:21 (29628): Guest Log: Copying input files 2025-07-24 12:59:23 (29628): Guest Log: Copied input files into RunAtlas. 2025-07-24 12:59:23 (29628): Guest Log: This VM did not configure a local http proxy via BOINC. 2025-07-24 12:59:23 (29628): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2025-07-24 12:59:23 (29628): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2025-07-24 12:59:23 (29628): Guest Log: Further information can be found at the LHC@home message board. 2025-07-24 12:59:23 (29628): Guest Log: 00:00:10.002357 timesync vgsvcTimeSyncWorker: Radical guest time change: 25 227 631 028 000ns (GuestNow=1 753 387 162 777 209 000 ns GuestLast=1 753 361 935 146 181 000 ns fSetTimeLastLoop=true ) 2025-07-24 12:59:33 (29628): Guest Log: Running cvmfs_config stat atlas.cern.ch 2025-07-24 12:59:34 (29628): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2025-07-24 12:59:34 (29628): Guest Log: 2.6.3.0 1679 0 32188 148713 4 1 3117619 4096000 0 65024 0 0 n/a 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1 2025-07-24 12:59:34 (29628): Guest Log: copied the webapp to /var/www 2025-07-24 12:59:34 (29628): Guest Log: ATHENA_PROC_NUMBER=8 2025-07-24 12:59:34 (29628): Guest Log: ATHENA_CORE_NUMBER=8 2025-07-24 12:59:35 (29628): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2025-07-24 12:59:35 (29628): Guest Log: *** Starting ATLAS job. (PandaID=6741760180 taskID=45697472) *** 2025-07-24 13:27:58 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:28:18 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:28:28 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:28:48 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:28:58 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:29:18 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:29:28 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:29:48 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:29:58 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:30:18 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:30:28 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:30:48 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:30:58 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:31:18 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:31:28 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:31:48 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:31:59 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:32:19 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:32:29 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:32:49 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:32:59 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:33:19 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:33:29 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:33:49 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:33:59 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:34:19 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:34:29 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:34:49 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:34:59 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:35:20 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:35:29 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:35:49 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:35:59 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:36:20 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:36:29 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:36:49 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:36:59 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:37:20 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:37:29 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:37:49 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:37:59 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:38:40 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:38:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:39:09 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:39:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:39:40 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:39:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:40:09 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:40:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:40:40 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:40:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:41:09 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:41:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:41:39 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:41:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:42:10 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:42:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:42:39 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:42:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:43:10 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:43:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:43:39 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:43:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:44:10 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:44:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:44:39 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:44:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:45:10 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:45:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:45:39 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:45:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:46:10 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:46:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:46:39 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:46:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:47:10 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:47:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:47:39 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:47:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:48:10 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:48:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:48:39 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:48:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:49:10 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:49:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:49:39 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:49:49 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:50:10 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:50:19 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:50:39 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:50:50 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:51:10 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:51:20 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:51:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:51:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:52:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:52:20 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:52:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:52:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:53:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:53:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:53:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:53:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:54:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:54:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:54:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:54:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:55:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:55:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:55:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:55:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:56:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:56:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:56:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:56:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:57:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:57:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:57:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:57:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:58:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:58:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:58:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:58:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:59:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:59:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 13:59:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 13:59:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:00:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:00:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:00:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:00:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:01:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:01:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:01:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:01:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:02:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:02:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:02:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:02:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:03:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:03:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:03:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:03:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:04:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:04:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:04:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:04:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:05:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:05:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:05:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:05:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:06:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:06:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:06:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:06:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:07:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:07:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:07:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:07:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:08:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:08:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:08:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:08:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:09:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:09:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:09:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:09:51 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:10:11 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:10:21 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:10:41 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:10:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:11:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:11:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:11:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:11:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:12:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:12:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:12:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:12:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:13:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:13:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:13:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:13:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:14:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:14:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:14:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:14:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:15:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:15:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:15:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:15:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:16:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:16:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:16:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:16:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:17:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:17:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:17:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:17:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:18:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:18:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:18:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:18:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:19:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:19:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:19:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:19:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:20:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:20:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:20:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:20:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:21:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:21:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:21:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:21:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:22:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:22:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:22:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:22:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:23:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:23:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:23:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:23:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:24:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:24:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:24:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:24:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:25:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:25:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:25:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:25:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:26:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:26:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:26:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:26:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:27:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:27:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:27:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:27:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:28:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:28:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:28:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:28:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:29:12 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:29:22 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:29:42 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:29:52 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:30:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:30:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:30:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:30:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:31:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:31:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:31:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:31:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:32:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:32:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:32:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:32:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:33:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:33:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:33:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:33:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:34:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:34:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:34:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:34:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:35:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:35:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:35:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:35:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:36:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:36:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:36:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:36:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:37:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:37:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:37:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:37:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:38:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:38:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:38:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:38:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:39:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:39:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:39:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:39:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:40:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:40:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:40:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:40:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:41:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:41:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:41:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:41:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:42:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:42:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:42:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:42:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:43:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:43:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:43:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:43:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:44:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:44:23 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:44:43 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:44:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:45:13 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:45:24 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:45:44 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:45:53 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:46:14 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:46:24 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:46:44 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:46:54 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:47:14 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:47:24 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:47:44 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:47:54 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:48:14 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:48:24 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:48:44 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:48:54 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:49:16 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:49:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:49:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:49:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:50:16 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:50:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:50:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:50:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:51:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:51:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:51:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:51:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:52:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:52:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:52:46 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:52:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:53:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:53:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:53:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:53:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:54:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:54:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:54:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:54:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:55:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:55:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:55:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:55:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:56:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:56:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:56:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:56:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:57:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:57:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:57:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:57:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:58:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:58:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:58:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:58:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:59:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:59:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 14:59:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 14:59:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:00:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:00:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:00:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:00:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:01:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:01:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:01:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:01:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:02:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:02:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:02:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:02:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:03:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:03:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:03:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:03:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:04:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:04:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:04:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:04:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:05:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:05:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:05:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:05:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:06:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:06:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:06:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:06:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:07:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:07:25 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:07:45 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:07:55 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:08:15 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:08:26 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:08:46 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:08:56 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:09:16 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:09:26 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:09:46 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:09:56 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:10:16 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:10:26 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:10:46 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:10:56 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:11:16 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:11:26 (29628): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 15:11:27 (29628): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 15:52:07 (29628): Status Report: Elapsed Time: '6000.000000' 2025-07-24 15:52:07 (29628): Status Report: CPU Time: '21901.343750' 2025-07-24 16:52:32 (29628): Stopping VM. 2025-07-24 16:52:49 (29628): Successfully stopped VM. 2025-07-24 18:35:42 (14196): Detected: vboxwrapper 26206 2025-07-24 18:35:42 (14196): Detected: BOINC client v8.0.2 2025-07-24 18:35:43 (14196): Detected: VirtualBox VboxManage Interface (Version: 7.1.8) 2025-07-24 18:35:43 (14196): Guest Log: BIOS: VirtualBox 7.1.8 2025-07-24 18:35:43 (14196): Guest Log: CPUID EDX: 0x178bfbff 2025-07-24 18:35:43 (14196): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2025-07-24 18:35:43 (14196): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2025-07-24 18:35:43 (14196): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2025-07-24 18:35:43 (14196): Guest Log: BIOS: Booting from Hard Disk... 2025-07-24 18:35:43 (14196): Guest Log: BIOS: KBD: unsupported int 16h function 03 2025-07-24 18:35:43 (14196): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2025-07-24 18:35:43 (14196): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2025-07-24 18:35:43 (14196): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2025-07-24 18:35:44 (14196): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2025-07-24 18:35:44 (14196): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2025-07-24 18:35:44 (14196): Guest Log: 00:00:00.000122 main Log opened 2025-07-24T12:58:55.144172000Z 2025-07-24 18:35:44 (14196): Guest Log: 00:00:00.000193 main OS Product: Linux 2025-07-24 18:35:44 (14196): Guest Log: 00:00:00.000223 main OS Release: 3.10.0-957.27.2.el7.x86_64 2025-07-24 18:35:44 (14196): Guest Log: 00:00:00.000245 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2025-07-24 18:35:44 (14196): Guest Log: 00:00:00.000266 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2025-07-24 18:35:44 (14196): Guest Log: 00:00:00.000267 main Process ID: 1375 2025-07-24 18:35:44 (14196): Guest Log: 00:00:00.000267 main Package type: LINUX_64BITS_GENERIC 2025-07-24 18:35:44 (14196): Guest Log: 00:00:00.001174 main 5.2.32 r132073 started. Verbose level = 0 2025-07-24 18:35:44 (14196): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2025-07-24 18:35:44 (14196): Guest Log: [INFO] Mounting shared directory 2025-07-24 18:35:44 (14196): Guest Log: [INFO] Checking for init_data.xml 2025-07-24 18:35:44 (14196): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2025-07-24 18:35:44 (14196): Guest Log: [INFO] Detected branch: prod 2025-07-24 18:35:44 (14196): Guest Log: This is the prod version of the ATLAS job wrapper 2025-07-24 18:35:44 (14196): Guest Log: Copying input files 2025-07-24 18:35:44 (14196): Guest Log: Copied input files into RunAtlas. 2025-07-24 18:35:44 (14196): Guest Log: This VM did not configure a local http proxy via BOINC. 2025-07-24 18:35:44 (14196): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2025-07-24 18:35:44 (14196): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2025-07-24 18:35:44 (14196): Guest Log: Further information can be found at the LHC@home message board. 2025-07-24 18:35:44 (14196): Guest Log: 00:00:10.002357 timesync vgsvcTimeSyncWorker: Radical guest time change: 25 227 631 028 000ns (GuestNow=1 753 387 162 777 209 000 ns GuestLast=1 753 361 935 146 181 000 ns fSetTimeLastLoop=true ) 2025-07-24 18:35:44 (14196): Guest Log: Running cvmfs_config stat atlas.cern.ch 2025-07-24 18:35:44 (14196): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2025-07-24 18:35:44 (14196): Guest Log: 2.6.3.0 1679 0 32188 148713 4 1 3117619 4096000 0 65024 0 0 n/a 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1 2025-07-24 18:35:44 (14196): Guest Log: copied the webapp to /var/www 2025-07-24 18:35:44 (14196): Guest Log: ATHENA_PROC_NUMBER=8 2025-07-24 18:35:44 (14196): Guest Log: ATHENA_CORE_NUMBER=8 2025-07-24 18:35:44 (14196): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2025-07-24 18:35:44 (14196): Guest Log: *** Starting ATLAS job. (PandaID=6741760180 taskID=45697472) *** 2025-07-24 18:35:44 (14196): Starting VM using VBoxManage interface. (boinc_0324e921c17d098a, slot#1) 2025-07-24 18:36:04 (14196): Successfully started VM. (PID = '13588') 2025-07-24 18:36:04 (14196): Reporting VM Process ID to BOINC. 2025-07-24 18:36:04 (14196): VM state change detected. (old = 'poweredoff', new = 'running') 2025-07-24 18:36:04 (14196): Detected: Web Application Enabled (http://localhost:50094) 2025-07-24 18:36:05 (14196): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 18:36:13 (14196): Status Report: Elapsed Time: '9621.000000' 2025-07-24 18:36:13 (14196): Status Report: CPU Time: '39271.312500' 2025-07-24 18:36:13 (14196): Preference change detected 2025-07-24 18:36:13 (14196): Setting CPU throttle for VM. (50%) 2025-07-24 18:36:13 (14196): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds)) 2025-07-24 18:36:13 (14196): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 18:36:17 (14196): Guest Log: 02:43:55.291949 timesync vgsvcTimeSyncWorker: Radical host time change: 6 229 435 000 000ns (HostNow=1 753 407 377 298 000 000 ns HostLast=1 753 401 147 863 000 000 ns) 2025-07-24 18:36:24 (14196): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 18:36:44 (14196): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 18:36:47 (14196): Guest Log: 02:44:05.292285 timesync vgsvcTimeSyncWorker: Radical guest time change: 6 786 907 690 000ns (GuestNow=1 753 407 387 308 958 000 ns GuestLast=1 753 400 600 401 268 000 ns fSetTimeLastLoop=true ) 2025-07-24 18:37:04 (14196): VM state change detected. (old = 'running', new = 'paused') 2025-07-24 18:37:25 (14196): VM state change detected. (old = 'paused', new = 'running') 2025-07-24 18:40:31 (14196): Guest Log: *** Job finished *** 2025-07-24 18:40:31 (14196): Guest Log: *** The last 20 lines of the pilot log: *** 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:32,763 | INFO | end of generic workflow (traces error code: 0) 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:32,763 | INFO | traces error code: 0 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:32,764 | INFO | pilot has finished (exit code=0, shell exit code=0) 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,599 | INFO | PID=6065 has CPU usage=0.6% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i PR -j managed --pilot-user ATLAS --harvester-submit-mode PUSH -w generic --job-type managed --resource-type MCORE -z -t 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,599 | INFO | found 0 job(s) in 20 queues 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,600 | WARNING | pilot monitor received instruction that args.graceful_stop has been set 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,600 | WARNING | will wait for a maximum of 300 s for threads to finish 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,600 | WARNING | job_aborted has been set - aborting pilot monitoring 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,600 | CRITICAL | thread 'MainThread' is not alive 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,600 | INFO | [monitor] control thread has ended 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,692 [wrapper] ==== pilot stdout END ==== 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,697 [wrapper] ==== wrapper stdout RESUME ==== 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,702 [wrapper] pilotpid: 6065 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,708 [wrapper] Pilot exit status: 0 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,822 [wrapper] pandaids: 6741760180 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,855 [wrapper] cleanup supervisor_pilot 8611 6066 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,860 [wrapper] Test setup, not cleaning 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,867 [wrapper] apfmon messages muted 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,872 [wrapper] ==== wrapper stdout END ==== 2025-07-24 18:40:31 (14196): Guest Log: 2025-07-25 01:39:49,877 [wrapper] ==== wrapper stderr END ==== 2025-07-24 18:40:31 (14196): Guest Log: *** Error codes and diagnostics *** 2025-07-24 18:40:31 (14196): Guest Log: "exeErrorCode": 0, 2025-07-24 18:40:31 (14196): Guest Log: "exeErrorDiag": "", 2025-07-24 18:40:31 (14196): Guest Log: "pilotErrorCode": 0, 2025-07-24 18:40:31 (14196): Guest Log: "pilotErrorDiag": "", 2025-07-24 18:40:31 (14196): Guest Log: *** Listing of results directory *** 2025-07-24 18:40:31 (14196): Guest Log: total 283948 2025-07-24 18:40:31 (14196): Guest Log: -rw-r--r--. 1 atlas atlas 530466 Jul 22 07:08 pilot3.tar.gz 2025-07-24 18:40:31 (14196): Guest Log: -rwx------. 1 atlas atlas 36292 Jul 22 07:51 runpilot2-wrapper.sh 2025-07-24 18:40:31 (14196): Guest Log: -rw-r--r--. 1 atlas atlas 5112 Jul 22 07:51 queuedata.json 2025-07-24 18:40:31 (14196): Guest Log: -rwxr-xr-x. 1 atlas atlas 8995 Jul 24 19:59 init_data.xml 2025-07-24 18:40:31 (14196): Guest Log: -rwxr-xr-x. 1 atlas atlas 542891 Jul 24 19:59 input.tar.gz 2025-07-24 18:40:31 (14196): Guest Log: -rwxr-xr-x. 1 atlas atlas 15095 Jul 24 19:59 start_atlas.sh 2025-07-24 18:40:31 (14196): Guest Log: lrwxrwxrwx. 1 atlas atlas 20 Jul 24 19:59 EVNT.45697470._000045.pool.root.1 -> /data/./ATLAS.root_0 2025-07-24 18:40:31 (14196): Guest Log: -rw-r--r--. 1 atlas atlas 2611 Jul 24 19:59 pandaJob.out 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 979685 Jul 24 20:01 agis_schedconf.cvmfs.json 2025-07-24 18:40:31 (14196): Guest Log: drwx------. 4 atlas atlas 4096 Jul 24 20:02 pilot3 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 284887336 Jul 25 01:38 HITS.45697472._001122.pool.root.1 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 1046 Jul 25 01:38 memory_monitor_summary.json 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 1593052 Jul 25 01:39 agis_ddmendpoints.agis.ALL.json 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 345940 Jul 25 01:39 log.45697472._001122.job.log.tgz.1 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 7797 Jul 25 01:39 heartbeat.json 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 97 Jul 25 01:39 pilot_heartbeat.json 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 814 Jul 25 01:39 pilotlog.txt 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 686364 Jul 25 01:39 log.45697472._001122.job.log.1 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 357 Jul 25 01:39 output.list 2025-07-24 18:40:31 (14196): Guest Log: -rw-r--r--. 1 atlas atlas 620 Jul 25 01:39 runtime_log 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 1054720 Jul 25 01:39 result.tar.gz 2025-07-24 18:40:31 (14196): Guest Log: -rw-r--r--. 1 atlas atlas 8581 Jul 25 01:39 runtime_log.err 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 656 Jul 25 01:39 dZOODmJxMy7nsSi4ap6QjLDmwznN0nGgGQJmUXzaDmlsILDmyFSFQn.diag 2025-07-24 18:40:31 (14196): Guest Log: Looking for outputfile HITS.45697472._001122.pool.root.1 2025-07-24 18:40:31 (14196): Guest Log: HITS file was successfully produced 2025-07-24 18:40:31 (14196): Guest Log: -rw-------. 1 atlas atlas 284887336 Jul 25 01:38 /home/atlas/RunAtlas/HITS.45697472._001122.pool.root.1 2025-07-24 18:40:33 (14196): Guest Log: Successfully finished the ATLAS job! 2025-07-24 18:40:33 (14196): Guest Log: Copying the results back to the shared directory! 2025-07-24 18:40:33 (14196): Guest Log: *** Contents of shared directory: *** 2025-07-24 18:40:33 (14196): Guest Log: total 603028 2025-07-24 18:40:33 (14196): Guest Log: -rwxrwxrwx. 1 root root 330979771 Jul 24 19:58 ATLAS.root_0 2025-07-24 18:40:33 (14196): Guest Log: -rwxrwxrwx. 1 root root 284887336 Jul 25 2025 HITS.pool.root.1 2025-07-24 18:40:33 (14196): Guest Log: -rwxrwxrwx. 1 root root 8995 Jul 24 19:58 init_data.xml 2025-07-24 18:40:33 (14196): Guest Log: -rwxrwxrwx. 1 root root 542891 Jul 22 20:19 input.tar.gz 2025-07-24 18:40:33 (14196): Guest Log: -rwxrwxrwx. 1 root root 1054720 Jul 25 2025 result.tar.gz 2025-07-24 18:40:33 (14196): Guest Log: -rwxrwxrwx. 1 root root 15095 Jul 22 20:19 start_atlas.sh 2025-07-24 18:40:33 (14196): Guest Log: *** Success! Shutting down the machine. *** 2025-07-24 18:40:33 (14196): VM Completion File Detected. 2025-07-24 18:40:33 (14196): Powering off VM. 2025-07-24 18:40:33 (14196): Successfully stopped VM. 2025-07-24 18:40:33 (14196): D
©2025 CERN