| Name | 9tnNDmtvE66n9Rq4apOajLDm4fhM0noT9bVoFjIUDmqbeKDmNfDeRn_0 |
| Workunit | 230519568 |
| Created | 23 Feb 2025, 0:22:06 UTC |
| Sent | 23 Feb 2025, 6:24:40 UTC |
| Report deadline | 3 Mar 2025, 6:24:40 UTC |
| Received | 24 Feb 2025, 5:32:29 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 10862817 |
| Run time | 9 hours 3 min 9 sec |
| CPU time | 2 hours 30 min 12 sec |
| Validate state | Valid |
| Credit | 1,441.25 |
| Device peak FLOPS | 2.81 GFLOPS |
| Application version | ATLAS Simulation v3.01 (vbox64_mt_mcore_atlas) windows_x86_64 |
| Peak working set size | 81.80 MB |
| Peak swap size | 87.59 MB |
| Peak disk usage | 2.21 GB |
Stderr output
<core_client_version>8.0.2</core_client_version> <![CDATA[ <stderr_txt> 2025-02-23 07:50:10 (6456): Detected: vboxwrapper 26206 2025-02-23 07:50:10 (6456): Detected: BOINC client v8.0.2 2025-02-23 07:50:14 (6456): Detected: VirtualBox VboxManage Interface (Version: 7.0.6) 2025-02-23 07:50:14 (6456): Successfully copied 'init_data.xml' to the shared directory. 2025-02-23 07:50:15 (6456): Create VM. (boinc_b38912053f1120a2, slot#3) 2025-02-23 07:50:16 (6456): Setting Memory Size for VM. (4200MB) 2025-02-23 07:50:16 (6456): Setting CPU Count for VM. (2) 2025-02-23 07:50:17 (6456): Setting Chipset Options for VM. 2025-02-23 07:50:17 (6456): Setting Graphics Controller Options for VM. 2025-02-23 07:50:17 (6456): Setting Boot Options for VM. 2025-02-23 07:50:18 (6456): Setting Network Configuration for NAT. 2025-02-23 07:50:18 (6456): Enabling VM Network Access. 2025-02-23 07:50:18 (6456): Disabling USB Support for VM. 2025-02-23 07:50:19 (6456): Disabling COM Port Support for VM. 2025-02-23 07:50:19 (6456): Disabling LPT Port Support for VM. 2025-02-23 07:50:20 (6456): Disabling Audio Support for VM. 2025-02-23 07:50:20 (6456): Disabling Clipboard Support for VM. 2025-02-23 07:50:20 (6456): Disabling Drag and Drop Support for VM. 2025-02-23 07:50:21 (6456): Adding storage controller(s) to VM. 2025-02-23 07:50:21 (6456): Adding virtual disk drive to VM. (ATLAS_vbox_3.01_image.vdi) 2025-02-23 07:50:27 (6456): Adding VirtualBox Guest Additions to VM. 2025-02-23 07:50:27 (6456): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2025-02-23 07:50:28 (6456): forwarding host port 51553 to guest port 80 2025-02-23 07:50:29 (6456): Enabling remote desktop for VM. 2025-02-23 07:50:30 (6456): Enabling shared directory for VM. 2025-02-23 07:50:31 (6456): Starting VM using VBoxManage interface. (boinc_b38912053f1120a2, slot#3) 2025-02-23 07:50:55 (6456): Successfully started VM. (PID = '8756') 2025-02-23 07:50:55 (6456): Reporting VM Process ID to BOINC. 2025-02-23 07:50:55 (6456): Guest Log: BIOS: VirtualBox 7.0.6 2025-02-23 07:50:55 (6456): Guest Log: CPUID EDX: 0x178bfbff 2025-02-23 07:50:55 (6456): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2025-02-23 07:50:55 (6456): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2025-02-23 07:50:55 (6456): VM state change detected. (old = 'poweredoff', new = 'running') 2025-02-23 07:50:55 (6456): Detected: Web Application Enabled (http://localhost:51553) 2025-02-23 07:50:55 (6456): Detected: Remote Desktop Enabled (localhost:51554) 2025-02-23 07:50:56 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 07:51:11 (6456): Preference change detected 2025-02-23 07:51:11 (6456): Setting CPU throttle for VM. (1%) 2025-02-23 07:51:11 (6456): Setting checkpoint interval to 3600 seconds. (Higher value of (Preference: 3600 seconds) or (Vbox_job.xml: 900 seconds)) 2025-02-23 07:51:11 (6456): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2025-02-23 07:51:11 (6456): Guest Log: BIOS: Booting from Hard Disk... 2025-02-23 07:51:11 (6456): Guest Log: BIOS: KBD: unsupported int 16h function 03 2025-02-23 07:51:11 (6456): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2025-02-23 07:51:11 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2025-02-23 07:51:11 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2025-02-23 07:51:11 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2025-02-23 07:51:11 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2025-02-23 07:51:11 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2025-02-23 07:51:11 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2025-02-23 07:51:11 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2025-02-23 07:51:11 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2025-02-23 07:51:12 (6456): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2025-02-23 07:51:12 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 07:51:16 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 07:51:36 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 07:54:28 (6456): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2025-02-23 07:54:28 (6456): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2025-02-23 08:00:27 (6456): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2025-02-23 08:00:27 (6456): Guest Log: 00:00:00.001033 main Log opened 2025-02-23T07:59:53.663575000Z 2025-02-23 08:00:27 (6456): Guest Log: 00:00:00.001698 main OS Product: Linux 2025-02-23 08:00:27 (6456): Guest Log: 00:00:00.002121 main OS Release: 3.10.0-957.27.2.el7.x86_64 2025-02-23 08:00:27 (6456): Guest Log: 00:00:00.002902 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2025-02-23 08:00:27 (6456): Guest Log: 00:00:00.003308 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2025-02-23 08:00:27 (6456): Guest Log: 00:00:00.003313 main Process ID: 1259 2025-02-23 08:00:27 (6456): Guest Log: 00:00:00.003315 main Package type: LINUX_64BITS_GENERIC 2025-02-23 08:00:27 (6456): Guest Log: 00:00:00.005633 main 5.2.32 r132073 started. Verbose level = 0 2025-02-23 08:00:35 (6456): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2025-02-23 08:00:36 (6456): Guest Log: [INFO] Mounting shared directory 2025-02-23 08:00:37 (6456): Guest Log: 00:00:10.093884 timesync vgsvcTimeSyncWorker: Radical guest time change: -3 556 989 028 000ns (GuestNow=1 740 294 036 691 970 000 ns GuestLast=1 740 297 593 680 998 000 ns fSetTimeLastLoop=true ) 2025-02-23 08:00:47 (6456): Guest Log: [INFO] Checking for init_data.xml 2025-02-23 08:02:06 (6456): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2025-02-23 08:02:07 (6456): Guest Log: [INFO] Detected branch: prod 2025-02-23 08:02:14 (6456): Guest Log: This is the prod version of the ATLAS job wrapper 2025-02-23 08:02:15 (6456): Guest Log: Copying input files 2025-02-23 08:04:12 (6456): Guest Log: Copied input files into RunAtlas. 2025-02-23 08:04:17 (6456): Guest Log: This VM did not configure a local http proxy via BOINC. 2025-02-23 08:04:17 (6456): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2025-02-23 08:04:18 (6456): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2025-02-23 08:04:18 (6456): Guest Log: Further information can be found at the LHC@home message board. 2025-02-23 08:05:08 (6456): Guest Log: Running cvmfs_config stat atlas.cern.ch 2025-02-23 08:05:24 (6456): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2025-02-23 08:05:24 (6456): Guest Log: 2.6.3.0 1580 3 30088 142966 3 1 3117296 4096000 0 65024 0 0 n/a 0 0 http://s1bnl-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1 2025-02-23 08:06:01 (6456): Guest Log: copied the webapp to /var/www 2025-02-23 08:06:06 (6456): Guest Log: ATHENA_PROC_NUMBER=2 2025-02-23 08:06:06 (6456): Guest Log: ATHENA_CORE_NUMBER=2 2025-02-23 08:06:13 (6456): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2025-02-23 08:06:18 (6456): Guest Log: *** Starting ATLAS job. (PandaID=6523477315 taskID=43078919) *** 2025-02-23 08:21:40 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 08:22:00 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 08:22:20 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 08:22:41 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 08:24:11 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 08:24:30 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 08:49:54 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 08:52:55 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 08:53:04 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 08:53:26 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 08:53:35 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 08:54:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 08:54:45 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 09:53:32 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 09:53:40 (6456): Guest Log: 00:49:24.374503 timesync vgsvcTimeSyncWorker: Radical host time change: 3 536 824 000 000ns (HostNow=1 740 300 819 868 000 000 ns HostLast=1 740 297 283 044 000 000 ns) 2025-02-23 09:53:42 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 09:54:22 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 09:54:30 (6456): Guest Log: 00:49:34.376514 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 839 138 456 000ns (GuestNow=1 740 300 829 990 733 000 ns GuestLast=1 740 296 990 852 277 000 ns fSetTimeLastLoop=true ) 2025-02-23 09:54:32 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 09:55:32 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 09:55:42 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 09:58:22 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 09:58:32 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 10:02:12 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 10:02:19 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 11:42:57 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 11:43:03 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 11:57:36 (6456): Guest Log: 00:50:04.573290 timesync vgsvcTimeSyncWorker: Radical host time change: 7 147 653 000 000ns (HostNow=1 740 308 256 612 000 000 ns HostLast=1 740 301 108 959 000 000 ns) 2025-02-23 11:57:36 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 11:57:46 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 11:58:07 (6456): Guest Log: 00:50:14.602621 timesync vgsvcTimeSyncWorker: Radical guest time change: 7 406 454 277 000ns (GuestNow=1 740 308 266 641 554 000 ns GuestLast=1 740 300 860 187 277 000 ns fSetTimeLastLoop=true ) 2025-02-23 11:58:07 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 11:58:17 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 11:58:37 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 11:58:47 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 13:28:31 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 13:28:41 (6456): Guest Log: 00:50:44.793470 timesync vgsvcTimeSyncWorker: Radical host time change: 5 394 099 000 000ns (HostNow=1 740 313 721 035 000 000 ns HostLast=1 740 308 326 936 000 000 ns) 2025-02-23 13:28:52 (6456): Guest Log: 00:50:54.840082 timesync vgsvcTimeSyncWorker: Radical guest time change: 5 434 457 196 000ns (GuestNow=1 740 313 731 185 614 000 ns GuestLast=1 740 308 296 728 418 000 ns fSetTimeLastLoop=true ) 2025-02-23 13:28:52 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 13:29:17 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 13:29:52 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 13:30:12 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 13:30:31 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 13:30:51 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 13:37:53 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 13:38:13 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 13:45:14 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 13:45:34 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 13:50:03 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 13:50:24 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 13:53:04 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 13:53:24 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 13:57:25 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 13:57:45 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 13:57:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 13:58:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:00:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:01:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:01:25 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:01:45 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:01:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:02:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:02:25 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:02:45 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:02:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:03:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:03:35 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:03:56 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:04:26 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:04:46 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:04:56 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:05:16 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:05:26 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:05:46 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:05:56 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:06:16 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:16:18 (6456): Status Report: Elapsed Time: '6000.723450' 2025-02-23 14:16:18 (6456): Status Report: CPU Time: '1655.218750' 2025-02-23 14:23:18 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:23:38 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:23:48 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:24:09 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:24:19 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:24:39 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:28:09 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 14:28:29 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 14:30:32 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 19:54:29 (6456): Guest Log: 01:44:52.191502 timesync vgsvcTimeSyncWorker: Radical host time change: 19 446 352 000 000ns (HostNow=1 740 336 868 531 000 000 ns HostLast=1 740 317 422 179 000 000 ns) 2025-02-23 19:54:29 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 19:54:39 (6456): Guest Log: 01:45:02.239849 timesync vgsvcTimeSyncWorker: Radical guest time change: 19 910 042 966 000ns (GuestNow=1 740 336 878 579 669 000 ns GuestLast=1 740 316 968 536 703 000 ns fSetTimeLastLoop=true ) 2025-02-23 19:54:59 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 19:55:20 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 19:55:39 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 19:56:01 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 19:56:10 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 19:56:29 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:01:40 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:02:00 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:02:10 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:02:30 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:02:40 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:03:00 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:04:50 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:05:10 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:05:21 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:05:40 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:05:50 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:06:10 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:06:21 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:06:41 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:07:20 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:07:41 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:09:50 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:10:11 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:13:31 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:13:51 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:19:52 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:20:12 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:24:52 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:27:53 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:29:44 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:30:03 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:30:13 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:30:34 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:43:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:44:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:48:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:49:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:49:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:50:16 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:50:26 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:50:46 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:51:06 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:51:26 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:52:26 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:52:46 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:53:26 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:53:46 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:54:16 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:54:37 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:55:16 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:55:36 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:55:46 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:56:06 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:57:47 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:58:07 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:58:56 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:59:17 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:59:27 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 20:59:47 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 20:59:58 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:00:37 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:00:47 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:01:07 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:01:17 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:01:37 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:01:47 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:02:27 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:02:37 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:02:58 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:04:48 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:16:30 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:20:20 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:20:39 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:24:40 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:25:00 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:49:02 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:49:22 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:50:03 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:50:23 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:50:43 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:51:02 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:52:52 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:53:13 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:54:53 (6456): Status Report: Elapsed Time: '12001.575954' 2025-02-23 21:54:53 (6456): Status Report: CPU Time: '3380.546875' 2025-02-23 21:57:04 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:57:24 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 21:58:54 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 21:59:14 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:00:24 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:00:44 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:04:40 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:04:55 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:10:47 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:11:05 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:23:38 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:29:35 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:30:35 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:30:55 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:46:27 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:46:48 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:48:17 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:49:18 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:49:57 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:50:18 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:50:38 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:50:57 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:55:58 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:56:19 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:56:48 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:57:08 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:57:18 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:57:38 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:57:48 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:58:08 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:58:18 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:58:38 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 22:58:49 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 22:58:50 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:02:49 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:03:09 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:03:19 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:03:39 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:03:49 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:04:09 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:04:18 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:05:00 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:05:09 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:21:57 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:22:03 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:22:36 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:22:49 (6456): Guest Log: 04:14:03.218179 timesync vgsvcTimeSyncWorker: Radical guest time change: 1 957 717 126 000ns (GuestNow=1 740 349 369 223 729 000 ns GuestLast=1 740 347 411 506 603 000 ns fSetTimeLastLoop=true ) 2025-02-23 23:23:12 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:24:12 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:24:23 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:25:04 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:25:13 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:26:13 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:26:23 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:32:04 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:32:14 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:32:34 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:32:44 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:33:05 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:33:14 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:33:34 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:33:54 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:34:14 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:34:24 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:34:44 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:35:34 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:36:55 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:48:26 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:48:27 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-23 23:48:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-23 23:49:16 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 00:04:38 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 00:05:20 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 00:20:45 (6456): Status Report: Elapsed Time: '18002.149300' 2025-02-24 00:20:45 (6456): Status Report: CPU Time: '5103.203125' 2025-02-24 00:25:51 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 00:26:11 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 00:26:20 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 00:26:41 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 00:26:50 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 00:27:11 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 00:27:21 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 00:27:41 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 00:28:13 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 00:29:31 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 00:31:11 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 00:31:31 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 01:01:45 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 01:02:05 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 01:03:26 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 01:03:46 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 01:05:06 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 01:05:26 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 01:05:36 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 01:05:56 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 01:06:06 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 01:16:09 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 01:16:16 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 01:21:56 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 01:22:05 (6456): Guest Log: 05:40:55.870794 timesync vgsvcTimeSyncWorker: Radical guest time change: 1 953 046 796 000ns (GuestNow=1 740 356 524 918 565 000 ns GuestLast=1 740 354 571 871 769 000 ns fSetTimeLastLoop=true ) 2025-02-24 01:25:27 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 01:25:47 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 01:26:18 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 01:32:59 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 01:33:08 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 01:33:28 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 01:33:48 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 01:34:08 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 01:44:10 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 01:44:30 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:04:11 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:04:31 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:05:42 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:06:02 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:10:22 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:10:33 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:15:23 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:15:43 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:19:54 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:20:14 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:20:53 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:21:13 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:22:14 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:22:34 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:23:04 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:23:24 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:25:05 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:25:27 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:25:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:26:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:26:24 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:26:45 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:26:54 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:27:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:27:25 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:27:46 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:27:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:28:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:28:28 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:29:05 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:30:52 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:31:26 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:32:16 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:32:35 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:39:10 (6456): Status Report: Elapsed Time: '24002.914879' 2025-02-24 02:39:10 (6456): Status Report: CPU Time: '6871.421875' 2025-02-24 02:43:58 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:44:17 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:46:27 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:46:47 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 02:58:28 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 02:58:49 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:00:49 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:01:28 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:04:49 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:05:09 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:05:31 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:05:49 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:06:20 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:15:00 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:15:13 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:15:51 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:16:01 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:16:20 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:16:30 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:16:51 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:17:01 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:17:21 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:17:41 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:19:01 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:19:11 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:19:31 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:22:31 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:22:52 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:23:11 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:23:32 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:23:56 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:28:29 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:28:59 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:29:20 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:35:20 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:35:40 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:36:30 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:36:50 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:37:00 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:37:20 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:38:00 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:38:20 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:41:16 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:41:31 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:47:02 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:47:21 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 03:49:32 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 03:49:33 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:05:54 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:06:54 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:07:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:08:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:12:15 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:12:36 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:17:06 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:17:26 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:23:07 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:23:27 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:27:57 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:28:18 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:28:27 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:29:48 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:29:59 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:30:17 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:31:38 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:31:59 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:32:18 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:32:38 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:32:49 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:33:09 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:33:28 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:33:49 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:41:01 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:41:19 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:42:09 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:42:29 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:50:10 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:50:30 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:52:41 (6456): Status Report: Elapsed Time: '30003.313219' 2025-02-24 04:52:41 (6456): Status Report: CPU Time: '8633.734375' 2025-02-24 04:54:41 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:55:00 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 04:58:31 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 04:58:51 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:03:02 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 05:03:22 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:04:23 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 05:04:43 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:05:54 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 05:06:14 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:06:33 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 05:06:56 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:07:04 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 05:14:24 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:14:35 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 05:15:14 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:15:37 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 05:16:58 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:17:15 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 05:17:35 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:17:55 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 05:18:15 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:19:45 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 05:20:05 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:31:00 (6456): Guest Log: *** Job finished *** 2025-02-24 05:31:00 (6456): Guest Log: *** The last 20 lines of the pilot log: *** 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:28,254 | INFO | [data] queue_monitor thread has finished 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:28,672 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139709753407296)>', '<ExcThread(monitor, started 139709145659136)>'] 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:28,905 | WARNING | job_aborted has been set - aborting pilot monitoring 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:28,906 | INFO | [monitor] control thread has ended 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:33,964 | INFO | all workflow threads have been joined 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:34,067 | INFO | end of generic workflow (traces error code: 1150) 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:34,068 | INFO | traces error code: 1150 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:34,069 | INFO | an exit code was already set: 1150 (will be converted to a standard shell code) 2025-02-24 05:31:00 (6456): Guest Log: no translation to shell exit code for error code 1150 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:34,070 | INFO | pilot has finished (exit code=1150, shell exit code=1) 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:42,843 [wrapper] ==== pilot stdout END ==== 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:43,467 [wrapper] ==== wrapper stdout RESUME ==== 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:44,190 [wrapper] pilotpid: 8138 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:44,451 [wrapper] Pilot exit status: 1 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:45,848 [wrapper] pandaids: 6523477315 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:48,842 [wrapper] cleanup supervisor_pilot 1094 8142 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:49,053 [wrapper] Test setup, not cleaning 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:50,290 [wrapper] apfmon messages muted 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:50,709 [wrapper] ==== wrapper stdout END ==== 2025-02-24 05:31:00 (6456): Guest Log: 2025-02-24 04:27:51,324 [wrapper] ==== wrapper stderr END ==== 2025-02-24 05:31:00 (6456): Guest Log: *** Error codes and diagnostics *** 2025-02-24 05:31:00 (6456): Guest Log: "exeErrorCode": 0, 2025-02-24 05:31:00 (6456): Guest Log: "exeErrorDiag": "", 2025-02-24 05:31:00 (6456): Guest Log: "pilotErrorCode": 1150, 2025-02-24 05:31:00 (6456): Guest Log: "pilotErrorDiag": "Looping job killed by pilot", 2025-02-24 05:31:01 (6456): Guest Log: *** Listing of results directory *** 2025-02-24 05:31:02 (6456): Guest Log: total 6952 2025-02-24 05:31:02 (6456): Guest Log: -rw-r--r--. 1 atlas atlas 491065 Feb 22 23:51 pilot3.tar.gz 2025-02-24 05:31:02 (6456): Guest Log: -rwx------. 1 atlas atlas 35865 Feb 23 00:21 runpilot2-wrapper.sh 2025-02-24 05:31:02 (6456): Guest Log: -rw-r--r--. 1 atlas atlas 5118 Feb 23 00:21 queuedata.json 2025-02-24 05:31:02 (6456): Guest Log: -rwxr-xr-x. 1 atlas atlas 8885 Feb 23 07:03 init_data.xml 2025-02-24 05:31:02 (6456): Guest Log: -rwxr-xr-x. 1 atlas atlas 503555 Feb 23 07:04 input.tar.gz 2025-02-24 05:31:02 (6456): Guest Log: -rwxr-xr-x. 1 atlas atlas 17569 Feb 23 07:04 start_atlas.sh 2025-02-24 05:31:02 (6456): Guest Log: lrwxrwxrwx. 1 atlas atlas 20 Feb 23 07:04 EVNT.43078917._002592.pool.root.1 -> /data/./ATLAS.root_0 2025-02-24 05:31:02 (6456): Guest Log: -rw-r--r--. 1 atlas atlas 2546 Feb 23 07:06 pandaJob.out 2025-02-24 05:31:02 (6456): Guest Log: -rw-------. 1 atlas atlas 424 Feb 23 07:07 setup.sh.local 2025-02-24 05:31:02 (6456): Guest Log: -rw-------. 1 atlas atlas 987744 Feb 23 07:32 agis_schedconf.cvmfs.json 2025-02-24 05:31:02 (6456): Guest Log: drwx------. 4 atlas atlas 4096 Feb 23 07:32 pilot3 2025-02-24 05:31:02 (6456): Guest Log: -rw-------. 1 atlas atlas 1023 Feb 24 03:33 memory_monitor_summary.json 2025-02-24 05:31:02 (6456): Guest Log: -rw-------. 1 atlas atlas 265247 Feb 24 03:34 log.43078919._089876.job.log.tgz.1 2025-02-24 05:31:02 (6456): Guest Log: -rw-------. 1 atlas atlas 1582569 Feb 24 03:34 agis_ddmendpoints.agis.ALL.json 2025-02-24 05:31:02 (6456): Guest Log: -rw-------. 1 atlas atlas 2727 Feb 24 04:26 heartbeat.json 2025-02-24 05:31:02 (6456): Guest Log: -rw-------. 1 atlas atlas 98 Feb 24 04:27 pilot_heartbeat.json 2025-02-24 05:31:02 (6456): Guest Log: -rw-------. 1 atlas atlas 4524 Feb 24 04:27 pilotlog.txt 2025-02-24 05:31:02 (6456): Guest Log: -rw-------. 1 atlas atlas 1425575 Feb 24 04:27 log.43078919._089876.job.log.1 2025-02-24 05:31:02 (6456): Guest Log: -rw-------. 1 atlas atlas 188 Feb 24 04:27 output.list 2025-02-24 05:31:02 (6456): Guest Log: -rw-r--r--. 1 atlas atlas 620 Feb 24 04:27 runtime_log 2025-02-24 05:31:02 (6456): Guest Log: -rw-------. 1 atlas atlas 1710080 Feb 24 04:27 result.tar.gz 2025-02-24 05:31:03 (6456): Guest Log: -rw-r--r--. 1 atlas atlas 10862 Feb 24 04:27 runtime_log.err 2025-02-24 05:31:03 (6456): Guest Log: -rw-------. 1 atlas atlas 678 Feb 24 04:27 9tnNDmtvE66n9Rq4apOajLDm4fhM0noT9bVoFjIUDmqbeKDmNfDeRn.diag 2025-02-24 05:31:04 (6456): Guest Log: Looking for outputfile HITS.43078919._089876.pool.root.1 2025-02-24 05:31:04 (6456): Guest Log: No HITS file was produced 2025-02-24 05:31:04 (6456): Guest Log: Successfully finished the ATLAS job! 2025-02-24 05:31:05 (6456): Guest Log: Copying the results back to the shared directory! 2025-02-24 05:31:12 (6456): Guest Log: *** Contents of shared directory: *** 2025-02-24 05:31:16 (6456): VM state change detected. (old = 'running', new = 'paused') 2025-02-24 05:31:36 (6456): Guest Log: total 338352 2025-02-24 05:31:36 (6456): Guest Log: -rwxrwxrwx. 1 root root 344221945 Feb 23 06:50 ATLAS.root_0 2025-02-24 05:31:36 (6456): Guest Log: -rwxrwxrwx. 1 root root 8885 Feb 23 06:50 init_data.xml 2025-02-24 05:31:36 (6456): Guest Log: -rwxrwxrwx. 1 root root 503555 Feb 23 06:24 input.tar.gz 2025-02-24 05:31:36 (6456): Guest Log: -rwxrwxrwx. 1 root root 1710080 Feb 24 2025 result.tar.gz 2025-02-24 05:31:36 (6456): Guest Log: -rwxrwxrwx. 1 root root 17569 Feb 23 06:24 start_atlas.sh 2025-02-24 05:31:36 (6456): VM state change detected. (old = 'paused', new = 'running') 2025-02-24 05:31:37 (6456): Guest Log: *** Success! Shutting down the machine. *** 2025-02-24 05:31:40 (6456): VM Completion File Detected. 2025-02-24 05:31:40 (6456): Powering off VM. 2025-02-24 05:31:45 (6456): Successfully stopped VM. 2025-02-24 05:31:45 (6456): Deregistering VM. (boinc_b38912053f1120a2, slot#3) 2025-02-24 05:31:45 (6456): Removing network bandwidth throttle group from VM. 2025-02-24 05:31:46 (6456): Removing VM from VirtualBox. 05:31:52 (6456): called boinc_finish(0) </stderr_txt> ]]>
©2025 CERN