Name Xw5LDmxTrN7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmaiRLDmZtw76n_0
Workunit 231567086
Created 12 Apr 2025, 14:58:03 UTC
Sent 12 Apr 2025, 18:31:39 UTC
Report deadline 20 Apr 2025, 18:31:39 UTC
Received 13 Apr 2025, 17:55:16 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10873001
Run time 10 hours 0 min 8 sec
CPU time 23 hours 5 min 49 sec
Validate state Valid
Credit 1,330.73
Device peak FLOPS 16.65 GFLOPS
Application version ATLAS Simulation v3.01 (vbox64_mt_mcore_atlas)
windows_x86_64
Peak working set size 94.65 MB
Peak swap size 87.71 MB
Peak disk usage 2.03 GB

Stderr output

<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
ELDL=8f
2025-04-13 08:35:32 (14108): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2025-04-13 08:35:32 (14108): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2025-04-13 08:35:32 (14108): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2025-04-13 08:35:32 (14108): Guest Log: 00:00:00.000132 main     Log opened 2025-04-13T06:24:37.814873000Z
2025-04-13 08:35:32 (14108): Guest Log: 00:00:00.000234 main     OS Product: Linux
2025-04-13 08:35:32 (14108): Guest Log: 00:00:00.000276 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2025-04-13 08:35:32 (14108): Guest Log: 00:00:00.000309 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2025-04-13 08:35:32 (14108): Guest Log: 00:00:00.000357 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2025-04-13 08:35:32 (14108): Guest Log: 00:00:00.000359 main     Process ID: 1301
2025-04-13 08:35:32 (14108): Guest Log: 00:00:00.000360 main     Package type: LINUX_64BITS_GENERIC
2025-04-13 08:35:32 (14108): Guest Log: 00:00:00.001401 main     5.2.32 r132073 started. Verbose level = 0
2025-04-13 08:35:32 (14108): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2025-04-13 08:35:32 (14108): Guest Log: [INFO] Mounting shared directory
2025-04-13 08:35:32 (14108): Guest Log: [INFO] Checking for init_data.xml
2025-04-13 08:35:32 (14108): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2025-04-13 08:35:32 (14108): Guest Log: [INFO] Detected branch: prod
2025-04-13 08:35:32 (14108): Guest Log: This is the prod version of the ATLAS job wrapper
2025-04-13 08:35:32 (14108): Guest Log: Copying input files
2025-04-13 08:35:32 (14108): Guest Log: Copied input files into RunAtlas.
2025-04-13 08:35:32 (14108): Guest Log: This VM did not configure a local http proxy via BOINC.
2025-04-13 08:35:32 (14108): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2025-04-13 08:35:32 (14108): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2025-04-13 08:35:32 (14108): Guest Log: Further information can be found at the LHC@home message board.
2025-04-13 08:35:32 (14108): Guest Log: 00:00:10.006342 timesync vgsvcTimeSyncWorker: Radical guest time change: -10 789 129 697 000ns (GuestNow=1 744 514 688 687 669 000 ns GuestLast=1 744 525 477 817 366 000 ns fSetTimeLastLoop=true )
2025-04-13 08:35:32 (14108): Guest Log: Running cvmfs_config stat atlas.cern.ch
2025-04-13 08:35:32 (14108): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2025-04-13 08:35:32 (14108): Guest Log: 2.6.3.0 1574 0 32328 144798 4 1 3119946 4096000 0 65024 0 0 n/a 1171 774 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1
2025-04-13 08:35:32 (14108): Guest Log: copied the webapp to /var/www
2025-04-13 08:35:32 (14108): Guest Log: ATHENA_PROC_NUMBER=4
2025-04-13 08:35:32 (14108): Guest Log: ATHENA_CORE_NUMBER=4
2025-04-13 08:35:32 (14108): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2025-04-13 08:35:32 (14108): Guest Log:  *** Starting ATLAS job. (PandaID=6600460411 taskID=44075164) ***
2025-04-13 08:35:32 (14108): Starting VM using VBoxManage interface. (boinc_7a4f2e9c99706bee, slot#2)
2025-04-13 08:35:52 (14108): Successfully started VM. (PID = '13496')
2025-04-13 08:35:52 (14108): Reporting VM Process ID to BOINC.
2025-04-13 08:35:52 (14108): VM state change detected. (old = 'poweredoff', new = 'running')
2025-04-13 08:35:52 (14108): Detected: Web Application Enabled (http://localhost:53001)
2025-04-13 08:35:52 (14108): Status Report: Elapsed Time: '7612.000000'
2025-04-13 08:35:52 (14108): Status Report: CPU Time: '14928.093750'
2025-04-13 08:35:52 (14108): Preference change detected
2025-04-13 08:35:52 (14108): Setting CPU throttle for VM. (50%)
2025-04-13 08:35:52 (14108): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2025-04-13 08:37:29 (14108): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 08:37:49 (14108): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 08:41:39 (14108): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 08:41:59 (14108): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 09:09:52 (14108): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 09:10:12 (14108): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 09:47:55 (14108): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 09:48:15 (14108): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 10:03:07 (14108): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 10:03:27 (14108): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 10:06:49 (14108): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 10:07:10 (14108): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 10:07:10 (14108): Stopping VM.
2025-04-13 10:07:30 (14108): Successfully stopped VM.
2025-04-13 10:09:48 (9368): Detected: vboxwrapper 26206
2025-04-13 10:09:48 (9368): Detected: BOINC client v8.0.2
2025-04-13 10:09:49 (9368): Detected: VirtualBox VboxManage Interface (Version: 7.0.6)
2025-04-13 10:09:50 (9368): Starting VM using VBoxManage interface. (boinc_7a4f2e9c99706bee, slot#2)
2025-04-13 10:10:09 (9368): Successfully started VM. (PID = '8844')
2025-04-13 10:10:09 (9368): Reporting VM Process ID to BOINC.
2025-04-13 10:10:09 (9368): VM state change detected. (old = 'poweredoff', new = 'running')
2025-04-13 10:10:09 (9368): Detected: Web Application Enabled (http://localhost:53001)
2025-04-13 10:10:09 (9368): Status Report: Elapsed Time: '12958.000000'
2025-04-13 10:10:09 (9368): Status Report: CPU Time: '27858.765625'
2025-04-13 10:10:09 (9368): Preference change detected
2025-04-13 10:10:09 (9368): Setting CPU throttle for VM. (50%)
2025-04-13 10:10:09 (9368): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2025-04-13 10:10:56 (9368): Stopping VM.
2025-04-13 10:11:10 (9368): Successfully stopped VM.
2025-04-13 11:20:34 (4320): Detected: vboxwrapper 26206
2025-04-13 11:20:34 (4320): Detected: BOINC client v8.0.2
2025-04-13 11:20:35 (4320): Detected: VirtualBox VboxManage Interface (Version: 7.0.6)
2025-04-13 11:20:36 (4320): Starting VM using VBoxManage interface. (boinc_7a4f2e9c99706bee, slot#2)
2025-04-13 11:21:05 (4320): Successfully started VM. (PID = '18312')
2025-04-13 11:21:05 (4320): Reporting VM Process ID to BOINC.
2025-04-13 11:21:05 (4320): Guest Log: 03:36:46.275769 timesync vgsvcTimeSyncWorker: Radical host time change: 4 217 230 000 000ns (HostNow=1 744 532 464 143 000 000 ns HostLast=1 744 528 246 913 000 000 ns)
2025-04-13 11:21:05 (4320): VM state change detected. (old = 'poweredoff', new = 'running')
2025-04-13 11:21:05 (4320): Detected: Web Application Enabled (http://localhost:53001)
2025-04-13 11:21:05 (4320): Status Report: Elapsed Time: '13005.000000'
2025-04-13 11:21:05 (4320): Status Report: CPU Time: '27970.187500'
2025-04-13 11:21:05 (4320): Preference change detected
2025-04-13 11:21:05 (4320): Setting CPU throttle for VM. (50%)
2025-04-13 11:21:05 (4320): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2025-04-13 11:21:14 (4320): Guest Log: 03:36:56.291691 timesync vgsvcTimeSyncWorker: Radical guest time change: 4 217 186 352 000ns (GuestNow=1 744 532 474 170 599 000 ns GuestLast=1 744 528 256 984 247 000 ns fSetTimeLastLoop=true )
2025-04-13 11:21:24 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:21:44 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:21:54 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:22:14 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:22:24 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:22:44 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:22:54 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:23:14 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:23:24 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:23:44 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:23:54 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:24:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:24:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:24:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:24:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:25:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:25:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:25:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:25:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:26:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:26:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:26:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:26:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:27:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:27:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:27:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:27:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:28:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:28:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:28:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:28:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:29:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:29:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:29:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:29:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:30:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:30:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:30:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:30:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:31:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:31:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:31:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:31:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:32:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:32:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:32:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:32:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:33:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:33:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:33:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:33:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:34:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:34:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:34:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:34:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:35:15 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:35:25 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:35:45 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:35:55 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:36:16 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:36:26 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:36:46 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:36:56 (4320): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 11:37:16 (4320): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 11:37:23 (4320): Stopping VM.
2025-04-13 11:37:40 (4320): Successfully stopped VM.
2025-04-13 12:15:29 (16684): Detected: vboxwrapper 26206
2025-04-13 12:15:29 (16684): Detected: BOINC client v8.0.2
2025-04-13 12:15:30 (16684): Detected: VirtualBox VboxManage Interface (Version: 7.0.6)
2025-04-13 12:15:30 (16684): Guest Log: 03:36:46.275769 timesync vgsvcTimeSyncWorker: Radical host time change: 4 217 230 000 000ns (HostNow=1 744 532 464 143 000 000 ns HostLast=1 744 528 246 913 000 000 ns)
2025-04-13 12:15:30 (16684): Guest Log: 03:36:56.291691 timesync vgsvcTimeSyncWorker: Radical guest time change: 4 217 186 352 000ns (GuestNow=1 744 532 474 170 599 000 ns GuestLast=1 744 528 256 984 247 000 ns fSetTimeLastLoop=true )
2025-04-13 12:15:30 (16684): Starting VM using VBoxManage interface. (boinc_7a4f2e9c99706bee, slot#2)
2025-04-13 12:15:52 (16684): Successfully started VM. (PID = '11776')
2025-04-13 12:15:52 (16684): Reporting VM Process ID to BOINC.
2025-04-13 12:15:52 (16684): Guest Log: 03:42:26.808363 timesync vgsvcTimeSyncWorker: Radical host time change: 2 337 430 000 000ns (HostNow=1 744 535 751 503 000 000 ns HostLast=1 744 533 414 073 000 000 ns)
2025-04-13 12:15:52 (16684): VM state change detected. (old = 'poweredoff', new = 'running')
2025-04-13 12:15:52 (16684): Detected: Web Application Enabled (http://localhost:53001)
2025-04-13 12:15:52 (16684): Status Report: Elapsed Time: '13308.000000'
2025-04-13 12:15:52 (16684): Status Report: CPU Time: '28770.187500'
2025-04-13 12:15:52 (16684): Preference change detected
2025-04-13 12:15:52 (16684): Setting CPU throttle for VM. (50%)
2025-04-13 12:15:52 (16684): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2025-04-13 12:16:02 (16684): Guest Log: 03:42:36.828938 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 956 837 120 000ns (GuestNow=1 744 535 761 523 949 000 ns GuestLast=1 744 532 804 686 829 000 ns fSetTimeLastLoop=true )
2025-04-13 12:18:24 (16684): Stopping VM.
2025-04-13 12:18:43 (16684): Successfully stopped VM.
2025-04-13 12:20:48 (19480): Detected: vboxwrapper 26206
2025-04-13 12:20:48 (19480): Detected: BOINC client v8.0.2
2025-04-13 12:20:49 (19480): Detected: VirtualBox VboxManage Interface (Version: 7.0.6)
2025-04-13 12:20:50 (19480): Guest Log: 03:42:26.808363 timesync vgsvcTimeSyncWorker: Radical host time change: 2 337 430 000 000ns (HostNow=1 744 535 751 503 000 000 ns HostLast=1 744 533 414 073 000 000 ns)
2025-04-13 12:20:50 (19480): Guest Log: 03:42:36.828938 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 956 837 120 000ns (GuestNow=1 744 535 761 523 949 000 ns GuestLast=1 744 532 804 686 829 000 ns fSetTimeLastLoop=true )
2025-04-13 12:20:50 (19480): Starting VM using VBoxManage interface. (boinc_7a4f2e9c99706bee, slot#2)
2025-04-13 12:21:08 (19480): Successfully started VM. (PID = '19460')
2025-04-13 12:21:08 (19480): Reporting VM Process ID to BOINC.
2025-04-13 12:21:08 (19480): VM state change detected. (old = 'poweredoff', new = 'running')
2025-04-13 12:21:08 (19480): Detected: Web Application Enabled (http://localhost:53001)
2025-04-13 12:21:08 (19480): Status Report: Elapsed Time: '13460.000000'
2025-04-13 12:21:08 (19480): Status Report: CPU Time: '29148.093750'
2025-04-13 12:21:08 (19480): Preference change detected
2025-04-13 12:21:08 (19480): Setting CPU throttle for VM. (50%)
2025-04-13 12:21:08 (19480): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2025-04-13 12:24:50 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 12:25:10 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 12:38:21 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 12:38:41 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 12:46:42 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 12:47:02 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 12:47:42 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 12:48:03 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 12:49:02 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 12:49:23 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 12:52:53 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 12:53:13 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 13:02:24 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 13:03:04 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 13:14:25 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 13:14:45 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 13:19:45 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 13:20:05 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 13:20:45 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 13:21:05 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 13:26:46 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 13:27:06 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 13:28:46 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 13:29:06 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 13:29:56 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 13:29:57 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 13:30:26 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 13:30:46 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 13:32:06 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 13:32:26 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 13:58:19 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 13:58:39 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:01:39 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:01:59 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:02:59 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:03:19 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:03:49 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:04:29 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:04:39 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:05:19 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:07:10 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:07:30 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:08:00 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:08:20 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:08:30 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:08:50 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:09:10 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:09:30 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:10:25 (19480): Status Report: Elapsed Time: '19460.000000'
2025-04-13 14:10:25 (19480): Status Report: CPU Time: '43708.562500'
2025-04-13 14:18:00 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:18:20 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:19:10 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:19:31 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:22:51 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:23:11 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:27:51 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:28:11 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:40:03 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:40:23 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:40:53 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:41:13 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:41:33 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:41:53 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:42:13 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:42:33 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:42:53 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:43:13 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:43:33 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:43:53 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:44:03 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:44:23 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:44:43 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:45:03 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:45:23 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:45:43 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:46:03 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:46:23 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:46:43 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:47:03 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:47:24 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:47:44 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:48:04 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:48:24 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:48:44 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:49:24 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:49:44 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:50:04 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:50:34 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:50:54 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:51:14 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:51:34 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:52:04 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:52:24 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:52:44 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:53:04 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:53:34 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:53:54 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:54:34 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:54:54 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:55:13 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:55:34 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:55:54 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:56:14 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:56:44 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:57:05 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:57:25 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:57:45 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 14:58:15 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 14:58:35 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:02:35 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:02:55 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:03:05 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:03:25 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:06:05 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:06:25 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:06:35 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:06:55 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:07:25 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:07:45 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:08:05 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:08:25 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:08:45 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:09:05 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:09:35 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:09:55 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:10:15 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:10:35 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:10:55 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:11:15 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:11:25 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:11:45 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:12:46 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:13:06 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:13:46 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:14:06 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:14:16 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:14:36 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:14:46 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:15:06 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:15:26 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:15:46 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:15:56 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:16:16 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:17:16 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:17:36 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:18:56 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:19:16 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:19:46 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:20:06 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:20:16 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:20:36 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:21:46 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:22:06 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:23:16 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:23:36 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:29:57 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:30:17 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:32:57 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:33:17 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:35:07 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:35:27 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:36:37 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:36:57 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:37:27 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:37:47 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:41:59 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:42:18 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:42:28 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:42:48 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:42:58 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:43:18 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:43:28 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:43:48 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:43:58 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:44:18 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:44:28 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:44:48 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:44:59 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:45:19 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:45:29 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:45:49 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:45:58 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:46:19 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:46:39 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:46:59 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:47:19 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:47:39 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:47:49 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:48:08 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:48:18 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:48:38 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:48:48 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:49:08 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:49:18 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:49:38 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:49:48 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:50:08 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:50:18 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:50:38 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:50:48 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:51:08 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:51:18 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:51:39 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:51:49 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:52:09 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:52:19 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:52:39 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:52:49 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:53:09 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:53:19 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:53:39 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:53:49 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:54:09 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:54:19 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:54:39 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:54:49 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:55:09 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:55:19 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:55:39 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:55:49 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:56:09 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:56:19 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:56:39 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:56:49 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:57:09 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:57:19 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:57:39 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:57:59 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:58:19 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:58:29 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:58:49 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:59:19 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 15:59:40 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 15:59:49 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:00:10 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:01:59 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:02:19 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:05:19 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:05:40 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:11:11 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:11:31 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:11:51 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:12:11 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:12:31 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:12:51 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:13:11 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:13:31 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:16:01 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:16:21 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:16:51 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:17:11 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:17:31 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:17:51 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:18:01 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:18:21 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:19:11 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:19:31 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:19:51 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:20:11 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:26:12 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:26:52 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:27:12 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:27:32 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:28:49 (19480): Status Report: Elapsed Time: '25460.000000'
2025-04-13 16:28:49 (19480): Status Report: CPU Time: '58403.406250'
2025-04-13 16:35:42 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:36:03 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:45:53 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:46:14 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:47:44 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:48:04 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:48:33 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:48:53 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:53:44 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:54:04 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:56:34 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 16:56:54 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 16:59:54 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:00:14 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:01:54 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:02:14 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:02:34 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:02:55 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:03:08 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:03:25 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:03:35 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:03:55 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:04:05 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:04:25 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:04:35 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:04:55 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:05:15 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:05:35 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:05:46 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:06:06 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:06:15 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:06:35 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:07:15 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:07:35 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:11:05 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:11:26 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:11:45 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:12:06 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:12:56 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:13:17 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:13:26 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:13:46 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:13:56 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:14:17 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:14:36 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:14:56 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:15:36 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:15:56 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:16:16 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:16:36 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:17:36 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:17:56 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:18:06 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:18:29 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:18:39 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:19:56 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:20:06 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:20:28 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:20:44 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:20:56 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:21:07 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:21:27 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:21:37 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:22:37 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:23:36 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:23:56 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:31:38 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:31:58 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:32:48 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:33:08 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:41:58 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:42:18 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:43:48 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:44:08 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:45:59 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:46:20 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:47:29 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:47:49 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:49:09 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:49:29 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:54:20 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:54:39 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:55:00 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:55:20 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:55:50 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:56:10 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:56:30 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:56:50 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:57:10 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:57:30 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:57:50 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:58:10 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:58:20 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:58:40 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 17:58:50 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 17:59:10 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:00:20 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:00:40 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:01:50 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:02:10 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:02:20 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:02:40 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:02:51 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:03:11 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:03:41 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:04:01 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:04:19 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:04:39 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:05:11 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:05:31 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:22:52 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:23:13 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:24:42 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:25:03 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:30:55 (19480): Status Report: Elapsed Time: '31460.840322'
2025-04-13 18:30:55 (19480): Status Report: CPU Time: '73108.015625'
2025-04-13 18:32:53 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:33:14 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:54:45 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:55:05 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:55:15 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:55:35 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:56:05 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:56:26 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 18:59:15 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 18:59:36 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:00:15 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:00:36 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:02:36 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:03:16 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:03:25 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:03:46 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:03:55 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:04:15 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:04:45 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:05:06 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:08:37 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:08:56 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:09:06 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:09:26 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:09:36 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:09:56 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:10:06 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:10:27 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:10:37 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:10:57 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:11:06 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:11:26 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:11:36 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:11:57 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:12:07 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:12:26 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:12:36 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:12:56 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:13:08 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:13:31 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:14:50 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:14:59 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:15:25 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:15:48 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:16:08 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:16:28 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:16:48 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:17:08 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:17:28 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:17:48 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:18:08 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:18:28 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:18:38 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:18:58 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:26:09 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:26:29 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:38:00 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:38:20 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:39:20 (19480): VM state change detected. (old = 'running', new = 'paused')
2025-04-13 19:39:40 (19480): VM state change detected. (old = 'paused', new = 'running')
2025-04-13 19:53:53 (19480): Guest Log:  *** Job finished ***
2025-04-13 19:53:53 (19480): Guest Log:  *** The last 20 lines of the pilot log: ***
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:38:52,106 | INFO     | [data] queue_monitor thread has finished
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:38:58,373 | INFO     | job.realtimelogging is not enabled
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:38:59,375 | INFO     | [payload] run_realtimelog thread has finished
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:00,463 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139675413903168)>', '<ExcThread(monitor, started 139674676881152)>']
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:01,121 | WARNING  | job_aborted has been set - aborting pilot monitoring
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:01,121 | INFO     | [monitor] control thread has ended
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,469 | INFO     | all workflow threads have been joined
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,470 | INFO     | end of generic workflow (traces error code: 0)
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,470 | INFO     | traces error code: 0
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,470 | INFO     | pilot has finished (exit code=0, shell exit code=0)
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,635 [wrapper] ==== pilot stdout END ====
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,641 [wrapper] ==== wrapper stdout RESUME ====
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,646 [wrapper] pilotpid: 5902
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,651 [wrapper] Pilot exit status: 0
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,820 [wrapper] pandaids: 6600460411
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,865 [wrapper] cleanup supervisor_pilot  6361 5903
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,870 [wrapper] Test setup, not cleaning
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,875 [wrapper] apfmon messages muted
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,880 [wrapper] ==== wrapper stdout END ====
2025-04-13 19:53:53 (19480): Guest Log: 2025-04-13 16:39:05,885 [wrapper] ==== wrapper stderr END ====
2025-04-13 19:53:53 (19480): Guest Log:  *** Error codes and diagnostics ***
2025-04-13 19:53:53 (19480): Guest Log:     "exeErrorCode": 0,
2025-04-13 19:53:53 (19480): Guest Log:     "exeErrorDiag": "",
2025-04-13 19:53:53 (19480): Guest Log:     "pilotErrorCode": 0,
2025-04-13 19:53:53 (19480): Guest Log:     "pilotErrorDiag": "",
2025-04-13 19:53:54 (19480): Guest Log:  *** Listing of results directory ***
2025-04-13 19:53:54 (19480): Guest Log: total 198200
2025-04-13 19:53:54 (19480): Guest Log: -rw-r--r--. 1 atlas atlas    495897 Apr 12 14:44 pilot3.tar.gz
2025-04-13 19:53:54 (19480): Guest Log: -rw-r--r--. 1 atlas atlas      5111 Apr 12 14:56 queuedata.json
2025-04-13 19:53:54 (19480): Guest Log: -rwx------. 1 atlas atlas     37140 Apr 12 14:57 runpilot2-wrapper.sh
2025-04-13 19:53:54 (19480): Guest Log: -rwxr-xr-x. 1 atlas atlas     11020 Apr 13 03:24 init_data.xml
2025-04-13 19:53:54 (19480): Guest Log: -rwxr-xr-x. 1 atlas atlas    508882 Apr 13 03:24 input.tar.gz
2025-04-13 19:53:54 (19480): Guest Log: -rwxr-xr-x. 1 atlas atlas     17569 Apr 13 03:24 start_atlas.sh
2025-04-13 19:53:54 (19480): Guest Log: lrwxrwxrwx. 1 atlas atlas        20 Apr 13 03:24 EVNT.44075162._001778.pool.root.1 -> /data/./ATLAS.root_0
2025-04-13 19:53:54 (19480): Guest Log: -rw-r--r--. 1 atlas atlas      2549 Apr 13 03:24 pandaJob.out
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas       424 Apr 13 03:25 setup.sh.local
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas    985792 Apr 13 03:25 agis_schedconf.cvmfs.json
2025-04-13 19:53:54 (19480): Guest Log: drwx------. 4 atlas atlas      4096 Apr 13 03:26 pilot3
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas 193786575 Apr 13 16:37 HITS.44075164._045756.pool.root.1
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas      1044 Apr 13 16:38 memory_monitor_summary.json
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas   1603529 Apr 13 16:38 agis_ddmendpoints.agis.ALL.json
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas    461782 Apr 13 16:38 log.44075164._045756.job.log.tgz.1
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas        97 Apr 13 16:38 pilot_heartbeat.json
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas      7723 Apr 13 16:38 heartbeat.json
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas      4485 Apr 13 16:39 pilotlog.txt
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas   2232522 Apr 13 16:39 log.44075164._045756.job.log.1
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas       357 Apr 13 16:39 output.list
2025-04-13 19:53:54 (19480): Guest Log: -rw-r--r--. 1 atlas atlas       620 Apr 13 16:39 runtime_log
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas   2713600 Apr 13 16:39 result.tar.gz
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas       659 Apr 13 16:39 Xw5LDmxTrN7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmaiRLDmZtw76n.diag
2025-04-13 19:53:54 (19480): Guest Log: -rw-r--r--. 1 atlas atlas     10939 Apr 13 16:39 runtime_log.err
2025-04-13 19:53:54 (19480): Guest Log: Looking for outputfile HITS.44075164._045756.pool.root.1
2025-04-13 19:53:54 (19480): Guest Log: HITS file was successfully produced
2025-04-13 19:53:54 (19480): Guest Log: -rw-------. 1 atlas atlas 193786575 Apr 13 16:37 /home/atlas/RunAtlas/HITS.44075164._045756.pool.root.1
2025-04-13 19:53:55 (19480): Guest Log: Successfully finished the ATLAS job!
2025-04-13 19:53:55 (19480): Guest Log: Copying the results back to the shared directory!
2025-04-13 19:53:56 (19480): Guest Log:  *** Contents of shared directory: ***
2025-04-13 1


©2025 CERN