Name MANODmXK4V7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmsP0LDm8JF8Ao_0
Workunit 232073749
Created 5 May 2025, 6:18:26 UTC
Sent 5 May 2025, 7:32:42 UTC
Report deadline 13 May 2025, 7:32:42 UTC
Received 6 May 2025, 0:26:23 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10864186
Run time 1 hours 38 min 9 sec
CPU time 6 hours 32 min 36 sec
Validate state Valid
Credit 747.48
Device peak FLOPS 16.69 GFLOPS
Application version ATLAS Simulation v3.01 (vbox64_mt_mcore_atlas)
windows_x86_64
Peak working set size 83.53 MB
Peak swap size 86.93 MB
Peak disk usage 2.14 GB

Stderr output

<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
ange detected. (old = 'paused', new = 'running')
2025-05-05 05:55:13 (7408): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2025-05-05 05:55:13 (7408): Guest Log: 00:00:00.000555 main     Log opened 2025-05-05T05:54:32.142683000Z
2025-05-05 05:55:13 (7408): Guest Log: 00:00:00.001036 main     OS Product: Linux
2025-05-05 05:55:13 (7408): Guest Log: 00:00:00.001198 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2025-05-05 05:55:13 (7408): Guest Log: 00:00:00.001505 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2025-05-05 05:55:13 (7408): Guest Log: 00:00:00.001686 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2025-05-05 05:55:13 (7408): Guest Log: 00:00:00.001692 main     Process ID: 1305
2025-05-05 05:55:13 (7408): Guest Log: 00:00:00.001696 main     Package type: LINUX_64BITS_GENERIC
2025-05-05 05:55:13 (7408): Guest Log: 00:00:00.005665 main     5.2.32 r132073 started. Verbose level = 0
2025-05-05 05:55:13 (7408): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2025-05-05 05:55:13 (7408): Guest Log: [INFO] Mounting shared directory
2025-05-05 05:55:14 (7408): Guest Log: [INFO] Checking for init_data.xml
2025-05-05 05:55:23 (7408): Guest Log: 00:00:10.017685 timesync vgsvcTimeSyncWorker: Radical guest time change: 18 050 984 711 000ns (GuestNow=1 746 442 523 138 629 000 ns GuestLast=1 746 424 472 153 918 000 ns fSetTimeLastLoop=true )
2025-05-05 05:55:32 (7408): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2025-05-05 05:55:32 (7408): Guest Log: [INFO] Detected branch: prod
2025-05-05 05:55:33 (7408): Guest Log: This is the prod version of the ATLAS job wrapper
2025-05-05 05:55:33 (7408): Guest Log: Copying input files
2025-05-05 05:55:37 (7408): Guest Log: Copied input files into RunAtlas.
2025-05-05 05:55:37 (7408): Guest Log: This VM did not configure a local http proxy via BOINC.
2025-05-05 05:55:37 (7408): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2025-05-05 05:55:37 (7408): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2025-05-05 05:55:37 (7408): Guest Log: Further information can be found at the LHC@home message board.
2025-05-05 05:55:50 (7408): Guest Log: Running cvmfs_config stat atlas.cern.ch
2025-05-05 05:55:50 (7408): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2025-05-05 05:55:50 (7408): Guest Log: 2.6.3.0 1589 0 30184 145634 3 1 3117345 4096000 0 65024 0 0 n/a 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
2025-05-05 05:55:54 (7408): Guest Log: copied the webapp to /var/www
2025-05-05 05:55:54 (7408): Guest Log: ATHENA_PROC_NUMBER=4
2025-05-05 05:55:54 (7408): Guest Log: ATHENA_CORE_NUMBER=4
2025-05-05 05:55:55 (7408): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2025-05-05 05:55:55 (7408): Guest Log:  *** Starting ATLAS job. (PandaID=6634104041 taskID=44506063) ***
2025-05-05 05:56:06 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 05:56:26 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 05:56:57 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 05:57:16 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 05:57:36 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 05:57:57 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 05:58:46 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 05:59:07 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 05:59:16 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 05:59:36 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:00:07 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:00:27 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:00:36 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:00:56 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:01:08 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:01:27 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:05:27 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:05:47 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:18:08 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:18:28 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:18:38 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:18:58 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:19:08 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:19:28 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:19:38 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:19:58 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:20:08 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:20:28 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:20:38 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:20:58 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:21:08 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:21:28 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:21:38 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:21:58 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:22:08 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:22:28 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:22:38 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:22:58 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:33:59 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:34:19 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:34:29 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:34:50 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:34:59 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:35:19 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:48:10 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:48:30 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:48:40 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:49:00 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:49:10 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:49:30 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:49:40 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:50:00 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:50:10 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:50:30 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:50:40 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:51:00 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:51:10 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:51:30 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:51:40 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:52:00 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:52:10 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:52:30 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:52:40 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:53:00 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:53:10 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:53:30 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:53:40 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:54:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:54:11 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:54:31 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:54:41 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:55:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:55:11 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:55:31 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:55:41 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:56:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:56:11 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:56:31 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:56:41 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:57:01 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:57:11 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:57:31 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:57:40 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:58:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:58:11 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:58:31 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:58:42 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:59:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:59:11 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 06:59:31 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 06:59:41 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:00:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:00:11 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:00:31 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:00:41 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:01:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:01:11 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:01:31 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:01:41 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:02:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:02:11 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:02:31 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:02:41 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:03:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:03:11 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:03:31 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:03:42 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:04:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:04:12 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:04:32 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:04:42 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:05:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:05:12 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:05:32 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:05:42 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:06:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:06:12 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:06:32 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:06:42 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:07:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:07:12 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:07:32 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:07:42 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:08:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:08:12 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:08:32 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:08:42 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:09:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:09:12 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:09:32 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:09:42 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:10:02 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:10:12 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:10:32 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:10:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:11:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:11:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:11:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:11:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:12:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:12:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:12:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:12:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:13:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:13:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:13:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:13:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:14:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:14:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:14:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:14:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:15:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:15:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:15:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:15:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:16:03 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:16:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:16:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:16:42 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:17:03 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:17:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:17:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:17:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:18:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:18:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:18:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:18:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:19:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:19:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:19:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:19:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:20:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:20:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:20:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:20:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:21:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:21:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:21:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:21:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:22:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:22:13 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:22:33 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:22:43 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:23:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:23:14 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:23:34 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:23:44 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:24:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:24:14 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:24:34 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:24:44 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:25:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:25:14 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:25:34 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:25:44 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:26:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:26:14 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:26:34 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:26:44 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:27:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:27:14 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:27:34 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:27:44 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:28:04 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:28:15 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:28:35 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:28:45 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:29:05 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:29:15 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:29:34 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:29:45 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:30:05 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:30:15 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:30:34 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:30:44 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:31:05 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:31:14 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:31:34 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:31:45 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:32:05 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:32:15 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:32:34 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:32:44 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:33:06 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:33:16 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:33:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:33:46 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:34:07 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:34:16 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:34:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:34:46 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:35:06 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:35:16 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:35:36 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:35:46 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:36:07 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:36:16 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:36:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:36:46 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:37:07 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:37:16 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:37:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:37:46 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:38:07 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:38:16 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:38:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:38:46 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:39:07 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:39:16 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:39:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:39:46 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:40:07 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:40:16 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:40:36 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:40:46 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:41:06 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:41:16 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:41:36 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:41:46 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:42:07 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:42:16 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:42:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:42:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:43:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:43:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:43:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:43:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:44:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:44:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:44:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:44:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:45:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:45:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:45:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:45:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:46:07 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:46:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:46:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:46:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:47:07 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:47:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:47:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:47:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:48:07 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:48:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:48:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:48:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:49:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:49:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:49:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:49:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:50:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:50:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:50:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:50:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:51:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:51:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:51:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:51:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:52:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:52:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:52:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:52:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:53:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:53:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:53:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:53:47 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:54:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:54:17 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:54:37 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:54:48 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:55:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:55:18 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:55:38 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:55:48 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:56:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:56:18 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:56:38 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:56:48 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:57:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:57:18 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:57:38 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:57:48 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:58:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:58:18 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:58:38 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:58:48 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:59:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:59:19 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 07:59:39 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 07:59:49 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:00:09 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:00:18 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:00:38 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:00:49 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:01:09 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:01:18 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:01:38 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:01:48 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:02:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:02:18 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:02:38 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:02:48 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:03:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:03:18 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:03:38 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:03:48 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:04:08 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:04:18 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:04:38 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:04:49 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:05:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:05:19 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:05:39 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:05:49 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:06:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:06:19 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:06:39 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:06:49 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:07:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:07:19 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:07:39 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:07:49 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:08:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:08:19 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:08:39 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:08:49 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:09:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:09:19 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:09:39 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:09:49 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:10:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:10:19 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:10:39 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:10:49 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:11:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:11:19 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:11:39 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:11:50 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:12:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:12:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:12:40 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:12:50 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:13:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:13:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:13:40 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:13:50 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:14:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:14:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:14:40 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:14:50 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:15:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:15:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:15:40 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:15:50 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:16:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:16:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:16:40 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:16:50 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:17:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:17:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:17:40 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:17:51 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:18:11 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:18:21 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:18:41 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:18:51 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:19:11 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:19:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:19:40 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:19:50 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:20:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:20:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:20:40 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:20:50 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:21:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:21:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:21:40 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:21:50 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:22:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:22:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:22:40 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:22:50 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:23:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:23:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:23:40 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:23:50 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:24:10 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:24:20 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:24:41 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:24:51 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:25:11 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:25:21 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:25:41 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:25:51 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:26:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:26:21 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:26:41 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:26:51 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:27:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:27:21 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:27:41 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:27:51 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:28:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:28:21 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:28:41 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:28:51 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:29:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:29:21 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:29:41 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:29:51 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:30:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:30:21 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:30:41 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:30:51 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:31:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:31:22 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:31:42 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:31:52 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:32:13 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:32:22 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:32:42 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:32:52 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:33:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:33:22 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:33:42 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:33:52 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:34:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:34:22 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:34:42 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:34:52 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:35:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:35:22 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:35:42 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:35:52 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:36:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:36:22 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:36:42 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:36:52 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:37:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:37:22 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:37:42 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:37:53 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:38:13 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:38:23 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:38:43 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:38:53 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:39:13 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:39:23 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:39:43 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:39:53 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:40:13 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:40:22 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:40:42 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:40:52 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:41:13 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:41:22 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:41:42 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:41:52 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:42:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:42:22 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:42:42 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:42:52 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:43:12 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:43:22 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:43:42 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:43:53 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:44:13 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:44:23 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:44:43 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:44:53 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:45:13 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:45:23 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:45:43 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:45:53 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:46:14 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:46:23 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:46:43 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:46:53 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:47:14 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:47:23 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:47:43 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:47:53 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:48:14 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:48:23 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:48:43 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:48:53 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:49:14 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:49:23 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:49:43 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:49:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:50:15 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:50:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:50:44 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:50:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:51:15 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:51:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:51:44 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:51:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:52:15 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:52:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:52:44 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:52:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:53:14 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:53:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:53:44 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:53:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:54:14 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:54:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:54:44 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:54:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:55:14 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:55:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:55:44 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:55:55 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:56:15 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:56:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:56:44 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:56:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:57:15 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:57:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:57:45 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:57:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:58:15 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:58:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:58:44 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:58:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:59:15 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:59:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 08:59:44 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 08:59:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:00:15 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:00:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:00:44 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:00:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:01:14 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:01:24 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:01:44 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:01:54 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:02:14 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:02:25 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:02:45 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:02:55 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:03:15 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:03:25 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:03:45 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:03:55 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:04:15 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:04:25 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:04:45 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:04:55 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:05:15 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:05:25 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:05:45 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:05:55 (7408): VM state change detected. (old = 'running', new = 'paused')
2025-05-05 09:05:56 (7408): VM state change detected. (old = 'paused', new = 'running')
2025-05-05 09:20:12 (7408): Status Report: Elapsed Time: '6000.469479'
2025-05-05 09:20:12 (7408): Status Report: CPU Time: '9980.437500'
2025-05-05 11:00:23 (7408): Status Report: Elapsed Time: '12000.469479'
2025-05-05 11:00:23 (7408): Status Report: CPU Time: '24395.250000'
2025-05-05 12:40:34 (7408): Status Report: Elapsed Time: '18000.469479'
2025-05-05 12:40:34 (7408): Status Report: CPU Time: '38811.718750'
2025-05-05 14:21:23 (7408): Status Report: Elapsed Time: '24001.416307'
2025-05-05 14:21:23 (7408): Status Report: CPU Time: '53262.218750'
2025-05-05 16:02:55 (7408): Status Report: Elapsed Time: '30001.742094'
2025-05-05 16:02:55 (7408): Status Report: CPU Time: '67807.687500'
2025-05-05 17:43:09 (7408): Status Report: Elapsed Time: '36001.742094'
2025-05-05 17:43:09 (7408): Status Report: CPU Time: '82234.078125'
2025-05-05 18:22:54 (7408): Guest Log:  *** Job finished ***
2025-05-05 18:22:54 (7408): Guest Log:  *** The last 20 lines of the pilot log: ***
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:06,436 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:07,439 | INFO     | [job] queue monitor thread has finished
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:08,957 | INFO     | [data] queue_monitor thread has finished
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:09,524 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140212908877632)>', '<ExcThread(monitor, started 140211958839040)>']
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:09,526 | WARNING  | job_aborted has been set - aborting pilot monitoring
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:09,527 | INFO     | [monitor] control thread has ended
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:14,532 | INFO     | all workflow threads have been joined
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:14,533 | INFO     | end of generic workflow (traces error code: 0)
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:14,534 | INFO     | traces error code: 0
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:14,535 | INFO     | pilot has finished (exit code=0, shell exit code=0)
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:15,111 [wrapper] ==== pilot stdout END ====
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:15,118 [wrapper] ==== wrapper stdout RESUME ====
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:15,125 [wrapper] pilotpid: 5932
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:15,132 [wrapper] Pilot exit status: 0
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:16,799 [wrapper] pandaids: 6634104041
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:16,905 [wrapper] cleanup supervisor_pilot 12755 5933
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:16,914 [wrapper] Test setup, not cleaning
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:16,923 [wrapper] apfmon messages muted
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:16,931 [wrapper] ==== wrapper stdout END ====
2025-05-05 18:22:54 (7408): Guest Log: 2025-05-05 23:04:16,937 [wrapper] ==== wrapper stderr END ====
2025-05-05 18:22:54 (7408): Guest Log:  *** Error codes and diagnostics ***
2025-05-05 18:22:54 (7408): Guest Log:     "exeErrorCode": 0,
2025-05-05 18:22:54 (7408): Guest Log:     "exeErrorDiag": "",
2025-05-05 18:22:54 (7408): Guest Log:     "pilotErrorCode": 0,
2025-05-05 18:22:54 (7408): Guest Log:     "pilotErrorDiag": "",
2025-05-05 18:22:54 (7408): Guest Log:  *** Listing of results directory ***
2025-05-05 18:22:54 (7408): Guest Log: total 198528
2025-05-05 18:22:54 (7408): Guest Log: -rw-r--r--. 1 atlas atlas    495897 May  5 05:49 pilot3.tar.gz
2025-05-05 18:22:54 (7408): Guest Log: -rwx------. 1 atlas atlas     37140 May  5 06:18 runpilot2-wrapper.sh
2025-05-05 18:22:54 (7408): Guest Log: -rw-r--r--. 1 atlas atlas      5111 May  5 06:18 queuedata.json
2025-05-05 18:22:54 (7408): Guest Log: -rwxr-xr-x. 1 atlas atlas      8139 May  5 10:55 init_data.xml
2025-05-05 18:22:54 (7408): Guest Log: -rwxr-xr-x. 1 atlas atlas    508874 May  5 10:55 input.tar.gz
2025-05-05 18:22:54 (7408): Guest Log: -rwxr-xr-x. 1 atlas atlas     17569 May  5 10:55 start_atlas.sh
2025-05-05 18:22:54 (7408): Guest Log: lrwxrwxrwx. 1 atlas atlas        20 May  5 10:55 EVNT.44506061._000162.pool.root.1 -> /data/./ATLAS.root_0
2025-05-05 18:22:54 (7408): Guest Log: -rw-r--r--. 1 atlas atlas      2555 May  5 10:55 pandaJob.out
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas       424 May  5 10:55 setup.sh.local
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas    995487 May  5 10:57 agis_schedconf.cvmfs.json
2025-05-05 18:22:54 (7408): Guest Log: drwx------. 4 atlas atlas      4096 May  5 10:57 pilot3
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas 193528097 May  5 23:00 HITS.44506063._003754.pool.root.1
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas      1029 May  5 23:03 memory_monitor_summary.json
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas   1596741 May  5 23:03 agis_ddmendpoints.agis.ALL.json
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas    477441 May  5 23:03 log.44506063._003754.job.log.tgz.1
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas        97 May  5 23:03 pilot_heartbeat.json
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas      7726 May  5 23:04 heartbeat.json
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas      4413 May  5 23:04 pilotlog.txt
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas   2517288 May  5 23:04 log.44506063._003754.job.log.1
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas       357 May  5 23:04 output.list
2025-05-05 18:22:54 (7408): Guest Log: -rw-r--r--. 1 atlas atlas       620 May  5 23:04 runtime_log
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas   3010560 May  5 23:04 result.tar.gz
2025-05-05 18:22:54 (7408): Guest Log: -rw-r--r--. 1 atlas atlas     10945 May  5 23:04 runtime_log.err
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas       661 May  5 23:04 MANODmXK4V7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmsP0LDm8JF8Ao.diag
2025-05-05 18:22:54 (7408): Guest Log: Looking for outputfile HITS.44506063._003754.pool.root.1
2025-05-05 18:22:54 (7408): Guest Log: HITS file was successfully produced
2025-05-05 18:22:54 (7408): Guest Log: -rw-------. 1 atlas atlas 193528097 May  5 23:


©2025 CERN