Name euLMDm8Psd7n9Rq4apOajLDm4fhM0noT9bVof3QYDmmcQKDmWIduIn_2
Workunit 232621549
Created 4 Jun 2025, 0:53:03 UTC
Sent 4 Jun 2025, 3:11:27 UTC
Report deadline 12 Jun 2025, 3:11:27 UTC
Received 4 Jun 2025, 9:08:46 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10831384
Run time 37 min 43 sec
CPU time 2 hours 30 min 52 sec
Validate state Valid
Credit 198.79
Device peak FLOPS 18.62 GFLOPS
Application version ATLAS Simulation v3.01 (vbox64_mt_mcore_atlas)
windows_x86_64
Peak working set size 110.91 MB
Peak swap size 125.94 MB
Peak disk usage 1.68 GB

Stderr output

<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
2025-06-03 23:55:48 (2188): Detected: vboxwrapper 26206
2025-06-03 23:55:48 (2188): Detected: BOINC client v8.0.2
2025-06-03 23:55:49 (2188): Detected: VirtualBox VboxManage Interface (Version: 6.0.14)
2025-06-03 23:55:50 (2188): Successfully copied 'init_data.xml' to the shared directory.
2025-06-03 23:55:50 (2188): Create VM. (boinc_aabc49d948b984f8, slot#0)
2025-06-03 23:55:51 (2188): Setting Memory Size for VM. (4400MB)
2025-06-03 23:55:51 (2188): Setting CPU Count for VM. (4)
2025-06-03 23:55:51 (2188): Setting Chipset Options for VM.
2025-06-03 23:55:52 (2188): Setting Graphics Controller Options for VM.
2025-06-03 23:55:52 (2188): Setting Boot Options for VM.
2025-06-03 23:55:52 (2188): Setting Network Configuration for NAT.
2025-06-03 23:55:52 (2188): Enabling VM Network Access.
2025-06-03 23:55:53 (2188): Disabling USB Support for VM.
2025-06-03 23:55:53 (2188): Disabling COM Port Support for VM.
2025-06-03 23:55:53 (2188): Disabling LPT Port Support for VM.
2025-06-03 23:55:53 (2188): Disabling Audio Support for VM.
2025-06-03 23:55:54 (2188): Disabling Clipboard Support for VM.
2025-06-03 23:55:54 (2188): Disabling Drag and Drop Support for VM.
2025-06-03 23:55:54 (2188): Adding storage controller(s) to VM.
2025-06-03 23:55:55 (2188): Adding virtual disk drive to VM. (ATLAS_vbox_3.01_image.vdi)
2025-06-03 23:55:56 (2188): Adding VirtualBox Guest Additions to VM.
2025-06-03 23:55:56 (2188): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB)
2025-06-03 23:55:56 (2188): forwarding host port 14765 to guest port 80
2025-06-03 23:55:56 (2188): Enabling remote desktop for VM.
2025-06-03 23:55:57 (2188): Required extension pack not installed, remote desktop not enabled.
2025-06-03 23:55:57 (2188): Enabling shared directory for VM.
2025-06-03 23:55:57 (2188): Starting VM using VBoxManage interface. (boinc_aabc49d948b984f8, slot#0)
2025-06-03 23:56:01 (2188): Successfully started VM. (PID = '7452')
2025-06-03 23:56:01 (2188): Reporting VM Process ID to BOINC.
2025-06-03 23:56:01 (2188): Guest Log: BIOS: VirtualBox 6.0.14
2025-06-03 23:56:01 (2188): Guest Log: CPUID EDX: 0x178bfbff
2025-06-03 23:56:01 (2188): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2025-06-03 23:56:01 (2188): VM state change detected. (old = 'poweredoff', new = 'running')
2025-06-03 23:56:01 (2188): Detected: Web Application Enabled (http://localhost:14765)
2025-06-03 23:56:01 (2188): Preference change detected
2025-06-03 23:56:01 (2188): Setting CPU throttle for VM. (100%)
2025-06-03 23:56:01 (2188): Setting network throttle for VM. (100KB)
2025-06-03 23:56:02 (2188): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2025-06-03 23:56:03 (2188): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2025-06-03 23:56:03 (2188): Guest Log: BIOS: Booting from Hard Disk...
2025-06-03 23:56:06 (2188): Guest Log: BIOS: KBD: unsupported int 16h function 03
2025-06-03 23:56:06 (2188): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2025-06-03 23:56:06 (2188): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2025-06-03 23:56:18 (2188): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2025-06-03 23:56:18 (2188): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2025-06-03 23:56:34 (2188): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2025-06-03 23:56:34 (2188): Guest Log: 00:00:00.000159 main     Log opened 2025-06-03T23:56:32.590532000Z
2025-06-03 23:56:34 (2188): Guest Log: 00:00:00.000254 main     OS Product: Linux
2025-06-03 23:56:34 (2188): Guest Log: 00:00:00.000286 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2025-06-03 23:56:34 (2188): Guest Log: 00:00:00.000311 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2025-06-03 23:56:34 (2188): Guest Log: 00:00:00.000336 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2025-06-03 23:56:34 (2188): Guest Log: 00:00:00.000337 main     Process ID: 1302
2025-06-03 23:56:34 (2188): Guest Log: 00:00:00.000337 main     Package type: LINUX_64BITS_GENERIC
2025-06-03 23:56:34 (2188): Guest Log: 00:00:00.001355 main     5.2.32 r132073 started. Verbose level = 0
2025-06-03 23:56:34 (2188): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2025-06-03 23:56:34 (2188): Guest Log: [INFO] Mounting shared directory
2025-06-03 23:56:34 (2188): Guest Log: [INFO] Checking for init_data.xml
2025-06-03 23:56:44 (2188): Guest Log: 00:00:10.003857 timesync vgsvcTimeSyncWorker: Radical guest time change: 14 411 142 327 000ns (GuestNow=1 749 009 403 735 713 000 ns GuestLast=1 748 994 992 593 386 000 ns fSetTimeLastLoop=true )
2025-06-03 23:56:52 (2188): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2025-06-03 23:56:52 (2188): Guest Log: [INFO] Detected branch: prod
2025-06-03 23:56:52 (2188): Guest Log: This is the prod version of the ATLAS job wrapper
2025-06-03 23:56:52 (2188): Guest Log: Copying input files
2025-06-03 23:56:53 (2188): Guest Log: Copied input files into RunAtlas.
2025-06-03 23:56:53 (2188): Guest Log: This VM did not configure a local http proxy via BOINC.
2025-06-03 23:56:53 (2188): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2025-06-03 23:56:53 (2188): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2025-06-03 23:56:53 (2188): Guest Log: Further information can be found at the LHC@home message board.
2025-06-03 23:57:03 (2188): Guest Log: Running cvmfs_config stat atlas.cern.ch
2025-06-03 23:57:03 (2188): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2025-06-03 23:57:03 (2188): Guest Log: 2.6.3.0 1583 0 32192 146767 4 1 3117617 4096000 0 65024 0 0 n/a 0 0 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1
2025-06-03 23:57:06 (2188): Guest Log: copied the webapp to /var/www
2025-06-03 23:57:06 (2188): Guest Log: ATHENA_PROC_NUMBER=4
2025-06-03 23:57:06 (2188): Guest Log: ATHENA_CORE_NUMBER=4
2025-06-03 23:57:07 (2188): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2025-06-03 23:57:07 (2188): Guest Log:  *** Starting ATLAS job. (PandaID=6666238834 taskID=44871837) ***
2025-06-03 23:58:59 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-03 23:59:19 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:01:29 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:01:49 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:02:09 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:02:29 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:02:49 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:03:09 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:03:39 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:03:59 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:04:30 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:04:50 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:05:10 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:05:30 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:05:50 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:06:10 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:06:30 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:06:50 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:07:35 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:08:02 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:08:04 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:08:22 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:09:01 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:09:10 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:09:39 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:10:15 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:10:46 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:11:11 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:11:55 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:12:20 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:12:49 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:13:15 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:13:43 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:14:13 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:17:19 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:17:34 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:17:58 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:18:24 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:18:58 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:19:26 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:20:05 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:20:31 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:22:05 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:22:31 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:23:30 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:23:52 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:24:13 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:24:41 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:25:16 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:25:50 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:26:58 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:27:30 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:28:09 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:28:27 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:29:26 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:30:02 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:30:35 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:31:01 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:31:42 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:31:56 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:32:21 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:32:45 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:33:14 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:33:37 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:34:02 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:34:28 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:34:54 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:35:17 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:35:56 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:36:28 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:36:50 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:37:17 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:38:14 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:38:44 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:39:21 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:39:35 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:40:04 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:40:24 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:40:40 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:40:54 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:41:12 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:41:23 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:41:43 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:41:53 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:42:11 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:42:30 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:42:41 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:42:55 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:43:09 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:43:24 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:43:43 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:43:53 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:44:07 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:44:25 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:44:39 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:44:56 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:45:14 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:45:24 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:45:50 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:46:17 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:46:41 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:47:26 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:47:50 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:48:20 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:49:07 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:49:28 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:50:15 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:50:39 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:51:12 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:51:34 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:52:06 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:52:47 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:53:06 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:53:29 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 00:55:37 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 00:56:02 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:01:40 (2188): Error in pause VM for VM: -182
Command:
VBoxManage -q controlvm "boinc_aabc49d948b984f8" pause
Output:

2025-06-04 01:05:59 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:06:32 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:07:15 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:07:42 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:08:24 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:08:48 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:09:47 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:10:21 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:14:37 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:14:54 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:15:53 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:16:18 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:16:41 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:17:10 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:18:19 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:18:43 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:19:30 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:20:00 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:22:13 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:22:39 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:22:51 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:23:08 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:23:24 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:23:38 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:23:56 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:24:09 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:25:09 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:25:39 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:25:59 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:26:28 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:26:45 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:26:58 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:27:13 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:27:28 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:27:53 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:28:29 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:29:10 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:29:36 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:32:01 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:32:26 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:33:03 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:33:30 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:34:20 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:34:48 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:38:34 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:39:06 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:39:32 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:40:00 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:40:44 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:41:16 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:42:13 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:42:43 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:44:23 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:44:50 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:45:32 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:46:01 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:46:48 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:47:14 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:48:31 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:48:41 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:49:54 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:50:11 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:51:23 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:51:48 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:52:04 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:52:36 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:53:10 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:53:26 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:53:58 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:54:15 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:54:55 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:55:20 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:55:59 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:56:13 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 01:56:48 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 01:57:07 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:01:46 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:02:11 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:03:18 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:03:42 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:04:08 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:04:31 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:05:04 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:05:25 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:06:11 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:06:32 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:06:49 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:07:03 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:07:16 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:07:32 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:07:44 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:08:01 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:08:24 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:08:52 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:09:14 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:09:43 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:10:06 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:10:33 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:10:50 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:11:03 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:11:21 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:11:33 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:11:47 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:12:04 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:12:22 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:12:35 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:13:35 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:14:03 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:14:52 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:15:28 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:15:52 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:16:06 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:16:39 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:16:53 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:17:51 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:18:09 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:19:00 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:19:14 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:23:46 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:24:08 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:25:27 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:26:01 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:27:01 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:27:24 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:28:27 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:29:07 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:30:02 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:30:26 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:30:53 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:31:17 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:36:44 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:37:07 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:37:28 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:37:58 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:38:24 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:38:50 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:39:40 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:39:59 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:41:03 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:41:25 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:42:00 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:42:18 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:42:50 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:43:10 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:43:30 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:43:57 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:44:42 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:45:15 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:45:45 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:45:58 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:46:25 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:46:47 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:47:00 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:47:15 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:47:28 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:47:45 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:48:00 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:48:18 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:48:38 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:49:05 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:49:23 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:49:36 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:49:59 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:50:26 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:50:45 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:51:00 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:51:12 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:51:27 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:51:40 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:51:55 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:52:17 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:52:53 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:53:16 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:53:37 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:57:38 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:57:48 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:58:14 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:58:39 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 02:59:25 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 02:59:53 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:00:17 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:00:40 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:01:05 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:01:28 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:02:41 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:03:05 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:03:39 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:04:09 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:05:08 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:05:20 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:05:42 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:06:15 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:07:07 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:07:20 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:08:44 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:09:10 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:09:44 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:10:02 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:12:26 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:12:53 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:13:45 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:14:06 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:15:38 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:15:52 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:16:34 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:17:09 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:20:18 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:20:29 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:20:39 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:21:18 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:21:28 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:21:48 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:21:58 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:22:18 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:22:28 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:22:48 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:22:58 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:23:18 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:23:29 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:23:49 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:23:59 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:24:19 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:24:29 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:24:49 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:24:59 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:25:19 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:25:29 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:25:49 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:25:59 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:26:19 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:26:29 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:26:49 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:26:59 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:27:19 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:27:29 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:27:49 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:27:59 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:28:19 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:28:39 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:28:59 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:29:29 (2188): VM state change detected. (old = 'running', new = 'paused')
2025-06-04 03:29:49 (2188): VM state change detected. (old = 'paused', new = 'running')
2025-06-04 03:30:24 (2188): Guest Log:  *** Job finished ***
2025-06-04 03:30:24 (2188): Guest Log:  *** The last 20 lines of the pilot log: ***
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:49,702 | INFO     | [data] queue_monitor thread has finished
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:52,668 | INFO     | job.realtimelogging is not enabled
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:53,670 | INFO     | [payload] run_realtimelog thread has finished
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:53,882 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139938569721664)>', '<ExcThread(monitor, started 139937550694144)>']
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:54,285 | WARNING  | job_aborted has been set - aborting pilot monitoring
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:54,285 | INFO     | [monitor] control thread has ended
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:58,888 | INFO     | all workflow threads have been joined
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:58,889 | INFO     | end of generic workflow (traces error code: 0)
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:58,890 | INFO     | traces error code: 0
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:58,890 | INFO     | pilot has finished (exit code=0, shell exit code=0)
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:59,074 [wrapper] ==== pilot stdout END ====
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:59,084 [wrapper] ==== wrapper stdout RESUME ====
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:59,093 [wrapper] pilotpid: 5901
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:59,098 [wrapper] Pilot exit status: 0
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:59,258 [wrapper] pandaids: 6666238834
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:59,327 [wrapper] cleanup supervisor_pilot  7948 5902
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:59,334 [wrapper] Test setup, not cleaning
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:59,339 [wrapper] apfmon messages muted
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:59,343 [wrapper] ==== wrapper stdout END ====
2025-06-04 03:30:24 (2188): Guest Log: 2025-06-04 07:15:59,347 [wrapper] ==== wrapper stderr END ====
2025-06-04 03:30:24 (2188): Guest Log:  *** Error codes and diagnostics ***
2025-06-04 03:30:24 (2188): Guest Log:     "exeErrorCode": 0,
2025-06-04 03:30:24 (2188): Guest Log:     "exeErrorDiag": "",
2025-06-04 03:30:24 (2188): Guest Log:     "pilotErrorCode": 0,
2025-06-04 03:30:24 (2188): Guest Log:     "pilotErrorDiag": "",
2025-06-04 03:30:24 (2188): Guest Log:  *** Listing of results directory ***
2025-06-04 03:30:24 (2188): Guest Log: total 199964
2025-06-04 03:30:24 (2188): Guest Log: -rw-r--r--. 1 atlas atlas      5111 May 26 19:11 queuedata.json
2025-06-04 03:30:24 (2188): Guest Log: -rwx------. 1 atlas atlas     37140 May 26 19:12 runpilot2-wrapper.sh
2025-06-04 03:30:24 (2188): Guest Log: -rw-r--r--. 1 atlas atlas    495897 May 26 19:12 pilot3.tar.gz
2025-06-04 03:30:24 (2188): Guest Log: -rwxr-xr-x. 1 atlas atlas      6177 Jun  4 03:56 init_data.xml
2025-06-04 03:30:24 (2188): Guest Log: -rwxr-xr-x. 1 atlas atlas    508872 Jun  4 03:56 input.tar.gz
2025-06-04 03:30:24 (2188): Guest Log: -rwxr-xr-x. 1 atlas atlas     15093 Jun  4 03:56 start_atlas.sh
2025-06-04 03:30:24 (2188): Guest Log: lrwxrwxrwx. 1 atlas atlas        20 Jun  4 03:56 EVNT.44871834._002209.pool.root.1 -> /data/./ATLAS.root_0
2025-06-04 03:30:24 (2188): Guest Log: -rw-r--r--. 1 atlas atlas      2558 Jun  4 03:57 pandaJob.out
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas    986077 Jun  4 03:58 agis_schedconf.cvmfs.json
2025-06-04 03:30:24 (2188): Guest Log: drwx------. 4 atlas atlas      4096 Jun  4 03:58 pilot3
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas 198788060 Jun  4 07:14 HITS.44871837._055710.pool.root.1
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas        97 Jun  4 07:15 pilot_heartbeat.json
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas      1030 Jun  4 07:15 memory_monitor_summary.json
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas   1603667 Jun  4 07:15 agis_ddmendpoints.agis.ALL.json
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas    288548 Jun  4 07:15 log.44871837._055710.job.log.tgz.1
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas      7723 Jun  4 07:15 heartbeat.json
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas      4608 Jun  4 07:15 pilotlog.txt
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas    816459 Jun  4 07:15 log.44871837._055710.job.log.1
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas       357 Jun  4 07:15 output.list
2025-06-04 03:30:24 (2188): Guest Log: -rw-r--r--. 1 atlas atlas       620 Jun  4 07:15 runtime_log
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas   1126400 Jun  4 07:15 result.tar.gz
2025-06-04 03:30:24 (2188): Guest Log: -rw-r--r--. 1 atlas atlas      8617 Jun  4 07:15 runtime_log.err
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas       664 Jun  4 07:15 euLMDm8Psd7n9Rq4apOajLDm4fhM0noT9bVof3QYDmmcQKDmWIduIn.diag
2025-06-04 03:30:24 (2188): Guest Log: Looking for outputfile HITS.44871837._055710.pool.root.1
2025-06-04 03:30:24 (2188): Guest Log: HITS file was successfully produced
2025-06-04 03:30:24 (2188): Guest Log: -rw-------. 1 atlas atlas 198788060 Jun  4 07:14 /home/atlas/RunAtlas/HITS.44871837._055710.pool.root.1
2025-06-04 03:30:25 (2188): Guest Log: Successfully finished the ATLAS job!
2025-06-04 03:30:25 (2188): Guest Log: Copying the results back to the shared directory!
2025-06-04 03:30:26 (2188): Guest Log:  *** Contents of shared directory: ***
2025-06-04 03:30:26 (2188): Guest Log: total 413104
2025-06-04 03:30:26 (2188): Guest Log: -rwxrwxrwx. 1 root root 222561024 Jun  4 03:55 ATLAS.root_0
2025-06-04 03:30:26 (2188): Guest Log: -rwxrwxrwx. 1 root root 198788060 Jun  4  2025 HITS.pool.root.1
2025-06-04 03:30:26 (2188): Guest Log: -rwxrwxrwx. 1 root root      6177 Jun  4 03:55 init_data.xml
2025-06-04 03:30:26 (2188): Guest Log: -rwxrwxrwx. 1 root root    508872 Jun  4 03:11 input.tar.gz
2025-06-04 03:30:26 (2188): Guest Log: -rwxrwxrwx. 1 root root   1126400 Jun  4  2025 result.tar.gz
2025-06-04 03:30:26 (2188): Guest Log: -rwxrwxrwx. 1 root root     15093 Jun  4 03:11 start_atlas.sh
2025-06-04 03:30:26 (2188): Guest Log:  *** Success! Shutting down the machine. ***
2025-06-04 03:30:26 (2188): VM Completion File Detected.
2025-06-04 03:30:26 (2188): Powering off VM.
2025-06-04 03:30:27 (2188): Successfully stopped VM.
2025-06-04 03:30:27 (2188): Deregistering VM. (boinc_aabc49d948b984f8, slot#0)
2025-06-04 03:30:27 (2188): Removing network bandwidth throttle group from VM.
2025-06-04 03:30:27 (2188): Removing VM from VirtualBox.
03:30:33 (2188): called boinc_finish(0)

</stderr_txt>
]]>


©2025 CERN