Name | S8mNDm2iug7n9Rq4apOajLDm4fhM0noT9bVof3QYDmpgaKDmMuFeem_1 |
Workunit | 232843534 |
Created | 4 Jun 2025, 6:41:07 UTC |
Sent | 4 Jun 2025, 9:08:47 UTC |
Report deadline | 12 Jun 2025, 9:08:47 UTC |
Received | 4 Jun 2025, 23:57:42 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 10831384 |
Run time | 27 min 48 sec |
CPU time | 1 hours 51 min 12 sec |
Validate state | Valid |
Credit | 179.37 |
Device peak FLOPS | 18.62 GFLOPS |
Application version | ATLAS Simulation v3.01 (vbox64_mt_mcore_atlas) windows_x86_64 |
Peak working set size | 109.26 MB |
Peak swap size | 127.23 MB |
Peak disk usage | 1.99 GB |
<core_client_version>8.0.2</core_client_version> <![CDATA[ <stderr_txt> 2025-06-04 05:57:45 (7828): Detected: vboxwrapper 26206 2025-06-04 05:57:45 (7828): Detected: BOINC client v8.0.2 2025-06-04 05:57:45 (7828): Detected: VirtualBox VboxManage Interface (Version: 6.0.14) 2025-06-04 05:57:45 (7828): Successfully copied 'init_data.xml' to the shared directory. 2025-06-04 05:57:46 (7828): Create VM. (boinc_9bb52737acc38aed, slot#0) 2025-06-04 05:57:47 (7828): Setting Memory Size for VM. (4400MB) 2025-06-04 05:57:47 (7828): Setting CPU Count for VM. (4) 2025-06-04 05:57:47 (7828): Setting Chipset Options for VM. 2025-06-04 05:57:48 (7828): Setting Graphics Controller Options for VM. 2025-06-04 05:57:48 (7828): Setting Boot Options for VM. 2025-06-04 05:57:48 (7828): Setting Network Configuration for NAT. 2025-06-04 05:57:49 (7828): Enabling VM Network Access. 2025-06-04 05:57:49 (7828): Disabling USB Support for VM. 2025-06-04 05:57:49 (7828): Disabling COM Port Support for VM. 2025-06-04 05:57:50 (7828): Disabling LPT Port Support for VM. 2025-06-04 05:57:50 (7828): Disabling Audio Support for VM. 2025-06-04 05:57:50 (7828): Disabling Clipboard Support for VM. 2025-06-04 05:57:51 (7828): Disabling Drag and Drop Support for VM. 2025-06-04 05:57:51 (7828): Adding storage controller(s) to VM. 2025-06-04 05:57:51 (7828): Adding virtual disk drive to VM. (ATLAS_vbox_3.01_image.vdi) 2025-06-04 05:57:52 (7828): Adding VirtualBox Guest Additions to VM. 2025-06-04 05:57:52 (7828): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2025-06-04 05:57:52 (7828): forwarding host port 16979 to guest port 80 2025-06-04 05:57:52 (7828): Enabling remote desktop for VM. 2025-06-04 05:57:53 (7828): Required extension pack not installed, remote desktop not enabled. 2025-06-04 05:57:53 (7828): Enabling shared directory for VM. 2025-06-04 05:57:53 (7828): Starting VM using VBoxManage interface. (boinc_9bb52737acc38aed, slot#0) 2025-06-04 05:57:57 (7828): Successfully started VM. (PID = '10556') 2025-06-04 05:57:57 (7828): Reporting VM Process ID to BOINC. 2025-06-04 05:57:57 (7828): Guest Log: BIOS: VirtualBox 6.0.14 2025-06-04 05:57:57 (7828): Guest Log: CPUID EDX: 0x178bfbff 2025-06-04 05:57:57 (7828): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2025-06-04 05:57:57 (7828): VM state change detected. (old = 'poweredoff', new = 'running') 2025-06-04 05:57:57 (7828): Detected: Web Application Enabled (http://localhost:16979) 2025-06-04 05:57:57 (7828): Preference change detected 2025-06-04 05:57:57 (7828): Setting CPU throttle for VM. (100%) 2025-06-04 05:57:57 (7828): Setting network throttle for VM. (100KB) 2025-06-04 05:57:58 (7828): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds)) 2025-06-04 05:57:59 (7828): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2025-06-04 05:57:59 (7828): Guest Log: BIOS: Booting from Hard Disk... 2025-06-04 05:58:02 (7828): Guest Log: BIOS: KBD: unsupported int 16h function 03 2025-06-04 05:58:02 (7828): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2025-06-04 05:58:02 (7828): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2025-06-04 05:58:13 (7828): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2025-06-04 05:58:13 (7828): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2025-06-04 05:58:30 (7828): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2025-06-04 05:58:30 (7828): Guest Log: 00:00:00.000151 main Log opened 2025-06-04T05:58:28.790586000Z 2025-06-04 05:58:30 (7828): Guest Log: 00:00:00.000273 main OS Product: Linux 2025-06-04 05:58:30 (7828): Guest Log: 00:00:00.000309 main OS Release: 3.10.0-957.27.2.el7.x86_64 2025-06-04 05:58:30 (7828): Guest Log: 00:00:00.000336 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2025-06-04 05:58:30 (7828): Guest Log: 00:00:00.000362 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2025-06-04 05:58:30 (7828): Guest Log: 00:00:00.000363 main Process ID: 1301 2025-06-04 05:58:30 (7828): Guest Log: 00:00:00.000363 main Package type: LINUX_64BITS_GENERIC 2025-06-04 05:58:30 (7828): Guest Log: 00:00:00.002121 main 5.2.32 r132073 started. Verbose level = 0 2025-06-04 05:58:30 (7828): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2025-06-04 05:58:30 (7828): Guest Log: [INFO] Mounting shared directory 2025-06-04 05:58:30 (7828): Guest Log: [INFO] Checking for init_data.xml 2025-06-04 05:58:36 (7828): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2025-06-04 05:58:36 (7828): Guest Log: [INFO] Detected branch: prod 2025-06-04 05:58:36 (7828): Guest Log: This is the prod version of the ATLAS job wrapper 2025-06-04 05:58:36 (7828): Guest Log: Copying input files 2025-06-04 05:58:38 (7828): Guest Log: Copied input files into RunAtlas. 2025-06-04 05:58:38 (7828): Guest Log: This VM did not configure a local http proxy via BOINC. 2025-06-04 05:58:38 (7828): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2025-06-04 05:58:38 (7828): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2025-06-04 05:58:38 (7828): Guest Log: Further information can be found at the LHC@home message board. 2025-06-04 05:58:40 (7828): Guest Log: 00:00:10.004488 timesync vgsvcTimeSyncWorker: Radical guest time change: 14 411 028 093 000ns (GuestNow=1 749 031 119 822 448 000 ns GuestLast=1 749 016 708 794 355 000 ns fSetTimeLastLoop=true ) 2025-06-04 05:58:47 (7828): Guest Log: Running cvmfs_config stat atlas.cern.ch 2025-06-04 05:58:48 (7828): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2025-06-04 05:58:48 (7828): Guest Log: 2.6.3.0 1578 0 32040 146775 4 1 3117617 4096000 0 65024 0 0 n/a 0 0 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1 2025-06-04 05:58:52 (7828): Guest Log: copied the webapp to /var/www 2025-06-04 05:58:52 (7828): Guest Log: ATHENA_PROC_NUMBER=4 2025-06-04 05:58:52 (7828): Guest Log: ATHENA_CORE_NUMBER=4 2025-06-04 05:58:53 (7828): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2025-06-04 05:58:53 (7828): Guest Log: *** Starting ATLAS job. (PandaID=6678312731 taskID=45006595) *** 2025-06-04 06:00:26 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:00:46 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:01:06 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:01:26 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:01:36 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:01:56 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:04:06 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:04:26 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:04:46 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:05:06 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:05:27 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:05:47 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:05:57 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:06:17 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:06:37 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:06:57 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:07:07 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:07:27 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:07:47 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:08:07 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:08:17 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:08:37 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:08:47 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:09:07 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:09:17 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:09:37 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:09:47 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:10:07 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:10:34 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:10:59 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:11:15 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:11:31 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:11:51 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:12:17 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:12:35 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:12:47 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:13:46 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:13:57 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:14:21 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:14:53 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:15:17 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:15:42 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:21:08 (7828): Error in pause VM for VM: -182 Command: VBoxManage -q controlvm "boinc_9bb52737acc38aed" pause Output: 2025-06-04 06:21:40 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:22:09 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:23:00 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:23:43 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:24:20 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:24:49 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:25:37 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:26:09 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:26:44 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:27:10 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:27:59 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:28:24 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:28:56 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:29:09 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:29:36 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:30:07 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:30:34 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:31:03 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:31:41 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:32:08 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:33:11 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:33:39 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:35:27 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:35:44 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:36:16 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:36:32 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:37:38 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:38:00 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:41:34 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:41:52 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:42:04 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:42:23 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:42:38 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:42:51 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:43:07 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:43:21 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:43:43 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:44:13 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:44:27 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:44:41 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:45:03 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:45:31 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:45:52 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:46:05 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:46:20 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:46:31 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:46:48 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:47:03 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:47:59 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:48:24 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:49:27 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:49:56 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:50:33 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:51:01 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:54:09 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:54:28 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:55:03 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:55:41 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:57:03 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:57:40 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:58:36 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:58:54 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 06:59:27 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 06:59:53 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 07:00:38 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:00:09 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:00:25 (7828): Guest Log: 00:46:21.184649 timesync vgsvcTimeSyncWorker: Radical host time change: 35 972 632 000 000ns (HostNow=1 749 070 810 939 000 000 ns HostLast=1 749 034 838 307 000 000 ns) 2025-06-04 17:00:25 (7828): Guest Log: 00:46:31.186094 timesync vgsvcTimeSyncWorker: Radical guest time change: 36 929 937 865 000ns (GuestNow=1 749 070 820 940 519 000 ns GuestLast=1 749 033 891 002 654 000 ns fSetTimeLastLoop=true ) 2025-06-04 17:00:25 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:00:48 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:01:02 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:01:18 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:01:35 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:01:47 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:02:01 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:02:17 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:02:58 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:03:08 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:03:23 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:03:38 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:03:50 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:04:10 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:04:26 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:04:42 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:04:54 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:05:09 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:05:26 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:05:41 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:05:56 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:06:08 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:06:25 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:06:38 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:07:05 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:07:32 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:07:49 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:08:21 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:08:58 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:09:20 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:09:37 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:10:03 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:10:35 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:10:51 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:11:27 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:11:39 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:15:56 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:16:15 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:18:43 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:19:03 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:20:48 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:21:09 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:23:50 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:24:04 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:25:58 (7828): Error in pause VM for VM: -2135228414 Command: VBoxManage -q controlvm "boinc_9bb52737acc38aed" pause Output: VBoxManage.exe: error: Already paused VBoxManage.exe: error: Details: code VBOX_E_INVALID_VM_STATE (0x80bb0002), component ConsoleWrap, interface IConsole, callee IUnknown VBoxManage.exe: error: Context: "Pause()" at line 405 of file VBoxManageControlVM.cpp 2025-06-04 17:25:59 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:26:11 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:27:02 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:27:29 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:28:27 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:28:52 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:29:41 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:30:04 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:30:41 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:31:15 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:31:44 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:31:59 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:32:20 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:32:30 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:33:22 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:33:40 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:33:54 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:34:12 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:34:43 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:35:06 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:35:33 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:35:56 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:40:23 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:40:43 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:41:16 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:41:33 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:41:59 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:42:24 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:42:52 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:43:16 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:43:50 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:44:02 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:44:29 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:44:56 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:45:06 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:45:23 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:45:37 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:45:52 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:46:08 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:46:22 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:46:43 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:47:12 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:47:28 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:47:42 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:47:58 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:48:12 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:48:28 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:48:47 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:49:40 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:49:52 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:50:10 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:50:24 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:51:06 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:51:36 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:52:20 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:52:42 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:53:36 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:53:58 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:55:16 (7828): Error in pause VM for VM: -2135228414 Command: VBoxManage -q controlvm "boinc_9bb52737acc38aed" pause Output: VBoxManage.exe: error: Already paused VBoxManage.exe: error: Details: code VBOX_E_INVALID_VM_STATE (0x80bb0002), component ConsoleWrap, interface IConsole, callee IUnknown VBoxManage.exe: error: Context: "Pause()" at line 405 of file VBoxManageControlVM.cpp 2025-06-04 17:55:17 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:55:25 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:56:01 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:56:17 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:57:03 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:57:31 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:58:16 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:58:34 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 17:59:02 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 17:59:30 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:00:32 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:01:03 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:01:29 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:01:50 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:02:10 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:02:35 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:03:05 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:03:25 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:03:55 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:04:21 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:05:17 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:05:45 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:07:20 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:07:35 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:08:04 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:09:00 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:13:44 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:14:03 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:15:55 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:16:09 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:16:29 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:16:59 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:17:43 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:18:06 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:18:47 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:19:22 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:19:57 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:20:24 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:20:34 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:20:54 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:21:04 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:21:24 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:21:34 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:21:54 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:22:04 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:22:24 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:22:34 (7828): VM state change detected. (old = 'running', new = 'paused') 2025-06-04 18:22:54 (7828): VM state change detected. (old = 'paused', new = 'running') 2025-06-04 18:23:46 (7828): Guest Log: *** Job finished *** 2025-06-04 18:23:46 (7828): Guest Log: *** The last 20 lines of the pilot log: *** 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:22:53,213 | INFO | [payload] run_realtimelog thread has finished 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:22:53,714 | WARNING | data:queue_monitoring:received graceful stop - abort after this iteration 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:22:57,893 | INFO | [data] queue_monitor thread has finished 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:22:58,095 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140106795636544)>', '<ExcThread(monitor, started 140105876477696)>'] 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:22:58,389 | WARNING | job_aborted has been set - aborting pilot monitoring 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:22:58,390 | INFO | [monitor] control thread has ended 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,122 | INFO | all workflow threads have been joined 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,123 | INFO | end of generic workflow (traces error code: 0) 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,124 | INFO | traces error code: 0 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,124 | INFO | pilot has finished (exit code=0, shell exit code=0) 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,350 [wrapper] ==== pilot stdout END ==== 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,359 [wrapper] ==== wrapper stdout RESUME ==== 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,368 [wrapper] pilotpid: 5893 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,374 [wrapper] Pilot exit status: 0 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,485 [wrapper] pandaids: 6678312731 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,539 [wrapper] cleanup supervisor_pilot 4725 5894 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,544 [wrapper] Test setup, not cleaning 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,549 [wrapper] apfmon messages muted 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,554 [wrapper] ==== wrapper stdout END ==== 2025-06-04 18:23:46 (7828): Guest Log: 2025-06-04 22:23:03,558 [wrapper] ==== wrapper stderr END ==== 2025-06-04 18:23:46 (7828): Guest Log: *** Error codes and diagnostics *** 2025-06-04 18:23:46 (7828): Guest Log: "exeErrorCode": 0, 2025-06-04 18:23:46 (7828): Guest Log: "exeErrorDiag": "", 2025-06-04 18:23:46 (7828): Guest Log: "pilotErrorCode": 0, 2025-06-04 18:23:46 (7828): Guest Log: "pilotErrorDiag": "", 2025-06-04 18:23:46 (7828): Guest Log: *** Listing of results directory *** 2025-06-04 18:23:46 (7828): Guest Log: total 178616 2025-06-04 18:23:46 (7828): Guest Log: -rw-r--r--. 1 atlas atlas 495897 Jun 4 04:04 pilot3.tar.gz 2025-06-04 18:23:46 (7828): Guest Log: -rwx------. 1 atlas atlas 37140 Jun 4 04:16 runpilot2-wrapper.sh 2025-06-04 18:23:46 (7828): Guest Log: -rw-r--r--. 1 atlas atlas 5111 Jun 4 04:16 queuedata.json 2025-06-04 18:23:46 (7828): Guest Log: -rwxr-xr-x. 1 atlas atlas 6177 Jun 4 09:58 init_data.xml 2025-06-04 18:23:46 (7828): Guest Log: -rwxr-xr-x. 1 atlas atlas 508877 Jun 4 09:58 input.tar.gz 2025-06-04 18:23:46 (7828): Guest Log: -rwxr-xr-x. 1 atlas atlas 15093 Jun 4 09:58 start_atlas.sh 2025-06-04 18:23:46 (7828): Guest Log: lrwxrwxrwx. 1 atlas atlas 20 Jun 4 09:58 EVNT.45006593._002089.pool.root.1 -> /data/./ATLAS.root_0 2025-06-04 18:23:46 (7828): Guest Log: -rw-r--r--. 1 atlas atlas 2525 Jun 4 09:58 pandaJob.out 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 986766 Jun 4 09:59 agis_schedconf.cvmfs.json 2025-06-04 18:23:46 (7828): Guest Log: drwx------. 4 atlas atlas 4096 Jun 4 10:00 pilot3 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 177476825 Jun 4 22:22 HITS.45006595._052177.pool.root.1 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 98 Jun 4 22:22 pilot_heartbeat.json 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 1030 Jun 4 22:22 memory_monitor_summary.json 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 1598969 Jun 4 22:22 agis_ddmendpoints.agis.ALL.json 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 269942 Jun 4 22:22 log.45006595._052177.job.log.tgz.1 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 7718 Jun 4 22:22 heartbeat.json 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 4413 Jun 4 22:23 pilotlog.txt 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 565259 Jun 4 22:23 log.45006595._052177.job.log.1 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 357 Jun 4 22:23 output.list 2025-06-04 18:23:46 (7828): Guest Log: -rw-r--r--. 1 atlas atlas 620 Jun 4 22:23 runtime_log 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 849920 Jun 4 22:23 result.tar.gz 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 662 Jun 4 22:23 S8mNDm2iug7n9Rq4apOajLDm4fhM0noT9bVof3QYDmpgaKDmMuFeem.diag 2025-06-04 18:23:46 (7828): Guest Log: -rw-r--r--. 1 atlas atlas 8617 Jun 4 22:23 runtime_log.err 2025-06-04 18:23:46 (7828): Guest Log: Looking for outputfile HITS.45006595._052177.pool.root.1 2025-06-04 18:23:46 (7828): Guest Log: HITS file was successfully produced 2025-06-04 18:23:46 (7828): Guest Log: -rw-------. 1 atlas atlas 177476825 Jun 4 22:22 /home/atlas/RunAtlas/HITS.45006595._052177.pool.root.1 2025-06-04 18:23:47 (7828): Guest Log: Successfully finished the ATLAS job! 2025-06-04 18:23:47 (7828): Guest Log: Copying the results back to the shared directory! 2025-06-04 18:23:47 (7828): Guest Log: *** Contents of shared directory: *** 2025-06-04 18:23:47 (7828): Guest Log: total 384828 2025-06-04 18:23:47 (7828): Guest Log: -rwxrwxrwx. 1 root root 215191603 Jun 4 09:57 ATLAS.root_0 2025-06-04 18:23:47 (7828): Guest Log: -rwxrwxrwx. 1 root root 177476825 Jun 4 2025 HITS.pool.root.1 2025-06-04 18:23:47 (7828): Guest Log: -rwxrwxrwx. 1 root root 6177 Jun 4 09:57 init_data.xml 2025-06-04 18:23:47 (7828): Guest Log: -rwxrwxrwx. 1 root root 508877 Jun 4 09:09 input.tar.gz 2025-06-04 18:23:47 (7828): Guest Log: -rwxrwxrwx. 1 root root 849920 Jun 4 2025 result.tar.gz 2025-06-04 18:23:47 (7828): Guest Log: -rwxrwxrwx. 1 root root 15093 Jun 4 09:09 start_atlas.sh 2025-06-04 18:23:47 (7828): Guest Log: *** Success! Shutting down the machine. *** 2025-06-04 18:23:47 (7828): VM Completion File Detected. 2025-06-04 18:23:47 (7828): Powering off VM. 2025-06-04 18:23:49 (7828): Successfully stopped VM. 2025-06-04 18:23:49 (7828): Deregistering VM. (boinc_9bb52737acc38aed, slot#0) 2025-06-04 18:23:49 (7828): Removing network bandwidth throttle group from VM. 2025-06-04 18:23:49 (7828): Removing VM from VirtualBox. 18:23:54 (7828): called boinc_finish(0) </stderr_txt> ]]>
©2025 CERN