| Name | e5429c828719_0 |
| Workunit | 240944278 |
| Created | 27 Apr 2026, 4:26:22 UTC |
| Sent | 27 Apr 2026, 9:04:23 UTC |
| Report deadline | 5 May 2026, 9:04:23 UTC |
| Received | 29 Apr 2026, 7:54:53 UTC |
| Server state | Over |
| Outcome | Validate error |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 10740518 |
| Run time | 11 min 29 sec |
| CPU time | 6 min 0 sec |
| Priority | 28 |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 17.01 GFLOPS |
| Application version | ATLAS Simulation v3.03 (vbox64_mt_mcore_atlas) windows_x86_64 |
| Peak working set size | 95.54 MB |
| Peak swap size | 123.12 MB |
| Peak disk usage | 1.43 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> 2026-04-27 05:13:19 (18632): vboxwrapper version 26210 2026-04-27 05:13:19 (18632): BOINC client version: 7.16.20 2026-04-27 05:13:20 (18632): Detected: VirtualBox VboxManage Interface (Version: 6.0.14) 2026-04-27 05:13:20 (18632): Successfully copied 'init_data.xml' to the shared directory. 2026-04-27 05:13:21 (18632): Create VM. (boinc_ed058b0fd42b7dff, slot#3) 2026-04-27 05:13:21 (18632): Setting Memory Size for VM. (4400MB) 2026-04-27 05:13:23 (18632): Setting CPU Count for VM. (4) 2026-04-27 05:13:24 (18632): Setting Chipset Options for VM. 2026-04-27 05:13:25 (18632): Setting Graphics Controller Options for VM. (Driver: VBoxVGA, 16MB) 2026-04-27 05:13:28 (18632): Setting Boot Options for VM. 2026-04-27 05:13:30 (18632): Setting Network Configuration for NAT. (Driver: virtio) 2026-04-27 05:13:31 (18632): Enabling VM Network Access. 2026-04-27 05:13:32 (18632): Disabling USB Support for VM. 2026-04-27 05:13:33 (18632): Disabling COM Port Support for VM. 2026-04-27 05:13:34 (18632): Disabling LPT Port Support for VM. 2026-04-27 05:13:36 (18632): Disabling Audio Support for VM. 2026-04-27 05:13:37 (18632): Disabling Clipboard Support for VM. 2026-04-27 05:13:38 (18632): Disabling Drag and Drop Support for VM. 2026-04-27 05:13:39 (18632): Adding storage controller(s) to VM. 2026-04-27 05:13:41 (18632): Adding virtual disk drive to VM. (ATLAS_vbox_3.03_image.vdi) 2026-04-27 05:13:47 (18632): Adding VirtualBox Guest Additions to VM. 2026-04-27 05:13:48 (18632): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2026-04-27 05:13:49 (18632): forwarding host port 64507 to guest port 80 2026-04-27 05:13:50 (18632): Enabling remote desktop for VM. 2026-04-27 05:13:50 (18632): Required extension pack not installed, remote desktop not enabled. 2026-04-27 05:13:50 (18632): Enabling shared directory for VM. 2026-04-27 05:13:51 (18632): Starting VM using VBoxManage interface. (boinc_ed058b0fd42b7dff, slot#3) 2026-04-27 05:13:58 (18632): Successfully started VM. (PID = '12248') 2026-04-27 05:13:58 (18632): Reporting VM Process ID to BOINC. 2026-04-27 05:13:58 (18632): Guest Log: BIOS: VirtualBox 6.0.14 2026-04-27 05:13:58 (18632): Guest Log: CPUID EDX: 0x178bfbff 2026-04-27 05:13:58 (18632): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2026-04-27 05:13:58 (18632): VM state change detected. (old = 'poweredoff', new = 'running') 2026-04-27 05:13:58 (18632): Detected: Web Application Enabled (http://localhost:64507) 2026-04-27 05:13:59 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 06:00:23 (18632): Preference change detected 2026-04-27 06:00:23 (18632): Setting CPU throttle for VM. (100%) 2026-04-27 06:00:23 (18632): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds)) 2026-04-27 06:00:24 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 06:00:25 (18632): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2026-04-27 06:00:25 (18632): Guest Log: BIOS: Booting from Hard Disk... 2026-04-27 06:00:28 (18632): Guest Log: BIOS: KBD: unsupported int 16h function 03 2026-04-27 06:00:28 (18632): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2026-04-27 06:00:28 (18632): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2026-04-27 06:00:34 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 06:23:04 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 06:23:07 (18632): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2026-04-27 06:23:07 (18632): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0000000 (size 0x400000) 2026-04-27 06:23:14 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 06:42:16 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 06:42:26 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 06:47:46 (18632): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2026-04-27 06:47:46 (18632): Guest Log: 00:00:00.000210 main Log opened 2026-04-27T05:14:27.820359000Z 2026-04-27 06:47:46 (18632): Guest Log: 00:00:00.000322 main OS Product: Linux 2026-04-27 06:47:46 (18632): Guest Log: 00:00:00.000364 main OS Release: 3.10.0-957.27.2.el7.x86_64 2026-04-27 06:47:46 (18632): Guest Log: 00:00:00.000437 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2026-04-27 06:47:46 (18632): Guest Log: 00:00:00.000475 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2026-04-27 06:47:46 (18632): Guest Log: 00:00:00.000476 main Process ID: 1305 2026-04-27 06:47:46 (18632): Guest Log: 00:00:00.000477 main Package type: LINUX_64BITS_GENERIC 2026-04-27 06:47:46 (18632): Guest Log: 00:00:00.001248 main 5.2.32 r132073 started. Verbose level = 0 2026-04-27 06:47:46 (18632): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2026-04-27 06:47:46 (18632): Guest Log: [INFO] Mounting shared directory 2026-04-27 06:47:46 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 06:47:47 (18632): Guest Log: [INFO] Checking for init_data.xml 2026-04-27 06:47:56 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 06:57:16 (18632): Guest Log: 00:00:10.252298 timesync vgsvcTimeSyncWorker: Radical guest time change: 20 007 609 189 000ns (GuestNow=1 777 286 875 432 758 000 ns GuestLast=1 777 266 867 823 569 000 ns fSetTimeLastLoop=true ) 2026-04-27 06:57:16 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 06:57:27 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 06:58:06 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 06:58:07 (18632): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2026-04-27 06:58:07 (18632): Guest Log: [INFO] Detected branch: prod 2026-04-27 06:58:08 (18632): Guest Log: This is the prod version of the ATLAS job wrapper 2026-04-27 06:58:08 (18632): Guest Log: Copying input files 2026-04-27 06:58:11 (18632): Guest Log: Copied input files into RunAtlas. 2026-04-27 06:58:11 (18632): Guest Log: This VM did not configure a local http proxy via BOINC. 2026-04-27 06:58:11 (18632): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2026-04-27 06:58:11 (18632): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2026-04-27 06:58:11 (18632): Guest Log: Further information can be found at the LHC@home message board. 2026-04-27 06:58:17 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 07:00:27 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 07:00:34 (18632): Guest Log: Running cvmfs_config stat atlas.cern.ch 2026-04-27 07:00:35 (18632): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2026-04-27 07:00:35 (18632): Guest Log: 2.6.3.0 1588 0 32168 158924 3 1 3117648 4096001 0 65024 0 0 n/a 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1 2026-04-27 07:00:37 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 07:01:47 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 07:01:50 (18632): Guest Log: copied the webapp to /var/www 2026-04-27 07:01:50 (18632): Guest Log: ATHENA_PROC_NUMBER=4 2026-04-27 07:01:50 (18632): Guest Log: ATHENA_CORE_NUMBER=4 2026-04-27 07:01:50 (18632): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2026-04-27 07:01:50 (18632): Guest Log: *** Starting ATLAS job. (PandaID=7116222787 taskID=49863714) *** 2026-04-27 07:01:57 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 20:00:25 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 20:00:32 (18632): Guest Log: 00:01:00.256330 timesync vgsvcTimeSyncWorker: Radical host time change: 46 717 728 000 000ns (HostNow=1 777 334 432 100 000 000 ns HostLast=1 777 287 714 372 000 000 ns) 2026-04-27 20:00:35 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 20:23:16 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 20:23:24 (18632): Guest Log: 00:01:10.553875 timesync vgsvcTimeSyncWorker: Radical guest time change: 47 516 671 746 000ns (GuestNow=1 777 334 442 108 195 000 ns GuestLast=1 777 286 925 436 449 000 ns fSetTimeLastLoop=true ) 2026-04-27 20:23:26 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 21:00:27 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 21:00:35 (18632): Guest Log: 00:01:20.566161 timesync vgsvcTimeSyncWorker: Radical host time change: 2 231 527 000 000ns (HostNow=1 777 338 034 416 000 000 ns HostLast=1 777 335 802 889 000 000 ns) 2026-04-27 21:00:37 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 21:22:18 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 21:22:25 (18632): Guest Log: 00:01:30.567832 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 231 227 334 000ns (GuestNow=1 777 338 044 417 665 000 ns GuestLast=1 777 335 813 190 331 000 ns fSetTimeLastLoop=true ) 2026-04-27 21:22:28 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 22:00:30 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 22:00:37 (18632): Guest Log: 00:01:40.759860 timesync vgsvcTimeSyncWorker: Radical host time change: 2 291 099 000 000ns (HostNow=1 777 341 637 002 000 000 ns HostLast=1 777 339 345 903 000 000 ns) 2026-04-27 22:00:40 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 22:01:00 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 22:01:07 (18632): Guest Log: 00:01:50.777549 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 291 306 432 000ns (GuestNow=1 777 341 647 210 441 000 ns GuestLast=1 777 339 355 904 009 000 ns fSetTimeLastLoop=true ) 2026-04-27 22:01:10 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 22:23:21 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 22:23:31 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 23:00:23 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 23:00:30 (18632): Guest Log: 00:02:10.790173 timesync vgsvcTimeSyncWorker: Radical host time change: 2 221 113 000 000ns (HostNow=1 777 345 229 296 000 000 ns HostLast=1 777 343 008 183 000 000 ns) 2026-04-27 23:00:33 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-27 23:47:45 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-27 23:47:51 (18632): Guest Log: 00:02:20.799267 timesync vgsvcTimeSyncWorker: Radical host time change: 2 841 999 000 000ns (HostNow=1 777 348 071 295 000 000 ns HostLast=1 777 345 229 296 000 000 ns) 2026-04-27 23:47:51 (18632): Guest Log: 00:02:20.799378 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 221 111 164 000ns (GuestNow=1 777 345 239 305 130 000 ns GuestLast=1 777 343 018 193 966 000 ns fSetTimeLastLoop=true ) 2026-04-27 23:47:55 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 00:00:26 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 00:00:32 (18632): Guest Log: 00:02:30.813621 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 842 004 324 000ns (GuestNow=1 777 348 081 309 454 000 ns GuestLast=1 777 345 239 305 130 000 ns fSetTimeLastLoop=true ) 2026-04-28 00:00:36 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 00:23:17 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 00:23:27 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 01:00:29 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 01:00:35 (18632): Guest Log: 00:02:50.832185 timesync vgsvcTimeSyncWorker: Radical host time change: 2 232 217 000 000ns (HostNow=1 777 352 434 928 000 000 ns HostLast=1 777 350 202 711 000 000 ns) 2026-04-28 01:00:35 (18632): Guest Log: 00:02:50.832268 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 121 418 729 000ns (GuestNow=1 777 350 212 728 680 000 ns GuestLast=1 777 348 091 309 951 000 ns fSetTimeLastLoop=true ) 2026-04-28 01:00:39 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 01:00:59 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 01:01:05 (18632): Guest Log: 00:03:00.832776 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 232 200 016 000ns (GuestNow=1 777 352 444 928 696 000 ns GuestLast=1 777 350 212 728 680 000 ns fSetTimeLastLoop=true ) 2026-04-28 01:01:09 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 01:05:19 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 01:05:29 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 02:00:32 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 02:00:38 (18632): Guest Log: 00:03:20.848794 timesync vgsvcTimeSyncWorker: Radical host time change: 3 312 725 000 000ns (HostNow=1 777 356 037 734 000 000 ns HostLast=1 777 352 725 009 000 000 ns) 2026-04-28 02:00:42 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 02:01:02 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 02:01:08 (18632): Guest Log: 00:03:30.849947 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 582 818 305 000ns (GuestNow=1 777 356 047 749 092 000 ns GuestLast=1 777 352 464 930 787 000 ns fSetTimeLastLoop=true ) 2026-04-28 02:01:12 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 02:23:23 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 02:23:33 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 02:31:03 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 02:31:13 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 03:00:25 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 03:00:35 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 03:30:57 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 03:31:08 (18632): Guest Log: 00:04:11.319911 timesync vgsvcTimeSyncWorker: Radical host time change: 1 831 436 000 000ns (HostNow=1 777 361 461 504 000 000 ns HostLast=1 777 359 630 068 000 000 ns) 2026-04-28 03:31:08 (18632): Guest Log: 00:04:11.320008 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 211 703 475 000ns (GuestNow=1 777 359 640 204 690 000 ns GuestLast=1 777 357 428 501 215 000 ns fSetTimeLastLoop=true ) 2026-04-28 03:31:08 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 03:34:28 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 03:34:31 (18632): Guest Log: 00:04:21.320476 timesync vgsvcTimeSyncWorker: Radical guest time change: 1 831 510 259 000ns (GuestNow=1 777 361 471 714 949 000 ns GuestLast=1 777 359 640 204 690 000 ns fSetTimeLastLoop=true ) 2026-04-28 03:34:38 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 03:35:28 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 03:35:38 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 03:37:28 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 03:37:38 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 03:45:48 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 03:45:59 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 04:00:40 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 04:00:49 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 04:01:09 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 04:01:20 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 04:23:20 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 04:23:30 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 04:31:41 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 04:31:51 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 05:00:32 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 05:00:42 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 05:31:04 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 05:31:05 (18632): Guest Log: 00:05:51.328879 timesync vgsvcTimeSyncWorker: Radical host time change: 1 831 813 000 000ns (HostNow=1 777 368 664 543 000 000 ns HostLast=1 777 366 832 730 000 000 ns) 2026-04-28 05:31:05 (18632): Guest Log: 00:05:51.328958 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 221 111 579 000ns (GuestNow=1 777 366 842 734 105 000 ns GuestLast=1 777 364 621 622 526 000 ns fSetTimeLastLoop=true ) 2026-04-28 05:31:14 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 05:47:44 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 05:47:45 (18632): Guest Log: 00:06:01.332697 timesync vgsvcTimeSyncWorker: Radical guest time change: 1 831 812 579 000ns (GuestNow=1 777 368 674 546 684 000 ns GuestLast=1 777 366 842 734 105 000 ns fSetTimeLastLoop=true ) 2026-04-28 05:47:54 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 06:00:25 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 06:00:35 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 06:01:05 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 06:01:15 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 06:23:16 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 06:23:26 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 06:38:27 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 06:38:37 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 07:00:28 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 07:00:38 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 07:29:10 (18632): Guest Log: 00:07:01.388976 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 220 850 444 000ns (GuestNow=1 777 374 037 744 289 000 ns GuestLast=1 777 371 816 893 845 000 ns fSetTimeLastLoop=true ) 2026-04-28 07:29:10 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 07:29:20 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 07:32:30 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 07:32:40 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 20:00:28 (18632): Guest Log: 00:07:21.391149 timesync vgsvcTimeSyncWorker: Radical host time change: 44 877 875 000 000ns (HostNow=1 777 420 827 597 000 000 ns HostLast=1 777 375 949 722 000 000 ns) 2026-04-28 20:00:28 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 20:00:38 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 20:01:58 (18632): Guest Log: 00:07:31.398231 timesync vgsvcTimeSyncWorker: Radical guest time change: 45 068 064 347 000ns (GuestNow=1 777 420 837 604 346 000 ns GuestLast=1 777 375 769 539 999 000 ns fSetTimeLastLoop=true ) 2026-04-28 20:01:58 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 20:02:08 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 20:05:48 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 20:05:58 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 20:23:18 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 20:23:28 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 20:35:39 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 20:35:49 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 20:52:10 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 20:52:20 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 20:53:10 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 20:53:20 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 21:00:30 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 21:00:40 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 21:11:51 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 21:12:01 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 22:00:34 (18632): Guest Log: 00:08:52.349582 timesync vgsvcTimeSyncWorker: Radical host time change: 2 922 422 000 000ns (HostNow=1 777 428 033 179 000 000 ns HostLast=1 777 425 110 757 000 000 ns) 2026-04-28 22:00:34 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 22:00:44 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 22:23:25 (18632): Guest Log: 00:09:02.403123 timesync vgsvcTimeSyncWorker: Radical guest time change: 4 073 299 485 000ns (GuestNow=1 777 428 043 232 573 000 ns GuestLast=1 777 423 969 933 088 000 ns fSetTimeLastLoop=true ) 2026-04-28 22:23:25 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 22:23:35 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 22:58:26 (18632): Guest Log: 00:09:12.456502 timesync vgsvcTimeSyncWorker: Radical host time change: 2 101 131 000 000ns (HostNow=1 777 431 506 076 000 000 ns HostLast=1 777 429 404 945 000 000 ns) 2026-04-28 22:58:26 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 22:58:36 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 22:59:37 (18632): Guest Log: 00:09:22.509074 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 101 130 577 000ns (GuestNow=1 777 431 516 128 629 000 ns GuestLast=1 777 429 414 998 052 000 ns fSetTimeLastLoop=true ) 2026-04-28 22:59:37 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 22:59:47 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-28 23:00:27 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-28 23:00:37 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-29 00:00:29 (18632): Guest Log: 00:09:42.726264 timesync vgsvcTimeSyncWorker: Radical host time change: 3 602 847 000 000ns (HostNow=1 777 435 228 999 000 000 ns HostLast=1 777 431 626 152 000 000 ns) 2026-04-29 00:00:29 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-29 00:00:39 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-29 00:23:21 (18632): Guest Log: 00:09:52.778471 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 702 706 278 000ns (GuestNow=1 777 435 239 051 152 000 ns GuestLast=1 777 431 536 344 874 000 ns fSetTimeLastLoop=true ) 2026-04-29 00:23:21 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-29 00:23:31 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-29 02:00:35 (18632): Guest Log: 00:10:02.841690 timesync vgsvcTimeSyncWorker: Radical host time change: 5 833 979 000 000ns (HostNow=1 777 442 434 703 000 000 ns HostLast=1 777 436 600 724 000 000 ns) 2026-04-29 02:00:35 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-29 02:00:45 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-29 02:23:27 (18632): Guest Log: 00:10:12.883092 timesync vgsvcTimeSyncWorker: Radical guest time change: 5 833 978 606 000ns (GuestNow=1 777 442 444 755 220 000 ns GuestLast=1 777 436 610 776 614 000 ns fSetTimeLastLoop=true ) 2026-04-29 02:23:27 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-29 02:23:37 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-29 02:25:17 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-29 02:25:27 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-29 03:00:28 (18632): Guest Log: 00:10:32.993162 timesync vgsvcTimeSyncWorker: Radical host time change: 2 111 138 000 000ns (HostNow=1 777 446 027 591 000 000 ns HostLast=1 777 443 916 453 000 000 ns) 2026-04-29 03:00:28 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-29 03:00:38 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-29 03:12:29 (18632): Guest Log: 00:10:43.046279 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 211 140 948 000ns (GuestNow=1 777 446 037 644 183 000 ns GuestLast=1 777 443 826 503 235 000 ns fSetTimeLastLoop=true ) 2026-04-29 03:12:29 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-29 03:12:39 (18632): VM state change detected. (old = 'running', new = 'paused') 2026-04-29 03:40:20 (18632): VM state change detected. (old = 'paused', new = 'running') 2026-04-29 03:40:27 (18632): Guest Log: *** Job finished *** 2026-04-29 03:40:27 (18632): Guest Log: *** The last 20 lines of the pilot log: *** 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:21,203 | INFO | found 0 job(s) in 20 queues 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:21,204 | WARNING | pilot monitor received instruction that args.graceful_stop has been set 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:21,204 | WARNING | will wait for a maximum of 300 s for threads to finish 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:21,274 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139721626851136)>', '<ExcThread(monitor, started 139720940033792)>'] 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:22,206 | WARNING | job_aborted has been set - aborting pilot monitoring 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:22,206 | INFO | [monitor] control thread has ended 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:26,282 | INFO | all workflow threads have been joined 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:26,282 | INFO | end of generic workflow (traces error code: 0) 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:26,282 | INFO | traces error code: 0 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:26,282 | INFO | pilot has finished (exit code=0, shell exit code=0) 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:26,447 [wrapper] ==== pilot stdout END ==== 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:26,453 [wrapper] ==== wrapper stdout RESUME ==== 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:26,459 [wrapper] pilotpid: 6061 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:26,466 [wrapper] Pilot exit status: 0 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:26,734 [wrapper] pandaids: 7116222787 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:26,777 [wrapper] cleanup supervisor_pilot 6067 6062 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:27,284 [wrapper] Test setup, not cleaning 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:27,291 [wrapper] apfmon messages muted 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:27,298 [wrapper] ==== wrapper stdout END ==== 2026-04-29 03:40:27 (18632): Guest Log: 2026-04-29 07:40:27,303 [wrapper] ==== wrapper stderr END ==== 2026-04-29 03:40:27 (18632): Guest Log: *** Error codes and diagnostics *** 2026-04-29 03:40:27 (18632): Guest Log: "exeErrorCode": 0, 2026-04-29 03:40:27 (18632): Guest Log: "pilotErrorCode": 1150, 2026-04-29 03:40:27 (18632): Guest Log: "pilotErrorDiag": "Looping job killed by pilot", 2026-04-29 03:40:27 (18632): Guest Log: *** Listing of results directory *** 2026-04-29 03:40:27 (18632): Guest Log: total 4396 2026-04-29 03:40:27 (18632): Guest Log: -rw-r--r--. 1 atlas atlas 5631 Apr 27 04:24 queuedata.json 2026-04-29 03:40:28 (18632): Guest Log: -rw-r--r--. 1 atlas atlas 683926 Apr 27 04:24 pilot3.tar.gz 2026-04-29 03:40:28 (18632): Guest Log: -rwx------. 1 atlas atlas 36322 Apr 27 04:25 runpilot2-wrapper.sh 2026-04-29 03:40:28 (18632): Guest Log: -rwxr-xr-x. 1 atlas atlas 8531 Apr 27 10:48 init_data.xml 2026-04-29 03:40:28 (18632): Guest Log: -rwxr-xr-x. 1 atlas atlas 697413 Apr 27 10:48 input.tar.gz 2026-04-29 03:40:28 (18632): Guest Log: -rwxr-xr-x. 1 atlas atlas 15667 Apr 27 10:48 start_atlas.sh 2026-04-29 03:40:28 (18632): Guest Log: lrwxrwxrwx. 1 atlas atlas 20 Apr 27 10:48 EVNT.49863712._000114.pool.root.1 -> /data/./ATLAS.root_0 2026-04-29 03:40:28 (18632): Guest Log: -rw-r--r--. 1 atlas atlas 2574 Apr 27 10:48 pandaJob.out 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 426 Apr 28 04:23 workernode_map.json 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 996863 Apr 28 05:00 agis_schedconf.cvmfs.json 2026-04-29 03:40:28 (18632): Guest Log: drwx------. 5 atlas atlas 4096 Apr 28 05:00 pilot3 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 1021 Apr 29 06:23 memory_monitor_summary.json 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 64084 Apr 29 06:23 log.49863714._002820.job.log.tgz.1 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 1512704 Apr 29 06:23 agis_ddmendpoints.agis.ALL.json 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 3233 Apr 29 07:00 heartbeat_new.json 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 3153 Apr 29 07:00 heartbeat.json 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 115 Apr 29 07:40 pilot_heartbeat.json 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 5966 Apr 29 07:40 pilotlog.txt 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 161002 Apr 29 07:40 log.49863714._002820.job.log.1 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 188 Apr 29 07:40 output.list 2026-04-29 03:40:28 (18632): Guest Log: -rw-r--r--. 1 atlas atlas 410 Apr 29 07:40 runtime_log 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 235520 Apr 29 07:40 result.tar.gz 2026-04-29 03:40:28 (18632): Guest Log: -rw-r--r--. 1 atlas atlas 8233 Apr 29 07:40 runtime_log.err 2026-04-29 03:40:28 (18632): Guest Log: -rw-------. 1 atlas atlas 649 Apr 29 07:40 e5429c828719.diag 2026-04-29 03:40:28 (18632): Guest Log: Looking for outputfile HITS.49863714._002820.pool.root.1 2026-04-29 03:40:28 (18632): Guest Log: No HITS file was produced 2026-04-29 03:40:28 (18632): Guest Log: Successfully finished the ATLAS job! 2026-04-29 03:40:28 (18632): Guest Log: Copying the results back to the shared directory! 2026-04-29 03:40:28 (18632): Guest Log: *** Contents of shared directory: *** 2026-04-29 03:40:28 (18632): Guest Log: total 257004 2026-04-29 03:40:28 (18632): Guest Log: -rwxrwxrwx. 1 root root 262205273 Apr 27 09:13 ATLAS.root_0 2026-04-29 03:40:28 (18632): Guest Log: -rwxrwxrwx. 1 root root 8531 Apr 27 09:13 init_data.xml 2026-04-29 03:40:28 (18632): Guest Log: -rwxrwxrwx. 1 root root 697413 Apr 27 09:04 input.tar.gz 2026-04-29 03:40:28 (18632): Guest Log: -rwxrwxrwx. 1 root root 235520 Apr 29 07:40 result.tar.gz 2026-04-29 03:40:28 (18632): Guest Log: -rwxrwxrwx. 1 root root 15667 Apr 27 09:04 start_atlas.sh 2026-04-29 03:40:28 (18632): Guest Log: *** Success! Shutting down the machine. *** 2026-04-29 03:40:28 (18632): VM Completion File Detected. 2026-04-29 03:40:28 (18632): Powering off VM. 2026-04-29 03:40:30 (18632): Successfully stopped VM. 2026-04-29 03:40:30 (18632): Deregistering VM. (boinc_ed058b0fd42b7dff, slot#3) 2026-04-29 03:40:30 (18632): Removing network bandwidth throttle group from VM. 2026-04-29 03:40:31 (18632): Removing VM from VirtualBox. 2026-04-29 03:40:36 (18632): called boinc_finish(0) </stderr_txt> ]]>
©2026 CERN