| Name | iXSKDmSI358nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmyLLKDmf7lISm_2 |
| Workunit | 238800034 |
| Created | 4 Feb 2026, 3:37:39 UTC |
| Sent | 4 Feb 2026, 3:55:07 UTC |
| Report deadline | 12 Feb 2026, 3:55:07 UTC |
| Received | 6 Feb 2026, 3:21:49 UTC |
| Server state | Over |
| Outcome | Validate error |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 10740518 |
| Run time | 14 min 30 sec |
| CPU time | 8 min 31 sec |
| Priority | 28 |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 16.56 GFLOPS |
| Application version | ATLAS Simulation v3.03 (vbox64_mt_mcore_atlas) windows_x86_64 |
| Peak working set size | 103.23 MB |
| Peak swap size | 122.11 MB |
| Peak disk usage | 1.42 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> 2026-02-03 23:01:09 (20136): vboxwrapper version 26210 2026-02-03 23:01:09 (20136): BOINC client version: 7.16.20 2026-02-03 23:01:16 (20136): Detected: VirtualBox VboxManage Interface (Version: 6.0.14) 2026-02-03 23:01:17 (20136): Successfully copied 'init_data.xml' to the shared directory. 2026-02-03 23:01:17 (20136): Create VM. (boinc_e75d5722dd7fe82e, slot#0) 2026-02-03 23:01:17 (20136): Setting Memory Size for VM. (4400MB) 2026-02-03 23:01:18 (20136): Setting CPU Count for VM. (4) 2026-02-03 23:01:18 (20136): Setting Chipset Options for VM. 2026-02-03 23:01:18 (20136): Setting Graphics Controller Options for VM. (Driver: VBoxVGA, 16MB) 2026-02-03 23:01:18 (20136): Setting Boot Options for VM. 2026-02-03 23:01:19 (20136): Setting Network Configuration for NAT. (Driver: virtio) 2026-02-03 23:01:19 (20136): Enabling VM Network Access. 2026-02-03 23:01:20 (20136): Disabling USB Support for VM. 2026-02-03 23:01:20 (20136): Disabling COM Port Support for VM. 2026-02-03 23:01:20 (20136): Disabling LPT Port Support for VM. 2026-02-03 23:01:20 (20136): Disabling Audio Support for VM. 2026-02-03 23:01:21 (20136): Disabling Clipboard Support for VM. 2026-02-03 23:01:21 (20136): Disabling Drag and Drop Support for VM. 2026-02-03 23:01:21 (20136): Adding storage controller(s) to VM. 2026-02-03 23:01:21 (20136): Adding virtual disk drive to VM. (ATLAS_vbox_3.03_image.vdi) 2026-02-03 23:01:23 (20136): Adding VirtualBox Guest Additions to VM. 2026-02-03 23:01:23 (20136): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2026-02-03 23:01:23 (20136): forwarding host port 52431 to guest port 80 2026-02-03 23:01:23 (20136): Enabling remote desktop for VM. 2026-02-03 23:01:24 (20136): Required extension pack not installed, remote desktop not enabled. 2026-02-03 23:01:24 (20136): Enabling shared directory for VM. 2026-02-03 23:01:24 (20136): Starting VM using VBoxManage interface. (boinc_e75d5722dd7fe82e, slot#0) 2026-02-03 23:01:31 (20136): Successfully started VM. (PID = '19192') 2026-02-03 23:01:31 (20136): Reporting VM Process ID to BOINC. 2026-02-03 23:01:31 (20136): Guest Log: BIOS: VirtualBox 6.0.14 2026-02-03 23:01:31 (20136): Guest Log: CPUID EDX: 0x178bfbff 2026-02-03 23:01:31 (20136): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2026-02-03 23:01:31 (20136): VM state change detected. (old = 'poweredoff', new = 'running') 2026-02-03 23:01:31 (20136): Detected: Web Application Enabled (http://localhost:52431) 2026-02-03 23:01:32 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-03 23:12:50 (20136): Preference change detected 2026-02-03 23:12:50 (20136): Setting CPU throttle for VM. (100%) 2026-02-03 23:12:50 (20136): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds)) 2026-02-03 23:12:51 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-03 23:12:52 (20136): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2026-02-03 23:12:52 (20136): Guest Log: BIOS: Booting from Hard Disk... 2026-02-03 23:12:55 (20136): Guest Log: BIOS: KBD: unsupported int 16h function 03 2026-02-03 23:12:55 (20136): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2026-02-03 23:12:55 (20136): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2026-02-03 23:13:01 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-03 23:48:43 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-03 23:48:46 (20136): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2026-02-03 23:48:46 (20136): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0000000 (size 0x400000) 2026-02-03 23:48:53 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 00:01:13 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 00:01:23 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 00:24:14 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 00:24:16 (20136): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2026-02-04 00:24:16 (20136): Guest Log: 00:00:00.000159 main Log opened 2026-02-03T23:02:03.635380000Z 2026-02-04 00:24:16 (20136): Guest Log: 00:00:00.000315 main OS Product: Linux 2026-02-04 00:24:16 (20136): Guest Log: 00:00:00.000360 main OS Release: 3.10.0-957.27.2.el7.x86_64 2026-02-04 00:24:16 (20136): Guest Log: 00:00:00.000412 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2026-02-04 00:24:16 (20136): Guest Log: 00:00:00.000448 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2026-02-04 00:24:16 (20136): Guest Log: 00:00:00.000449 main Process ID: 1325 2026-02-04 00:24:16 (20136): Guest Log: 00:00:00.000450 main Package type: LINUX_64BITS_GENERIC 2026-02-04 00:24:16 (20136): Guest Log: 00:00:00.001344 main 5.2.32 r132073 started. Verbose level = 0 2026-02-04 00:24:17 (20136): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2026-02-04 00:24:17 (20136): Guest Log: [INFO] Mounting shared directory 2026-02-04 00:24:17 (20136): Guest Log: [INFO] Checking for init_data.xml 2026-02-04 00:24:24 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 00:46:16 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 00:46:18 (20136): Guest Log: 00:00:10.003323 timesync vgsvcTimeSyncWorker: Radical guest time change: 22 942 978 971 000ns (GuestNow=1 770 182 666 617 170 000 ns GuestLast=1 770 159 723 638 199 000 ns fSetTimeLastLoop=true ) 2026-02-04 00:46:24 (20136): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2026-02-04 00:46:24 (20136): Guest Log: [INFO] Detected branch: prod 2026-02-04 00:46:24 (20136): Guest Log: This is the prod version of the ATLAS job wrapper 2026-02-04 00:46:24 (20136): Guest Log: Copying input files 2026-02-04 00:46:26 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 01:01:17 (20136): Guest Log: Copied input files into RunAtlas. 2026-02-04 01:01:17 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 01:01:18 (20136): Guest Log: This VM did not configure a local http proxy via BOINC. 2026-02-04 01:01:18 (20136): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2026-02-04 01:01:18 (20136): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2026-02-04 01:01:18 (20136): Guest Log: Further information can be found at the LHC@home message board. 2026-02-04 01:01:27 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 01:03:17 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 01:03:21 (20136): Guest Log: Running cvmfs_config stat atlas.cern.ch 2026-02-04 01:03:21 (20136): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2026-02-04 01:03:21 (20136): Guest Log: 2.6.3.0 1611 22 32184 155857 4 1 3117739 4096000 0 65024 0 0 n/a 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1 2026-02-04 01:03:27 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 01:05:17 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 01:05:20 (20136): Guest Log: copied the webapp to /var/www 2026-02-04 01:05:20 (20136): Guest Log: ATHENA_PROC_NUMBER=4 2026-02-04 01:05:20 (20136): Guest Log: ATHENA_CORE_NUMBER=4 2026-02-04 01:05:20 (20136): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2026-02-04 01:05:20 (20136): Guest Log: *** Starting ATLAS job. (PandaID=6985830253 taskID=48329843) *** 2026-02-04 01:05:27 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 01:45:59 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 01:46:00 (20136): Guest Log: 00:00:50.057310 timesync vgsvcTimeSyncWorker: Radical host time change: 2 441 586 000 000ns (HostNow=1 770 187 559 912 000 000 ns HostLast=1 770 185 118 326 000 000 ns) 2026-02-04 01:46:09 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 01:46:29 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 01:46:30 (20136): Guest Log: 00:01:00.058175 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 551 580 541 000ns (GuestNow=1 770 187 569 962 005 000 ns GuestLast=1 770 184 018 381 464 000 ns fSetTimeLastLoop=true ) 2026-02-04 01:46:40 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 01:47:30 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 01:47:40 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 01:56:00 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 01:56:10 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 02:01:10 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 02:01:20 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 02:24:21 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 02:24:31 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 02:43:43 (20136): Guest Log: 00:01:50.121265 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 260 628 464 000ns (GuestNow=1 770 189 870 649 904 000 ns GuestLast=1 770 187 610 021 440 000 ns fSetTimeLastLoop=true ) 2026-02-04 02:43:43 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 02:43:53 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 03:01:13 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 03:01:23 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 03:16:14 (20136): Guest Log: 00:02:10.839630 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 202 986 376 000ns (GuestNow=1 770 192 083 698 198 000 ns GuestLast=1 770 189 880 711 822 000 ns fSetTimeLastLoop=true ) 2026-02-04 03:16:14 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 03:16:24 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 04:01:17 (20136): Guest Log: 00:02:20.896813 timesync vgsvcTimeSyncWorker: Radical host time change: 2 702 571 000 000ns (HostNow=1 770 195 676 135 000 000 ns HostLast=1 770 192 973 564 000 000 ns) 2026-02-04 04:01:17 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 04:01:27 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 04:02:47 (20136): Guest Log: 00:02:30.949532 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 592 432 292 000ns (GuestNow=1 770 195 686 187 562 000 ns GuestLast=1 770 192 093 755 270 000 ns fSetTimeLastLoop=true ) 2026-02-04 04:02:47 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 04:02:57 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 04:05:17 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 04:05:27 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 04:15:37 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 04:15:47 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 04:24:17 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 04:24:27 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 04:36:48 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 04:36:58 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 04:47:08 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 04:47:18 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 05:01:20 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 05:01:30 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 05:28:51 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 05:29:01 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 05:55:33 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 05:55:42 (20136): Guest Log: 00:04:01.322282 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 492 145 058 000ns (GuestNow=1 770 200 949 712 060 000 ns GuestLast=1 770 198 457 567 002 000 ns fSetTimeLastLoop=true ) 2026-02-04 05:55:43 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 06:01:13 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 06:01:23 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 06:06:03 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 06:06:13 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 06:24:14 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 06:24:24 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 06:53:55 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 06:54:06 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 07:01:16 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 07:01:26 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 07:34:17 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 07:34:24 (20136): Guest Log: 00:05:01.329229 timesync vgsvcTimeSyncWorker: Radical host time change: 1 981 163 000 000ns (HostNow=1 770 208 464 759 000 000 ns HostLast=1 770 206 483 596 000 000 ns) 2026-02-04 07:34:27 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 07:44:08 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 07:44:15 (20136): Guest Log: 00:05:11.329933 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 411 259 036 000ns (GuestNow=1 770 208 474 759 778 000 ns GuestLast=1 770 206 063 500 742 000 ns fSetTimeLastLoop=true ) 2026-02-04 07:44:18 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 07:45:28 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 07:45:38 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 20:01:08 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 20:01:15 (20136): Guest Log: 00:05:31.331565 timesync vgsvcTimeSyncWorker: Radical host time change: 44 140 527 000 000ns (HostNow=1 770 253 275 466 000 000 ns HostLast=1 770 209 134 939 000 000 ns) 2026-02-04 20:01:18 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 20:24:40 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 20:24:47 (20136): Guest Log: 00:05:41.350651 timesync vgsvcTimeSyncWorker: Radical guest time change: 44 790 723 369 000ns (GuestNow=1 770 253 285 484 708 000 ns GuestLast=1 770 208 494 761 339 000 ns fSetTimeLastLoop=true ) 2026-02-04 20:24:50 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 20:33:41 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 20:33:51 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 20:54:12 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 20:54:22 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 21:01:12 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 21:01:22 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 21:18:53 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 21:19:03 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 22:01:15 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 22:01:22 (20136): Guest Log: 00:06:31.354089 timesync vgsvcTimeSyncWorker: Radical host time change: 2 542 074 000 000ns (HostNow=1 770 260 481 765 000 000 ns HostLast=1 770 257 939 691 000 000 ns) 2026-02-04 22:01:25 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 22:24:57 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 22:25:04 (20136): Guest Log: 00:06:41.356526 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 542 075 685 000ns (GuestNow=1 770 260 491 767 206 000 ns GuestLast=1 770 257 949 691 521 000 ns fSetTimeLastLoop=true ) 2026-02-04 22:25:07 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 22:48:48 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 22:48:58 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 23:01:19 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 23:01:29 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 23:07:49 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 23:07:59 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 23:45:51 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 23:45:57 (20136): Guest Log: 00:07:21.365223 timesync vgsvcTimeSyncWorker: Radical host time change: 2 281 535 000 000ns (HostNow=1 770 266 757 270 000 000 ns HostLast=1 770 264 475 735 000 000 ns) 2026-02-04 23:46:01 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-04 23:51:11 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-04 23:51:17 (20136): Guest Log: 00:07:31.366553 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 402 319 686 000ns (GuestNow=1 770 266 767 271 418 000 ns GuestLast=1 770 263 364 951 732 000 ns fSetTimeLastLoop=true ) 2026-02-04 23:51:21 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 00:01:12 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 00:01:22 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 00:03:22 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 00:03:32 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 00:24:54 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 00:25:03 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 01:01:16 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 01:01:22 (20136): Guest Log: 00:08:11.376213 timesync vgsvcTimeSyncWorker: Radical host time change: 2 182 815 000 000ns (HostNow=1 770 271 282 360 000 000 ns HostLast=1 770 269 099 545 000 000 ns) 2026-02-05 01:01:22 (20136): Guest Log: 00:08:11.376285 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 312 272 506 000ns (GuestNow=1 770 269 109 549 242 000 ns GuestLast=1 770 266 797 276 736 000 ns fSetTimeLastLoop=true ) 2026-02-05 01:01:26 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 01:14:37 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 01:14:43 (20136): Guest Log: 00:08:21.380746 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 182 815 398 000ns (GuestNow=1 770 271 292 364 640 000 ns GuestLast=1 770 269 109 549 242 000 ns fSetTimeLastLoop=true ) 2026-02-05 01:14:47 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 01:43:38 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 01:43:48 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 02:01:19 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 02:01:25 (20136): Guest Log: 00:08:41.391054 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 531 913 630 000ns (GuestNow=1 770 273 834 282 621 000 ns GuestLast=1 770 271 302 368 991 000 ns fSetTimeLastLoop=true ) 2026-02-05 02:01:29 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 02:09:09 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 02:09:20 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 02:09:30 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 02:09:40 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 02:10:09 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 02:10:19 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 02:10:39 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 02:10:49 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 02:24:51 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 02:25:01 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 02:54:22 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 02:54:32 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 03:01:23 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 03:01:28 (20136): Guest Log: 00:09:51.411365 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 671 612 515 000ns (GuestNow=1 770 278 077 089 005 000 ns GuestLast=1 770 275 405 476 490 000 ns fSetTimeLastLoop=true ) 2026-02-05 03:01:33 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 03:19:13 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 03:19:23 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 03:21:54 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 03:22:04 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 03:36:44 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 03:36:54 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 04:01:16 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 04:01:26 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 04:15:37 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 04:15:42 (20136): Guest Log: 00:10:41.423480 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 502 840 702 000ns (GuestNow=1 770 282 090 983 469 000 ns GuestLast=1 770 279 588 142 767 000 ns fSetTimeLastLoop=true ) 2026-02-05 04:15:47 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 04:24:58 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 04:25:08 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 04:47:29 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 04:47:39 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 04:55:29 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 04:55:39 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 05:01:20 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 05:01:30 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 05:34:42 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 05:34:46 (20136): Guest Log: 00:11:31.434214 timesync vgsvcTimeSyncWorker: Radical host time change: 2 002 568 000 000ns (HostNow=1 770 287 686 438 000 000 ns HostLast=1 770 285 683 870 000 000 ns) 2026-02-05 05:34:51 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 05:53:53 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 05:53:58 (20136): Guest Log: 00:11:41.437815 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 813 146 940 000ns (GuestNow=1 770 287 696 441 608 000 ns GuestLast=1 770 284 883 294 668 000 ns fSetTimeLastLoop=true ) 2026-02-05 05:54:03 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 06:01:13 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 06:01:23 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 06:24:55 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 06:25:05 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 06:34:15 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 06:34:25 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 07:01:16 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 07:01:26 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 07:44:59 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 07:45:04 (20136): Guest Log: 00:12:31.457956 timesync vgsvcTimeSyncWorker: Radical host time change: 2 623 005 000 000ns (HostNow=1 770 295 504 298 000 000 ns HostLast=1 770 292 881 293 000 000 ns) 2026-02-05 07:45:04 (20136): Guest Log: 00:12:31.458035 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 171 663 393 000ns (GuestNow=1 770 292 891 294 450 000 ns GuestLast=1 770 290 719 631 057 000 ns fSetTimeLastLoop=true ) 2026-02-05 07:45:09 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 20:01:13 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 20:01:19 (20136): Guest Log: 00:12:41.477526 timesync vgsvcTimeSyncWorker: Radical host time change: 44 174 463 000 000ns (HostNow=1 770 339 678 761 000 000 ns HostLast=1 770 295 504 298 000 000 ns) 2026-02-05 20:01:19 (20136): Guest Log: 00:12:41.486521 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 623 023 120 000ns (GuestNow=1 770 295 514 317 570 000 ns GuestLast=1 770 292 891 294 450 000 ns fSetTimeLastLoop=true ) 2026-02-05 20:01:23 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 20:24:55 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 20:25:00 (20136): Guest Log: 00:12:51.488165 timesync vgsvcTimeSyncWorker: Radical guest time change: 44 174 454 081 000ns (GuestNow=1 770 339 688 771 651 000 ns GuestLast=1 770 295 514 317 570 000 ns fSetTimeLastLoop=true ) 2026-02-05 20:25:05 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 21:01:17 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 21:01:22 (20136): Guest Log: 00:13:01.488678 timesync vgsvcTimeSyncWorker: Radical host time change: 2 181 688 000 000ns (HostNow=1 770 343 282 499 000 000 ns HostLast=1 770 341 100 811 000 000 ns) 2026-02-05 21:01:27 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 21:25:39 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 21:25:44 (20136): Guest Log: 00:13:11.492567 timesync vgsvcTimeSyncWorker: Radical guest time change: 2 181 691 141 000ns (GuestNow=1 770 343 292 502 588 000 ns GuestLast=1 770 341 110 811 447 000 ns fSetTimeLastLoop=true ) 2026-02-05 21:26:00 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 21:47:31 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 21:47:41 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 21:48:41 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 21:48:51 (20136): VM state change detected. (old = 'running', new = 'paused') 2026-02-05 22:01:11 (20136): VM state change detected. (old = 'paused', new = 'running') 2026-02-05 22:01:19 (20136): Guest Log: *** Job finished *** 2026-02-05 22:01:19 (20136): Guest Log: *** The last 20 lines of the pilot log: *** 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:35,944 | WARNING | pilot monitor received instruction that args.graceful_stop has been set 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:35,944 | WARNING | will wait for a maximum of 300 s for threads to finish 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:52,092 | INFO | [monitor] cgroup control has ended 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:52,362 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139838997927744)>', '<ExcThread(monitor, started 139837952747264)>'] 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:53,044 | WARNING | job_aborted has been set - aborting pilot monitoring 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:53,045 | INFO | [monitor] control thread has ended 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,368 | INFO | all workflow threads have been joined 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,369 | INFO | end of generic workflow (traces error code: 0) 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,369 | INFO | traces error code: 0 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,369 | INFO | pilot has finished (exit code=0, shell exit code=0) 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,504 [wrapper] ==== pilot stdout END ==== 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,511 [wrapper] ==== wrapper stdout RESUME ==== 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,517 [wrapper] pilotpid: 6045 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,524 [wrapper] Pilot exit status: 0 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,835 [wrapper] pandaids: 6985830253 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,883 [wrapper] cleanup supervisor_pilot 6051 6046 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,891 [wrapper] Test setup, not cleaning 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,898 [wrapper] apfmon messages muted 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,906 [wrapper] ==== wrapper stdout END ==== 2026-02-05 22:01:19 (20136): Guest Log: 2026-02-06 02:47:57,913 [wrapper] ==== wrapper stderr END ==== 2026-02-05 22:01:19 (20136): Guest Log: *** Error codes and diagnostics *** 2026-02-05 22:01:19 (20136): Guest Log: "exeErrorCode": 0, 2026-02-05 22:01:19 (20136): Guest Log: "exeErrorDiag": "", 2026-02-05 22:01:19 (20136): Guest Log: "pilotErrorCode": 1150, 2026-02-05 22:01:19 (20136): Guest Log: "pilotErrorDiag": "Looping job killed by pilot", 2026-02-05 22:01:19 (20136): Guest Log: *** Listing of results directory *** 2026-02-05 22:01:19 (20136): Guest Log: total 4460 2026-02-05 22:01:19 (20136): Guest Log: -rwx------. 1 atlas atlas 36322 Jan 30 13:00 runpilot2-wrapper.sh 2026-02-05 22:01:19 (20136): Guest Log: -rw-r--r--. 1 atlas atlas 584422 Jan 30 13:01 pilot3.tar.gz 2026-02-05 22:01:19 (20136): Guest Log: -rw-r--r--. 1 atlas atlas 5111 Jan 30 13:01 queuedata.json 2026-02-05 22:01:19 (20136): Guest Log: -rwxr-xr-x. 1 atlas atlas 8617 Feb 4 05:46 init_data.xml 2026-02-05 22:01:19 (20136): Guest Log: -rwxr-xr-x. 1 atlas atlas 597769 Feb 4 05:46 input.tar.gz 2026-02-05 22:01:19 (20136): Guest Log: -rwxr-xr-x. 1 atlas atlas 15845 Feb 4 05:46 start_atlas.sh 2026-02-05 22:01:19 (20136): Guest Log: lrwxrwxrwx. 1 atlas atlas 20 Feb 4 05:46 EVNT.48329840._000005.pool.root.1 -> /data/./ATLAS.root_0 2026-02-05 22:01:19 (20136): Guest Log: -rw-r--r--. 1 atlas atlas 2608 Feb 4 05:46 pandaJob.out 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 1009236 Feb 4 09:01 agis_schedconf.cvmfs.json 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 426 Feb 4 09:01 workernode_map.json 2026-02-05 22:01:19 (20136): Guest Log: drwx------. 5 atlas atlas 4096 Feb 4 09:01 pilot3 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 1023 Feb 6 01:25 memory_monitor_summary.json 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 118830 Feb 6 02:01 log.48329843._000106.job.log.tgz.1 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 1513144 Feb 6 02:01 agis_ddmendpoints.agis.ALL.json 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 3221 Feb 6 02:25 heartbeat.json 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 115 Feb 6 02:47 pilot_heartbeat.json 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 5523 Feb 6 02:47 pilotlog.txt 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 233095 Feb 6 02:47 log.48329843._000106.job.log.1 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 188 Feb 6 02:47 output.list 2026-02-05 22:01:19 (20136): Guest Log: -rw-r--r--. 1 atlas atlas 620 Feb 6 02:47 runtime_log 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 368640 Feb 6 02:47 result.tar.gz 2026-02-05 22:01:19 (20136): Guest Log: -rw-r--r--. 1 atlas atlas 8610 Feb 6 02:47 runtime_log.err 2026-02-05 22:01:19 (20136): Guest Log: -rw-------. 1 atlas atlas 649 Feb 6 02:47 iXSKDmSI358nsSi4ap6QjLDmwznN0nGgGQJmIVkRDmyLLKDmf7lISm.diag 2026-02-05 22:01:19 (20136): Guest Log: Looking for outputfile HITS.48329843._000106.pool.root.1 2026-02-05 22:01:19 (20136): Guest Log: No HITS file was produced 2026-02-05 22:01:19 (20136): Guest Log: Successfully finished the ATLAS job! 2026-02-05 22:01:19 (20136): Guest Log: Copying the results back to the shared directory! 2026-02-05 22:01:19 (20136): Guest Log: *** Contents of shared directory: *** 2026-02-05 22:01:19 (20136): Guest Log: total 269284 2026-02-05 22:01:19 (20136): Guest Log: -rwxrwxrwx. 1 root root 274748789 Feb 4 04:01 ATLAS.root_0 2026-02-05 22:01:19 (20136): Guest Log: -rwxrwxrwx. 1 root root 8617 Feb 4 04:01 init_data.xml 2026-02-05 22:01:19 (20136): Guest Log: -rwxrwxrwx. 1 root root 597769 Feb 4 03:55 input.tar.gz 2026-02-05 22:01:19 (20136): Guest Log: -rwxrwxrwx. 1 root root 368640 Feb 6 2026 result.tar.gz 2026-02-05 22:01:19 (20136): Guest Log: -rwxrwxrwx. 1 root root 15845 Feb 4 03:55 start_atlas.sh 2026-02-05 22:01:19 (20136): Guest Log: *** Success! Shutting down the machine. *** 2026-02-05 22:01:19 (20136): VM Completion File Detected. 2026-02-05 22:01:19 (20136): Powering off VM. 2026-02-05 22:01:21 (20136): Successfully stopped VM. 2026-02-05 22:01:22 (20136): Deregistering VM. (boinc_e75d5722dd7fe82e, slot#0) 2026-02-05 22:01:22 (20136): Removing network bandwidth throttle group from VM. 2026-02-05 22:01:22 (20136): Removing VM from VirtualBox. 2026-02-05 22:01:28 (20136): called boinc_finish(0) </stderr_txt> ]]>
©2026 CERN