Name ZgGODmHae46n9Rq4apOajLDm4fhM0noT9bVoFjIUDmpOZKDm0h8kCo_0
Workunit 230440015
Created 18 Feb 2025, 15:21:15 UTC
Sent 18 Feb 2025, 18:53:46 UTC
Report deadline 26 Feb 2025, 18:53:46 UTC
Received 22 Feb 2025, 4:59:39 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10774714
Run time 19 hours 20 min 31 sec
CPU time 18 hours 42 min 54 sec
Validate state Valid
Credit 767.30
Device peak FLOPS 3.85 GFLOPS
Application version ATLAS Simulation v3.01 (vbox64_mt_mcore_atlas)
windows_x86_64
Peak working set size 86.55 MB
Peak swap size 86.43 MB
Peak disk usage 2.61 GB

Stderr output

<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
2025-02-18 22:07:44 (1316): Detected: vboxwrapper 26206
2025-02-18 22:07:44 (1316): Detected: BOINC client v8.0.2
2025-02-18 22:07:46 (1316): Detected: VirtualBox VboxManage Interface (Version: 7.0.6)
2025-02-18 22:07:47 (1316): Successfully copied 'init_data.xml' to the shared directory.
2025-02-18 22:07:47 (1316): Create VM. (boinc_112bc1f508f5d5bc, slot#1)
2025-02-18 22:07:48 (1316): Setting Memory Size for VM. (4100MB)
2025-02-18 22:07:48 (1316): Setting CPU Count for VM. (1)
2025-02-18 22:07:48 (1316): Setting Chipset Options for VM.
2025-02-18 22:07:48 (1316): Setting Graphics Controller Options for VM.
2025-02-18 22:07:49 (1316): Setting Boot Options for VM.
2025-02-18 22:07:49 (1316): Setting Network Configuration for NAT.
2025-02-18 22:07:49 (1316): Enabling VM Network Access.
2025-02-18 22:07:49 (1316): Disabling USB Support for VM.
2025-02-18 22:07:50 (1316): Disabling COM Port Support for VM.
2025-02-18 22:07:50 (1316): Disabling LPT Port Support for VM.
2025-02-18 22:07:50 (1316): Disabling Audio Support for VM.
2025-02-18 22:07:51 (1316): Disabling Clipboard Support for VM.
2025-02-18 22:07:51 (1316): Disabling Drag and Drop Support for VM.
2025-02-18 22:07:51 (1316): Adding storage controller(s) to VM.
2025-02-18 22:07:51 (1316): Adding virtual disk drive to VM. (ATLAS_vbox_3.01_image.vdi)
2025-02-18 22:07:54 (1316): Adding VirtualBox Guest Additions to VM.
2025-02-18 22:07:55 (1316): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB)
2025-02-18 22:07:55 (1316): forwarding host port 54144 to guest port 80
2025-02-18 22:07:55 (1316): Enabling remote desktop for VM.
2025-02-18 22:07:56 (1316): Enabling shared directory for VM.
2025-02-18 22:07:56 (1316): Starting VM using VBoxManage interface. (boinc_112bc1f508f5d5bc, slot#1)
2025-02-18 22:08:06 (1316): Successfully started VM. (PID = '3196')
2025-02-18 22:08:06 (1316): Reporting VM Process ID to BOINC.
2025-02-18 22:08:06 (1316): Guest Log: BIOS: VirtualBox 7.0.6
2025-02-18 22:08:06 (1316): Guest Log: CPUID EDX: 0x178bfbff
2025-02-18 22:08:06 (1316): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2025-02-18 22:08:06 (1316): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2025-02-18 22:08:06 (1316): VM state change detected. (old = 'poweredoff', new = 'running')
2025-02-18 22:08:06 (1316): Detected: Web Application Enabled (http://localhost:54144)
2025-02-18 22:08:06 (1316): Detected: Remote Desktop Enabled (localhost:54145)
2025-02-18 22:08:06 (1316): Preference change detected
2025-02-18 22:08:06 (1316): Setting CPU throttle for VM. (100%)
2025-02-18 22:08:06 (1316): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2025-02-18 22:08:08 (1316): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2025-02-18 22:08:08 (1316): Guest Log: BIOS: Booting from Hard Disk...
2025-02-18 22:08:11 (1316): Guest Log: BIOS: KBD: unsupported int 16h function 03
2025-02-18 22:08:11 (1316): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2025-02-18 22:08:11 (1316): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2025-02-18 22:08:16 (1316): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2025-02-18 22:08:16 (1316): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2025-02-18 22:08:27 (1316): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2025-02-18 22:08:27 (1316): Guest Log: 00:00:00.000224 main     Log opened 2025-02-18T22:08:25.874192000Z
2025-02-18 22:08:27 (1316): Guest Log: 00:00:00.000377 main     OS Product: Linux
2025-02-18 22:08:27 (1316): Guest Log: 00:00:00.000417 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2025-02-18 22:08:27 (1316): Guest Log: 00:00:00.000486 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2025-02-18 22:08:27 (1316): Guest Log: 00:00:00.000523 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2025-02-18 22:08:27 (1316): Guest Log: 00:00:00.000524 main     Process ID: 1252
2025-02-18 22:08:27 (1316): Guest Log: 00:00:00.000525 main     Package type: LINUX_64BITS_GENERIC
2025-02-18 22:08:27 (1316): Guest Log: 00:00:00.001868 main     5.2.32 r132073 started. Verbose level = 0
2025-02-18 22:08:28 (1316): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2025-02-18 22:08:28 (1316): Guest Log: [INFO] Mounting shared directory
2025-02-18 22:08:28 (1316): Guest Log: [INFO] Checking for init_data.xml
2025-02-18 22:08:32 (1316): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2025-02-18 22:08:32 (1316): Guest Log: [INFO] Detected branch: prod
2025-02-18 22:08:33 (1316): Guest Log: This is the prod version of the ATLAS job wrapper
2025-02-18 22:08:33 (1316): Guest Log: Copying input files
2025-02-18 22:08:35 (1316): Guest Log: Copied input files into RunAtlas.
2025-02-18 22:08:35 (1316): Guest Log: This VM did not configure a local http proxy via BOINC.
2025-02-18 22:08:35 (1316): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2025-02-18 22:08:35 (1316): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2025-02-18 22:08:35 (1316): Guest Log: Further information can be found at the LHC@home message board.
2025-02-18 22:08:37 (1316): Guest Log: 00:00:10.027878 timesync vgsvcTimeSyncWorker: Radical guest time change: -10 788 571 812 000ns (GuestNow=1 739 905 717 329 487 000 ns GuestLast=1 739 916 505 901 299 000 ns fSetTimeLastLoop=true )
2025-02-18 22:08:45 (1316): Guest Log: Running cvmfs_config stat atlas.cern.ch
2025-02-18 22:08:45 (1316): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2025-02-18 22:08:45 (1316): Guest Log: 2.6.3.0 1521 0 30080 142798 4 1 3117296 4096000 0 65024 0 0 n/a 1 0 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
2025-02-18 22:08:47 (1316): Guest Log: copied the webapp to /var/www
2025-02-18 22:08:47 (1316): Guest Log: core_number=1
2025-02-18 22:08:48 (1316): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2025-02-18 22:08:48 (1316): Guest Log:  *** Starting ATLAS job. (PandaID=6518301004 taskID=43078919) ***
2025-02-18 22:49:47 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-18 22:50:07 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-18 23:22:55 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 07:59:36 (1316): Guest Log: 01:14:12.046549 timesync vgsvcTimeSyncWorker: Radical host time change: 31 005 089 000 000ns (HostNow=1 739 941 173 438 000 000 ns HostLast=1 739 910 168 349 000 000 ns)
2025-02-19 07:59:36 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 07:59:39 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 08:00:15 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 08:00:21 (1316): Guest Log: 01:14:22.050793 timesync vgsvcTimeSyncWorker: Radical guest time change: 31 024 094 119 000ns (GuestNow=1 739 941 183 442 280 000 ns GuestLast=1 739 910 159 348 161 000 ns fSetTimeLastLoop=true )
2025-02-19 08:08:34 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 08:08:54 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 08:09:13 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 08:15:14 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 08:15:24 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 08:15:44 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 08:15:54 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 08:16:14 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 08:17:34 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 08:17:54 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 08:18:14 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 08:18:34 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 08:20:54 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 08:21:14 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 08:32:45 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 08:33:05 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 08:34:19 (1316): Status Report: Elapsed Time: '6000.464905'
2025-02-19 08:34:19 (1316): Status Report: CPU Time: '5112.281250'
2025-02-19 09:00:47 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 09:01:07 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 09:29:48 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 09:30:08 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 10:15:04 (1316): Status Report: Elapsed Time: '12000.464905'
2025-02-19 10:15:04 (1316): Status Report: CPU Time: '11033.640625'
2025-02-19 10:26:32 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 10:26:52 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 11:23:05 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-19 11:23:25 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-19 11:24:48 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 07:59:38 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 07:59:40 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 08:00:01 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 08:00:05 (1316): Guest Log: 04:29:18.645631 timesync vgsvcTimeSyncWorker: Radical host time change: 74 122 027 000 000ns (HostNow=1 740 027 605 489 000 000 ns HostLast=1 739 953 483 462 000 000 ns)
2025-02-20 08:00:16 (1316): Guest Log: 04:29:29.175876 timesync vgsvcTimeSyncWorker: Radical guest time change: 74 735 982 215 000ns (GuestNow=1 740 027 616 019 290 000 ns GuestLast=1 739 952 880 037 075 000 ns fSetTimeLastLoop=true )
2025-02-20 08:08:31 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 08:08:51 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 08:09:21 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 08:09:41 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 08:09:51 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 08:10:31 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 08:10:42 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 08:13:22 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 08:35:08 (1316): Status Report: Elapsed Time: '18000.491205'
2025-02-20 08:35:08 (1316): Status Report: CPU Time: '16991.156250'
2025-02-20 08:58:05 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 08:58:26 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 09:39:09 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 09:39:29 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 09:59:44 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 10:46:18 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 10:46:22 (1316): Guest Log: 06:24:23.033213 timesync vgsvcTimeSyncWorker: Radical host time change: 2 804 575 000 000ns (HostNow=1 740 037 581 990 000 000 ns HostLast=1 740 034 777 415 000 000 ns)
2025-02-20 10:46:25 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 10:46:45 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 10:46:52 (1316): Guest Log: 06:24:33.043819 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 082 124 451 000ns (GuestNow=1 740 037 592 000 631 000 ns GuestLast=1 740 034 509 876 180 000 ns fSetTimeLastLoop=true )
2025-02-20 11:02:51 (1316): Status Report: Elapsed Time: '24000.491205'
2025-02-20 11:02:51 (1316): Status Report: CPU Time: '22939.406250'
2025-02-20 11:33:28 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 11:33:48 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 12:30:22 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 12:30:42 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 12:43:37 (1316): Status Report: Elapsed Time: '30000.491205'
2025-02-20 12:43:37 (1316): Status Report: CPU Time: '28898.000000'
2025-02-20 13:05:34 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 14:31:06 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 14:31:15 (1316): Guest Log: 08:42:47.714700 timesync vgsvcTimeSyncWorker: Radical host time change: 5 142 668 000 000ns (HostNow=1 740 051 075 155 000 000 ns HostLast=1 740 045 932 487 000 000 ns)
2025-02-20 14:31:25 (1316): Guest Log: 08:42:57.716764 timesync vgsvcTimeSyncWorker: Radical guest time change: 5 198 485 564 000ns (GuestNow=1 740 051 085 157 073 000 ns GuestLast=1 740 045 886 671 509 000 ns fSetTimeLastLoop=true )
2025-02-20 14:59:29 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 14:59:48 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 15:38:33 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 15:38:53 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 15:49:55 (1316): Status Report: Elapsed Time: '36000.491205'
2025-02-20 15:49:55 (1316): Status Report: CPU Time: '34850.718750'
2025-02-20 16:01:26 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:01:46 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:03:46 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:05:36 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:05:46 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:06:06 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:06:16 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:06:36 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:06:46 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:07:06 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:07:16 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:07:36 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:07:46 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:08:06 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:08:16 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:08:36 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:08:46 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:09:06 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:09:16 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:09:36 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:09:46 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:10:06 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:10:16 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:10:36 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:10:46 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:11:06 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:11:16 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:11:36 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:11:46 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:12:06 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:12:16 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:12:36 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:12:46 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:13:06 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 16:56:57 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 16:58:56 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 17:39:41 (1316): Status Report: Elapsed Time: '42000.558569'
2025-02-20 17:39:41 (1316): Status Report: CPU Time: '40792.000000'
2025-02-20 18:42:05 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 18:42:25 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 18:59:31 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-20 20:59:44 (1316): VM state change detected. (old = 'paused', new = 'running')
2025-02-20 20:59:47 (1316): Guest Log: 13:01:06.417823 timesync vgsvcTimeSyncWorker: Radical host time change: 7 222 516 000 000ns (HostNow=1 740 074 386 450 000 000 ns HostLast=1 740 067 163 934 000 000 ns)
2025-02-20 20:59:57 (1316): Guest Log: 13:01:16.427980 timesync vgsvcTimeSyncWorker: Radical guest time change: 7 822 602 047 000ns (GuestNow=1 740 074 396 460 166 000 ns GuestLast=1 740 066 573 858 119 000 ns fSetTimeLastLoop=true )
2025-02-20 21:20:19 (1316): Status Report: Elapsed Time: '48000.558569'
2025-02-20 21:20:19 (1316): Status Report: CPU Time: '46700.203125'
2025-02-20 21:54:34 (1316): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 10:56:41 (10968): Detected: vboxwrapper 26206
2025-02-21 10:56:41 (10968): Detected: BOINC client v8.0.2
2025-02-21 10:56:43 (10968): Detected: VirtualBox VboxManage Interface (Version: 7.0.6)
2025-02-21 10:56:44 (10968): Guest Log: BIOS: VirtualBox 7.0.6
2025-02-21 10:56:44 (10968): Guest Log: CPUID EDX: 0x178bfbff
2025-02-21 10:56:44 (10968): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2025-02-21 10:56:44 (10968): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2025-02-21 10:56:44 (10968): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2025-02-21 10:56:44 (10968): Guest Log: BIOS: Booting from Hard Disk...
2025-02-21 10:56:44 (10968): Guest Log: BIOS: KBD: unsupported int 16h function 03
2025-02-21 10:56:44 (10968): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2025-02-21 10:56:44 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2025-02-21 10:56:44 (10968): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2025-02-21 10:56:44 (10968): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2025-02-21 10:56:44 (10968): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2025-02-21 10:56:44 (10968): Guest Log: 00:00:00.000224 main     Log opened 2025-02-18T22:08:25.874192000Z
2025-02-21 10:56:44 (10968): Guest Log: 00:00:00.000377 main     OS Product: Linux
2025-02-21 10:56:44 (10968): Guest Log: 00:00:00.000417 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2025-02-21 10:56:44 (10968): Guest Log: 00:00:00.000486 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2025-02-21 10:56:44 (10968): Guest Log: 00:00:00.000523 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2025-02-21 10:56:44 (10968): Guest Log: 00:00:00.000524 main     Process ID: 1252
2025-02-21 10:56:44 (10968): Guest Log: 00:00:00.000525 main     Package type: LINUX_64BITS_GENERIC
2025-02-21 10:56:44 (10968): Guest Log: 00:00:00.001868 main     5.2.32 r132073 started. Verbose level = 0
2025-02-21 10:56:44 (10968): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2025-02-21 10:56:44 (10968): Guest Log: [INFO] Mounting shared directory
2025-02-21 10:56:44 (10968): Guest Log: [INFO] Checking for init_data.xml
2025-02-21 10:56:44 (10968): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2025-02-21 10:56:44 (10968): Guest Log: [INFO] Detected branch: prod
2025-02-21 10:56:44 (10968): Guest Log: This is the prod version of the ATLAS job wrapper
2025-02-21 10:56:44 (10968): Guest Log: Copying input files
2025-02-21 10:56:44 (10968): Guest Log: Copied input files into RunAtlas.
2025-02-21 10:56:44 (10968): Guest Log: This VM did not configure a local http proxy via BOINC.
2025-02-21 10:56:44 (10968): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2025-02-21 10:56:44 (10968): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2025-02-21 10:56:44 (10968): Guest Log: Further information can be found at the LHC@home message board.
2025-02-21 10:56:44 (10968): Guest Log: 00:00:10.027878 timesync vgsvcTimeSyncWorker: Radical guest time change: -10 788 571 812 000ns (GuestNow=1 739 905 717 329 487 000 ns GuestLast=1 739 916 505 901 299 000 ns fSetTimeLastLoop=true )
2025-02-21 10:56:44 (10968): Guest Log: Running cvmfs_config stat atlas.cern.ch
2025-02-21 10:56:44 (10968): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2025-02-21 10:56:44 (10968): Guest Log: 2.6.3.0 1521 0 30080 142798 4 1 3117296 4096000 0 65024 0 0 n/a 1 0 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
2025-02-21 10:56:44 (10968): Guest Log: copied the webapp to /var/www
2025-02-21 10:56:44 (10968): Guest Log: core_number=1
2025-02-21 10:56:44 (10968): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2025-02-21 10:56:44 (10968): Guest Log:  *** Starting ATLAS job. (PandaID=6518301004 taskID=43078919) ***
2025-02-21 10:56:44 (10968): Guest Log: 01:14:12.046549 timesync vgsvcTimeSyncWorker: Radical host time change: 31 005 089 000 000ns (HostNow=1 739 941 173 438 000 000 ns HostLast=1 739 910 168 349 000 000 ns)
2025-02-21 10:56:44 (10968): Guest Log: 01:14:22.050793 timesync vgsvcTimeSyncWorker: Radical guest time change: 31 024 094 119 000ns (GuestNow=1 739 941 183 442 280 000 ns GuestLast=1 739 910 159 348 161 000 ns fSetTimeLastLoop=true )
2025-02-21 10:56:44 (10968): Guest Log: 04:29:18.645631 timesync vgsvcTimeSyncWorker: Radical host time change: 74 122 027 000 000ns (HostNow=1 740 027 605 489 000 000 ns HostLast=1 739 953 483 462 000 000 ns)
2025-02-21 10:56:44 (10968): Guest Log: 04:29:29.175876 timesync vgsvcTimeSyncWorker: Radical guest time change: 74 735 982 215 000ns (GuestNow=1 740 027 616 019 290 000 ns GuestLast=1 739 952 880 037 075 000 ns fSetTimeLastLoop=true )
2025-02-21 10:56:44 (10968): Guest Log: 06:24:23.033213 timesync vgsvcTimeSyncWorker: Radical host time change: 2 804 575 000 000ns (HostNow=1 740 037 581 990 000 000 ns HostLast=1 740 034 777 415 000 000 ns)
2025-02-21 10:56:44 (10968): Guest Log: 06:24:33.043819 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 082 124 451 000ns (GuestNow=1 740 037 592 000 631 000 ns GuestLast=1 740 034 509 876 180 000 ns fSetTimeLastLoop=true )
2025-02-21 10:56:44 (10968): Guest Log: 08:42:47.714700 timesync vgsvcTimeSyncWorker: Radical host time change: 5 142 668 000 000ns (HostNow=1 740 051 075 155 000 000 ns HostLast=1 740 045 932 487 000 000 ns)
2025-02-21 10:56:44 (10968): Guest Log: 08:42:57.716764 timesync vgsvcTimeSyncWorker: Radical guest time change: 5 198 485 564 000ns (GuestNow=1 740 051 085 157 073 000 ns GuestLast=1 740 045 886 671 509 000 ns fSetTimeLastLoop=true )
2025-02-21 10:56:44 (10968): Guest Log: 13:01:06.417823 timesync vgsvcTimeSyncWorker: Radical host time change: 7 222 516 000 000ns (HostNow=1 740 074 386 450 000 000 ns HostLast=1 740 067 163 934 000 000 ns)
2025-02-21 10:56:44 (10968): Guest Log: 13:01:16.427980 timesync vgsvcTimeSyncWorker: Radical guest time change: 7 822 602 047 000ns (GuestNow=1 740 074 396 460 166 000 ns GuestLast=1 740 066 573 858 119 000 ns fSetTimeLastLoop=true )
2025-02-21 10:56:44 (10968): Starting VM using VBoxManage interface. (boinc_112bc1f508f5d5bc, slot#1)
2025-02-21 10:56:53 (10968): Successfully started VM. (PID = '4108')
2025-02-21 10:56:53 (10968): Reporting VM Process ID to BOINC.
2025-02-21 10:56:53 (10968): Guest Log: BIOS: VirtualBox 7.0.6
2025-02-21 10:56:53 (10968): Guest Log: CPUID EDX: 0x178bfbff
2025-02-21 10:56:53 (10968): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2025-02-21 10:56:53 (10968): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2025-02-21 10:56:53 (10968): VM state change detected. (old = 'poweredoff', new = 'running')
2025-02-21 10:56:53 (10968): Detected: Web Application Enabled (http://localhost:54144)
2025-02-21 10:56:53 (10968): Detected: Remote Desktop Enabled (localhost:54145)
2025-02-21 10:56:54 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 10:57:07 (10968): Status Report: Elapsed Time: '50012.558569'
2025-02-21 10:57:07 (10968): Status Report: CPU Time: '48687.640625'
2025-02-21 10:57:07 (10968): Preference change detected
2025-02-21 10:57:07 (10968): Setting CPU throttle for VM. (100%)
2025-02-21 10:57:07 (10968): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2025-02-21 10:57:08 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 10:57:09 (10968): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2025-02-21 10:57:09 (10968): Guest Log: BIOS: Booting from Hard Disk...
2025-02-21 10:57:12 (10968): Guest Log: BIOS: KBD: unsupported int 16h function 03
2025-02-21 10:57:12 (10968): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2025-02-21 10:57:12 (10968): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2025-02-21 10:57:17 (10968): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2025-02-21 10:57:17 (10968): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2025-02-21 10:57:29 (10968): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2025-02-21 10:57:29 (10968): Guest Log: 00:00:00.000215 main     Log opened 2025-02-21T10:57:13.140031000Z
2025-02-21 10:57:29 (10968): Guest Log: 00:00:00.000362 main     OS Product: Linux
2025-02-21 10:57:29 (10968): Guest Log: 00:00:00.000399 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2025-02-21 10:57:29 (10968): Guest Log: 00:00:00.000431 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2025-02-21 10:57:29 (10968): Guest Log: 00:00:00.000496 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2025-02-21 10:57:29 (10968): Guest Log: 00:00:00.000497 main     Process ID: 1253
2025-02-21 10:57:29 (10968): Guest Log: 00:00:00.000498 main     Package type: LINUX_64BITS_GENERIC
2025-02-21 10:57:29 (10968): Guest Log: 00:00:00.001804 main     5.2.32 r132073 started. Verbose level = 0
2025-02-21 10:57:29 (10968): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2025-02-21 10:57:29 (10968): Guest Log: [INFO] Mounting shared directory
2025-02-21 10:57:29 (10968): Guest Log: [INFO] Checking for init_data.xml
2025-02-21 10:57:34 (10968): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2025-02-21 10:57:34 (10968): Guest Log: [INFO] Detected branch: prod
2025-02-21 10:57:34 (10968): Guest Log: This is the prod version of the ATLAS job wrapper
2025-02-21 10:57:34 (10968): Guest Log: Copying input files
2025-02-21 10:57:37 (10968): Guest Log: Copied input files into RunAtlas.
2025-02-21 10:57:37 (10968): Guest Log: This VM did not configure a local http proxy via BOINC.
2025-02-21 10:57:37 (10968): Guest Log: Small home clusters do not require a local http proxy but it is suggested if
2025-02-21 10:57:37 (10968): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
2025-02-21 10:57:37 (10968): Guest Log: Further information can be found at the LHC@home message board.
2025-02-21 10:57:39 (10968): Guest Log: 00:00:10.030755 timesync vgsvcTimeSyncWorker: Radical guest time change: -10 774 764 483 000ns (GuestNow=1 740 124 658 405 510 000 ns GuestLast=1 740 135 433 169 993 000 ns fSetTimeLastLoop=true )
2025-02-21 10:57:49 (10968): Guest Log: Running cvmfs_config stat atlas.cern.ch
2025-02-21 10:57:49 (10968): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2025-02-21 10:57:49 (10968): Guest Log: 2.6.3.0 1522 0 32100 142895 4 1 3998488 4096000 0 65024 0 0 n/a 0 0 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1
2025-02-21 10:57:50 (10968): Guest Log: copied the webapp to /var/www
2025-02-21 10:57:51 (10968): Guest Log: core_number=1
2025-02-21 10:57:51 (10968): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2025-02-21 10:57:51 (10968): Guest Log:  *** Starting ATLAS job. (PandaID=6518301004 taskID=43078919) ***
2025-02-21 12:01:11 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 12:51:48 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 12:51:57 (10968): Guest Log: 01:03:51.579780 timesync vgsvcTimeSyncWorker: Radical host time change: 3 046 825 000 000ns (HostNow=1 740 131 516 722 000 000 ns HostLast=1 740 128 469 897 000 000 ns)
2025-02-21 12:52:07 (10968): Guest Log: 01:04:01.589559 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 046 777 650 000ns (GuestNow=1 740 131 526 731 810 000 ns GuestLast=1 740 128 479 954 160 000 ns fSetTimeLastLoop=true )
2025-02-21 13:08:29 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 13:08:49 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 13:28:09 (10968): Status Report: Elapsed Time: '56012.558569'
2025-02-21 13:28:09 (10968): Status Report: CPU Time: '54035.406250'
2025-02-21 14:52:28 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 16:31:52 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 16:32:02 (10968): Guest Log: 03:04:15.527849 timesync vgsvcTimeSyncWorker: Radical host time change: 5 973 733 000 000ns (HostNow=1 740 144 721 298 000 000 ns HostLast=1 740 138 747 565 000 000 ns)
2025-02-21 16:32:12 (10968): Guest Log: 03:04:25.536566 timesync vgsvcTimeSyncWorker: Radical guest time change: 5 990 636 765 000ns (GuestNow=1 740 144 731 306 790 000 ns GuestLast=1 740 138 740 670 025 000 ns fSetTimeLastLoop=true )
2025-02-21 16:45:00 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 16:45:20 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 16:47:59 (10968): Status Report: Elapsed Time: '62012.558569'
2025-02-21 16:47:59 (10968): Status Report: CPU Time: '59986.171875'
2025-02-21 16:56:27 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 17:08:49 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 17:21:54 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 17:22:14 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:00:49 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:02:47 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:02:57 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:03:17 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:03:27 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:03:47 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:03:57 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:04:18 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:04:27 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:04:48 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:04:57 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:05:17 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:05:28 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:05:48 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:05:58 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:06:18 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:06:28 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:06:48 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:06:58 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:07:18 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:07:28 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:07:48 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:07:58 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:08:18 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:08:28 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:08:48 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:08:58 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:09:18 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:09:28 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 18:09:48 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 18:47:45 (10968): Status Report: Elapsed Time: '68012.558569'
2025-02-21 18:47:45 (10968): Status Report: CPU Time: '65963.421875'
2025-02-21 19:09:03 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 23:17:16 (10968): Guest Log: 05:21:40.018411 timesync vgsvcTimeSyncWorker: Radical host time change: 14 902 822 000 000ns (HostNow=1 740 169 036 050 000 000 ns HostLast=1 740 154 133 228 000 000 ns)
2025-02-21 23:17:16 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 23:17:21 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 23:17:41 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 23:17:46 (10968): Guest Log: 05:21:50.022174 timesync vgsvcTimeSyncWorker: Radical guest time change: 16 080 265 145 000ns (GuestNow=1 740 169 046 053 765 000 ns GuestLast=1 740 152 965 788 620 000 ns fSetTimeLastLoop=true )
2025-02-21 23:18:35 (10968): VM state change detected. (old = 'running', new = 'paused')
2025-02-21 23:18:51 (10968): VM state change detected. (old = 'paused', new = 'running')
2025-02-21 23:20:50 (10968): Guest Log:  *** Job finished ***
2025-02-21 23:20:50 (10968): Guest Log:  *** The last 20 lines of the pilot log: ***
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:08,098 | INFO     | [data] queue_monitor thread has finished
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:08,220 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139975789131584)>', '<ExcThread(monitor, started 139975131657984)>']
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:08,825 | WARNING  | job_aborted has been set - aborting pilot monitoring
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:08,825 | INFO     | [monitor] control thread has ended
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:13,226 | INFO     | all workflow threads have been joined
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:13,227 | INFO     | end of generic workflow (traces error code: 1150)
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:13,227 | INFO     | traces error code: 1150
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:13,227 | INFO     | an exit code was already set: 1150 (will be converted to a standard shell code)
2025-02-21 23:20:50 (10968): Guest Log: no translation to shell exit code for error code 1150
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:13,227 | INFO     | pilot has finished (exit code=1150, shell exit code=1)
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:13,385 [wrapper] ==== pilot stdout END ====
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:13,392 [wrapper] ==== wrapper stdout RESUME ====
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:13,399 [wrapper] pilotpid: 5798
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:13,405 [wrapper] Pilot exit status: 1
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:14,256 [wrapper] pandaids: 6518301004
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:14,300 [wrapper] cleanup supervisor_pilot 18078 5799
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:14,309 [wrapper] Test setup, not cleaning
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:14,325 [wrapper] apfmon messages muted
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:14,333 [wrapper] ==== wrapper stdout END ====
2025-02-21 23:20:50 (10968): Guest Log: 2025-02-21 20:20:14,339 [wrapper] ==== wrapper stderr END ====
2025-02-21 23:20:50 (10968): Guest Log:  *** Error codes and diagnostics ***
2025-02-21 23:20:50 (10968): Guest Log:     "exeErrorCode": 0,
2025-02-21 23:20:50 (10968): Guest Log:     "exeErrorDiag": "",
2025-02-21 23:20:50 (10968): Guest Log:     "pilotErrorCode": 1150,
2025-02-21 23:20:50 (10968): Guest Log:     "pilotErrorDiag": "Looping job killed by pilot",
2025-02-21 23:20:50 (10968): Guest Log:  *** Listing of results directory ***
2025-02-21 23:20:50 (10968): Guest Log: total 8560
2025-02-21 23:20:50 (10968): Guest Log: -rw-r--r--. 1 atlas atlas  491065 Feb 18 15:18 pilot3.tar.gz
2025-02-21 23:20:50 (10968): Guest Log: -rwx------. 1 atlas atlas   35865 Feb 18 15:20 runpilot2-wrapper.sh
2025-02-21 23:20:50 (10968): Guest Log: -rw-r--r--. 1 atlas atlas    5118 Feb 18 15:20 queuedata.json
2025-02-21 23:20:50 (10968): Guest Log: -rwxr-xr-x. 1 atlas atlas    9008 Feb 21 07:57 init_data.xml
2025-02-21 23:20:50 (10968): Guest Log: -rwxr-xr-x. 1 atlas atlas  503555 Feb 21 07:57 input.tar.gz
2025-02-21 23:20:50 (10968): Guest Log: -rwxr-xr-x. 1 atlas atlas   17569 Feb 21 07:57 start_atlas.sh
2025-02-21 23:20:50 (10968): Guest Log: lrwxrwxrwx. 1 atlas atlas      20 Feb 21 07:57 EVNT.43078917._001552.pool.root.1 -> /data/./ATLAS.root_0
2025-02-21 23:20:50 (10968): Guest Log: -rw-r--r--. 1 atlas atlas    2547 Feb 21 07:57 pandaJob.out
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas     424 Feb 21 07:57 setup.sh.local
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas  994744 Feb 21 07:58 agis_schedconf.cvmfs.json
2025-02-21 23:20:50 (10968): Guest Log: drwx------. 4 atlas atlas    4096 Feb 21 07:58 pilot3
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas      98 Feb 21 20:19 pilot_heartbeat.json
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas    1027 Feb 21 20:19 memory_monitor_summary.json
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas  337608 Feb 21 20:19 log.43078919._072258.job.log.tgz.1
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas 1582569 Feb 21 20:19 agis_ddmendpoints.agis.ALL.json
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas    2743 Feb 21 20:20 heartbeat.json
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas    4524 Feb 21 20:20 pilotlog.txt
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas 2180223 Feb 21 20:20 log.43078919._072258.job.log.1
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas     188 Feb 21 20:20 output.list
2025-02-21 23:20:50 (10968): Guest Log: -rw-r--r--. 1 atlas atlas     620 Feb 21 20:20 runtime_log
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas 2529280 Feb 21 20:20 result.tar.gz
2025-02-21 23:20:50 (10968): Guest Log: -rw-------. 1 atlas atlas     653 Feb 21 20:20 ZgGODmHae46n9Rq4apOajLDm4fhM0noT9bVoFjIUDmpOZKDm0h8kCo.diag
2025-02-21 23:20:50 (10968): Guest Log: -rw-r--r--. 1 atlas atlas   10678 Feb 21 20:20 runtime_log.err
2025-02-21 23:20:50 (10968): Guest Log: Looking for outputfile HITS.43078919._072258.pool.root.1
2025-02-21 23:20:50 (10968): Guest Log: No HITS file was produced
2025-02-21 23:20:50 (10968): Guest Log: Successfully finished the ATLAS job!
2025-02-21 23:20:50 (10968): Guest Log: Copying the results back to the shared directory!
2025-02-21 23:20:50 (10968): Guest Log:  *** Contents of shared directory: ***
2025-02-21 23:20:50 (10968): Guest Log: total 334796
2025-02-21 23:20:50 (10968): Guest Log: -rwxrwxrwx. 1 root root 339762733 Feb 18 19:07 ATLAS.root_0
2025-02-21 23:20:50 (10968): Guest Log: -rwxrwxrwx. 1 root root      9008 Feb 18 19:07 init_data.xml
2025-02-21 23:20:50 (10968): Guest Log: -rwxrwxrwx. 1 root root    503555 Feb 18 18:53 input.tar.gz
2025-02-21 23:20:50 (10968): Guest Log: -rwxrwxrwx. 1 root root   2529280 Feb 21  2025 result.tar.gz
2025-02-21 23:20:50 (10968): Guest Log: -rwxrwxrwx. 1 root root     17569 Feb 18 18:53 start_atlas.sh
2025-02-21 23:20:50 (10968): Guest Log:  *** Success! Shutting down the machine. ***
2025-02-21 23:20:50 (10968): VM Completion File Detected.
2025-02-21 23:20:50 (10968): Powering off VM.
2025-02-21 23:20:52 (10968): Successfully stopped VM.
2025-02-21 23:20:52 (10968): Deregistering VM. (boinc_112bc1f508f5d5bc, slot#1)
2025-02-21 23:20:52 (10968): Removing network bandwidth throttle group from VM.
2025-02-21 23:20:52 (10968): Removing VM from VirtualBox.
23:20:57 (10968): called boinc_finish(0)

</stderr_txt>
]]>


©2025 CERN