Name NzOKDmE65c5n7Olcko1bjSoqABFKDmABFKDmOtvXDmjcpKDm0unWQn_0
Workunit 223631529
Created 16 Jun 2024, 14:32:10 UTC
Sent 16 Jun 2024, 20:28:52 UTC
Report deadline 24 Jun 2024, 20:28:52 UTC
Received 22 Jun 2024, 6:35:40 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 10836791
Run time 5 days 9 hours 55 min 14 sec
CPU time 5 days 9 hours 58 min 58 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 19.99 GFLOPS
Application version ATLAS Simulation v3.01 (vbox64_mt_mcore_atlas)
x86_64-pc-linux-gnu
Peak working set size 4.12 GB
Peak swap size 5.75 GB
Peak disk usage 6.42 GB

Stderr output

<core_client_version>8.0.3</core_client_version>
<![CDATA[
<stderr_txt>
2024-06-16 22:29:21 (225977): Detected: vboxwrapper 26206
2024-06-16 22:29:21 (225977): Detected: BOINC client v8.0.2
2024-06-16 22:29:22 (225977): Detected: VirtualBox VboxManage Interface (Version: 7.0.16)
2024-06-16 22:29:23 (225977): Successfully copied 'init_data.xml' to the shared directory.
2024-06-16 22:29:23 (225977): Create VM. (boinc_aea62baf4ba02adc, slot#35)
2024-06-16 22:29:24 (225977): Setting Memory Size for VM. (4096MB)
2024-06-16 22:29:25 (225977): Setting CPU Count for VM. (1)
2024-06-16 22:29:25 (225977): Setting Chipset Options for VM.
2024-06-16 22:29:26 (225977): Setting Graphics Controller Options for VM.
2024-06-16 22:29:26 (225977): Setting Boot Options for VM.
2024-06-16 22:29:27 (225977): Setting Network Configuration for NAT.
2024-06-16 22:29:27 (225977): Enabling VM Network Access.
2024-06-16 22:29:28 (225977): Disabling USB Support for VM.
2024-06-16 22:29:28 (225977): Disabling COM Port Support for VM.
2024-06-16 22:29:29 (225977): Disabling LPT Port Support for VM.
2024-06-16 22:29:29 (225977): Disabling Audio Support for VM.
2024-06-16 22:29:30 (225977): Disabling Clipboard Support for VM.
2024-06-16 22:29:30 (225977): Disabling Drag and Drop Support for VM.
2024-06-16 22:29:31 (225977): Adding storage controller(s) to VM.
2024-06-16 22:29:31 (225977): Adding virtual disk drive to VM. (ATLAS_vbox_3.01_image.vdi)
2024-06-16 22:29:32 (225977): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB)
2024-06-16 22:29:32 (225977): forwarding host port 55383 to guest port 80
2024-06-16 22:29:33 (225977): Enabling remote desktop for VM.
2024-06-16 22:29:34 (225977): Enabling shared directory for VM.
2024-06-16 22:29:35 (225977): Starting VM using VBoxManage interface. (boinc_aea62baf4ba02adc, slot#35)
2024-06-16 22:29:37 (225977): Successfully started VM. (PID = '226460')
2024-06-16 22:29:37 (225977): Reporting VM Process ID to BOINC.
2024-06-16 22:29:37 (225977): Guest Log: BIOS: VirtualBox 7.0.16
2024-06-16 22:29:37 (225977): Guest Log: CPUID EDX: 0x178bfbff
2024-06-16 22:29:37 (225977): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2024-06-16 22:29:37 (225977): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2024-06-16 22:29:37 (225977): VM state change detected. (old = 'poweredoff', new = 'running')
2024-06-16 22:29:37 (225977): Detected: Web Application Enabled (http://localhost:55383)
2024-06-16 22:29:37 (225977): Detected: Remote Desktop Enabled (localhost:35909)
2024-06-16 22:29:37 (225977): Preference change detected
2024-06-16 22:29:37 (225977): Setting CPU throttle for VM. (100%)
2024-06-16 22:29:37 (225977): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2024-06-16 22:29:39 (225977): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2024-06-16 22:29:39 (225977): Guest Log: BIOS: Booting from Hard Disk...
2024-06-16 22:29:43 (225977): Guest Log: BIOS: KBD: unsupported int 16h function 03
2024-06-16 22:29:43 (225977): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2024-06-16 22:29:43 (225977): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2024-06-16 22:29:54 (225977): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2024-06-16 22:29:54 (225977): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2024-06-16 22:30:28 (225977): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2024-06-16 22:30:28 (225977): Guest Log: 00:00:00.000556 main     Log opened 2024-06-16T20:30:27.339042000Z
2024-06-16 22:30:28 (225977): Guest Log: 00:00:00.000900 main     OS Product: Linux
2024-06-16 22:30:28 (225977): Guest Log: 00:00:00.001011 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2024-06-16 22:30:28 (225977): Guest Log: 00:00:00.001082 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2024-06-16 22:30:28 (225977): Guest Log: 00:00:00.001152 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2024-06-16 22:30:28 (225977): Guest Log: 00:00:00.001154 main     Process ID: 1242
2024-06-16 22:30:28 (225977): Guest Log: 00:00:00.001156 main     Package type: LINUX_64BITS_GENERIC
2024-06-16 22:30:28 (225977): Guest Log: 00:00:00.005979 main     5.2.32 r132073 started. Verbose level = 0
2024-06-16 22:30:29 (225977): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2024-06-16 22:30:29 (225977): Guest Log: [INFO] Mounting shared directory
2024-06-16 22:30:29 (225977): Guest Log: [INFO] Checking for init_data.xml
2024-06-16 22:30:38 (225977): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2024-06-16 22:30:38 (225977): Guest Log: [INFO] Detected branch: prod
2024-06-16 22:30:38 (225977): Guest Log: This is the prod version of the ATLAS job wrapper
2024-06-16 22:30:38 (225977): Guest Log: Copying input files
2024-06-16 22:30:48 (225977): Guest Log: Copied input files into RunAtlas.
2024-06-16 22:30:48 (225977): Guest Log: Detected user-configured HTTP proxy at http://192.168.1.179:3128 - will set in /etc/cvmfs/default.local
2024-06-16 22:30:58 (225977): Guest Log: Running cvmfs_config stat atlas.cern.ch
2024-06-16 22:30:59 (225977): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2024-06-16 22:30:59 (225977): Guest Log: 2.6.3.0 1514 0 29756 133950 4 1 3119736 4096000 0 65024 0 0 n/a 1141 1987 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.1.179:3128 1
2024-06-16 22:31:01 (225977): Guest Log: copied the webapp to /var/www
2024-06-16 22:31:01 (225977): Guest Log: core_number=1
2024-06-16 22:31:01 (225977): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2024-06-16 22:31:01 (225977): Guest Log:  *** Starting ATLAS job. (PandaID=6232587987 taskID=38920995) ***
2024-06-17 00:08:38 (225977): Status Report: Elapsed Time: '6000.000000'
2024-06-17 00:08:38 (225977): Status Report: CPU Time: '5263.520000'
2024-06-17 01:47:38 (225977): Status Report: Elapsed Time: '12000.000000'
2024-06-17 01:47:38 (225977): Status Report: CPU Time: '11216.910000'
2024-06-17 03:26:39 (225977): Status Report: Elapsed Time: '18000.000000'
2024-06-17 03:26:39 (225977): Status Report: CPU Time: '17170.750000'
2024-06-17 05:05:40 (225977): Status Report: Elapsed Time: '24000.000000'
2024-06-17 05:05:40 (225977): Status Report: CPU Time: '23124.830000'
2024-06-17 06:44:41 (225977): Status Report: Elapsed Time: '30000.000000'
2024-06-17 06:44:41 (225977): Status Report: CPU Time: '29081.000000'
2024-06-17 08:23:42 (225977): Status Report: Elapsed Time: '36000.000000'
2024-06-17 08:23:42 (225977): Status Report: CPU Time: '35035.090000'
2024-06-17 10:02:43 (225977): Status Report: Elapsed Time: '42000.000000'
2024-06-17 10:02:43 (225977): Status Report: CPU Time: '40989.230000'
2024-06-17 11:41:44 (225977): Status Report: Elapsed Time: '48000.000000'
2024-06-17 11:41:44 (225977): Status Report: CPU Time: '46944.870000'
2024-06-17 13:20:45 (225977): Status Report: Elapsed Time: '54000.000000'
2024-06-17 13:20:45 (225977): Status Report: CPU Time: '52898.690000'
2024-06-17 14:59:46 (225977): Status Report: Elapsed Time: '60000.000000'
2024-06-17 14:59:46 (225977): Status Report: CPU Time: '58851.770000'
2024-06-17 16:38:47 (225977): Status Report: Elapsed Time: '66000.000000'
2024-06-17 16:38:47 (225977): Status Report: CPU Time: '64804.560000'
2024-06-17 18:17:48 (225977): Status Report: Elapsed Time: '72000.000000'
2024-06-17 18:17:48 (225977): Status Report: CPU Time: '70760.260000'
2024-06-17 19:16:39 (225977): Stopping VM.
2024-06-17 19:17:18 (225977): Successfully stopped VM.
2024-06-17 19:18:28 (381566): Detected: vboxwrapper 26206
2024-06-17 19:18:28 (381566): Detected: BOINC client v8.0.3
2024-06-17 19:18:29 (381566): Detected: VirtualBox VboxManage Interface (Version: 7.0.16)
2024-06-17 19:18:31 (381566): Guest Log: BIOS: VirtualBox 7.0.16
2024-06-17 19:18:31 (381566): Guest Log: CPUID EDX: 0x178bfbff
2024-06-17 19:18:31 (381566): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2024-06-17 19:18:31 (381566): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2024-06-17 19:18:31 (381566): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2024-06-17 19:18:31 (381566): Guest Log: BIOS: Booting from Hard Disk...
2024-06-17 19:18:31 (381566): Guest Log: BIOS: KBD: unsupported int 16h function 03
2024-06-17 19:18:31 (381566): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2024-06-17 19:18:31 (381566): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2024-06-17 19:18:31 (381566): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2024-06-17 19:18:31 (381566): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2024-06-17 19:18:31 (381566): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2024-06-17 19:18:31 (381566): Guest Log: 00:00:00.000556 main     Log opened 2024-06-16T20:30:27.339042000Z
2024-06-17 19:18:31 (381566): Guest Log: 00:00:00.000900 main     OS Product: Linux
2024-06-17 19:18:31 (381566): Guest Log: 00:00:00.001011 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2024-06-17 19:18:31 (381566): Guest Log: 00:00:00.001082 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2024-06-17 19:18:31 (381566): Guest Log: 00:00:00.001152 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2024-06-17 19:18:31 (381566): Guest Log: 00:00:00.001154 main     Process ID: 1242
2024-06-17 19:18:31 (381566): Guest Log: 00:00:00.001156 main     Package type: LINUX_64BITS_GENERIC
2024-06-17 19:18:31 (381566): Guest Log: 00:00:00.005979 main     5.2.32 r132073 started. Verbose level = 0
2024-06-17 19:18:31 (381566): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2024-06-17 19:18:31 (381566): Guest Log: [INFO] Mounting shared directory
2024-06-17 19:18:31 (381566): Guest Log: [INFO] Checking for init_data.xml
2024-06-17 19:18:31 (381566): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2024-06-17 19:18:31 (381566): Guest Log: [INFO] Detected branch: prod
2024-06-17 19:18:31 (381566): Guest Log: This is the prod version of the ATLAS job wrapper
2024-06-17 19:18:31 (381566): Guest Log: Copying input files
2024-06-17 19:18:31 (381566): Guest Log: Copied input files into RunAtlas.
2024-06-17 19:18:31 (381566): Guest Log: Detected user-configured HTTP proxy at http://192.168.1.179:3128 - will set in /etc/cvmfs/default.local
2024-06-17 19:18:31 (381566): Guest Log: Running cvmfs_config stat atlas.cern.ch
2024-06-17 19:18:31 (381566): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2024-06-17 19:18:31 (381566): Guest Log: 2.6.3.0 1514 0 29756 133950 4 1 3119736 4096000 0 65024 0 0 n/a 1141 1987 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.1.179:3128 1
2024-06-17 19:18:31 (381566): Guest Log: copied the webapp to /var/www
2024-06-17 19:18:31 (381566): Guest Log: core_number=1
2024-06-17 19:18:31 (381566): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2024-06-17 19:18:31 (381566): Guest Log:  *** Starting ATLAS job. (PandaID=6232587987 taskID=38920995) ***
2024-06-17 19:18:31 (381566): Starting VM using VBoxManage interface. (boinc_aea62baf4ba02adc, slot#35)
2024-06-17 19:19:02 (381566): Successfully started VM. (PID = '384840')
2024-06-17 19:19:02 (381566): Reporting VM Process ID to BOINC.
2024-06-17 19:19:02 (381566): VM state change detected. (old = 'poweredoff', new = 'running')
2024-06-17 19:19:02 (381566): Detected: Web Application Enabled (http://localhost:55383)
2024-06-17 19:19:02 (381566): Detected: Remote Desktop Enabled (localhost:35909)
2024-06-17 19:19:02 (381566): Status Report: Elapsed Time: '75566.000000'
2024-06-17 19:19:02 (381566): Status Report: CPU Time: '74293.070000'
2024-06-17 19:19:02 (381566): Preference change detected
2024-06-17 19:19:02 (381566): Setting CPU throttle for VM. (100%)
2024-06-17 19:19:03 (381566): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2024-06-17 20:58:03 (381566): Status Report: Elapsed Time: '81566.000000'
2024-06-17 20:58:03 (381566): Status Report: CPU Time: '80269.790000'
2024-06-17 22:37:04 (381566): Status Report: Elapsed Time: '87566.000000'
2024-06-17 22:37:04 (381566): Status Report: CPU Time: '86223.480000'
2024-06-18 00:16:05 (381566): Status Report: Elapsed Time: '93566.000000'
2024-06-18 00:16:05 (381566): Status Report: CPU Time: '92179.480000'
2024-06-18 01:55:06 (381566): Status Report: Elapsed Time: '99566.000000'
2024-06-18 01:55:06 (381566): Status Report: CPU Time: '98134.330000'
2024-06-18 03:34:07 (381566): Status Report: Elapsed Time: '105566.000000'
2024-06-18 03:34:07 (381566): Status Report: CPU Time: '104088.910000'
2024-06-18 05:13:08 (381566): Status Report: Elapsed Time: '111566.000000'
2024-06-18 05:13:08 (381566): Status Report: CPU Time: '110044.330000'
2024-06-18 06:52:09 (381566): Status Report: Elapsed Time: '117566.000000'
2024-06-18 06:52:09 (381566): Status Report: CPU Time: '115998.600000'
2024-06-18 08:31:10 (381566): Status Report: Elapsed Time: '123566.000000'
2024-06-18 08:31:10 (381566): Status Report: CPU Time: '121952.470000'
2024-06-18 10:10:11 (381566): Status Report: Elapsed Time: '129566.000000'
2024-06-18 10:10:11 (381566): Status Report: CPU Time: '127905.670000'
2024-06-18 11:49:12 (381566): Status Report: Elapsed Time: '135566.000000'
2024-06-18 11:49:12 (381566): Status Report: CPU Time: '133861.630000'
2024-06-18 13:28:13 (381566): Status Report: Elapsed Time: '141566.000000'
2024-06-18 13:28:13 (381566): Status Report: CPU Time: '139814.930000'
2024-06-18 15:07:14 (381566): Status Report: Elapsed Time: '147566.000000'
2024-06-18 15:07:14 (381566): Status Report: CPU Time: '145764.520000'
2024-06-18 16:46:15 (381566): Status Report: Elapsed Time: '153566.000000'
2024-06-18 16:46:15 (381566): Status Report: CPU Time: '151714.650000'
2024-06-18 18:25:16 (381566): Status Report: Elapsed Time: '159566.000000'
2024-06-18 18:25:16 (381566): Status Report: CPU Time: '157667.380000'
2024-06-18 20:04:17 (381566): Status Report: Elapsed Time: '165566.000000'
2024-06-18 20:04:17 (381566): Status Report: CPU Time: '163618.720000'
2024-06-18 21:43:18 (381566): Status Report: Elapsed Time: '171566.000000'
2024-06-18 21:43:18 (381566): Status Report: CPU Time: '169568.800000'
2024-06-18 23:22:19 (381566): Status Report: Elapsed Time: '177566.000000'
2024-06-18 23:22:19 (381566): Status Report: CPU Time: '175520.960000'
2024-06-19 00:19:24 (381566): Preference change detected
2024-06-19 00:19:24 (381566): Setting CPU throttle for VM. (100%)
2024-06-19 00:19:25 (381566): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2024-06-19 01:01:20 (381566): Status Report: Elapsed Time: '183566.060712'
2024-06-19 01:01:20 (381566): Status Report: CPU Time: '181471.190000'
2024-06-19 02:40:21 (381566): Status Report: Elapsed Time: '189566.060712'
2024-06-19 02:40:21 (381566): Status Report: CPU Time: '187422.420000'
2024-06-19 04:19:22 (381566): Status Report: Elapsed Time: '195566.060712'
2024-06-19 04:19:22 (381566): Status Report: CPU Time: '193373.760000'
2024-06-19 05:58:23 (381566): Status Report: Elapsed Time: '201566.060712'
2024-06-19 05:58:23 (381566): Status Report: CPU Time: '199326.420000'
2024-06-19 07:37:24 (381566): Status Report: Elapsed Time: '207566.060712'
2024-06-19 07:37:24 (381566): Status Report: CPU Time: '205276.980000'
2024-06-19 09:16:25 (381566): Status Report: Elapsed Time: '213566.060712'
2024-06-19 09:16:25 (381566): Status Report: CPU Time: '211228.420000'
2024-06-19 10:55:26 (381566): Status Report: Elapsed Time: '219566.060712'
2024-06-19 10:55:26 (381566): Status Report: CPU Time: '217180.340000'
2024-06-19 12:34:27 (381566): Status Report: Elapsed Time: '225566.060712'
2024-06-19 12:34:27 (381566): Status Report: CPU Time: '223133.820000'
2024-06-19 14:13:28 (381566): Status Report: Elapsed Time: '231566.060712'
2024-06-19 14:13:28 (381566): Status Report: CPU Time: '229085.050000'
2024-06-19 15:52:29 (381566): Status Report: Elapsed Time: '237566.060712'
2024-06-19 15:52:29 (381566): Status Report: CPU Time: '235036.430000'
2024-06-19 17:31:30 (381566): Status Report: Elapsed Time: '243566.060712'
2024-06-19 17:31:30 (381566): Status Report: CPU Time: '240988.050000'
2024-06-19 19:10:30 (381566): Status Report: Elapsed Time: '249566.060712'
2024-06-19 19:10:30 (381566): Status Report: CPU Time: '246939.210000'
2024-06-19 20:49:31 (381566): Status Report: Elapsed Time: '255566.060712'
2024-06-19 20:49:31 (381566): Status Report: CPU Time: '252889.820000'
2024-06-19 22:28:32 (381566): Status Report: Elapsed Time: '261566.060712'
2024-06-19 22:28:32 (381566): Status Report: CPU Time: '258839.580000'
2024-06-20 00:07:33 (381566): Status Report: Elapsed Time: '267566.060712'
2024-06-20 00:07:33 (381566): Status Report: CPU Time: '264793.650000'
2024-06-20 01:46:34 (381566): Status Report: Elapsed Time: '273566.060712'
2024-06-20 01:46:34 (381566): Status Report: CPU Time: '270745.890000'
2024-06-20 03:25:35 (381566): Status Report: Elapsed Time: '279566.060712'
2024-06-20 03:25:35 (381566): Status Report: CPU Time: '276696.990000'
2024-06-20 05:04:36 (381566): Status Report: Elapsed Time: '285566.060712'
2024-06-20 05:04:36 (381566): Status Report: CPU Time: '282646.960000'
2024-06-20 06:43:37 (381566): Status Report: Elapsed Time: '291566.060712'
2024-06-20 06:43:37 (381566): Status Report: CPU Time: '288598.230000'
2024-06-20 08:22:38 (381566): Status Report: Elapsed Time: '297566.060712'
2024-06-20 08:22:38 (381566): Status Report: CPU Time: '294548.300000'
2024-06-20 10:01:39 (381566): Status Report: Elapsed Time: '303566.060712'
2024-06-20 10:01:39 (381566): Status Report: CPU Time: '300498.540000'
2024-06-20 11:40:40 (381566): Status Report: Elapsed Time: '309566.060712'
2024-06-20 11:40:40 (381566): Status Report: CPU Time: '306450.750000'
2024-06-20 13:19:41 (381566): Status Report: Elapsed Time: '315566.060712'
2024-06-20 13:19:41 (381566): Status Report: CPU Time: '312400.990000'
2024-06-20 14:58:42 (381566): Status Report: Elapsed Time: '321566.060712'
2024-06-20 14:58:42 (381566): Status Report: CPU Time: '318351.100000'
2024-06-20 16:37:43 (381566): Status Report: Elapsed Time: '327566.060712'
2024-06-20 16:37:43 (381566): Status Report: CPU Time: '324301.320000'
2024-06-20 18:16:44 (381566): Status Report: Elapsed Time: '333566.060712'
2024-06-20 18:16:44 (381566): Status Report: CPU Time: '330253.620000'
2024-06-20 19:55:45 (381566): Status Report: Elapsed Time: '339566.060712'
2024-06-20 19:55:45 (381566): Status Report: CPU Time: '336205.050000'
2024-06-20 21:34:46 (381566): Status Report: Elapsed Time: '345566.060712'
2024-06-20 21:34:46 (381566): Status Report: CPU Time: '342156.300000'
2024-06-20 23:13:47 (381566): Status Report: Elapsed Time: '351566.060712'
2024-06-20 23:13:47 (381566): Status Report: CPU Time: '348107.850000'
2024-06-21 00:52:48 (381566): Status Report: Elapsed Time: '357566.060712'
2024-06-21 00:52:48 (381566): Status Report: CPU Time: '354058.610000'
2024-06-21 02:31:49 (381566): Status Report: Elapsed Time: '363566.060712'
2024-06-21 02:31:49 (381566): Status Report: CPU Time: '360008.820000'
2024-06-21 04:10:50 (381566): Status Report: Elapsed Time: '369566.060712'
2024-06-21 04:10:50 (381566): Status Report: CPU Time: '365960.220000'
2024-06-21 05:49:51 (381566): Status Report: Elapsed Time: '375566.060712'
2024-06-21 05:49:51 (381566): Status Report: CPU Time: '371913.380000'
2024-06-21 07:28:52 (381566): Status Report: Elapsed Time: '381566.060712'
2024-06-21 07:28:52 (381566): Status Report: CPU Time: '377866.830000'
2024-06-21 09:07:53 (381566): Status Report: Elapsed Time: '387566.060712'
2024-06-21 09:07:53 (381566): Status Report: CPU Time: '383820.370000'
2024-06-21 10:46:54 (381566): Status Report: Elapsed Time: '393566.060712'
2024-06-21 10:46:54 (381566): Status Report: CPU Time: '389773.690000'
2024-06-21 12:25:55 (381566): Status Report: Elapsed Time: '399566.060712'
2024-06-21 12:25:55 (381566): Status Report: CPU Time: '395729.740000'
2024-06-21 14:04:56 (381566): Status Report: Elapsed Time: '405566.060712'
2024-06-21 14:04:56 (381566): Status Report: CPU Time: '401684.270000'
2024-06-21 15:43:57 (381566): Status Report: Elapsed Time: '411566.060712'
2024-06-21 15:43:57 (381566): Status Report: CPU Time: '407638.440000'
2024-06-21 17:22:58 (381566): Status Report: Elapsed Time: '417566.060712'
2024-06-21 17:22:58 (381566): Status Report: CPU Time: '413595.830000'
2024-06-21 19:01:59 (381566): Status Report: Elapsed Time: '423566.060712'
2024-06-21 19:01:59 (381566): Status Report: CPU Time: '419550.740000'
2024-06-21 19:18:23 (381566): Stopping VM.
2024-06-21 19:19:01 (381566): Successfully stopped VM.
2024-06-21 19:22:55 (4412): Detected: vboxwrapper 26206
2024-06-21 19:22:55 (4412): Detected: BOINC client v8.0.3
2024-06-21 19:22:56 (4412): Detected: VirtualBox VboxManage Interface (Version: 7.0.16)
2024-06-21 19:22:58 (4412): Starting VM using VBoxManage interface. (boinc_aea62baf4ba02adc, slot#35)
2024-06-21 19:23:15 (4412): Successfully started VM. (PID = '8122')
2024-06-21 19:23:15 (4412): Reporting VM Process ID to BOINC.
2024-06-21 19:23:15 (4412): VM state change detected. (old = 'poweredoff', new = 'running')
2024-06-21 19:23:15 (4412): Detected: Web Application Enabled (http://localhost:55383)
2024-06-21 19:23:15 (4412): Detected: Remote Desktop Enabled (localhost:35909)
2024-06-21 19:23:15 (4412): Status Report: Elapsed Time: '424560.060712'
2024-06-21 19:23:15 (4412): Status Report: CPU Time: '420532.810000'
2024-06-21 19:23:15 (4412): Preference change detected
2024-06-21 19:23:15 (4412): Setting CPU throttle for VM. (100%)
2024-06-21 19:23:17 (4412): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2024-06-21 20:58:14 (4412): Preference change detected
2024-06-21 20:58:14 (4412): Setting CPU throttle for VM. (100%)
2024-06-21 20:58:16 (4412): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2024-06-21 21:02:16 (4412): Status Report: Elapsed Time: '430560.196240'
2024-06-21 21:02:16 (4412): Status Report: CPU Time: '426504.180000'
2024-06-21 22:41:17 (4412): Status Report: Elapsed Time: '436560.196240'
2024-06-21 22:41:17 (4412): Status Report: CPU Time: '432454.840000'
2024-06-22 00:20:18 (4412): Status Report: Elapsed Time: '442560.196240'
2024-06-22 00:20:18 (4412): Status Report: CPU Time: '438408.210000'
2024-06-22 01:59:19 (4412): Status Report: Elapsed Time: '448560.196240'
2024-06-22 01:59:19 (4412): Status Report: CPU Time: '444358.700000'
2024-06-22 03:38:20 (4412): Status Report: Elapsed Time: '454560.196240'
2024-06-22 03:38:20 (4412): Status Report: CPU Time: '450310.280000'
2024-06-22 05:17:21 (4412): Status Report: Elapsed Time: '460560.196240'
2024-06-22 05:17:21 (4412): Status Report: CPU Time: '456263.320000'
2024-06-22 06:56:22 (4412): Status Report: Elapsed Time: '466560.196240'
2024-06-22 06:56:22 (4412): Status Report: CPU Time: '462215.370000'
2024-06-22 08:31:40 (4412): Guest Log:  *** Job finished ***
2024-06-22 08:31:40 (4412): Guest Log:  *** The last 20 lines of the pilot log: ***
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:30,007 | INFO     | [data] copytool_out thread has finished
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:30,109 | INFO     | [job] queue monitor thread has finished
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:31,174 | INFO     | [data] queue_monitor thread has finished
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:33,092 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140563725633344)>', '<ExcThread(monitor, started 140563072415488)>']
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:33,721 | WARNING  | job_aborted has been set - aborting pilot monitoring
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:33,722 | INFO     | [monitor] control thread has ended
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,098 | INFO     | all workflow threads have been joined
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,099 | INFO     | end of generic workflow (traces error code: 0)
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,100 | INFO     | traces error code: 0
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,101 | INFO     | pilot has finished (exit code=0, shell exit code=0)
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,371 [wrapper] ==== pilot stdout END ====
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,384 [wrapper] ==== wrapper stdout RESUME ====
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,396 [wrapper] pilotpid: 6332
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,408 [wrapper] Pilot exit status: 0
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,472 [wrapper] pandaids: 6232587987
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,548 [wrapper] cleanup supervisor_pilot  9199 6333
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,564 [wrapper] Test setup, not cleaning
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,578 [wrapper] ==== wrapper stdout END ====
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,594 [wrapper] ==== wrapper stderr END ====
2024-06-22 08:31:40 (4412): Guest Log: 2024-06-22 06:31:38,621 [wrapper] apfmon messages muted
2024-06-22 08:31:40 (4412): Guest Log:  *** Error codes and diagnostics ***
2024-06-22 08:31:40 (4412): Guest Log:     "exeErrorCode": 0,
2024-06-22 08:31:40 (4412): Guest Log:     "exeErrorDiag": "",
2024-06-22 08:31:40 (4412): Guest Log:     "pilotErrorCode": 0,
2024-06-22 08:31:40 (4412): Guest Log:     "pilotErrorDiag": "",
2024-06-22 08:31:40 (4412): Guest Log:  *** Listing of results directory ***
2024-06-22 08:31:41 (4412): Guest Log: total 834008
2024-06-22 08:31:41 (4412): Guest Log: -rw-r--r--. 1 atlas atlas    469766 Jun 16 14:12 pilot3.tar.gz
2024-06-22 08:31:41 (4412): Guest Log: -rw-r--r--. 1 atlas atlas      5654 Jun 16 14:31 queuedata.json
2024-06-22 08:31:41 (4412): Guest Log: -rwx------. 1 atlas atlas     32308 Jun 16 14:31 runpilot2-wrapper.sh
2024-06-22 08:31:41 (4412): Guest Log: -rw-r--r--. 1 atlas atlas    482525 Jun 16 20:30 input.tar.gz
2024-06-22 08:31:41 (4412): Guest Log: -rw-r--r--. 1 atlas atlas     17537 Jun 16 20:30 start_atlas.sh
2024-06-22 08:31:41 (4412): Guest Log: -rw-r--r--. 1 atlas atlas      9665 Jun 16 20:30 init_data.xml
2024-06-22 08:31:41 (4412): Guest Log: lrwxrwxrwx. 1 atlas atlas        20 Jun 16 20:30 EVNT.38776180._000914.pool.root.1 -> /data/./ATLAS.root_0
2024-06-22 08:31:41 (4412): Guest Log: -rw-r--r--. 1 atlas atlas      2615 Jun 16 20:31 pandaJob.out
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas       460 Jun 16 20:31 setup.sh.local
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas   1021038 Jun 16 20:31 agis_schedconf.cvmfs.json
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas   1316805 Jun 16 20:31 cric_ddmendpoints.json
2024-06-22 08:31:41 (4412): Guest Log: drwx------. 4 atlas atlas      4096 Jun 16 20:31 pilot3
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas 345978126 Jun 22 06:27 HITS.38920995._054193.pool.root.1
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas      1035 Jun 22 06:29 memory_monitor_summary.json
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas         0 Jun 22 06:29 agis_ddmendpoints.agis.ALL.json
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas  38422648 Jun 22 06:30 log.38920995._054193.job.log.tgz.1
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas        96 Jun 22 06:31 pilot_heartbeat.json
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas      7748 Jun 22 06:31 heartbeat.json
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas      4271 Jun 22 06:31 pilotlog.txt
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas 213868487 Jun 22 06:31 log.38920995._054193.job.log.1
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas       357 Jun 22 06:31 output.list
2024-06-22 08:31:41 (4412): Guest Log: -rw-r--r--. 1 atlas atlas       620 Jun 22 06:31 runtime_log
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas 252313600 Jun 22 06:31 result.tar.gz
2024-06-22 08:31:41 (4412): Guest Log: -rw-r--r--. 1 atlas atlas     11174 Jun 22 06:31 runtime_log.err
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas       657 Jun 22 06:31 NzOKDmE65c5n7Olcko1bjSoqABFKDmABFKDmOtvXDmjcpKDm0unWQn.diag
2024-06-22 08:31:41 (4412): Guest Log: Looking for outputfile HITS.38920995._054193.pool.root.1
2024-06-22 08:31:41 (4412): Guest Log: HITS file was successfully produced
2024-06-22 08:31:41 (4412): Guest Log: -rw-------. 1 atlas atlas 345978126 Jun 22 06:27 /home/atlas/RunAtlas/HITS.38920995._054193.pool.root.1
2024-06-22 08:31:41 (4412): Guest Log: Successfully finished the ATLAS job!
2024-06-22 08:31:41 (4412): Guest Log: Copying the results back to the shared directory!
2024-06-22 08:31:46 (4412): Guest Log:  *** Contents of shared directory: ***
2024-06-22 08:31:46 (4412): Guest Log: total 868536
2024-06-22 08:31:46 (4412): Guest Log: -rw-rw-r--. 1 root root 636546871 Jun 16 20:29 ATLAS.root_0
2024-06-22 08:31:46 (4412): Guest Log: -rw-rw-r--. 1 root root      9665 Jun 16 20:29 init_data.xml
2024-06-22 08:31:46 (4412): Guest Log: -rw-rw-r--. 1 root root    482525 Jun 16 20:29 input.tar.gz
2024-06-22 08:31:46 (4412): Guest Log: -rw-r--r--. 1 root root 252313600 Jun 22 06:31 result.tar.gz
2024-06-22 08:31:46 (4412): Guest Log: -rw-rw-r--. 1 root root     17537 Jun 16 20:29 start_atlas.sh
2024-06-22 08:31:46 (4412): Guest Log:  *** Success! Shutting down the machine. ***
2024-06-22 08:31:47 (4412): VM Completion File Detected.
2024-06-22 08:31:47 (4412): Powering off VM.
2024-06-22 08:31:50 (4412): Successfully stopped VM.
2024-06-22 08:31:50 (4412): Deregistering VM. (boinc_aea62baf4ba02adc, slot#35)
2024-06-22 08:31:50 (4412): Removing network bandwidth throttle group from VM.
2024-06-22 08:31:51 (4412): Removing VM from VirtualBox.
08:31:56 (4412): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>NzOKDmE65c5n7Olcko1bjSoqABFKDmABFKDmOtvXDmjcpKDm0unWQn_0_r917597507_ATLAS_result</file_name>
  <error_code>-131 (file size too big)</error_code>
</file_xfer_error>
</message>
]]>


©2024 CERN