Name RhLNDmQC6c5nsSi4ap6QjLDmwznN0nGgGQJmpmIZDmZHhKDm0E4yGn_0
Workunit 223631556
Created 16 Jun 2024, 14:38:36 UTC
Sent 16 Jun 2024, 20:27:07 UTC
Report deadline 24 Jun 2024, 20:27:07 UTC
Received 22 Jun 2024, 7:59:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 10836791
Run time 5 days 10 hours 23 min 15 sec
CPU time 5 days 10 hours 26 min 54 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 19.99 GFLOPS
Application version ATLAS Simulation v3.01 (vbox64_mt_mcore_atlas)
x86_64-pc-linux-gnu
Peak working set size 4.13 GB
Peak swap size 5.75 GB
Peak disk usage 6.46 GB

Stderr output

<core_client_version>8.0.3</core_client_version>
<![CDATA[
<stderr_txt>
2024-06-16 22:27:34 (225349): Detected: vboxwrapper 26206
2024-06-16 22:27:34 (225349): Detected: BOINC client v8.0.2
2024-06-16 22:27:35 (225349): Detected: VirtualBox VboxManage Interface (Version: 7.0.16)
2024-06-16 22:27:36 (225349): Successfully copied 'init_data.xml' to the shared directory.
2024-06-16 22:27:37 (225349): Create VM. (boinc_85d603498d87dbda, slot#55)
2024-06-16 22:27:37 (225349): Setting Memory Size for VM. (4096MB)
2024-06-16 22:27:38 (225349): Setting CPU Count for VM. (1)
2024-06-16 22:27:38 (225349): Setting Chipset Options for VM.
2024-06-16 22:27:39 (225349): Setting Graphics Controller Options for VM.
2024-06-16 22:27:39 (225349): Setting Boot Options for VM.
2024-06-16 22:27:40 (225349): Setting Network Configuration for NAT.
2024-06-16 22:27:40 (225349): Enabling VM Network Access.
2024-06-16 22:27:41 (225349): Disabling USB Support for VM.
2024-06-16 22:27:41 (225349): Disabling COM Port Support for VM.
2024-06-16 22:27:41 (225349): Disabling LPT Port Support for VM.
2024-06-16 22:27:42 (225349): Disabling Audio Support for VM.
2024-06-16 22:27:42 (225349): Disabling Clipboard Support for VM.
2024-06-16 22:27:43 (225349): Disabling Drag and Drop Support for VM.
2024-06-16 22:27:43 (225349): Adding storage controller(s) to VM.
2024-06-16 22:27:44 (225349): Adding virtual disk drive to VM. (ATLAS_vbox_3.01_image.vdi)
2024-06-16 22:27:45 (225349): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB)
2024-06-16 22:27:45 (225349): forwarding host port 34109 to guest port 80
2024-06-16 22:27:46 (225349): Enabling remote desktop for VM.
2024-06-16 22:27:46 (225349): Enabling shared directory for VM.
2024-06-16 22:27:48 (225349): Starting VM using VBoxManage interface. (boinc_85d603498d87dbda, slot#55)
2024-06-16 22:27:50 (225349): Successfully started VM. (PID = '225798')
2024-06-16 22:27:50 (225349): Reporting VM Process ID to BOINC.
2024-06-16 22:27:50 (225349): Guest Log: BIOS: VirtualBox 7.0.16
2024-06-16 22:27:50 (225349): Guest Log: CPUID EDX: 0x178bfbff
2024-06-16 22:27:50 (225349): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2024-06-16 22:27:50 (225349): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2024-06-16 22:27:50 (225349): VM state change detected. (old = 'poweredoff', new = 'running')
2024-06-16 22:27:50 (225349): Detected: Web Application Enabled (http://localhost:34109)
2024-06-16 22:27:50 (225349): Detected: Remote Desktop Enabled (localhost:43869)
2024-06-16 22:27:50 (225349): Preference change detected
2024-06-16 22:27:50 (225349): Setting CPU throttle for VM. (100%)
2024-06-16 22:27:50 (225349): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2024-06-16 22:27:52 (225349): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2024-06-16 22:27:52 (225349): Guest Log: BIOS: Booting from Hard Disk...
2024-06-16 22:27:56 (225349): Guest Log: BIOS: KBD: unsupported int 16h function 03
2024-06-16 22:27:56 (225349): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2024-06-16 22:27:56 (225349): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2024-06-16 22:28:05 (225349): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2024-06-16 22:28:05 (225349): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2024-06-16 22:28:39 (225349): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2024-06-16 22:28:39 (225349): Guest Log: 00:00:00.000474 main     Log opened 2024-06-16T20:28:37.384289000Z
2024-06-16 22:28:39 (225349): Guest Log: 00:00:00.000750 main     OS Product: Linux
2024-06-16 22:28:39 (225349): Guest Log: 00:00:00.000818 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2024-06-16 22:28:39 (225349): Guest Log: 00:00:00.000941 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2024-06-16 22:28:39 (225349): Guest Log: 00:00:00.001029 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2024-06-16 22:28:39 (225349): Guest Log: 00:00:00.001031 main     Process ID: 1243
2024-06-16 22:28:39 (225349): Guest Log: 00:00:00.001032 main     Package type: LINUX_64BITS_GENERIC
2024-06-16 22:28:39 (225349): Guest Log: 00:00:00.008355 main     5.2.32 r132073 started. Verbose level = 0
2024-06-16 22:28:39 (225349): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2024-06-16 22:28:39 (225349): Guest Log: [INFO] Mounting shared directory
2024-06-16 22:28:39 (225349): Guest Log: [INFO] Checking for init_data.xml
2024-06-16 22:28:46 (225349): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2024-06-16 22:28:46 (225349): Guest Log: [INFO] Detected branch: prod
2024-06-16 22:28:47 (225349): Guest Log: This is the prod version of the ATLAS job wrapper
2024-06-16 22:28:47 (225349): Guest Log: Copying input files
2024-06-16 22:28:58 (225349): Guest Log: Copied input files into RunAtlas.
2024-06-16 22:28:58 (225349): Guest Log: Detected user-configured HTTP proxy at http://192.168.1.179:3128 - will set in /etc/cvmfs/default.local
2024-06-16 22:29:07 (225349): Guest Log: Running cvmfs_config stat atlas.cern.ch
2024-06-16 22:29:08 (225349): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2024-06-16 22:29:08 (225349): Guest Log: 2.6.3.0 1520 0 29724 133950 3 1 3119736 4096000 0 65024 0 0 n/a 1141 1221 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.1.179:3128 1
2024-06-16 22:29:10 (225349): Guest Log: copied the webapp to /var/www
2024-06-16 22:29:10 (225349): Guest Log: core_number=1
2024-06-16 22:29:10 (225349): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2024-06-16 22:29:10 (225349): Guest Log:  *** Starting ATLAS job. (PandaID=6232590346 taskID=38920995) ***
2024-06-17 00:06:51 (225349): Status Report: Elapsed Time: '6000.000000'
2024-06-17 00:06:51 (225349): Status Report: CPU Time: '5273.290000'
2024-06-17 01:45:51 (225349): Status Report: Elapsed Time: '12000.000000'
2024-06-17 01:45:51 (225349): Status Report: CPU Time: '11227.030000'
2024-06-17 03:24:52 (225349): Status Report: Elapsed Time: '18000.000000'
2024-06-17 03:24:52 (225349): Status Report: CPU Time: '17180.810000'
2024-06-17 05:03:53 (225349): Status Report: Elapsed Time: '24000.000000'
2024-06-17 05:03:53 (225349): Status Report: CPU Time: '23134.970000'
2024-06-17 06:42:54 (225349): Status Report: Elapsed Time: '30000.000000'
2024-06-17 06:42:54 (225349): Status Report: CPU Time: '29091.350000'
2024-06-17 08:21:56 (225349): Status Report: Elapsed Time: '36000.000000'
2024-06-17 08:21:56 (225349): Status Report: CPU Time: '35046.110000'
2024-06-17 10:00:57 (225349): Status Report: Elapsed Time: '42000.000000'
2024-06-17 10:00:57 (225349): Status Report: CPU Time: '41000.320000'
2024-06-17 11:39:58 (225349): Status Report: Elapsed Time: '48000.000000'
2024-06-17 11:39:58 (225349): Status Report: CPU Time: '46956.610000'
2024-06-17 13:18:59 (225349): Status Report: Elapsed Time: '54000.000000'
2024-06-17 13:18:59 (225349): Status Report: CPU Time: '52910.310000'
2024-06-17 14:58:00 (225349): Status Report: Elapsed Time: '60000.000000'
2024-06-17 14:58:00 (225349): Status Report: CPU Time: '58863.460000'
2024-06-17 16:37:01 (225349): Status Report: Elapsed Time: '66000.000000'
2024-06-17 16:37:01 (225349): Status Report: CPU Time: '64817.330000'
2024-06-17 18:16:02 (225349): Status Report: Elapsed Time: '72000.000000'
2024-06-17 18:16:02 (225349): Status Report: CPU Time: '70774.020000'
2024-06-17 19:16:38 (225349): Stopping VM.
2024-06-17 19:17:12 (225349): Successfully stopped VM.
2024-06-17 19:18:28 (381560): Detected: vboxwrapper 26206
2024-06-17 19:18:28 (381560): Detected: BOINC client v8.0.3
2024-06-17 19:19:00 (381560): Detected: VirtualBox VboxManage Interface (Version: 7.0.16)
2024-06-17 19:19:04 (381560): Guest Log: BIOS: VirtualBox 7.0.16
2024-06-17 19:19:04 (381560): Guest Log: CPUID EDX: 0x178bfbff
2024-06-17 19:19:04 (381560): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2024-06-17 19:19:04 (381560): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2024-06-17 19:19:04 (381560): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2024-06-17 19:19:04 (381560): Guest Log: BIOS: Booting from Hard Disk...
2024-06-17 19:19:04 (381560): Guest Log: BIOS: KBD: unsupported int 16h function 03
2024-06-17 19:19:04 (381560): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f
2024-06-17 19:19:04 (381560): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f
2024-06-17 19:19:04 (381560): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2024-06-17 19:19:04 (381560): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2024-06-17 19:19:04 (381560): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2024-06-17 19:19:04 (381560): Guest Log: 00:00:00.000474 main     Log opened 2024-06-16T20:28:37.384289000Z
2024-06-17 19:19:04 (381560): Guest Log: 00:00:00.000750 main     OS Product: Linux
2024-06-17 19:19:04 (381560): Guest Log: 00:00:00.000818 main     OS Release: 3.10.0-957.27.2.el7.x86_64
2024-06-17 19:19:04 (381560): Guest Log: 00:00:00.000941 main     OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2024-06-17 19:19:04 (381560): Guest Log: 00:00:00.001029 main     Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2024-06-17 19:19:04 (381560): Guest Log: 00:00:00.001031 main     Process ID: 1243
2024-06-17 19:19:04 (381560): Guest Log: 00:00:00.001032 main     Package type: LINUX_64BITS_GENERIC
2024-06-17 19:19:04 (381560): Guest Log: 00:00:00.008355 main     5.2.32 r132073 started. Verbose level = 0
2024-06-17 19:19:04 (381560): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch...
2024-06-17 19:19:04 (381560): Guest Log: [INFO] Mounting shared directory
2024-06-17 19:19:04 (381560): Guest Log: [INFO] Checking for init_data.xml
2024-06-17 19:19:04 (381560): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK
2024-06-17 19:19:04 (381560): Guest Log: [INFO] Detected branch: prod
2024-06-17 19:19:04 (381560): Guest Log: This is the prod version of the ATLAS job wrapper
2024-06-17 19:19:04 (381560): Guest Log: Copying input files
2024-06-17 19:19:04 (381560): Guest Log: Copied input files into RunAtlas.
2024-06-17 19:19:04 (381560): Guest Log: Detected user-configured HTTP proxy at http://192.168.1.179:3128 - will set in /etc/cvmfs/default.local
2024-06-17 19:19:04 (381560): Guest Log: Running cvmfs_config stat atlas.cern.ch
2024-06-17 19:19:04 (381560): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2024-06-17 19:19:04 (381560): Guest Log: 2.6.3.0 1520 0 29724 133950 3 1 3119736 4096000 0 65024 0 0 n/a 1141 1221 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.1.179:3128 1
2024-06-17 19:19:04 (381560): Guest Log: copied the webapp to /var/www
2024-06-17 19:19:04 (381560): Guest Log: core_number=1
2024-06-17 19:19:04 (381560): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 
2024-06-17 19:19:04 (381560): Guest Log:  *** Starting ATLAS job. (PandaID=6232590346 taskID=38920995) ***
2024-06-17 19:19:04 (381560): Starting VM using VBoxManage interface. (boinc_85d603498d87dbda, slot#55)
2024-06-17 19:19:35 (381560): Successfully started VM. (PID = '387657')
2024-06-17 19:19:35 (381560): Reporting VM Process ID to BOINC.
2024-06-17 19:19:35 (381560): VM state change detected. (old = 'poweredoff', new = 'running')
2024-06-17 19:19:35 (381560): Detected: Web Application Enabled (http://localhost:34109)
2024-06-17 19:19:35 (381560): Detected: Remote Desktop Enabled (localhost:43869)
2024-06-17 19:19:35 (381560): Status Report: Elapsed Time: '75673.000000'
2024-06-17 19:19:35 (381560): Status Report: CPU Time: '74415.910000'
2024-06-17 19:19:35 (381560): Preference change detected
2024-06-17 19:19:35 (381560): Setting CPU throttle for VM. (100%)
2024-06-17 19:19:36 (381560): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2024-06-17 20:58:36 (381560): Status Report: Elapsed Time: '81673.000000'
2024-06-17 20:58:36 (381560): Status Report: CPU Time: '80395.540000'
2024-06-17 22:37:37 (381560): Status Report: Elapsed Time: '87673.000000'
2024-06-17 22:37:37 (381560): Status Report: CPU Time: '86349.210000'
2024-06-18 00:16:38 (381560): Status Report: Elapsed Time: '93673.000000'
2024-06-18 00:16:38 (381560): Status Report: CPU Time: '92304.320000'
2024-06-18 01:55:39 (381560): Status Report: Elapsed Time: '99673.000000'
2024-06-18 01:55:39 (381560): Status Report: CPU Time: '98259.040000'
2024-06-18 03:34:40 (381560): Status Report: Elapsed Time: '105673.000000'
2024-06-18 03:34:40 (381560): Status Report: CPU Time: '104213.370000'
2024-06-18 05:13:41 (381560): Status Report: Elapsed Time: '111673.000000'
2024-06-18 05:13:41 (381560): Status Report: CPU Time: '110167.350000'
2024-06-18 06:52:42 (381560): Status Report: Elapsed Time: '117673.000000'
2024-06-18 06:52:42 (381560): Status Report: CPU Time: '116123.620000'
2024-06-18 08:31:43 (381560): Status Report: Elapsed Time: '123673.000000'
2024-06-18 08:31:43 (381560): Status Report: CPU Time: '122077.290000'
2024-06-18 10:10:44 (381560): Status Report: Elapsed Time: '129673.000000'
2024-06-18 10:10:44 (381560): Status Report: CPU Time: '128031.550000'
2024-06-18 11:49:45 (381560): Status Report: Elapsed Time: '135673.000000'
2024-06-18 11:49:45 (381560): Status Report: CPU Time: '133987.030000'
2024-06-18 13:28:46 (381560): Status Report: Elapsed Time: '141673.000000'
2024-06-18 13:28:46 (381560): Status Report: CPU Time: '139940.130000'
2024-06-18 15:07:47 (381560): Status Report: Elapsed Time: '147673.000000'
2024-06-18 15:07:47 (381560): Status Report: CPU Time: '145890.800000'
2024-06-18 16:46:48 (381560): Status Report: Elapsed Time: '153673.000000'
2024-06-18 16:46:48 (381560): Status Report: CPU Time: '151840.400000'
2024-06-18 18:25:49 (381560): Status Report: Elapsed Time: '159673.000000'
2024-06-18 18:25:49 (381560): Status Report: CPU Time: '157791.950000'
2024-06-18 20:04:50 (381560): Status Report: Elapsed Time: '165673.000000'
2024-06-18 20:04:50 (381560): Status Report: CPU Time: '163742.880000'
2024-06-18 21:43:51 (381560): Status Report: Elapsed Time: '171673.000000'
2024-06-18 21:43:51 (381560): Status Report: CPU Time: '169693.720000'
2024-06-18 23:22:52 (381560): Status Report: Elapsed Time: '177673.000000'
2024-06-18 23:22:52 (381560): Status Report: CPU Time: '175644.900000'
2024-06-19 00:19:25 (381560): Preference change detected
2024-06-19 00:19:25 (381560): Setting CPU throttle for VM. (100%)
2024-06-19 00:19:27 (381560): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2024-06-19 01:01:53 (381560): Status Report: Elapsed Time: '183673.803762'
2024-06-19 01:01:53 (381560): Status Report: CPU Time: '181595.750000'
2024-06-19 02:40:54 (381560): Status Report: Elapsed Time: '189673.803762'
2024-06-19 02:40:54 (381560): Status Report: CPU Time: '187547.700000'
2024-06-19 04:19:55 (381560): Status Report: Elapsed Time: '195673.803762'
2024-06-19 04:19:55 (381560): Status Report: CPU Time: '193499.660000'
2024-06-19 05:58:56 (381560): Status Report: Elapsed Time: '201673.803762'
2024-06-19 05:58:56 (381560): Status Report: CPU Time: '199452.660000'
2024-06-19 07:37:57 (381560): Status Report: Elapsed Time: '207673.803762'
2024-06-19 07:37:57 (381560): Status Report: CPU Time: '205403.950000'
2024-06-19 09:16:58 (381560): Status Report: Elapsed Time: '213673.803762'
2024-06-19 09:16:58 (381560): Status Report: CPU Time: '211355.020000'
2024-06-19 10:55:59 (381560): Status Report: Elapsed Time: '219673.803762'
2024-06-19 10:55:59 (381560): Status Report: CPU Time: '217306.790000'
2024-06-19 12:35:00 (381560): Status Report: Elapsed Time: '225673.803762'
2024-06-19 12:35:00 (381560): Status Report: CPU Time: '223260.980000'
2024-06-19 14:14:01 (381560): Status Report: Elapsed Time: '231673.803762'
2024-06-19 14:14:01 (381560): Status Report: CPU Time: '229212.210000'
2024-06-19 15:53:02 (381560): Status Report: Elapsed Time: '237673.803762'
2024-06-19 15:53:02 (381560): Status Report: CPU Time: '235162.490000'
2024-06-19 17:32:03 (381560): Status Report: Elapsed Time: '243673.803762'
2024-06-19 17:32:03 (381560): Status Report: CPU Time: '241114.280000'
2024-06-19 19:11:04 (381560): Status Report: Elapsed Time: '249673.803762'
2024-06-19 19:11:04 (381560): Status Report: CPU Time: '247066.680000'
2024-06-19 20:50:05 (381560): Status Report: Elapsed Time: '255673.803762'
2024-06-19 20:50:05 (381560): Status Report: CPU Time: '253018.570000'
2024-06-19 22:29:06 (381560): Status Report: Elapsed Time: '261673.803762'
2024-06-19 22:29:06 (381560): Status Report: CPU Time: '258969.600000'
2024-06-20 00:08:07 (381560): Status Report: Elapsed Time: '267673.803762'
2024-06-20 00:08:07 (381560): Status Report: CPU Time: '264922.990000'
2024-06-20 01:47:08 (381560): Status Report: Elapsed Time: '273673.803762'
2024-06-20 01:47:08 (381560): Status Report: CPU Time: '270874.590000'
2024-06-20 03:26:09 (381560): Status Report: Elapsed Time: '279673.803762'
2024-06-20 03:26:09 (381560): Status Report: CPU Time: '276826.200000'
2024-06-20 05:05:10 (381560): Status Report: Elapsed Time: '285673.803762'
2024-06-20 05:05:10 (381560): Status Report: CPU Time: '282777.450000'
2024-06-20 06:44:11 (381560): Status Report: Elapsed Time: '291673.803762'
2024-06-20 06:44:11 (381560): Status Report: CPU Time: '288728.510000'
2024-06-20 08:23:12 (381560): Status Report: Elapsed Time: '297673.803762'
2024-06-20 08:23:12 (381560): Status Report: CPU Time: '294678.780000'
2024-06-20 10:02:13 (381560): Status Report: Elapsed Time: '303673.803762'
2024-06-20 10:02:13 (381560): Status Report: CPU Time: '300629.560000'
2024-06-20 11:41:14 (381560): Status Report: Elapsed Time: '309673.803762'
2024-06-20 11:41:14 (381560): Status Report: CPU Time: '306581.170000'
2024-06-20 13:20:14 (381560): Status Report: Elapsed Time: '315673.803762'
2024-06-20 13:20:14 (381560): Status Report: CPU Time: '312527.070000'
2024-06-20 14:59:15 (381560): Status Report: Elapsed Time: '321673.803762'
2024-06-20 14:59:15 (381560): Status Report: CPU Time: '318477.730000'
2024-06-20 16:38:16 (381560): Status Report: Elapsed Time: '327673.803762'
2024-06-20 16:38:16 (381560): Status Report: CPU Time: '324427.470000'
2024-06-20 18:17:17 (381560): Status Report: Elapsed Time: '333673.803762'
2024-06-20 18:17:17 (381560): Status Report: CPU Time: '330378.740000'
2024-06-20 19:56:18 (381560): Status Report: Elapsed Time: '339673.803762'
2024-06-20 19:56:18 (381560): Status Report: CPU Time: '336330.330000'
2024-06-20 21:35:19 (381560): Status Report: Elapsed Time: '345673.803762'
2024-06-20 21:35:19 (381560): Status Report: CPU Time: '342280.380000'
2024-06-20 23:14:20 (381560): Status Report: Elapsed Time: '351673.803762'
2024-06-20 23:14:20 (381560): Status Report: CPU Time: '348232.100000'
2024-06-21 00:53:21 (381560): Status Report: Elapsed Time: '357673.803762'
2024-06-21 00:53:21 (381560): Status Report: CPU Time: '354183.110000'
2024-06-21 02:32:22 (381560): Status Report: Elapsed Time: '363673.803762'
2024-06-21 02:32:22 (381560): Status Report: CPU Time: '360133.960000'
2024-06-21 04:11:23 (381560): Status Report: Elapsed Time: '369673.803762'
2024-06-21 04:11:23 (381560): Status Report: CPU Time: '366084.650000'
2024-06-21 05:50:24 (381560): Status Report: Elapsed Time: '375673.803762'
2024-06-21 05:50:24 (381560): Status Report: CPU Time: '372035.860000'
2024-06-21 07:29:25 (381560): Status Report: Elapsed Time: '381673.803762'
2024-06-21 07:29:25 (381560): Status Report: CPU Time: '377988.910000'
2024-06-21 09:08:26 (381560): Status Report: Elapsed Time: '387673.803762'
2024-06-21 09:08:26 (381560): Status Report: CPU Time: '383941.740000'
2024-06-21 10:47:27 (381560): Status Report: Elapsed Time: '393673.803762'
2024-06-21 10:47:27 (381560): Status Report: CPU Time: '389895.280000'
2024-06-21 12:26:28 (381560): Status Report: Elapsed Time: '399673.803762'
2024-06-21 12:26:28 (381560): Status Report: CPU Time: '395850.810000'
2024-06-21 14:05:29 (381560): Status Report: Elapsed Time: '405673.803762'
2024-06-21 14:05:29 (381560): Status Report: CPU Time: '401804.470000'
2024-06-21 15:44:30 (381560): Status Report: Elapsed Time: '411673.803762'
2024-06-21 15:44:30 (381560): Status Report: CPU Time: '407759.540000'
2024-06-21 17:23:31 (381560): Status Report: Elapsed Time: '417673.803762'
2024-06-21 17:23:31 (381560): Status Report: CPU Time: '413716.720000'
2024-06-21 19:02:32 (381560): Status Report: Elapsed Time: '423673.803762'
2024-06-21 19:02:32 (381560): Status Report: CPU Time: '419670.880000'
2024-06-21 19:18:23 (381560): Stopping VM.
2024-06-21 19:19:03 (381560): Successfully stopped VM.
2024-06-21 19:22:55 (4407): Detected: vboxwrapper 26206
2024-06-21 19:22:55 (4407): Detected: BOINC client v8.0.3
2024-06-21 19:23:27 (4407): Detected: VirtualBox VboxManage Interface (Version: 7.0.16)
2024-06-21 19:23:32 (4407): Starting VM using VBoxManage interface. (boinc_85d603498d87dbda, slot#55)
2024-06-21 19:23:57 (4407): Successfully started VM. (PID = '11662')
2024-06-21 19:23:57 (4407): Reporting VM Process ID to BOINC.
2024-06-21 19:23:57 (4407): VM state change detected. (old = 'poweredoff', new = 'running')
2024-06-21 19:23:57 (4407): Detected: Web Application Enabled (http://localhost:34109)
2024-06-21 19:23:57 (4407): Detected: Remote Desktop Enabled (localhost:43869)
2024-06-21 19:23:57 (4407): Status Report: Elapsed Time: '424634.803762'
2024-06-21 19:23:57 (4407): Status Report: CPU Time: '420623.590000'
2024-06-21 19:23:57 (4407): Preference change detected
2024-06-21 19:23:57 (4407): Setting CPU throttle for VM. (100%)
2024-06-21 19:23:58 (4407): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2024-06-21 20:58:14 (4407): Preference change detected
2024-06-21 20:58:14 (4407): Setting CPU throttle for VM. (100%)
2024-06-21 20:58:16 (4407): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds))
2024-06-21 21:02:59 (4407): Status Report: Elapsed Time: '430635.191631'
2024-06-21 21:02:59 (4407): Status Report: CPU Time: '426605.360000'
2024-06-21 22:42:00 (4407): Status Report: Elapsed Time: '436635.191631'
2024-06-21 22:42:00 (4407): Status Report: CPU Time: '432554.490000'
2024-06-22 00:21:01 (4407): Status Report: Elapsed Time: '442635.191631'
2024-06-22 00:21:01 (4407): Status Report: CPU Time: '438506.030000'
2024-06-22 02:00:02 (4407): Status Report: Elapsed Time: '448635.191631'
2024-06-22 02:00:02 (4407): Status Report: CPU Time: '444456.200000'
2024-06-22 03:39:03 (4407): Status Report: Elapsed Time: '454635.191631'
2024-06-22 03:39:03 (4407): Status Report: CPU Time: '450405.650000'
2024-06-22 05:18:04 (4407): Status Report: Elapsed Time: '460635.191631'
2024-06-22 05:18:04 (4407): Status Report: CPU Time: '456358.460000'
2024-06-22 06:57:05 (4407): Status Report: Elapsed Time: '466635.191631'
2024-06-22 06:57:05 (4407): Status Report: CPU Time: '462310.420000'
2024-06-22 08:36:06 (4407): Status Report: Elapsed Time: '472635.191631'
2024-06-22 08:36:06 (4407): Status Report: CPU Time: '468263.050000'
2024-06-22 08:58:52 (4407): Guest Log:  *** Job finished ***
2024-06-22 08:58:52 (4407): Guest Log:  *** The last 20 lines of the pilot log: ***
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:40,523 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:40,969 | INFO     | [job] queue monitor thread has finished
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:44,526 | INFO     | [data] queue_monitor thread has finished
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:44,558 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139648493365056)>', '<ExcThread(monitor, started 139647833335552)>']
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:45,061 | WARNING  | job_aborted has been set - aborting pilot monitoring
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:45,062 | INFO     | [monitor] control thread has ended
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:49,564 | INFO     | all workflow threads have been joined
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:49,565 | INFO     | end of generic workflow (traces error code: 0)
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:49,566 | INFO     | traces error code: 0
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:49,567 | INFO     | pilot has finished (exit code=0, shell exit code=0)
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:49,879 [wrapper] ==== pilot stdout END ====
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:49,896 [wrapper] ==== wrapper stdout RESUME ====
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:49,911 [wrapper] pilotpid: 6339
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:49,926 [wrapper] Pilot exit status: 0
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:50,006 [wrapper] pandaids: 6232590346
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:50,098 [wrapper] cleanup supervisor_pilot 12204 6340
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:50,114 [wrapper] Test setup, not cleaning
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:50,129 [wrapper] ==== wrapper stdout END ====
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:50,144 [wrapper] ==== wrapper stderr END ====
2024-06-22 08:58:52 (4407): Guest Log: 2024-06-22 06:58:50,176 [wrapper] apfmon messages muted
2024-06-22 08:58:52 (4407): Guest Log:  *** Error codes and diagnostics ***
2024-06-22 08:58:52 (4407): Guest Log:     "exeErrorCode": 0,
2024-06-22 08:58:52 (4407): Guest Log:     "exeErrorDiag": "",
2024-06-22 08:58:52 (4407): Guest Log:     "pilotErrorCode": 0,
2024-06-22 08:58:52 (4407): Guest Log:     "pilotErrorDiag": "",
2024-06-22 08:58:52 (4407): Guest Log:  *** Listing of results directory ***
2024-06-22 08:58:53 (4407): Guest Log: total 848772
2024-06-22 08:58:53 (4407): Guest Log: -rw-r--r--. 1 atlas atlas      5654 Jun 16 14:36 queuedata.json
2024-06-22 08:58:53 (4407): Guest Log: -rwx------. 1 atlas atlas     32308 Jun 16 14:38 runpilot2-wrapper.sh
2024-06-22 08:58:53 (4407): Guest Log: -rw-r--r--. 1 atlas atlas    469766 Jun 16 14:38 pilot3.tar.gz
2024-06-22 08:58:53 (4407): Guest Log: -rw-r--r--. 1 atlas atlas    482530 Jun 16 20:28 input.tar.gz
2024-06-22 08:58:53 (4407): Guest Log: -rw-r--r--. 1 atlas atlas     17537 Jun 16 20:28 start_atlas.sh
2024-06-22 08:58:53 (4407): Guest Log: -rw-r--r--. 1 atlas atlas      9665 Jun 16 20:28 init_data.xml
2024-06-22 08:58:53 (4407): Guest Log: lrwxrwxrwx. 1 atlas atlas        20 Jun 16 20:28 EVNT.38776180._000812.pool.root.1 -> /data/./ATLAS.root_0
2024-06-22 08:58:53 (4407): Guest Log: -rw-r--r--. 1 atlas atlas      2612 Jun 16 20:29 pandaJob.out
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas       460 Jun 16 20:29 setup.sh.local
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas   1021038 Jun 16 20:29 agis_schedconf.cvmfs.json
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas   1316805 Jun 16 20:29 cric_ddmendpoints.json
2024-06-22 08:58:53 (4407): Guest Log: drwx------. 4 atlas atlas      4096 Jun 16 20:30 pilot3
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas 353513879 Jun 22 06:53 HITS.38920995._054203.pool.root.1
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas      1035 Jun 22 06:56 memory_monitor_summary.json
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas         0 Jun 22 06:56 agis_ddmendpoints.agis.ALL.json
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas  39318978 Jun 22 06:57 log.38920995._054203.job.log.tgz.1
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas        96 Jun 22 06:58 pilot_heartbeat.json
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas      7745 Jun 22 06:58 heartbeat.json
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas      4580 Jun 22 06:58 pilotlog.txt
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas 216762351 Jun 22 06:58 log.38920995._054203.job.log.1
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas       357 Jun 22 06:58 output.list
2024-06-22 08:58:53 (4407): Guest Log: -rw-r--r--. 1 atlas atlas       620 Jun 22 06:58 runtime_log
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas 256102400 Jun 22 06:58 result.tar.gz
2024-06-22 08:58:53 (4407): Guest Log: -rw-r--r--. 1 atlas atlas     11174 Jun 22 06:58 runtime_log.err
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas       657 Jun 22 06:58 RhLNDmQC6c5nsSi4ap6QjLDmwznN0nGgGQJmpmIZDmZHhKDm0E4yGn.diag
2024-06-22 08:58:53 (4407): Guest Log: Looking for outputfile HITS.38920995._054203.pool.root.1
2024-06-22 08:58:53 (4407): Guest Log: HITS file was successfully produced
2024-06-22 08:58:53 (4407): Guest Log: -rw-------. 1 atlas atlas 353513879 Jun 22 06:53 /home/atlas/RunAtlas/HITS.38920995._054203.pool.root.1
2024-06-22 08:58:53 (4407): Guest Log: Successfully finished the ATLAS job!
2024-06-22 08:58:53 (4407): Guest Log: Copying the results back to the shared directory!
2024-06-22 08:58:58 (4407): Guest Log:  *** Contents of shared directory: ***
2024-06-22 08:58:58 (4407): Guest Log: total 869524
2024-06-22 08:58:58 (4407): Guest Log: -rw-rw-r--. 1 root root 633769617 Jun 16 20:27 ATLAS.root_0
2024-06-22 08:58:58 (4407): Guest Log: -rw-rw-r--. 1 root root      9665 Jun 16 20:27 init_data.xml
2024-06-22 08:58:58 (4407): Guest Log: -rw-rw-r--. 1 root root    482530 Jun 16 20:27 input.tar.gz
2024-06-22 08:58:58 (4407): Guest Log: -rw-r--r--. 1 root root 256102400 Jun 22 06:58 result.tar.gz
2024-06-22 08:58:58 (4407): Guest Log: -rw-rw-r--. 1 root root     17537 Jun 16 20:27 start_atlas.sh
2024-06-22 08:58:58 (4407): Guest Log:  *** Success! Shutting down the machine. ***
2024-06-22 08:58:58 (4407): VM Completion File Detected.
2024-06-22 08:58:58 (4407): Powering off VM.
2024-06-22 08:59:01 (4407): Successfully stopped VM.
2024-06-22 08:59:01 (4407): Deregistering VM. (boinc_85d603498d87dbda, slot#55)
2024-06-22 08:59:01 (4407): Removing network bandwidth throttle group from VM.
2024-06-22 08:59:02 (4407): Removing VM from VirtualBox.
08:59:07 (4407): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>RhLNDmQC6c5nsSi4ap6QjLDmwznN0nGgGQJmpmIZDmZHhKDm0E4yGn_0_r1139917849_ATLAS_result</file_name>
  <error_code>-131 (file size too big)</error_code>
</file_xfer_error>
</message>
]]>


©2024 CERN