| Name | 7GPLDmUWNe5n9Rq4apOajLDm4fhM0noT9bVo2ijZDmX5WKDm95Y2Fn_0 |
| Workunit | 223663175 |
| Created | 20 Jun 2024, 3:20:31 UTC |
| Sent | 20 Jun 2024, 10:33:48 UTC |
| Report deadline | 28 Jun 2024, 10:33:48 UTC |
| Received | 30 Jun 2024, 22:39:17 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 0 (0x00000000) |
| Computer ID | 10331395 |
| Run time | 5 days 11 hours 6 min 46 sec |
| CPU time | 5 days 9 hours 59 min 26 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 3.59 GFLOPS |
| Application version | ATLAS Simulation v3.01 (vbox64_mt_mcore_atlas) windows_x86_64 |
| Peak working set size | 90.70 MB |
| Peak swap size | 111.09 MB |
| Peak disk usage | 6.46 GB |
Stderr output
<core_client_version>7.24.1</core_client_version> <![CDATA[ <stderr_txt> 2024-06-22 15:27:54 (12404): Detected: vboxwrapper 26206 2024-06-22 15:27:54 (12404): Detected: BOINC client v7.24.1 2024-06-22 15:27:56 (12404): Detected: VirtualBox VboxManage Interface (Version: 7.0.14) 2024-06-22 15:27:56 (12404): Successfully copied 'init_data.xml' to the shared directory. 2024-06-22 15:27:57 (12404): Create VM. (boinc_1353552f7843e1aa, slot#2) 2024-06-22 15:27:57 (12404): Setting Memory Size for VM. (4100MB) 2024-06-22 15:27:58 (12404): Setting CPU Count for VM. (1) 2024-06-22 15:27:58 (12404): Setting Chipset Options for VM. 2024-06-22 15:27:59 (12404): Setting Graphics Controller Options for VM. 2024-06-22 15:27:59 (12404): Setting Boot Options for VM. 2024-06-22 15:27:59 (12404): Setting Network Configuration for NAT. 2024-06-22 15:28:00 (12404): Enabling VM Network Access. 2024-06-22 15:28:00 (12404): Disabling USB Support for VM. 2024-06-22 15:28:01 (12404): Disabling COM Port Support for VM. 2024-06-22 15:28:01 (12404): Disabling LPT Port Support for VM. 2024-06-22 15:28:01 (12404): Disabling Audio Support for VM. 2024-06-22 15:28:02 (12404): Disabling Clipboard Support for VM. 2024-06-22 15:28:02 (12404): Disabling Drag and Drop Support for VM. 2024-06-22 15:28:02 (12404): Adding storage controller(s) to VM. 2024-06-22 15:28:03 (12404): Adding virtual disk drive to VM. (ATLAS_vbox_3.01_image.vdi) 2024-06-22 15:28:06 (12404): Adding VirtualBox Guest Additions to VM. 2024-06-22 15:28:07 (12404): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2024-06-22 15:28:07 (12404): forwarding host port 64274 to guest port 80 2024-06-22 15:28:07 (12404): Enabling remote desktop for VM. 2024-06-22 15:28:08 (12404): Enabling shared directory for VM. 2024-06-22 15:28:09 (12404): Starting VM using VBoxManage interface. (boinc_1353552f7843e1aa, slot#2) 2024-06-22 15:28:20 (12404): Successfully started VM. (PID = '27588') 2024-06-22 15:28:20 (12404): Reporting VM Process ID to BOINC. 2024-06-22 15:28:20 (12404): Guest Log: BIOS: VirtualBox 7.0.14 2024-06-22 15:28:20 (12404): Guest Log: CPUID EDX: 0x178bfbff 2024-06-22 15:28:20 (12404): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2024-06-22 15:28:20 (12404): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2024-06-22 15:28:21 (12404): VM state change detected. (old = 'poweredoff', new = 'running') 2024-06-22 15:28:21 (12404): Detected: Web Application Enabled (http://localhost:64274) 2024-06-22 15:28:21 (12404): Detected: Remote Desktop Enabled (localhost:64275) 2024-06-22 15:28:21 (12404): Preference change detected 2024-06-22 15:28:21 (12404): Setting CPU throttle for VM. (100%) 2024-06-22 15:28:21 (12404): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds)) 2024-06-22 15:28:23 (12404): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2024-06-22 15:28:23 (12404): Guest Log: BIOS: Booting from Hard Disk... 2024-06-22 15:28:26 (12404): Guest Log: BIOS: KBD: unsupported int 16h function 03 2024-06-22 15:28:26 (12404): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2024-06-22 15:28:26 (12404): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2024-06-22 15:28:37 (12404): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2024-06-22 15:28:37 (12404): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2024-06-22 15:29:01 (12404): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2024-06-22 15:29:01 (12404): Guest Log: 00:00:00.000366 main Log opened 2024-06-22T15:28:58.291201000Z 2024-06-22 15:29:01 (12404): Guest Log: 00:00:00.000551 main OS Product: Linux 2024-06-22 15:29:01 (12404): Guest Log: 00:00:00.000614 main OS Release: 3.10.0-957.27.2.el7.x86_64 2024-06-22 15:29:01 (12404): Guest Log: 00:00:00.000671 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2024-06-22 15:29:01 (12404): Guest Log: 00:00:00.000762 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2024-06-22 15:29:01 (12404): Guest Log: 00:00:00.000764 main Process ID: 1250 2024-06-22 15:29:01 (12404): Guest Log: 00:00:00.000765 main Package type: LINUX_64BITS_GENERIC 2024-06-22 15:29:01 (12404): Guest Log: 00:00:00.003023 main 5.2.32 r132073 started. Verbose level = 0 2024-06-22 15:29:01 (12404): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2024-06-22 15:29:01 (12404): Guest Log: [INFO] Mounting shared directory 2024-06-22 15:29:02 (12404): Guest Log: [INFO] Checking for init_data.xml 2024-06-22 15:29:11 (12404): Guest Log: 00:00:10.023359 timesync vgsvcTimeSyncWorker: Radical guest time change: 25 212 262 104 000ns (GuestNow=1 719 095 350 575 127 000 ns GuestLast=1 719 070 138 313 023 000 ns fSetTimeLastLoop=true ) 2024-06-22 15:30:02 (12404): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2024-06-22 15:30:02 (12404): Guest Log: [INFO] Detected branch: prod 2024-06-22 15:30:02 (12404): Guest Log: This is the prod version of the ATLAS job wrapper 2024-06-22 15:30:03 (12404): Guest Log: Copying input files 2024-06-22 15:30:13 (12404): Guest Log: Copied input files into RunAtlas. 2024-06-22 15:30:13 (12404): Guest Log: This VM did not configure a local http proxy via BOINC. 2024-06-22 15:30:13 (12404): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2024-06-22 15:30:13 (12404): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2024-06-22 15:30:13 (12404): Guest Log: Further information can be found at the LHC@home message board. 2024-06-22 15:31:25 (12404): Guest Log: Running cvmfs_config stat atlas.cern.ch 2024-06-22 15:31:26 (12404): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2024-06-22 15:31:26 (12404): Guest Log: 2.6.3.0 1548 2 32116 134182 4 1 3117206 4096000 0 65024 0 0 n/a 0 0 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1 2024-06-22 15:31:29 (12404): Guest Log: copied the webapp to /var/www 2024-06-22 15:31:29 (12404): Guest Log: core_number=1 2024-06-22 15:31:29 (12404): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2024-06-22 15:31:30 (12404): Guest Log: *** Starting ATLAS job. (PandaID=6238668825 taskID=38921007) *** 2024-06-22 17:08:26 (12404): Status Report: Elapsed Time: '6000.000000' 2024-06-22 17:08:26 (12404): Status Report: CPU Time: '4857.859375' 2024-06-22 18:48:31 (12404): Status Report: Elapsed Time: '12000.000000' 2024-06-22 18:48:31 (12404): Status Report: CPU Time: '10680.671875' 2024-06-22 20:28:36 (12404): Status Report: Elapsed Time: '18000.000000' 2024-06-22 20:28:36 (12404): Status Report: CPU Time: '16661.406250' 2024-06-22 22:08:42 (12404): Status Report: Elapsed Time: '24000.000000' 2024-06-22 22:08:42 (12404): Status Report: CPU Time: '22663.140625' 2024-06-22 23:48:47 (12404): Status Report: Elapsed Time: '30000.000000' 2024-06-22 23:48:47 (12404): Status Report: CPU Time: '28664.828125' 2024-06-23 01:28:52 (12404): Status Report: Elapsed Time: '36000.000000' 2024-06-23 01:28:52 (12404): Status Report: CPU Time: '34668.718750' 2024-06-23 03:08:57 (12404): Status Report: Elapsed Time: '42000.000000' 2024-06-23 03:08:57 (12404): Status Report: CPU Time: '40672.718750' 2024-06-23 04:49:02 (12404): Status Report: Elapsed Time: '48000.000000' 2024-06-23 04:49:02 (12404): Status Report: CPU Time: '46651.484375' 2024-06-23 06:29:07 (12404): Status Report: Elapsed Time: '54000.000000' 2024-06-23 06:29:07 (12404): Status Report: CPU Time: '52633.281250' 2024-06-23 08:09:12 (12404): Status Report: Elapsed Time: '60000.000000' 2024-06-23 08:09:12 (12404): Status Report: CPU Time: '58633.906250' 2024-06-23 09:49:17 (12404): Status Report: Elapsed Time: '66000.000000' 2024-06-23 09:49:17 (12404): Status Report: CPU Time: '64634.015625' 2024-06-23 11:29:22 (12404): Status Report: Elapsed Time: '72000.000000' 2024-06-23 11:29:22 (12404): Status Report: CPU Time: '70604.718750' 2024-06-23 13:09:28 (12404): Status Report: Elapsed Time: '78000.232342' 2024-06-23 13:09:28 (12404): Status Report: CPU Time: '76531.250000' 2024-06-23 14:38:15 (12404): Stopping VM. 2024-06-23 14:39:02 (12404): Error in stop VM for VM: -182 Command: VBoxManage -q controlvm "boinc_1353552f7843e1aa" savestate Output: 0%...10%...20%...30%...40%...50%...60%...70%...80%...90%... 2024-06-23 14:39:02 (12404): VM did not stop when requested. 2024-06-23 14:39:02 (12404): VM was successfully terminated. 2024-06-23 15:43:42 (33752): Detected: vboxwrapper 26206 2024-06-23 15:43:42 (33752): Detected: BOINC client v7.24.1 2024-06-23 15:43:43 (33752): Detected: VirtualBox VboxManage Interface (Version: 7.0.14) 2024-06-23 15:43:45 (33752): Guest Log: BIOS: VirtualBox 7.0.14 2024-06-23 15:43:45 (33752): Guest Log: CPUID EDX: 0x178bfbff 2024-06-23 15:43:45 (33752): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2024-06-23 15:43:45 (33752): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2024-06-23 15:43:45 (33752): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2024-06-23 15:43:45 (33752): Guest Log: BIOS: Booting from Hard Disk... 2024-06-23 15:43:45 (33752): Guest Log: BIOS: KBD: unsupported int 16h function 03 2024-06-23 15:43:45 (33752): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2024-06-23 15:43:45 (33752): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2024-06-23 15:43:45 (33752): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2024-06-23 15:43:45 (33752): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2024-06-23 15:43:45 (33752): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2024-06-23 15:43:45 (33752): Guest Log: 00:00:00.000366 main Log opened 2024-06-22T15:28:58.291201000Z 2024-06-23 15:43:45 (33752): Guest Log: 00:00:00.000551 main OS Product: Linux 2024-06-23 15:43:45 (33752): Guest Log: 00:00:00.000614 main OS Release: 3.10.0-957.27.2.el7.x86_64 2024-06-23 15:43:45 (33752): Guest Log: 00:00:00.000671 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2024-06-23 15:43:45 (33752): Guest Log: 00:00:00.000762 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2024-06-23 15:43:45 (33752): Guest Log: 00:00:00.000764 main Process ID: 1250 2024-06-23 15:43:45 (33752): Guest Log: 00:00:00.000765 main Package type: LINUX_64BITS_GENERIC 2024-06-23 15:43:45 (33752): Guest Log: 00:00:00.003023 main 5.2.32 r132073 started. Verbose level = 0 2024-06-23 15:43:45 (33752): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2024-06-23 15:43:45 (33752): Guest Log: [INFO] Mounting shared directory 2024-06-23 15:43:45 (33752): Guest Log: [INFO] Checking for init_data.xml 2024-06-23 15:43:45 (33752): Guest Log: 00:00:10.023359 timesync vgsvcTimeSyncWorker: Radical guest time change: 25 212 262 104 000ns (GuestNow=1 719 095 350 575 127 000 ns GuestLast=1 719 070 138 313 023 000 ns fSetTimeLastLoop=true ) 2024-06-23 15:43:45 (33752): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2024-06-23 15:43:45 (33752): Guest Log: [INFO] Detected branch: prod 2024-06-23 15:43:45 (33752): Guest Log: This is the prod version of the ATLAS job wrapper 2024-06-23 15:43:45 (33752): Guest Log: Copying input files 2024-06-23 15:43:45 (33752): Guest Log: Copied input files into RunAtlas. 2024-06-23 15:43:45 (33752): Guest Log: This VM did not configure a local http proxy via BOINC. 2024-06-23 15:43:45 (33752): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2024-06-23 15:43:45 (33752): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2024-06-23 15:43:45 (33752): Guest Log: Further information can be found at the LHC@home message board. 2024-06-23 15:43:45 (33752): Guest Log: Running cvmfs_config stat atlas.cern.ch 2024-06-23 15:43:45 (33752): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2024-06-23 15:43:45 (33752): Guest Log: 2.6.3.0 1548 2 32116 134182 4 1 3117206 4096000 0 65024 0 0 n/a 0 0 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1 2024-06-23 15:43:45 (33752): Guest Log: copied the webapp to /var/www 2024-06-23 15:43:45 (33752): Guest Log: core_number=1 2024-06-23 15:43:45 (33752): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2024-06-23 15:43:45 (33752): Guest Log: *** Starting ATLAS job. (PandaID=6238668825 taskID=38921007) *** 2024-06-23 15:43:45 (33752): Starting VM using VBoxManage interface. (boinc_1353552f7843e1aa, slot#2) 2024-06-23 15:44:38 (33752): Successfully started VM. (PID = '20836') 2024-06-23 15:44:38 (33752): Reporting VM Process ID to BOINC. 2024-06-23 15:44:38 (33752): VM state change detected. (old = 'poweredoff', new = 'running') 2024-06-23 15:44:38 (33752): Detected: Web Application Enabled (http://localhost:64274) 2024-06-23 15:44:38 (33752): Detected: Remote Desktop Enabled (localhost:64275) 2024-06-23 15:44:38 (33752): Status Report: Elapsed Time: '83323.232342' 2024-06-23 15:44:38 (33752): Status Report: CPU Time: '81854.453125' 2024-06-23 15:44:38 (33752): Preference change detected 2024-06-23 15:44:38 (33752): Setting CPU throttle for VM. (100%) 2024-06-23 15:44:39 (33752): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds)) 2024-06-23 15:44:45 (33752): Guest Log: 23:09:23.796208 timesync vgsvcTimeSyncWorker: Radical host time change: 3 990 429 000 000ns (HostNow=1 719 182 684 770 000 000 ns HostLast=1 719 178 694 341 000 000 ns) 2024-06-23 15:44:55 (33752): Guest Log: 23:09:33.816158 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 990 442 314 000ns (GuestNow=1 719 182 694 789 971 000 ns GuestLast=1 719 178 704 347 657 000 ns fSetTimeLastLoop=true ) 2024-06-23 16:49:40 (33752): Stopping VM. 2024-06-23 16:50:22 (33752): Successfully stopped VM. 2024-06-23 18:46:10 (9068): Detected: vboxwrapper 26206 2024-06-23 18:46:10 (9068): Detected: BOINC client v7.24.1 2024-06-23 18:46:10 (9068): Detected: VirtualBox VboxManage Interface (Version: 7.0.14) 2024-06-23 18:46:12 (9068): Guest Log: 23:09:23.796208 timesync vgsvcTimeSyncWorker: Radical host time change: 3 990 429 000 000ns (HostNow=1 719 182 684 770 000 000 ns HostLast=1 719 178 694 341 000 000 ns) 2024-06-23 18:46:12 (9068): Guest Log: 23:09:33.816158 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 990 442 314 000ns (GuestNow=1 719 182 694 789 971 000 ns GuestLast=1 719 178 704 347 657 000 ns fSetTimeLastLoop=true ) 2024-06-23 18:46:12 (9068): Starting VM using VBoxManage interface. (boinc_1353552f7843e1aa, slot#2) 2024-06-23 18:48:00 (9068): Successfully started VM. (PID = '28656') 2024-06-23 18:48:00 (9068): Reporting VM Process ID to BOINC. 2024-06-23 18:48:01 (9068): VM state change detected. (old = 'poweredoff', new = 'running') 2024-06-23 18:48:01 (9068): Detected: Web Application Enabled (http://localhost:64274) 2024-06-23 18:48:01 (9068): Detected: Remote Desktop Enabled (localhost:64275) 2024-06-23 18:48:01 (9068): Status Report: Elapsed Time: '87221.232342' 2024-06-23 18:48:01 (9068): Status Report: CPU Time: '85764.328125' 2024-06-23 18:48:01 (9068): Preference change detected 2024-06-23 18:48:01 (9068): Setting CPU throttle for VM. (100%) 2024-06-23 18:48:02 (9068): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds)) 2024-06-23 18:48:04 (9068): Guest Log: 24:14:25.404243 timesync vgsvcTimeSyncWorker: Radical host time change: 7 108 122 000 000ns (HostNow=1 719 193 684 496 000 000 ns HostLast=1 719 186 576 374 000 000 ns) 2024-06-23 18:48:14 (9068): Guest Log: 24:14:35.412035 timesync vgsvcTimeSyncWorker: Radical guest time change: 7 108 126 256 000ns (GuestNow=1 719 193 694 503 880 000 ns GuestLast=1 719 186 586 377 624 000 ns fSetTimeLastLoop=true ) 2024-06-23 18:51:57 (9068): Stopping VM. 2024-06-23 18:51:58 (9068): CreateProcess failed! (1455). 2024-06-23 18:51:58 (9068): Error in stop VM for VM: -108 Command: VBoxManage -q controlvm "boinc_1353552f7843e1aa" savestate Output: 2024-06-23 18:51:58 (9068): VM did not stop when requested. 2024-06-23 18:51:58 (9068): VM was successfully terminated. 2024-06-26 03:36:47 (44860): Detected: vboxwrapper 26206 2024-06-26 03:36:47 (44860): Detected: BOINC client v7.24.1 2024-06-26 03:36:49 (44860): Detected: VirtualBox VboxManage Interface (Version: 7.0.14) 2024-06-26 03:36:51 (44860): Guest Log: 24:14:25.404243 timesync vgsvcTimeSyncWorker: Radical host time change: 7 108 122 000 000ns (HostNow=1 719 193 684 496 000 000 ns HostLast=1 719 186 576 374 000 000 ns) 2024-06-26 03:36:51 (44860): Guest Log: 24:14:35.412035 timesync vgsvcTimeSyncWorker: Radical guest time change: 7 108 126 256 000ns (GuestNow=1 719 193 694 503 880 000 ns GuestLast=1 719 186 586 377 624 000 ns fSetTimeLastLoop=true ) 2024-06-26 03:36:51 (44860): Starting VM using VBoxManage interface. (boinc_1353552f7843e1aa, slot#2) 2024-06-26 03:37:00 (44860): Successfully started VM. (PID = '31668') 2024-06-26 03:37:00 (44860): Reporting VM Process ID to BOINC. 2024-06-26 03:37:00 (44860): Guest Log: BIOS: VirtualBox 7.0.14 2024-06-26 03:37:00 (44860): Guest Log: CPUID EDX: 0x178bfbff 2024-06-26 03:37:00 (44860): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2024-06-26 03:37:00 (44860): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2024-06-26 03:37:00 (44860): VM state change detected. (old = 'poweredoff', new = 'running') 2024-06-26 03:37:00 (44860): Detected: Web Application Enabled (http://localhost:64274) 2024-06-26 03:37:00 (44860): Detected: Remote Desktop Enabled (localhost:64275) 2024-06-26 03:37:00 (44860): Status Report: Elapsed Time: '87457.721699' 2024-06-26 03:37:00 (44860): Status Report: CPU Time: '85993.125000' 2024-06-26 03:37:00 (44860): Preference change detected 2024-06-26 03:37:00 (44860): Setting CPU throttle for VM. (100%) 2024-06-26 03:37:01 (44860): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds)) 2024-06-26 03:37:02 (44860): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2024-06-26 03:37:02 (44860): Guest Log: BIOS: Booting from Hard Disk... 2024-06-26 03:37:06 (44860): Guest Log: BIOS: KBD: unsupported int 16h function 03 2024-06-26 03:37:06 (44860): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2024-06-26 03:37:06 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2024-06-26 03:37:06 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2024-06-26 03:37:06 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2024-06-26 03:37:06 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2024-06-26 03:37:06 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2024-06-26 03:37:06 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2024-06-26 03:37:06 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2024-06-26 03:37:06 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2024-06-26 03:37:06 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2024-06-26 03:37:06 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2024-06-26 03:37:06 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2024-06-26 03:37:07 (44860): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2024-06-26 03:37:19 (44860): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2024-06-26 03:37:19 (44860): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2024-06-26 03:37:44 (44860): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2024-06-26 03:37:44 (44860): Guest Log: 00:00:00.000261 main Log opened 2024-06-26T03:37:41.747265000Z 2024-06-26 03:37:44 (44860): Guest Log: 00:00:00.000443 main OS Product: Linux 2024-06-26 03:37:44 (44860): Guest Log: 00:00:00.000557 main OS Release: 3.10.0-957.27.2.el7.x86_64 2024-06-26 03:37:44 (44860): Guest Log: 00:00:00.000607 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2024-06-26 03:37:44 (44860): Guest Log: 00:00:00.000655 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2024-06-26 03:37:44 (44860): Guest Log: 00:00:00.000657 main Process ID: 1249 2024-06-26 03:37:44 (44860): Guest Log: 00:00:00.000658 main Package type: LINUX_64BITS_GENERIC 2024-06-26 03:37:44 (44860): Guest Log: 00:00:00.002688 main 5.2.32 r132073 started. Verbose level = 0 2024-06-26 03:37:45 (44860): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2024-06-26 03:37:45 (44860): Guest Log: [INFO] Mounting shared directory 2024-06-26 03:37:45 (44860): Guest Log: [INFO] Checking for init_data.xml 2024-06-26 03:37:54 (44860): Guest Log: 00:00:10.020956 timesync vgsvcTimeSyncWorker: Radical guest time change: 25 211 697 284 000ns (GuestNow=1 719 398 273 464 592 000 ns GuestLast=1 719 373 061 767 308 000 ns fSetTimeLastLoop=true ) 2024-06-26 03:38:53 (44860): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2024-06-26 03:38:53 (44860): Guest Log: [INFO] Detected branch: prod 2024-06-26 03:38:53 (44860): Guest Log: This is the prod version of the ATLAS job wrapper 2024-06-26 03:38:53 (44860): Guest Log: Copying input files 2024-06-26 03:39:14 (44860): Guest Log: Copied input files into RunAtlas. 2024-06-26 03:39:14 (44860): Guest Log: This VM did not configure a local http proxy via BOINC. 2024-06-26 03:39:14 (44860): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2024-06-26 03:39:14 (44860): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2024-06-26 03:39:14 (44860): Guest Log: Further information can be found at the LHC@home message board. 2024-06-26 03:39:27 (44860): Guest Log: Running cvmfs_config stat atlas.cern.ch 2024-06-26 03:39:27 (44860): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2024-06-26 03:39:27 (44860): Guest Log: 2.6.3.0 1547 0 30064 134312 4 1 2372473 4096000 0 65024 0 0 n/a 0 0 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1 2024-06-26 03:39:30 (44860): Guest Log: copied the webapp to /var/www 2024-06-26 03:39:30 (44860): Guest Log: core_number=1 2024-06-26 03:39:31 (44860): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2024-06-26 03:39:31 (44860): Guest Log: *** Starting ATLAS job. (PandaID=6238668825 taskID=38921007) *** 2024-06-26 05:17:21 (44860): Status Report: Elapsed Time: '93457.721699' 2024-06-26 05:17:21 (44860): Status Report: CPU Time: '91151.250000' 2024-06-26 06:57:27 (44860): Status Report: Elapsed Time: '99457.841509' 2024-06-26 06:57:27 (44860): Status Report: CPU Time: '97084.078125' 2024-06-26 08:37:37 (44860): Status Report: Elapsed Time: '105458.209650' 2024-06-26 08:37:37 (44860): Status Report: CPU Time: '103034.062500' 2024-06-26 10:17:42 (44860): Status Report: Elapsed Time: '111458.209650' 2024-06-26 10:17:42 (44860): Status Report: CPU Time: '109016.890625' 2024-06-26 11:57:50 (44860): Status Report: Elapsed Time: '117458.209650' 2024-06-26 11:57:50 (44860): Status Report: CPU Time: '114990.640625' 2024-06-26 13:37:56 (44860): Status Report: Elapsed Time: '123459.177178' 2024-06-26 13:37:56 (44860): Status Report: CPU Time: '120969.765625' 2024-06-26 13:44:03 (44860): Stopping VM. 2024-06-26 13:44:51 (44860): Error in stop VM for VM: -182 Command: VBoxManage -q controlvm "boinc_1353552f7843e1aa" savestate Output: 0%...10%...20%...30%...40%... 2024-06-26 13:44:51 (44860): VM did not stop when requested. 2024-06-26 13:44:51 (44860): VM was successfully terminated. 2024-06-26 14:40:53 (3784): Detected: vboxwrapper 26206 2024-06-26 14:40:53 (3784): Detected: BOINC client v7.24.1 2024-06-26 14:40:54 (3784): Detected: VirtualBox VboxManage Interface (Version: 7.0.14) 2024-06-26 14:40:56 (3784): Guest Log: BIOS: VirtualBox 7.0.14 2024-06-26 14:40:56 (3784): Guest Log: CPUID EDX: 0x178bfbff 2024-06-26 14:40:56 (3784): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2024-06-26 14:40:56 (3784): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2024-06-26 14:40:56 (3784): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2024-06-26 14:40:56 (3784): Guest Log: BIOS: Booting from Hard Disk... 2024-06-26 14:40:56 (3784): Guest Log: BIOS: KBD: unsupported int 16h function 03 2024-06-26 14:40:56 (3784): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2024-06-26 14:40:56 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2024-06-26 14:40:56 (3784): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2024-06-26 14:40:56 (3784): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2024-06-26 14:40:56 (3784): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2024-06-26 14:40:56 (3784): Guest Log: 00:00:00.000261 main Log opened 2024-06-26T03:37:41.747265000Z 2024-06-26 14:40:56 (3784): Guest Log: 00:00:00.000443 main OS Product: Linux 2024-06-26 14:40:56 (3784): Guest Log: 00:00:00.000557 main OS Release: 3.10.0-957.27.2.el7.x86_64 2024-06-26 14:40:56 (3784): Guest Log: 00:00:00.000607 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2024-06-26 14:40:56 (3784): Guest Log: 00:00:00.000655 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2024-06-26 14:40:56 (3784): Guest Log: 00:00:00.000657 main Process ID: 1249 2024-06-26 14:40:56 (3784): Guest Log: 00:00:00.000658 main Package type: LINUX_64BITS_GENERIC 2024-06-26 14:40:56 (3784): Guest Log: 00:00:00.002688 main 5.2.32 r132073 started. Verbose level = 0 2024-06-26 14:40:56 (3784): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2024-06-26 14:40:56 (3784): Guest Log: [INFO] Mounting shared directory 2024-06-26 14:40:56 (3784): Guest Log: [INFO] Checking for init_data.xml 2024-06-26 14:40:56 (3784): Guest Log: 00:00:10.020956 timesync vgsvcTimeSyncWorker: Radical guest time change: 25 211 697 284 000ns (GuestNow=1 719 398 273 464 592 000 ns GuestLast=1 719 373 061 767 308 000 ns fSetTimeLastLoop=true ) 2024-06-26 14:40:56 (3784): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2024-06-26 14:40:56 (3784): Guest Log: [INFO] Detected branch: prod 2024-06-26 14:40:56 (3784): Guest Log: This is the prod version of the ATLAS job wrapper 2024-06-26 14:40:56 (3784): Guest Log: Copying input files 2024-06-26 14:40:56 (3784): Guest Log: Copied input files into RunAtlas. 2024-06-26 14:40:56 (3784): Guest Log: This VM did not configure a local http proxy via BOINC. 2024-06-26 14:40:56 (3784): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2024-06-26 14:40:56 (3784): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2024-06-26 14:40:56 (3784): Guest Log: Further information can be found at the LHC@home message board. 2024-06-26 14:40:56 (3784): Guest Log: Running cvmfs_config stat atlas.cern.ch 2024-06-26 14:40:56 (3784): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2024-06-26 14:40:56 (3784): Guest Log: 2.6.3.0 1547 0 30064 134312 4 1 2372473 4096000 0 65024 0 0 n/a 0 0 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1 2024-06-26 14:40:56 (3784): Guest Log: copied the webapp to /var/www 2024-06-26 14:40:56 (3784): Guest Log: core_number=1 2024-06-26 14:40:56 (3784): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2024-06-26 14:40:56 (3784): Guest Log: *** Starting ATLAS job. (PandaID=6238668825 taskID=38921007) *** 2024-06-26 14:40:56 (3784): Starting VM using VBoxManage interface. (boinc_1353552f7843e1aa, slot#2) 2024-06-26 14:41:12 (3784): Successfully started VM. (PID = '3556') 2024-06-26 14:41:12 (3784): Reporting VM Process ID to BOINC. 2024-06-26 14:41:12 (3784): Guest Log: BIOS: VirtualBox 7.0.14 2024-06-26 14:41:12 (3784): Guest Log: CPUID EDX: 0x178bfbff 2024-06-26 14:41:12 (3784): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2024-06-26 14:41:12 (3784): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2024-06-26 14:41:12 (3784): VM state change detected. (old = 'poweredoff', new = 'running') 2024-06-26 14:41:12 (3784): Detected: Web Application Enabled (http://localhost:64274) 2024-06-26 14:41:12 (3784): Detected: Remote Desktop Enabled (localhost:64275) 2024-06-26 14:41:12 (3784): Status Report: Elapsed Time: '123826.177178' 2024-06-26 14:41:12 (3784): Status Report: CPU Time: '121327.703125' 2024-06-26 14:41:12 (3784): Preference change detected 2024-06-26 14:41:12 (3784): Setting CPU throttle for VM. (100%) 2024-06-26 14:41:12 (3784): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 900 seconds)) 2024-06-26 14:41:14 (3784): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2024-06-26 14:41:15 (3784): Guest Log: BIOS: Booting from Hard Disk... 2024-06-26 14:41:31 (3784): Guest Log: BIOS: KBD: unsupported int 16h function 03 2024-06-26 14:41:31 (3784): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=81 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=81 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=82 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=82 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=83 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=83 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=84 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=84 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=85 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=85 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=86 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=86 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=87 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=87 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=88 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=88 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=89 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=89 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8a 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8a 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8b 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8b 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8c 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8c 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8d 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8d 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8e 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8e 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk_ext: function 41, unmapped device for ELDL=8f 2024-06-26 14:41:31 (3784): Guest Log: int13_harddisk: function 02, unmapped device for ELDL=8f 2024-06-26 14:41:45 (3784): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2024-06-26 14:41:45 (3784): Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2024-06-26 14:42:33 (3784): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log 2024-06-26 14:42:33 (3784): Guest Log: 00:00:00.000353 main Log opened 2024-06-26T14:42:31.441673000Z 2024-06-26 14:42:33 (3784): Guest Log: 00:00:00.000714 main OS Product: Linux 2024-06-26 14:42:33 (3784): Guest Log: 00:00:00.000794 main OS Release: 3.10.0-957.27.2.el7.x86_64 2024-06-26 14:42:33 (3784): Guest Log: 00:00:00.000861 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019 2024-06-26 14:42:33 (3784): Guest Log: 00:00:00.000927 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService 2024-06-26 14:42:33 (3784): Guest Log: 00:00:00.000929 main Process ID: 1280 2024-06-26 14:42:33 (3784): Guest Log: 00:00:00.000931 main Package type: LINUX_64BITS_GENERIC 2024-06-26 14:42:33 (3784): Guest Log: 00:00:00.003676 main 5.2.32 r132073 started. Verbose level = 0 2024-06-26 14:42:35 (3784): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... 2024-06-26 14:42:35 (3784): Guest Log: [INFO] Mounting shared directory 2024-06-26 14:42:35 (3784): Guest Log: [INFO] Checking for init_data.xml 2024-06-26 14:42:43 (3784): Guest Log: 00:00:10.022734 timesync vgsvcTimeSyncWorker: Radical guest time change: 25 211 540 520 000ns (GuestNow=1 719 438 163 004 242 000 ns GuestLast=1 719 412 951 463 722 000 ns fSetTimeLastLoop=true ) 2024-06-26 14:42:51 (3784): Guest Log: [INFO] Probing /cvmfs/atlas.cern.ch... OK 2024-06-26 14:42:51 (3784): Guest Log: [INFO] Detected branch: prod 2024-06-26 14:42:51 (3784): Guest Log: This is the prod version of the ATLAS job wrapper 2024-06-26 14:42:51 (3784): Guest Log: Copying input files 2024-06-26 14:44:20 (3784): Guest Log: Copied input files into RunAtlas. 2024-06-26 14:44:20 (3784): Guest Log: This VM did not configure a local http proxy via BOINC. 2024-06-26 14:44:20 (3784): Guest Log: Small home clusters do not require a local http proxy but it is suggested if 2024-06-26 14:44:20 (3784): Guest Log: more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. 2024-06-26 14:44:20 (3784): Guest Log: Further information can be found at the LHC@home message board. 2024-06-26 14:44:32 (3784): Guest Log: Running cvmfs_config stat atlas.cern.ch 2024-06-26 14:44:33 (3784): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2024-06-26 14:44:33 (3784): Guest Log: 2.6.3.0 1562 1 32088 134332 4 1 2631218 4096000 0 65024 0 0 n/a 0 0 http://s1bnl-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1 2024-06-26 14:44:36 (3784): Guest Log: copied the webapp to /var/www 2024-06-26 14:44:36 (3784): Guest Log: core_number=1 2024-06-26 14:44:37 (3784): Guest Log: Apptainer command /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/data,/home/atlas/RunAtlas /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 2024-06-26 14:44:38 (3784): Guest Log: *** Starting ATLAS job. (PandaID=6238668825 taskID=38921007) *** 2024-06-26 16:21:18 (3784): Status Report: Elapsed Time: '129827.156108' 2024-06-26 16:21:18 (3784): Status Report: CPU Time: '126370.375000' 2024-06-26 18:01:24 (3784): Status Report: Elapsed Time: '135827.670584' 2024-06-26 18:01:24 (3784): Status Report: CPU Time: '132322.390625' 2024-06-26 19:41:29 (3784): Status Report: Elapsed Time: '141827.670584' 2024-06-26 19:41:29 (3784): Status Report: CPU Time: '138263.921875' 2024-06-26 21:21:34 (3784): Status Report: Elapsed Time: '147828.006619' 2024-06-26 21:21:34 (3784): Status Report: CPU Time: '144265.171875' 2024-06-26 23:01:39 (3784): Status Report: Elapsed Time: '153828.006619' 2024-06-26 23:01:39 (3784): Status Report: CPU Time: '150263.890625' 2024-06-27 00:41:43 (3784): Status Report: Elapsed Time: '159828.006619' 2024-06-27 00:41:43 (3784): Status Report: CPU Time: '156261.234375' 2024-06-27 02:21:48 (3784): Status Report: Elapsed Time: '165828.006619' 2024-06-27 02:21:48 (3784): Status Report: CPU Time: '162259.031250' 2024-06-27 04:01:54 (3784): Status Report: Elapsed Time: '171828.906426' 2024-06-27 04:01:54 (3784): Status Report: CPU Time: '168236.937500' 2024-06-27 05:42:00 (3784): Status Report: Elapsed Time: '177829.646782' 2024-06-27 05:42:00 (3784): Status Report: CPU Time: '174200.656250' 2024-06-27 07:22:05 (3784): Status Report: Elapsed Time: '183829.646782' 2024-06-27 07:22:05 (3784): Status Report: CPU Time: '180171.171875' 2024-06-27 09:02:11 (3784): Status Report: Elapsed Time: '189829.646782' 2024-06-27 09:02:11 (3784): Status Report: CPU Time: '186142.093750' 2024-06-27 10:42:16 (3784): Status Report: Elapsed Time: '195829.646782' 2024-06-27 10:42:16 (3784): Status Report: CPU Time: '192141.984375' 2024-06-27 12:22:22 (3784): Status Report: Elapsed Time: '201829.646782' 2024-06-27 12:22:22 (3784): Status Report: CPU Time: '198115.281250' 2024-06-27 14:02:27 (3784): Status Report: Elapsed Time: '207829.646782' 2024-06-27 14:02:27 (3784): Status Report: CPU Time: '204086.703125' 2024-06-27 15:42:30 (3784): Status Report: Elapsed Time: '213829.646782' 2024-06-27 15:42:30 (3784): Status Report: CPU Time: '210071.093750' 2024-06-27 17:22:35 (3784): Status Report: Elapsed Time: '219829.646782' 2024-06-27 17:22:35 (3784): Status Report: CPU Time: '216068.906250' 2024-06-27 19:02:41 (3784): Status Report: Elapsed Time: '225829.646782' 2024-06-27 19:02:41 (3784): Status Report: CPU Time: '222049.984375' 2024-06-27 20:42:46 (3784): Status Report: Elapsed Time: '231829.862765' 2024-06-27 20:42:46 (3784): Status Report: CPU Time: '228047.125000' 2024-06-27 22:22:51 (3784): Status Report: Elapsed Time: '237829.862765' 2024-06-27 22:22:51 (3784): Status Report: CPU Time: '234049.031250' 2024-06-28 00:02:57 (3784): Status Report: Elapsed Time: '243829.862765' 2024-06-28 00:02:57 (3784): Status Report: CPU Time: '240050.093750' 2024-06-28 01:43:02 (3784): Status Report: Elapsed Time: '249829.862765' 2024-06-28 01:43:02 (3784): Status Report: CPU Time: '246052.234375' 2024-06-28 03:23:07 (3784): Status Report: Elapsed Time: '255829.862765' 2024-06-28 03:23:07 (3784): Status Report: CPU Time: '252041.140625' 2024-06-28 05:03:12 (3784): Status Report: Elapsed Time: '261829.862765' 2024-06-28 05:03:12 (3784): Status Report: CPU Time: '258024.156250' 2024-06-28 06:43:17 (3784): Status Report: Elapsed Time: '267829.862765' 2024-06-28 06:43:17 (3784): Status Report: CPU Time: '264013.515625' 2024-06-28 08:23:22 (3784): Status Report: Elapsed Time: '273829.862765' 2024-06-28 08:23:22 (3784): Status Report: CPU Time: '270009.546875' 2024-06-28 10:03:28 (3784): Status Report: Elapsed Time: '279829.862765' 2024-06-28 10:03:28 (3784): Status Report: CPU Time: '275997.328125' 2024-06-28 11:43:33 (3784): Status Report: Elapsed Time: '285829.862765' 2024-06-28 11:43:33 (3784): Status Report: CPU Time: '281992.734375' 2024-06-28 13:23:38 (3784): Status Report: Elapsed Time: '291829.862765' 2024-06-28 13:23:38 (3784): Status Report: CPU Time: '287987.312500' 2024-06-28 15:03:43 (3784): Status Report: Elapsed Time: '297829.862765' 2024-06-28 15:03:43 (3784): Status Report: CPU Time: '293963.390625' 2024-06-28 16:43:48 (3784): Status Report: Elapsed Time: '303830.274926' 2024-06-28 16:43:48 (3784): Status Report: CPU Time: '299939.953125' 2024-06-28 18:23:53 (3784): Status Report: Elapsed Time: '309830.274926' 2024-06-28 18:23:53 (3784): Status Report: CPU Time: '305926.453125' 2024-06-28 20:03:58 (3784): Status Report: Elapsed Time: '315830.274926' 2024-06-28 20:03:58 (3784): Status Report: CPU Time: '311926.187500' 2024-06-28 21:44:03 (3784): Status Report: Elapsed Time: '321830.274926' 2024-06-28 21:44:03 (3784): Status Report: CPU Time: '317927.687500' 2024-06-28 23:24:08 (3784): Status Report: Elapsed Time: '327830.274926' 2024-06-28 23:24:08 (3784): Status Report: CPU Time: '323928.687500' 2024-06-29 01:04:10 (3784): Status Report: Elapsed Time: '333830.274926' 2024-06-29 01:04:10 (3784): Status Report: CPU Time: '329928.687500' 2024-06-29 02:44:15 (3784): Status Report: Elapsed Time: '339830.274926' 2024-06-29 02:44:15 (3784): Status Report: CPU Time: '335929.531250' 2024-06-29 04:24:20 (3784): Status Report: Elapsed Time: '345830.805899' 2024-06-29 04:24:20 (3784): Status Report: CPU Time: '341908.640625' 2024-06-29 06:04:25 (3784): Status Report: Elapsed Time: '351830.865197' 2024-06-29 06:04:25 (3784): Status Report: CPU Time: '347891.625000' 2024-06-29 07:44:30 (3784): Status Report: Elapsed Time: '357830.865197' 2024-06-29 07:44:30 (3784): Status Report: CPU Time: '353875.125000' 2024-06-29 09:24:36 (3784): Status Report: Elapsed Time: '363831.702294' 2024-06-29 09:24:36 (3784): Status Report: CPU Time: '359868.703125' 2024-06-29 11:04:41 (3784): Status Report: Elapsed Time: '369831.702294' 2024-06-29 11:04:41 (3784): Status Report: CPU Time: '365857.796875' 2024-06-29 12:44:46 (3784): Status Report: Elapsed Time: '375831.702294' 2024-06-29 12:44:46 (3784): Status Report: CPU Time: '371827.140625' 2024-06-29 14:24:51 (3784): Status Report: Elapsed Time: '381831.702294' 2024-06-29 14:24:51 (3784): Status Report: CPU Time: '377817.250000' 2024-06-29 16:04:56 (3784): Status Report: Elapsed Time: '387831.702294' 2024-06-29 16:04:56 (3784): Status Report: CPU Time: '383792.890625' 2024-06-29 17:45:02 (3784): Status Report: Elapsed Time: '393831.702294' 2024-06-29 17:45:02 (3784): Status Report: CPU Time: '389773.578125' 2024-06-29 19:25:07 (3784): Status Report: Elapsed Time: '399831.702294' 2024-06-29 19:25:07 (3784): Status Report: CPU Time: '395772.578125' 2024-06-29 21:05:13 (3784): Status Report: Elapsed Time: '405832.168908' 2024-06-29 21:05:13 (3784): Status Report: CPU Time: '401752.828125' 2024-06-29 22:45:19 (3784): Status Report: Elapsed Time: '411832.168908' 2024-06-29 22:45:19 (3784): Status Report: CPU Time: '407748.296875' 2024-06-30 00:25:24 (3784): Status Report: Elapsed Time: '417832.168908' 2024-06-30 00:25:24 (3784): Status Report: CPU Time: '413744.546875' 2024-06-30 02:05:27 (3784): Status Report: Elapsed Time: '423832.168908' 2024-06-30 02:05:27 (3784): Status Report: CPU Time: '419740.578125' 2024-06-30 03:45:32 (3784): Status Report: Elapsed Time: '429832.168908' 2024-06-30 03:45:32 (3784): Status Report: CPU Time: '425738.796875' 2024-06-30 05:25:37 (3784): Status Report: Elapsed Time: '435832.168908' 2024-06-30 05:25:37 (3784): Status Report: CPU Time: '431723.171875' 2024-06-30 07:05:42 (3784): Status Report: Elapsed Time: '441832.168908' 2024-06-30 07:05:42 (3784): Status Report: CPU Time: '437703.125000' 2024-06-30 08:45:48 (3784): Status Report: Elapsed Time: '447832.168908' 2024-06-30 08:45:48 (3784): Status Report: CPU Time: '443704.218750' 2024-06-30 10:25:53 (3784): Status Report: Elapsed Time: '453832.168908' 2024-06-30 10:25:53 (3784): Status Report: CPU Time: '449703.671875' 2024-06-30 12:05:58 (3784): Status Report: Elapsed Time: '459832.168908' 2024-06-30 12:05:58 (3784): Status Report: CPU Time: '455697.687500' 2024-06-30 13:46:03 (3784): Status Report: Elapsed Time: '465832.168908' 2024-06-30 13:46:03 (3784): Status Report: CPU Time: '461684.359375' 2024-06-30 15:26:06 (3784): Status Report: Elapsed Time: '471832.277970' 2024-06-30 15:26:06 (3784): Status Report: CPU Time: '467668.062500' 2024-06-30 15:33:13 (3784): Guest Log: *** Job finished *** 2024-06-30 15:33:13 (3784): Guest Log: *** The last 20 lines of the pilot log: *** 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:01,627 | INFO | [payload] failed_post thread has finished 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:02,316 | INFO | [job] queue monitor thread has finished 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:03,439 | INFO | [data] queue_monitor thread has finished 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:03,981 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139839199438656)>', '<ExcThread(monitor, started 139838615443200)>'] 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:04,239 | WARNING | job_aborted has been set - aborting pilot monitoring 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:04,240 | INFO | [monitor] control thread has ended 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:08,987 | INFO | all workflow threads have been joined 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:08,987 | INFO | end of generic workflow (traces error code: 0) 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:08,987 | INFO | traces error code: 0 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:08,988 | INFO | pilot has finished (exit code=0, shell exit code=0) 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:09,259 [wrapper] ==== pilot stdout END ==== 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:09,266 [wrapper] ==== wrapper stdout RESUME ==== 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:09,273 [wrapper] pilotpid: 6431 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:09,280 [wrapper] Pilot exit status: 0 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:09,490 [wrapper] pandaids: 6238668825 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:09,545 [wrapper] cleanup supervisor_pilot 26880 6432 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:09,554 [wrapper] Test setup, not cleaning 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:09,561 [wrapper] ==== wrapper stdout END ==== 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:09,568 [wrapper] ==== wrapper stderr END ==== 2024-06-30 15:33:13 (3784): Guest Log: 2024-06-30 22:33:09,583 [wrapper] apfmon messages muted 2024-06-30 15:33:13 (3784): Guest Log: *** Error codes and diagnostics *** 2024-06-30 15:33:13 (3784): Guest Log: "exeErrorCode": 0, 2024-06-30 15:33:13 (3784): Guest Log: "exeErrorDiag": "", 2024-06-30 15:33:13 (3784): Guest Log: "pilotErrorCode": 0, 2024-06-30 15:33:13 (3784): Guest Log: "pilotErrorDiag": "", 2024-06-30 15:33:13 (3784): Guest Log: *** Listing of results directory *** 2024-06-30 15:33:13 (3784): Guest Log: total 628984 2024-06-30 15:33:13 (3784): Guest Log: -rw-r--r--. 1 atlas atlas 469766 Jun 20 03:13 pilot3.tar.gz 2024-06-30 15:33:13 (3784): Guest Log: -rw-r--r--. 1 atlas atlas 5654 Jun 20 03:19 queuedata.json 2024-06-30 15:33:13 (3784): Guest Log: -rwx------. 1 atlas atlas 32308 Jun 20 03:20 runpilot2-wrapper.sh 2024-06-30 15:33:13 (3784): Guest Log: -rwxr-xr-x. 1 atlas atlas 8902 Jun 26 21:44 init_data.xml 2024-06-30 15:33:13 (3784): Guest Log: -rwxr-xr-x. 1 atlas atlas 482532 Jun 26 21:44 input.tar.gz 2024-06-30 15:33:13 (3784): Guest Log: -rwxr-xr-x. 1 atlas atlas 17537 Jun 26 21:44 start_atlas.sh 2024-06-30 15:33:13 (3784): Guest Log: lrwxrwxrwx. 1 atlas atlas 20 Jun 26 21:44 EVNT.38776201._000584.pool.root.1 -> /data/./ATLAS.root_0 2024-06-30 15:33:13 (3784): Guest Log: -rw-r--r--. 1 atlas atlas 2630 Jun 26 21:44 pandaJob.out 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 424 Jun 26 21:45 setup.sh.local 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 1034735 Jun 26 21:46 agis_schedconf.cvmfs.json 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 1321363 Jun 26 21:46 cric_ddmendpoints.json 2024-06-30 15:33:13 (3784): Guest Log: drwx------. 4 atlas atlas 4096 Jun 26 21:46 pilot3 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 348921075 Jun 30 22:29 HITS.38921007._050861.pool.root.1 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 1029 Jun 30 22:31 memory_monitor_summary.json 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 0 Jun 30 22:31 agis_ddmendpoints.agis.ALL.json 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 21522426 Jun 30 22:31 log.38921007._050861.job.log.tgz.1 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 95 Jun 30 22:32 pilot_heartbeat.json 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 7750 Jun 30 22:32 heartbeat.json 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 4271 Jun 30 22:33 pilotlog.txt 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 124315932 Jun 30 22:33 log.38921007._050861.job.log.1 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 357 Jun 30 22:33 output.list 2024-06-30 15:33:13 (3784): Guest Log: -rw-r--r--. 1 atlas atlas 620 Jun 30 22:33 runtime_log 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 145858560 Jun 30 22:33 result.tar.gz 2024-06-30 15:33:13 (3784): Guest Log: -rw-r--r--. 1 atlas atlas 10802 Jun 30 22:33 runtime_log.err 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 654 Jun 30 22:33 7GPLDmUWNe5n9Rq4apOajLDm4fhM0noT9bVo2ijZDmX5WKDm95Y2Fn.diag 2024-06-30 15:33:13 (3784): Guest Log: Looking for outputfile HITS.38921007._050861.pool.root.1 2024-06-30 15:33:13 (3784): Guest Log: HITS file was successfully produced 2024-06-30 15:33:13 (3784): Guest Log: -rw-------. 1 atlas atlas 348921075 Jun 30 22:29 /home/atlas/RunAtlas/HITS.38921007._050861.pool.root.1 2024-06-30 15:33:19 (3784): Guest Log: Successfully finished the ATLAS job! 2024-06-30 15:33:19 (3784): Guest Log: Copying the results back to the shared directory! 2024-06-30 15:33:20 (3784): Guest Log: *** Contents of shared directory: *** 2024-06-30 15:33:22 (3784): Guest Log: total 1052576 2024-06-30 15:33:22 (3784): Guest Log: -rwxrwxrwx. 1 root root 582540341 Jun 22 22:27 ATLAS.root_0 2024-06-30 15:33:22 (3784): Guest Log: -rwxrwxrwx. 1 root root 348921075 Jun 30 22:33 HITS.pool.root.1 2024-06-30 15:33:22 (3784): Guest Log: -rwxrwxrwx. 1 root root 8902 Jun 22 22:27 init_data.xml 2024-06-30 15:33:22 (3784): Guest Log: -rwxrwxrwx. 1 root root 482532 Jun 20 10:33 input.tar.gz 2024-06-30 15:33:22 (3784): Guest Log: -rwxrwxrwx. 1 root root 145858560 Jun 30 22:33 result.tar.gz 2024-06-30 15:33:22 (3784): Guest Log: -rwxrwxrwx. 1 root root 17537 Jun 20 10:33 start_atlas.sh 2024-06-30 15:33:22 (3784): Guest Log: *** Success! Shutting down the machine. *** 2024-06-30 15:33:23 (3784): VM Completion File Detected. 2024-06-30 15:33:23 (3784): Powering off VM. 2024-06-30 15:33:35 (3784): Successfully stopped VM. 2024-06-30 15:33:35 (3784): Deregistering VM. (boinc_1353552f7843e1aa, slot#2) 2024-06-30 15:33:36 (3784): Removing network bandwidth throttle group from VM. 2024-06-30 15:33:36 (3784): Removing VM from VirtualBox. 15:33:43 (3784): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>7GPLDmUWNe5n9Rq4apOajLDm4fhM0noT9bVo2ijZDmX5WKDm95Y2Fn_0_r1650649267_ATLAS_result</file_name> <error_code>-131 (file size too big)</error_code> </file_xfer_error> </message> ]]>
©2024 CERN