Certificate acquisition failure

Author	Message
Administrator Send message Joined: 23 Jul 22 Posts: 1 Credit: 26,679 RAC: 0	Message 49518 - Posted: 11 Feb 2024, 11:33:26 UTC I've been failing for a long time now, before it was because the VMs didn't seem to be started correctly by the watchdog program, and now that problem seems to be fixed, but there are still new problems. I've shown my computer. This is the log of one of the errors, all the others are the same: <core_client_version>7.24.1</core_client_version> <![CDATA[ <message> - exit code 206 (0xce)</message> <stderr_txt> 2024-02-11 18:37:19 (22008): Detected: vboxwrapper 26206 2024-02-11 18:37:19 (22008): Detected: BOINC client v7.24.1 2024-02-11 18:37:20 (22008): Detected: VirtualBox VboxManage Interface (Version: 7.0.6) 2024-02-11 18:37:20 (22008): Detected: Heartbeat check (file: 'heartbeat' every 1200.000000 seconds) 2024-02-11 18:37:20 (22008): Successfully copied 'init_data.xml' to the shared directory. 2024-02-11 18:37:20 (22008): Create VM. (boinc_79560dc33133198b, slot#5) 2024-02-11 18:37:21 (22008): Setting Memory Size for VM. (2048MB) 2024-02-11 18:37:21 (22008): Setting CPU Count for VM. (1) 2024-02-11 18:37:22 (22008): Setting Chipset Options for VM. 2024-02-11 18:37:22 (22008): Setting Graphics Controller Options for VM. 2024-02-11 18:37:22 (22008): Setting Boot Options for VM. 2024-02-11 18:37:22 (22008): Setting Network Configuration for NAT. 2024-02-11 18:37:23 (22008): Enabling VM Network Access. 2024-02-11 18:37:23 (22008): Disabling USB Support for VM. 2024-02-11 18:37:23 (22008): Disabling COM Port Support for VM. 2024-02-11 18:37:23 (22008): Disabling LPT Port Support for VM. 2024-02-11 18:37:24 (22008): Disabling Audio Support for VM. 2024-02-11 18:37:24 (22008): Disabling Clipboard Support for VM. 2024-02-11 18:37:24 (22008): Disabling Drag and Drop Support for VM. 2024-02-11 18:37:24 (22008): Adding storage controller(s) to VM. 2024-02-11 18:37:25 (22008): Adding virtual disk drive to VM. (CMS_2022_09_07_prod.vdi) 2024-02-11 18:37:27 (22008): Adding VirtualBox Guest Additions to VM. 2024-02-11 18:37:28 (22008): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2024-02-11 18:37:28 (22008): forwarding host port 4933 to guest port 80 2024-02-11 18:37:28 (22008): Enabling remote desktop for VM. 2024-02-11 18:37:28 (22008): Required extension pack not installed, remote desktop not enabled. 2024-02-11 18:37:28 (22008): Enabling shared directory for VM. 2024-02-11 18:37:29 (22008): Starting VM using VBoxManage interface. (boinc_79560dc33133198b, slot#5) 2024-02-11 18:37:34 (22008): Successfully started VM. (PID = '5940') 2024-02-11 18:37:34 (22008): Reporting VM Process ID to BOINC. 2024-02-11 18:37:34 (22008): Guest Log: BIOS: VirtualBox 7.0.6 2024-02-11 18:37:34 (22008): Guest Log: CPUID EDX: 0x178bfbff 2024-02-11 18:37:34 (22008): Guest Log: BIOS: No PCI IDE controller, not probing IDE 2024-02-11 18:37:34 (22008): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors 2024-02-11 18:37:34 (22008): VM state change detected. (old = 'poweredoff', new = 'running') 2024-02-11 18:37:34 (22008): Detected: Web Application Enabled (http://localhost:4933) 2024-02-11 18:37:35 (22008): Preference change detected 2024-02-11 18:37:35 (22008): Setting CPU throttle for VM. (95%) 2024-02-11 18:37:35 (22008): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 30 seconds) or (Vbox_job.xml: 600 seconds)) 2024-02-11 18:37:37 (22008): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2024-02-11 18:37:37 (22008): Guest Log: BIOS: Booting from Hard Disk... 2024-02-11 18:37:40 (22008): Guest Log: BIOS: KBD: unsupported int 16h function 03 2024-02-11 18:37:40 (22008): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2024-02-11 18:38:17 (22008): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2024-02-11 18:38:17 (22008): Guest Log: vboxguest: misc device minor 56, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2024-02-11 18:38:20 (22008): Guest Log: VBoxService 5.2.6 r120293 (verbosity: 0) linux.amd64 (Jan 15 2018 14:51:00) release log 2024-02-11 18:38:20 (22008): Guest Log: 00:00:00.000095 main Log opened 2024-02-11T10:38:26.109236000Z 2024-02-11 18:38:20 (22008): Guest Log: 00:00:00.000858 main OS Product: Linux 2024-02-11 18:38:20 (22008): Guest Log: 00:00:00.000950 main OS Release: 4.14.232-19.cernvm.x86_64 2024-02-11 18:38:20 (22008): Guest Log: 00:00:00.001001 main OS Version: #1 SMP Fri Apr 30 17:12:25 CEST 2021 2024-02-11 18:38:20 (22008): Guest Log: 00:00:00.001044 main Executable: /usr/sbin/VBoxService 2024-02-11 18:38:20 (22008): Guest Log: 00:00:00.001045 main Process ID: 2169 2024-02-11 18:38:20 (22008): Guest Log: 00:00:00.001046 main Package type: LINUX_64BITS_GENERIC 2024-02-11 18:38:20 (22008): Guest Log: 00:00:00.003057 main 5.2.6 r120293 started. Verbose level = 0 2024-02-11 18:38:39 (22008): Guest Log: [INFO] Mounting the shared directory 2024-02-11 18:38:39 (22008): Guest Log: [INFO] Shared directory mounted, enabling vboxmonitor 2024-02-11 18:38:39 (22008): Guest Log: [INFO] Sourcing essential functions from /cvmfs/grid.cern.ch 2024-02-11 18:38:40 (22008): Guest Log: [INFO] Testing connection to cern.ch 2024-02-11 18:38:40 (22008): Guest Log: [INFO] Testing connection to VCCS 2024-02-11 18:38:41 (22008): Guest Log: [INFO] Testing connection to HTCondor 2024-02-11 18:38:41 (22008): Guest Log: [INFO] Testing connection to WMAgent 2024-02-11 18:38:42 (22008): Guest Log: [INFO] Testing connection to EOSCMS 2024-02-11 18:38:43 (22008): Guest Log: [INFO] Testing connection to CMS-Factory 2024-02-11 18:38:43 (22008): Guest Log: [INFO] Testing connection to CMS-Frontier 2024-02-11 18:38:44 (22008): Guest Log: [INFO] Testing connection to Frontier 2024-02-11 18:38:47 (22008): VM state change detected. (old = 'running', new = 'paused') 2024-02-11 18:39:06 (22008): VM state change detected. (old = 'paused', new = 'running') 2024-02-11 18:39:09 (22008): Guest Log: [INFO] Could not find a local HTTP proxy 2024-02-11 18:39:09 (22008): Guest Log: [INFO] CVMFS and Frontier will have to use DIRECT connections 2024-02-11 18:39:09 (22008): Guest Log: [INFO] This makes the application less efficient 2024-02-11 18:39:09 (22008): Guest Log: [INFO] It also puts higher load on the project servers 2024-02-11 18:39:09 (22008): Guest Log: [INFO] Setting up a local HTTP proxy is highly recommended 2024-02-11 18:39:09 (22008): Guest Log: [INFO] Advice can be found in the project forum 2024-02-11 18:39:11 (22008): Guest Log: [INFO] Reloading and probing the CVMFS configuration 2024-02-11 18:39:18 (22008): Guest Log: [INFO] Probing /cvmfs/grid.cern.ch... OK 2024-02-11 18:39:21 (22008): Guest Log: [INFO] Probing /cvmfs/oasis.opensciencegrid.org... OK 2024-02-11 18:39:22 (22008): Guest Log: [INFO] Probing /cvmfs/cms-ib.cern.ch... OK 2024-02-11 18:39:22 (22008): Guest Log: [INFO] Probing /cvmfs/singularity.opensciencegrid.org... OK 2024-02-11 18:39:26 (22008): Guest Log: [INFO] Probing /cvmfs/cms.cern.ch... OK 2024-02-11 18:39:27 (22008): Guest Log: [INFO] Excerpt from "cvmfs_config stat": VERSION HOST PROXY 2024-02-11 18:39:27 (22008): Guest Log: [INFO] 2.7.2.0 http://s1ral-cvmfs.openhtc.io DIRECT 2024-02-11 18:39:27 (22008): Guest Log: [INFO] Environment HTTP proxy: not set 2024-02-11 18:39:28 (22008): Guest Log: [INFO] Reading volunteer information 2024-02-11 18:40:25 (22008): Guest Log: [INFO] Requesting an X509 credential from LHC@home 2024-02-11 18:41:27 (22008): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev 2024-02-11 18:41:58 (22008): Guest Log: [INFO] Requesting an X509 credential from LHC@home 2024-02-11 18:43:00 (22008): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev 2024-02-11 18:43:31 (22008): Guest Log: [INFO] Requesting an X509 credential from LHC@home 2024-02-11 18:43:50 (22008): VM state change detected. (old = 'running', new = 'paused') 2024-02-11 18:44:10 (22008): VM state change detected. (old = 'paused', new = 'running') 2024-02-11 18:44:32 (22008): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev 2024-02-11 18:45:03 (22008): Guest Log: [INFO] Requesting an X509 credential from LHC@home 2024-02-11 18:46:05 (22008): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev 2024-02-11 18:46:36 (22008): Guest Log: [INFO] Requesting an X509 credential from LHC@home 2024-02-11 18:47:37 (22008): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev 2024-02-11 18:48:09 (22008): Guest Log: [INFO] Requesting an X509 credential from LHC@home 2024-02-11 18:49:10 (22008): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev 2024-02-11 18:50:35 (22008): VM state change detected. (old = 'running', new = 'paused') 2024-02-11 18:50:55 (22008): Guest Log: [DEBUG] % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-11 18:50:55 (22008): Guest Log: Dload Upload Total Spent Left Speed 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:05 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:06 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:07 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:08 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:09 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:10 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:11 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:12 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:13 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:14 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:15 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:16 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:17 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:18 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:19 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:20 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:21 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:22 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:23 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:24 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:25 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:26 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:27 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:28 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:29 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:30 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:31 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:32 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:33 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:34 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:35 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:36 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:37 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:38 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:39 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:40 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:41 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:42 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:43 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:44 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:45 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:46 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:47 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:48 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:49 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:50 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:51 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:52 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 0 0 0 0 0 0 0 --:--:-- 0:00:53 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 0 247 0 0 0 0 0 0 --:--:-- 0:00:53 --:--:-- 0 2024-02-11 18:50:55 (22008): Guest Log: 100 247 100 247 0 0 4 0 0:01:01 0:00:53 0:00:08 71 2024-02-11 18:50:55 (22008): Guest Log: [DEBUG] 2024-02-11 18:50:55 (22008): Guest Log: ERROR: Couldn't read proxy from: /tmp/x509up_u0 2024-02-11 18:50:55 (22008): Guest Log: globus_credential: Error reading proxy credential 2024-02-11 18:50:55 (22008): Guest Log: globus_credential: Error reading proxy credential: Couldn't read PEM from bio 2024-02-11 18:50:55 (22008): Guest Log: OpenSSL Error: pem_lib.c:707: in library: PEM routines, function PEM_read_bio: no start line 2024-02-11 18:50:55 (22008): Guest Log: Use -debug for further information. 2024-02-11 18:50:55 (22008): Guest Log: [ERROR] Could not get an x509 credential 2024-02-11 18:50:55 (22008): Guest Log: [ERROR] The x509 proxy creation failed. 2024-02-11 18:50:55 (22008): Guest Log: [DEBUG] Volunteer: Administrator (804829) 2024-02-11 18:50:55 (22008): Guest Log: [INFO] Shutting Down. 2024-02-11 18:50:55 (22008): VM state change detected. (old = 'paused', new = 'running') 2024-02-11 18:51:25 (22008): VM Completion File Detected. 2024-02-11 18:51:25 (22008): VM Completion Message: The x509 proxy creation failed. . 2024-02-11 18:51:25 (22008): Powering off VM. 2024-02-11 18:51:26 (22008): Successfully stopped VM. 2024-02-11 18:51:26 (22008): Deregistering VM. (boinc_79560dc33133198b, slot#5) 2024-02-11 18:51:26 (22008): Removing network bandwidth throttle group from VM. 2024-02-11 18:51:26 (22008): Removing VM from VirtualBox. 18:51:32 (22008): called boinc_finish(206) </stderr_txt> ]]> ID: 49518 · Reply Quote

Harri Liljeroos Send message Joined: 28 Sep 04 Posts: 675 Credit: 43,683,149 RAC: 15,891	Message 49520 - Posted: 11 Feb 2024, 12:41:49 UTC - in response to Message 49518. This problem you are seeing is currently happening to everybody for CMS tasks (only tasks available from LHC@home at the moment). See more from here: https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5631&postid=49503#49503 There's nothing you can do about it. Just set No New Tasks and follow the forums and server status page to see when situation changes. ID: 49520 · Reply Quote

LHC@home