Message boards : Theory Application : New tasks all failing?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
Anne Havinga

Send message
Joined: 4 Mar 20
Posts: 14
Credit: 6,491,849
RAC: 5,448
Message 51505 - Posted: 7 Feb 2025, 8:57:30 UTC - in response to Message 51500.  

The same thing happened this morning again and after some investigation it appears to be the Ubuntu auto update service as only my Unbuntu boinc-client were affected.

2025-02-07T06:21:02.303865+01:00 Starting apt-daily-upgrade.service - Daily apt upgrade and clean activities ...

2025-02-07T06:21:25.306957+01:00 systemd[1]: Starting packagekit.service - PackageKit Daemon...
2025-02-07T06:21:25.323697+01:00 PackageKit: daemon start
2025-02-07T06:21:25.361604+01:00 dbus-daemon[759]: [system] Successfully activated service 'org.freedesktop.PackageKit'
2025-02-07T06:21:25.362957+01:00 systemd[1]: Started packagekit.service - PackageKit Daemon.

2025-02-07T06:21:26.204095+01:00 cvmfs2: (cernvm-prod.cern.ch) watchdog: received unexpected signal 15 from PID 1 / UID 0
2025-02-07T06:21:26.205344+01:00 cvmfs2: (cvmfs-config.cern.ch) watchdog: received unexpected signal 15 from PID 1 / UID 0
2025-02-07T06:21:26.207985+01:00 systemd[1]: Stopping autofs.service - Automounts filesystems on demand...
2025-02-07T06:21:26.208295+01:00 cvmfs2: (cvmfs-config.cern.ch) watchdog disappeared, disabling stack trace reporting (revents: 16 / 8|16|32)
2025-02-07T06:21:26.208504+01:00 cvmfs2: (sft.cern.ch) watchdog: received unexpected signal 15 from PID 1 / UID 0
2025-02-07T06:21:26.208697+01:00 cvmfs2: watchdog: received unexpected signal 15 from PID 1 / UID 0
2025-02-07T06:21:26.210188+01:00 cvmfs2: (cernvm-prod.cern.ch) watchdog disappeared, disabling stack trace reporting (revents: 16 / 8|16|32)
2025-02-07T06:21:26.210756+01:00 cvmfs2: (sft.cern.ch) watchdog disappeared, disabling stack trace reporting (revents: 1
2025-02-07T06:21:26.217079+01:00 systemd[1]: Stopping boinc-client.service - Berkeley Open Infrastructure Network Computing Client...
.
2025-02-07T06:22:57.525614+01:00 systemd[1]: boinc-client.service: State 'final-sigterm' timed out. Killing.
2025-02-07T06:22:57.526223+01:00 systemd[1]: boinc-client.service: Killing process 105597 (sudo) with signal SIGKILL.
2025-02-07T06:22:57.528687+01:00 systemd[1]: boinc-client.service: Failed with result 'timeout'.
2025-02-07T06:22:57.528930+01:00 systemd[1]: Stopped boinc-client.service - Berkeley Open Infrastructure Network Computing Client.
2025-02-07T06:22:57.529036+01:00 systemd[1]: boinc-client.service: Consumed 2min 25.519s CPU time, 21.3M memory peak, 0B memory swap peak.
2025-02-07T06:22:57.541958+01:00 systemd[1]: Started boinc-client.service - Berkeley Open Infrastructure Network Computing Client.
2025-02-07T06:22:59.030946+01:00 boinc[177468]: 07-Feb-2025 06:22:59 [---] Starting BOINC client version 8.0.4 for x86_64-pc-linux-gnu
2025-02-07T06:22:59.032312+01:00 boinc[177468]: 07-Feb-2025 06:22:59 [---] log flags: file_xfer, sched_ops, task
2025-02-07T06:22:59.039025+01:00 boinc[177468]: 07-Feb-2025 06:22:59 [---] Libraries: libcurl/8.5.0 OpenSSL/3.0.13 zlib/1.3 brotli/1.1.0 zstd/1.5.5 libidn2/2.3.7 libpsl/0.21.2 (+libidn2/2.3.7) libssh/0.10.6/openssl/zlib nghttp2/1.59.0 librtmp/2.3 OpenLDAP/2.6.7
2025-02-07T06:22:59.039187+01:00 boinc[177468]: 07-Feb-2025 06:22:59 [---] Data directory: /var/lib/boinc-client
2025-02-07T06:23:00.091285+01:00 boinc[177468]: 07-Feb-2025 06:23:00 [---] libc: version 2.39
2025-02-07T06:23:00.092266+01:00 boinc[177468]: 07-Feb-2025 06:23:00 [---] Processor: 2 AuthenticAMD AMD Ryzen 5 PRO 3500U w/ Radeon Vega Mobile Gfx [Family 23 Model 24 Stepping 1]
2025-02-07T06:23:00.092353+01:00 boinc[177468]: 07-Feb-2025 06:23:00 [---] Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx f xsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext ssbd ibpb vmmcall fsgsbase bmi1 avx2 smep bmi2 rdseed adx smap clflushopt sha_ni xsaveopt xsavec xgetbv1 xsaveerptr virt_ssbd arat
2025-02-07T06:23:00.092500+01:00 boinc[177468]: 07-Feb-2025 06:23:00 [---] OS: Linux Ubuntu: Ubuntu 24.04.1 LTS [6.8.0-52-generic|libc 2.39]

But after the restart cvmfs is not working properly. A reboot will do the trick.
I try to get it fixed by disabling the packetkit service as well as the autoupdate service.
ID: 51505 · Report as offensive     Reply Quote
Guilhem

Send message
Joined: 28 Aug 15
Posts: 4
Credit: 1,088,746
RAC: 966
Message 51872 - Posted: 2 May 2025, 11:28:56 UTC

Most of theory task take a very short time to be accomplished (less than a minute) and the Jobs chart show a high rate of failure (~60-70%). How to know if a task as due been completed ?

025-05-02 11:47:07 (10908): Guest Log: Environment HTTP proxy: not set
2025-05-02 11:47:08 (10908): Guest Log: job: htmld=/var/www/lighttpd
2025-05-02 11:47:08 (10908): Guest Log: job: unpack exitcode=0
2025-05-02 11:48:40 (10908): Guest Log: job: run exitcode=1
2025-05-02 11:48:40 (10908): Guest Log: job: diskusage=5704
2025-05-02 11:48:40 (10908): Guest Log: job: logsize=4 k
2025-05-02 11:48:40 (10908): Guest Log: job: times=
2025-05-02 11:48:40 (10908): Guest Log: 0m0.002s 0m0.004s
2025-05-02 11:48:40 (10908): Guest Log: 0m0.424s 0m0.248s
2025-05-02 11:48:40 (10908): Guest Log: job: cpuusage=1
2025-05-02 11:48:40 (10908): Guest Log: Job Finished
2025-05-02 11:48:40 (10908): Guest Log: boinc_shutdown called with exit code 0
2025-05-02 11:48:40 (10908): Guest Log: sd_delay: 845
2025-05-02 11:48:40 (10908): Guest Log: ETA: 2025-05-02 10:02:44 UTC
2025-05-02 12:02:45 (10908): VM Completion File Detected.
2025-05-02 12:02:45 (10908): Powering off VM.
2025-05-02 12:02:45 (10908): Successfully stopped VM.
2025-05-02 12:02:45 (10908): Deregistering VM. (boinc_1114d9ba70cb8796, slot#0)
2025-05-02 12:02:46 (10908): Removing network bandwidth throttle group from VM.
2025-05-02 12:02:46 (10908): Removing VM from VirtualBox.
2025-05-02 12:02:51 (10908): called boinc_finish(0)
ID: 51872 · Report as offensive     Reply Quote
Previous · 1 · 2

Message boards : Theory Application : New tasks all failing?


©2025 CERN