Message boards : Number crunching : LHC VM tasks no longer working on all of my computers since yesterday
Message board moderation

To post messages, you must log in.

AuthorMessage
Erich56

Send message
Joined: 18 Dec 15
Posts: 1562
Credit: 58,205,305
RAC: 50,632
Message 46460 - Posted: 18 Mar 2022, 7:22:49 UTC
Last modified: 18 Mar 2022, 7:32:05 UTC

I am experiencing a strange problem which I never had before:

Yesterday evening I noticed that all ATLAS and Theory tasks running on various computers were running "idle" so to say, which means no CPU usage.

On the ATLAS tasks, access to VM console did not work - when I pushed F2, nothing happened.

On the Theory tasks, VM console only showed:
[ERROR] 'cvmfs_config probe sft.cern.ch' failed
ERROR Could not source logging functions from /cvmfs/grid.cern.ch ...

Then I tried a CMS task on one machine, again no CPU usage shown, and the VM console got stuck right on the first page after start at "Starting VirtualBox Guest additions", and after about 10 minutes the connection to the VM console was no longer possible.

Here the URLs for one ea. task of the three subprojects:

Theory: https://lhcathome.cern.ch/lhcathome/result.php?resultid=349218729
ATLAS: https://lhcathome.cern.ch/lhcathome/result.php?resultid=349211501
CMS: https://lhcathome.cern.ch/lhcathome/result.php?resultid=349238197

FYI:
- VM tasks from another project, i.e. QChemPedia, work without any problems.
- just to make sure, I rebooted the internet modem/router, in order to preclude any disruption there being the cause for my problem.
- all computers running on Windows 10 Pro or Home. BOINC version and Oracle VM version can be seen when opening the above URLs.
- also any recent MS Windows updates should have nothing to do with the problem, since some of the computers I had not updated for about a week.

Hope that any of the experts here can spot the problem and give me hints for solving it. Many thanks in advance.
ID: 46460 · Report as offensive     Reply Quote
Crystal Pellet
Volunteer moderator
Volunteer tester

Send message
Joined: 14 Jan 10
Posts: 1158
Credit: 7,118,800
RAC: 2,303
Message 46462 - Posted: 18 Mar 2022, 8:48:28 UTC

For me it seems to be a (temporary) network issue to LHC.
ID: 46462 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1562
Credit: 58,205,305
RAC: 50,632
Message 46464 - Posted: 18 Mar 2022, 12:52:50 UTC - in response to Message 46462.  

For me it seems to be a (temporary) network issue to LHC.
Probably so - now everything is working fine :-)
I am just surprised though that obviously no other people were affected by this problem - at least no complaints here in the forum from anyone else.
ID: 46464 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1729
Credit: 130,891,428
RAC: 282,575
Message 46465 - Posted: 18 Mar 2022, 13:07:29 UTC - in response to Message 46462.  

Last 24 hours 22k Error-Tasks from Agile Boincers:
[2022-03-18 14:02:03] >>>>>>>>>>>>>>>>>>>>>>>>> Information for user <<<<<<<<<<<<<<<<<<<<<<<<<
[2022-03-18 14:02:03] emi:
[2022-03-18 14:02:03] No valid proxy present. Type "voms-proxy-init -voms atlas"
[2022-03-18 14:02:03] ************************************************************************
[2022-03-18 14:02:03]
[2022-03-18 14:02:03] ---- Setup logstash ----
[2022-03-18 14:02:03] 2022-03-18 13:01:08,182 [wrapper] Logstash not requested in CRIC catchall
[2022-03-18 14:02:03]
[2022-03-18 14:02:03] ---- Proxy Information ----
[2022-03-18 14:02:03] 2022-03-18 13:01:08,188 [wrapper] Skipping proxy checks due to -t flag
[2022-03-18 14:02:03] --- Bespoke environment from CRIC ---
[2022-03-18 14:02:03] 2022-03-18 13:01:08,237 [wrapper] CRIC environ field: <empty>
ID: 46465 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 929
Credit: 6,106,380
RAC: 1,024
Message 46469 - Posted: 18 Mar 2022, 16:40:49 UTC - in response to Message 46462.  

For me it seems to be a (temporary) network issue to LHC.

Yes, we had a lot of CMS job failures between 2000 last night and 1000 this morning.
ID: 46469 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1562
Credit: 58,205,305
RAC: 50,632
Message 46471 - Posted: 18 Mar 2022, 17:30:40 UTC - in response to Message 46469.  
Last modified: 18 Mar 2022, 17:33:15 UTC

For me it seems to be a (temporary) network issue to LHC.

Yes, we had a lot of CMS job failures between 2000 last night and 1000 this morning.
okay, thanks Ivan, for your comment. This was about the time I had all these problems here.
ID: 46471 · Report as offensive     Reply Quote

Message boards : Number crunching : LHC VM tasks no longer working on all of my computers since yesterday


©2023 CERN