Message boards : CMS Application : New Heights
Message board moderation

To post messages, you must log in.

AuthorMessage
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2549
Credit: 255,287,973
RAC: 58,068
Message 50670 - Posted: 1 Oct 2024, 7:40:36 UTC

CERN grafana shows 570 CMS jobs are currently running using a total of nearly 2.3 k cores.
Numbers are slowly increasing.
ID: 50670 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1065
Credit: 7,896,399
RAC: 12,060
Message 50732 - Posted: 7 Oct 2024, 12:11:42 UTC - in response to Message 50670.  

CERN grafana shows 570 CMS jobs are currently running using a total of nearly 2.3 k cores.
Numbers are slowly increasing.

Yes. Unfortunately there seemed to be some sort of CMS-wide reporting failure over the weekend so the running-jobs graph has a large hole, for all sites. Since then our WMAgent has suffered a component failure and the number of running jobs has been falling quickly.
I've put out an SOS on the WMOps Mattermost channel, so hopefully someone can fix it soon.
ID: 50732 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1065
Credit: 7,896,399
RAC: 12,060
Message 50733 - Posted: 7 Oct 2024, 13:31:10 UTC - in response to Message 50732.  

Since then our WMAgent has suffered a component failure and the number of running jobs has been falling quickly.
I've put out an SOS on the WMOps Mattermost channel, so hopefully someone can fix it soon.

OK, that's been fixed and more jobs are available now.
ID: 50733 · Report as offensive     Reply Quote
Crystal Pellet
Volunteer moderator
Volunteer tester

Send message
Joined: 14 Jan 10
Posts: 1427
Credit: 9,510,310
RAC: 2,545
Message 50746 - Posted: 8 Oct 2024, 8:54:55 UTC - in response to Message 50733.  
Last modified: 8 Oct 2024, 10:41:25 UTC

OK, that's been fixed and more jobs are available now.
Now running fine again. 628 CMS jobs currently in production.
ID: 50746 · Report as offensive     Reply Quote

Message boards : CMS Application : New Heights


©2025 CERN