Message boards : CMS Application : no new WUs available
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 11 · 12 · 13 · 14 · 15 · 16 · 17 . . . 20 · Next

AuthorMessage
Erich56

Send message
Joined: 18 Dec 15
Posts: 1690
Credit: 104,068,230
RAC: 122,502
Message 47969 - Posted: 4 Apr 2023, 16:16:16 UTC - in response to Message 47968.  

Ivan, thanks a lot for the information :-)
ID: 47969 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1690
Credit: 104,068,230
RAC: 122,502
Message 48015 - Posted: 16 Apr 2023, 4:34:01 UTC - in response to Message 47969.  

the queue has run dry :-(
ID: 48015 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1006
Credit: 6,272,232
RAC: 315
Message 48016 - Posted: 16 Apr 2023, 13:01:23 UTC - in response to Message 48015.  

the queue has run dry :-(

Oops! Apologies. I edited the workflow script to halve the number of jobs per submission, but with my deteriorating vision[*] I deleted one too many digits and ended up with only a tenth of the jobs I'd intended.
[*] Look up dry age-related macular degeneration. See also: cataracts, hayfever.
ID: 48016 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1006
Credit: 6,272,232
RAC: 315
Message 48040 - Posted: 26 Apr 2023, 11:16:55 UTC

I'm about to close off the current workflow to allow a WMAgent upgrade. You might want to set No New Tasks until it's over.
ID: 48040 · Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 1128
Credit: 49,757,934
RAC: 8,198
Message 48041 - Posted: 26 Apr 2023, 12:57:48 UTC - in response to Message 48040.  
Last modified: 26 Apr 2023, 13:00:35 UTC

Thanks for the update Ivan

(and -dev)
ID: 48041 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1006
Credit: 6,272,232
RAC: 315
Message 48042 - Posted: 26 Apr 2023, 14:01:58 UTC - in response to Message 48040.  

I'm about to close off the current workflow to allow a WMAgent upgrade. You might want to set No New Tasks until it's over.

It's done. Barring problems, jobs should be coming down the turnpike Real Soon Now.
ID: 48042 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1690
Credit: 104,068,230
RAC: 122,502
Message 48054 - Posted: 3 May 2023, 20:31:04 UTC

the queue has run dry :-(
ID: 48054 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1006
Credit: 6,272,232
RAC: 315
Message 48055 - Posted: 4 May 2023, 13:29:33 UTC - in response to Message 48054.  

the queue has run dry :-(

It's strange, WMStats insists there are ~1200 jobs running, Grafana says there are none.
ID: 48055 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1006
Credit: 6,272,232
RAC: 315
Message 48056 - Posted: 4 May 2023, 14:46:49 UTC - in response to Message 48055.  

An upgrade went wrong. Seems to be working again now.
ID: 48056 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2413
Credit: 226,653,494
RAC: 130,737
Message 48057 - Posted: 4 May 2023, 14:58:45 UTC - in response to Message 48056.  

Seems to be working again now.

Right.
Thanks.
ID: 48057 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1006
Credit: 6,272,232
RAC: 315
Message 48072 - Posted: 8 May 2023, 16:05:35 UTC

Oops, holiday here, plus I've been dealing with a neighbour whose daughter comitted suicide this morning...
New jobs on their way.
ID: 48072 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1006
Credit: 6,272,232
RAC: 315
Message 48092 - Posted: 15 May 2023, 12:37:30 UTC

There's a database problem at CERN which means I can't submit new jobs. We will run out of jobs shortly if it's not fixed.
ID: 48092 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1006
Credit: 6,272,232
RAC: 315
Message 48093 - Posted: 15 May 2023, 13:30:48 UTC

New jobs on their way, but it will take an hour or so to get them into the queues.
ID: 48093 · Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 418
Credit: 5,667,249
RAC: 3
Message 48094 - Posted: 15 May 2023, 14:08:25 UTC - in response to Message 48093.  
Last modified: 15 May 2023, 14:09:01 UTC

Any reason why my computers set to get any type of work (they usually get CMS, I assume that's your top priority) were told there were no tasks, even though I can see Atlas and Theory available? The ones set to not get CMS continued to get Atlas and Theory ok.
ID: 48094 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1006
Credit: 6,272,232
RAC: 315
Message 48114 - Posted: 18 May 2023, 10:11:14 UTC - in response to Message 48094.  

Any reason why my computers set to get any type of work (they usually get CMS, I assume that's your top priority) were told there were no tasks, even though I can see Atlas and Theory available? The ones set to not get CMS continued to get Atlas and Theory ok.

It could be that your quota has run down -- I see one of your machines had a lot of aborted tasks:
https://lhcathome.cern.ch/lhcathome/results.php?hostid=10825779&offset=0&show_names=0&state=0&appid=11
Each time you return an error task, your daily quota is reduced, and it will eventually reach one per day so much of the time it will tell you that there are no tasks (although it should say you've reached quota in the event log). Another possibility is that there is a problem with the VirtualBox setup so BOINC won't send tasks that require a VM, but your machines all say virtualisation is enabled.
ID: 48114 · Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 418
Credit: 5,667,249
RAC: 3
Message 48115 - Posted: 18 May 2023, 13:18:09 UTC - in response to Message 48114.  

Any reason why my computers set to get any type of work (they usually get CMS, I assume that's your top priority) were told there were no tasks, even though I can see Atlas and Theory available? The ones set to not get CMS continued to get Atlas and Theory ok.

It could be that your quota has run down -- I see one of your machines had a lot of aborted tasks:
https://lhcathome.cern.ch/lhcathome/results.php?hostid=10825779&offset=0&show_names=0&state=0&appid=11
Each time you return an error task, your daily quota is reduced, and it will eventually reach one per day so much of the time it will tell you that there are no tasks (although it should say you've reached quota in the event log). Another possibility is that there is a problem with the VirtualBox setup so BOINC won't send tasks that require a VM, but your machines all say virtualisation is enabled.
The machines in question had only been running CMS, and had not produced errors of any significant quantity, and were never refused CMS. They were set to get any type of task, but always receive CMS (I assume that's the most important one to you). When I saw CMS run out, I tested to see if they'd get something else automatically. I forced them to get new work, and they were told there was none. Yet the computers I told not to get CMS (different venue, to stop me running out of internet bandwidth) were happily getting Theory.
ID: 48115 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 808
Credit: 652,904,123
RAC: 279,990
Message 48116 - Posted: 19 May 2023, 9:44:53 UTC

I've seen this before, in that the server just seems to send all of one sub-project, to me it seems to be a server side thing.

I personally came to the conclusion that the scientist or administators have the balance of work the way they want it and I should not try to make an even split between the sub-projects.
ID: 48116 · Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 418
Credit: 5,667,249
RAC: 3
Message 48119 - Posted: 19 May 2023, 18:09:21 UTC - in response to Message 48116.  

I've seen this before, in that the server just seems to send all of one sub-project, to me it seems to be a server side thing.

I personally came to the conclusion that the scientist or administrators have the balance of work the way they want it and I should not try to make an even split between the sub-projects.
It may well be a lot of people choose one subproject for RAM/bandwidth/personal reasons, and that happens to even out the way the scientists need it. If everyone selected "anything", only CMS would get done. But most folk don't have the RAM or bandwidth to run those. I just run them on 2 of my 8 machines, and that's my uplink saturated. I set the rest to run "anything but CMS" and they get theory with the occasional Atlas.
ID: 48119 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1690
Credit: 104,068,230
RAC: 122,502
Message 48137 - Posted: 27 May 2023, 3:17:04 UTC

the queue has run dry :-(
ID: 48137 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1690
Credit: 104,068,230
RAC: 122,502
Message 48138 - Posted: 27 May 2023, 5:43:32 UTC - in response to Message 48137.  

the queue has run dry :-(
it has filled up now :-)
ID: 48138 · Report as offensive     Reply Quote
Previous · 1 . . . 11 · 12 · 13 · 14 · 15 · 16 · 17 . . . 20 · Next

Message boards : CMS Application : no new WUs available


©2024 CERN