Message boards : CMS Application : EXIT_NO_SUB_TASKS
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 16 · Next

AuthorMessage
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 223,045,730
RAC: 136,912
Message 41355 - Posted: 25 Jan 2020, 11:15:04 UTC

Thanks to the unknown brave knight who fought the "empty queue dragons" last night and provided fresh work.
ID: 41355 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1686
Credit: 100,488,944
RAC: 104,589
Message 41357 - Posted: 25 Jan 2020, 12:26:42 UTC - in response to Message 41355.  

... and provided fresh work.
the question is: how long will this nice situation last ???
(I admit, this is a rather pessemistic question - but I've become quite pessemistic meanwhile, concerning many aspects of LHC crunching)
ID: 41357 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 223,045,730
RAC: 136,912
Message 41361 - Posted: 25 Jan 2020, 14:41:07 UTC

Again out of subtasks(?)!
May the brave knight ride again.
ID: 41361 · Report as offensive     Reply Quote
NOGOOD

Send message
Joined: 18 Nov 17
Posts: 119
Credit: 51,321,891
RAC: 22,102
Message 41385 - Posted: 27 Jan 2020, 18:12:31 UTC - in response to Message 41361.  

EXIT_NO_SUB_TASKS again :-(
ID: 41385 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1686
Credit: 100,488,944
RAC: 104,589
Message 41411 - Posted: 28 Jan 2020, 6:25:17 UTC - in response to Message 41385.  

EXIT_NO_SUB_TASKS again :-(
when I remember how often this has happened in the past - CMS is definitely not a well working sub-project :-(

and once more my question: what happened to Ivan? Does no-one know?
ID: 41411 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 998
Credit: 6,264,307
RAC: 71
Message 41415 - Posted: 28 Jan 2020, 12:55:50 UTC - in response to Message 41411.  

EXIT_NO_SUB_TASKS again :-(
when I remember how often this has happened in the past - CMS is definitely not a well working sub-project :-(

and once more my question: what happened to Ivan? Does no-one know?

Ivan is not having a very good personal life at the moment. :-(
I'm keeping jobs available, and I'm aware of the dips in the jobs graphs (plus you may have noticed a network interruption at CERN last week). These are due to HTCondor not matching worker machines to job requirements. There are some indications that it depends on available memory, but that can't be the full story because my machines stop getting jobs during the lulls but then build up again afterwards. I'm trying to get a condor expert to look at it.
Sorry for your frustration, I feel it too but I have deeper problems to worry about at the moment.
ID: 41415 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 602
Credit: 24,371,321
RAC: 0
Message 41416 - Posted: 28 Jan 2020, 15:22:54 UTC - in response to Message 41415.  

Sorry for your frustration, I feel it too but I have deeper problems to worry about at the moment.

I hope not related to the fires. Anything is better than that.
Good luck.
ID: 41416 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1686
Credit: 100,488,944
RAC: 104,589
Message 41418 - Posted: 28 Jan 2020, 19:46:54 UTC - in response to Message 41415.  

Ivan is not having a very good personal life at the moment. :-(
I'm keeping jobs available, ...
Sorry for your frustration, I feel it too but I have deeper problems to worry about at the moment.
I am sorry to read this, Ivan :-(
And thanks that you, nevertheless, are taking care of CMS.
Let me wish you all the best for your personal situation (whatever it might be).
ID: 41418 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 223,045,730
RAC: 136,912
Message 41419 - Posted: 29 Jan 2020, 6:48:52 UTC - in response to Message 41415.  

Whatever it may be - best wishes.
ID: 41419 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 798
Credit: 644,865,174
RAC: 226,190
Message 41426 - Posted: 30 Jan 2020, 7:34:25 UTC

Seems like this is back, best to set NNT for time being.
ID: 41426 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 998
Credit: 6,264,307
RAC: 71
Message 41427 - Posted: 30 Jan 2020, 10:07:14 UTC

Hmm, something curious there. The current batch should have been 10,000 jobs but only 7,300 have been created, so we started running out overnight. Apologies for that. I've submitted a new batch so more jobs should be available soon.
ID: 41427 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 798
Credit: 644,865,174
RAC: 226,190
Message 41432 - Posted: 30 Jan 2020, 16:45:03 UTC

I switched it back on, should be good I imagine.
ID: 41432 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 223,045,730
RAC: 136,912
Message 41465 - Posted: 4 Feb 2020, 5:52:02 UTC

Greetings from Punxsutawney.
:-(
ID: 41465 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 602
Credit: 24,371,321
RAC: 0
Message 41466 - Posted: 4 Feb 2020, 6:19:04 UTC - in response to Message 41465.  

Greetings from Punxsutawney.
:-(

That is a few hours drive from us. We have visited it once. Or maybe it was again and again.
I don't remember.
ID: 41466 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 998
Credit: 6,264,307
RAC: 71
Message 41469 - Posted: 4 Feb 2020, 8:37:46 UTC

Sorry, I don't know what's going on. There are plenty of jobs available but the server doesn't seem to want to send them out.
ID: 41469 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 602
Credit: 24,371,321
RAC: 0
Message 41470 - Posted: 4 Feb 2020, 10:16:03 UTC - in response to Message 41469.  
Last modified: 4 Feb 2020, 10:39:45 UTC

It is about the same on ATLAS and Theory. I am within an hour of running our of work, and can't get any more.

EDIT: I just picked up a few Theory, but not enough to fill the buffer. That has been the story for some time now, now matter how I set the buffer. I can never get more than about 3 hours of work.
ID: 41470 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 223,045,730
RAC: 136,912
Message 41499 - Posted: 9 Feb 2020, 8:27:55 UTC

CMS subtask queue is empty again.
I set my CMS clients to NNT until the queue is refilled.
ID: 41499 · Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 1114
Credit: 49,504,475
RAC: 3,850
Message 41609 - Posted: 17 Feb 2020, 7:19:20 UTC

Exit status 207 (0x000000CF) EXIT_NO_SUB_TASKS

(over at -dev also)
ID: 41609 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 223,045,730
RAC: 136,912
Message 41618 - Posted: 18 Feb 2020, 6:21:05 UTC

Yesterday evening CMS started to send out subtasks again and all of my clients could get some of them but during the night the servers sent them out only occasionally.
Grafana shows there are about 200 running jobs which is far less than during the good days before.
ID: 41618 · Report as offensive     Reply Quote
NOGOOD

Send message
Joined: 18 Nov 17
Posts: 119
Credit: 51,321,891
RAC: 22,102
Message 41711 - Posted: 24 Feb 2020, 8:51:54 UTC - in response to Message 41618.  

EXIT_NO_SUB_TASKS:
https://lhcathome.cern.ch/lhcathome/result.php?resultid=265044631
https://lhcathome.cern.ch/lhcathome/result.php?resultid=265056154
https://lhcathome.cern.ch/lhcathome/result.php?resultid=265056429
https://lhcathome.cern.ch/lhcathome/result.php?resultid=265068000
ID: 41711 · Report as offensive     Reply Quote
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 16 · Next

Message boards : CMS Application : EXIT_NO_SUB_TASKS


©2024 CERN