Message boards : CMS Application : CMS tasks failing
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · Next

AuthorMessage
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1152
Credit: 11,734,920
RAC: 801
Message 53096 - Posted: 26 Feb 2026, 11:01:27 UTC - in response to Message 53095.  

In reply to Erich56's message of 26 Feb 2026:
In reply to ivan's message of 24 Feb 2026:
We've now been told that the cleanest solution is to rebuild the host from scratch, so that is being worked on.
Ivan, any idea how long this might take? a couple of days? 1 week or 2? or even longer?

I'm not sure at the moment, but I have just noticed that the condor collector is responding to network queries again, so I think that means the firewall rules are back in operation. I've submitted some tasks and now wait to see if they pick up jobs -- current indications are that there aren't jobs running, but the monitoring is always a bit behind real-time.
ID: 53096 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1152
Credit: 11,734,920
RAC: 801
Message 53097 - Posted: 26 Feb 2026, 11:16:47 UTC - in response to Message 53096.  

Hmm, no, the tasks timed out without picking up jobs.
ID: 53097 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1152
Credit: 11,734,920
RAC: 801
Message 53098 - Posted: 26 Feb 2026, 11:34:09 UTC - in response to Message 53097.  

In reply to ivan's message of 26 Feb 2026:
Hmm, no, the tasks timed out without picking up jobs.

Ah, the WMAgent is down; I've asked for it to be reset.
ID: 53098 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1964
Credit: 159,289,840
RAC: 46,178
Message 53103 - Posted: 27 Feb 2026, 14:33:20 UTC - in response to Message 53098.  

In reply to ivan's message of 26 Feb 2026:
In reply to ivan's message of 26 Feb 2026:
Hmm, no, the tasks timed out without picking up jobs.

Ah, the WMAgent is down; I've asked for it to be reset.
Ivan, any idea when the WMAgent will function again ?
ID: 53103 · Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jun 18
Posts: 140
Credit: 57,421,670
RAC: 1,401
Message 53104 - Posted: 27 Feb 2026, 14:58:19 UTC
Last modified: 27 Feb 2026, 15:02:58 UTC

Are we supposed to try to run CMS WUs or not? All of mine are failing.
ID: 53104 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1964
Credit: 159,289,840
RAC: 46,178
Message 53105 - Posted: 27 Feb 2026, 15:08:06 UTC - in response to Message 53104.  

ID: 53105 · Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jun 18
Posts: 140
Credit: 57,421,670
RAC: 1,401
Message 53107 - Posted: 27 Feb 2026, 15:37:36 UTC

I can't access your reference. The Server Status shows 200 WUs. I'll try again next week.
ID: 53107 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 918
Credit: 779,138,205
RAC: 152,761
Message 53110 - Posted: 27 Feb 2026, 18:06:46 UTC - in response to Message 53107.  

I have set No New Tasks
ID: 53110 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1152
Credit: 11,734,920
RAC: 801
Message 53112 - Posted: 27 Feb 2026, 23:31:16 UTC - in response to Message 53110.  

In reply to Toby Broom's message of 27 Feb 2026:
I have set No New Tasks

I think that's wise. :-( The certificate/firewall problem seems to be resolved, but no tasks are getting jobs from the Condor server. I've not heard any more news since yesterday, so I presume nothing will be resolved before Monday.

On a personal note, my Visiting Fellowship at the uni expires on Sunday, despite assurances it would be renewed, so I may lose all my network accesses there. Helpfully, there is a 60-day grace period before I lose CERN access.
ID: 53112 · Report as offensive     Reply Quote
ProfileMagic Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 1290
Credit: 95,259,444
RAC: 34,938
Message 53113 - Posted: 28 Feb 2026, 0:04:36 UTC - in response to Message 53112.  

In reply to ivan's message of 27 Feb 2026:
On a personal note, my Visiting Fellowship at the uni expires on Sunday, despite assurances it would be renewed, so I may lose all my network accesses there. Helpfully, there is a 60-day grace period before I lose CERN access.


I hope so Ivan.......I guess this was the only way to get me to run Atlas instead of CMS

Volunteer Mad Scientist For Life

unbelievable are you trying to promote linux again?
ID: 53113 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1152
Credit: 11,734,920
RAC: 801
Message 53114 - Posted: 28 Feb 2026, 0:45:29 UTC - in response to Message 53113.  
Last modified: 28 Feb 2026, 0:50:07 UTC

In reply to Magic Quantum Mechanic's message of 28 Feb 2026:
In reply to ivan's message of 27 Feb 2026:
On a personal note, my Visiting Fellowship at the uni expires on Sunday, despite assurances it would be renewed, so I may lose all my network accesses there. Helpfully, there is a 60-day grace period before I lose CERN access.


I hope so Ivan.......I guess this was the only way to get me to run Atlas instead of CMS

I have to admit, ATLAS has been far more supportive of XXX@Home than CMS ever was. (I got roped into CMS@Home ages ago because I was the leading UK contributor to SETI@Home. at the time).
ID: 53114 · Report as offensive     Reply Quote
ProfileMagic Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 1290
Credit: 95,259,444
RAC: 34,938
Message 53115 - Posted: 28 Feb 2026, 3:49:38 UTC - in response to Message 53114.  


I have to admit, ATLAS has been far more supportive of XXX@Home than CMS ever was. (I got roped into CMS@Home ages ago because I was the leading UK contributor to SETI@Home. at the time).


Well the main reason I ran all those CMS here and at -dev was when it is running I didn't have to depend on the super speed internet and Atlas is a internet hog up and down.......I have run some here but the last time was when we had Atlas -Test running so there was only 2 of us that are still here and I rather not have as many Atlas running at the same time since with all the ones I have running it is at times fast d/l but u/l is slow over and over. (yeah I was at seti classic too)
ID: 53115 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1964
Credit: 159,289,840
RAC: 46,178
Message 53116 - Posted: 28 Feb 2026, 4:25:37 UTC - in response to Message 53112.  

In reply to ivan's message of 27 Feb 2026:

On a personal note, my Visiting Fellowship at the uni expires on Sunday, despite assurances it would be renewed, so I may lose all my network accesses there. Helpfully, there is a 60-day grace period before I lose CERN access.
Ivan, this is sad to read :-(
Is there anyone else in sight who will take over?
ID: 53116 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1152
Credit: 11,734,920
RAC: 801
Message 53127 - Posted: 1 Mar 2026, 22:21:52 UTC - in response to Message 53116.  

In reply to Erich56's message of 28 Feb 2026:
In reply to ivan's message of 27 Feb 2026:

On a personal note, my Visiting Fellowship at the uni expires on Sunday, despite assurances it would be renewed, so I may lose all my network accesses there. Helpfully, there is a 60-day grace period before I lose CERN access.
Ivan, this is sad to read :-(
Is there anyone else in sight who will take over?

Well, Federica has been helping me for a few years, and has even taken a leading role at times (especially where HTCondor is concerned), so not all is lost.
ID: 53127 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1964
Credit: 159,289,840
RAC: 46,178
Message 53131 - Posted: 3 Mar 2026, 13:27:24 UTC - in response to Message 53127.  

In reply to ivan's message of 1 Mar 2026:
Well, Federica has been helping me for a few years, and has even taken a leading role at times (especially where HTCondor is concerned), so not all is lost.
thanks, Ivan, for the information. So let's keep our fingers crossed :-)

BTW: CMS tasks still don't work, so probably the WMAgent is still down. Any news on this ?
ID: 53131 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1152
Credit: 11,734,920
RAC: 801
Message 53132 - Posted: 3 Mar 2026, 15:45:21 UTC - in response to Message 53131.  

In reply to Erich56's message of 3 Mar 2026:
In reply to ivan's message of 1 Mar 2026:
Well, Federica has been helping me for a few years, and has even taken a leading role at times (especially where HTCondor is concerned), so not all is lost.
thanks, Ivan, for the information. So let's keep our fingers crossed :-)

BTW: CMS tasks still don't work, so probably the WMAgent is still down. Any news on this ?

No, I've not had any updates since last week, and Federica is away at a conference at the moment.
ID: 53132 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1964
Credit: 159,289,840
RAC: 46,178
Message 53136 - Posted: 5 Mar 2026, 8:19:44 UTC - in response to Message 53132.  

Ivan, any idea when CMS will function again?
ID: 53136 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 1152
Credit: 11,734,920
RAC: 801
Message 53140 - Posted: 6 Mar 2026, 23:57:24 UTC - in response to Message 53136.  
Last modified: 7 Mar 2026, 1:02:04 UTC

In reply to Erich56's message of 5 Mar 2026:
Ivan, any idea when CMS will function again?

No, not at the moment. I'm locked out of my Uni digital resources at the moment -- which I expected, but it came without warning[0]. So, I wasn't able to try to set up a redirect from my uni e-mail account to gmail in time :-(.

[0] My group leader assures me that he put in a request to extend my Visiting Fellowship. but the new beancounter regime now requires £1,000 p.a. to cover "overheads" for such positions, and we don't have any facility/grant in place to cover it[1].

[1] Ironic, because at our meeting this afternoon he was able to give me my Certificate from the Breakthrough Prize confirming my contribution to the $1,000,000 award they gave to CMS last year. (This money went to a fund for Young Researchers to work at CERN. There doesn't seem to be a similar fund to help experienced researchers to avoid the boredom of retirement.)
ID: 53140 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1964
Credit: 159,289,840
RAC: 46,178
Message 53153 - Posted: 11 Mar 2026, 6:41:49 UTC - in response to Message 53140.  

Ivan, still no idea when CMS will be up again?
ID: 53153 · Report as offensive     Reply Quote
nairb

Send message
Joined: 1 May 07
Posts: 31
Credit: 2,470,198
RAC: 33
Message 53206 - Posted: 19 Mar 2026, 23:45:37 UTC

Is this why all my recent jobs failed with
errors Too many total results

?
ID: 53206 · Report as offensive     Reply Quote
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · Next

Message boards : CMS Application : CMS tasks failing


©2026 CERN