Message boards :
CMS Application :
no new WUs available
Message board moderation
Previous · 1 . . . 17 · 18 · 19 · 20 · 21 · 22 · 23 . . . 24 · Next
| Author | Message |
|---|---|
 Magic Quantum Mechanic Send message Joined: 24 Oct 04 Posts: 1176 Credit: 54,887,670 RAC: 5,761   
|
[quote]I just checked the two I started 7 hours ago and this time they are still running but still stuck at LOL I have checked thousands of my tasks doing that Axel......every single VB task I have run I watch them by doing that. and the entire Run time 13 hours 53 min 5 sec on that page it never got past *application starting check log files* But last month they did some update so you can't get the same version of the log with a CMS as they used to be so you had to check another tab there but not the running log tab https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3302911 This one did finally have the info on the stderr instead of watching that other url so until the one tonight they were all doing this here and at -dev https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3302801 That is the one I mentioned and it finished and sent it in BUT it still stayed at *application starting check log files* And all the ones before that didn't actually run and were sent back after one hour runs and less than 10 minutes CPU time. Before this started they always * Requesting an idtoken from LHC@home* I only have one running now doing the same thing and since it is 4;20am I better wait until later to try again and see if they will actually run a job (oh and I always take snap shots of logs so I have thousands of those too) |
|
Magic Quantum Mechanic Send message Joined: 24 Oct 04 Posts: 1176 Credit: 54,887,670 RAC: 5,761
|
well I couldn't sleep until I went upstairs and got this current running snap shot and as I mentioned the CMS don't run this the same as it used to and the Theory tasks do still give us the running logs there.....and this is after running 13 hours and at 66.5%  goodnight |
|
Send message Joined: 14 Jan 10 Posts: 1422 Credit: 9,484,585 RAC: 1,266   |
CMS jobs inside BOINC-VM available again . . . |
|
Send message Joined: 18 Dec 15 Posts: 1821 Credit: 118,941,546 RAC: 21,113  
|
CMS jobs inside BOINC-VM available again . . .credentials working now? |
 Send message Joined: 15 Jun 08 Posts: 2541 Credit: 254,608,838 RAC: 34,609 |
credentials working now? Looks like they do. Got a bunch of CMS tasks all running fine and CERN Grafana shows an increasing number of running jobs since 08:12 UTC. |
|
Magic Quantum Mechanic Send message Joined: 24 Oct 04 Posts: 1176 Credit: 54,887,670 RAC: 5,761
|
NICE Good thing I am always awake after 2am |
|
Send message Joined: 18 Dec 15 Posts: 1821 Credit: 118,941,546 RAC: 21,113
|
all works fine now. So let's keep our fingers crossed :-)credentials working now? |
|
Send message Joined: 18 Dec 15 Posts: 1821 Credit: 118,941,546 RAC: 21,113
|
good morning Ivan, last night, the jobs bucket got empty again :-( |
 Send message Joined: 29 Aug 05 Posts: 1061 Credit: 7,737,455 RAC: 298 |
good morning Ivan, Sorry, I got caught out by how fast the queues were emptying. One of our script suppliers made an inadvertent reversion that meant more jobs were waiting for reconnection to Condor than recent configurations.  |
|
Send message Joined: 27 Sep 08 Posts: 850 Credit: 692,823,409 RAC: 68,497  |
â¤ï¸ CMS error rate dropped below 10 %, sadly Theory still over 50 % |
|
Send message Joined: 18 Dec 15 Posts: 1821 Credit: 118,941,546 RAC: 21,113
|
queue is empty :-( |
|
Send message Joined: 18 Dec 15 Posts: 1821 Credit: 118,941,546 RAC: 21,113
|
queue is empty :-( |
|
Send message Joined: 29 Aug 05 Posts: 1061 Credit: 7,737,455 RAC: 298 |
queue is empty :-( Sorry, misjudged the job queue. |
|
Send message Joined: 18 Dec 15 Posts: 1821 Credit: 118,941,546 RAC: 21,113
|
new new tasks since last night :-( |
|
Send message Joined: 18 Dec 15 Posts: 1821 Credit: 118,941,546 RAC: 21,113
|
new new tasks since last night :-(sorry, should read "NO new tasks ..." |
|
Send message Joined: 29 Aug 05 Posts: 1061 Credit: 7,737,455 RAC: 298 |
new new tasks since last night :-(sorry, should read "NO new tasks ..." Tja, I was waiting to see if Daniele's multi-core workflow would spawn new jobs, in case my old one was holding it back. Turned out not to happen, so I'm submitting smaller job batches until we work out how to get the multi-core jobs into the system. There may be intermittent disruptions over the next few days if my sleep cycle disagrees with the job queues' needs for attention. |
|
Send message Joined: 18 Dec 15 Posts: 1821 Credit: 118,941,546 RAC: 21,113
|
no jobs available since yesterday. This time, the automatic task distribution stop worked well :-) |
|
Send message Joined: 29 Aug 05 Posts: 1061 Credit: 7,737,455 RAC: 298 |
There seems to be a problem at CERN. Several WMAgents, including ours, are showing error status and I don't think we are generating jobs. A polite e-mail has been sent. |
|
Send message Joined: 3 Nov 12 Posts: 59 Credit: 142,182,531 RAC: 42,802
|
No work to do, but this workstation has loaded hundreds of wu s just for killing them: https://lhcathome.cern.ch/lhcathome/results.php?hostid=10698193&offset=0&show_names=0&state=0&appid=11 Would be great to limit the work for this workstation or to resend these wu s |
|
Send message Joined: 29 Aug 05 Posts: 1061 Credit: 7,737,455 RAC: 298 |
There seems to be a problem at CERN. Several WMAgents, including ours, are showing error status and I don't think we are generating jobs. A polite e-mail has been sent. Polite response: The CMSWEB team have been upgrading cmsweb-testbed frontends to a new technology and the redirect rules are still being polished (i.e. it looks like WM is still not fully functional).This transition started last Thursday. Sorry about that. |
©2024 CERN