Message boards : CMS Application : no new WUs available
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 13 · Next

AuthorMessage
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 881
Credit: 5,850,679
RAC: 295
Message 33484 - Posted: 23 Dec 2017, 17:48:52 UTC - in response to Message 33482.  

According to the Project Status Page, CMS has run out of tasks :-(

Yes, I'm trying to work out what's the cause. Trouble trying to contact Laurence, of course. We are still serving up jobs over at -dev if you are really desperate for heating power from your PCs. :-)
ID: 33484 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1514
Credit: 44,221,636
RAC: 46,895
Message 33489 - Posted: 23 Dec 2017, 19:07:45 UTC - in response to Message 33484.  

... if you are really desperate for heating power from your PCs. :-)
haha, right now we have springtime temperatures here in Austria.
Merry X-Mas :-)
ID: 33489 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 881
Credit: 5,850,679
RAC: 295
Message 33490 - Posted: 23 Dec 2017, 19:12:55 UTC - in response to Message 33489.  

... if you are really desperate for heating power from your PCs. :-)
haha, right now we have springtime temperatures here in Austria.
Merry X-Mas :-)

Tja! Nice and mild here. My gas boiler is bjorked so I'm relying on expensive electrickery to keep warm. Minimum temperatures close to double-digits are keeping my costs down!
ID: 33490 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 881
Credit: 5,850,679
RAC: 295
Message 33495 - Posted: 24 Dec 2017, 9:59:51 UTC - in response to Message 33484.  

According to the Project Status Page, CMS has run out of tasks :-(

Yes, I'm trying to work out what's the cause. Trouble trying to contact Laurence, of course. We are still serving up jobs over at -dev if you are really desperate for heating power from your PCs. :-)

OK, I'm not sure what broke the log-jam (no messages in my in-box) but our task creator seems to be working again -- 186 pending tasks in the queue. I logged on to my Uni cruncher just now and persuaded it to download two tasks, so it looks like we're in business again. Have a warm Christmas (unless you're back home in Byron Bay, then rather search out the air-conditioner or de-humidifier!).
ID: 33495 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1514
Credit: 44,221,636
RAC: 46,895
Message 33645 - Posted: 4 Jan 2018, 10:14:27 UTC - in response to Message 33495.  

hello Ivan, the queue ran dry :-(
will there be new tasks soon?
ID: 33645 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 881
Credit: 5,850,679
RAC: 295
Message 33646 - Posted: 4 Jan 2018, 12:41:14 UTC - in response to Message 33645.  
Last modified: 4 Jan 2018, 12:44:38 UTC

hello Ivan, the queue ran dry :-(
will there be new tasks soon?

Hi; I'm not sure if the server status page is misleading or not. There seems to be little change to the actual jobs running. I'll do some further checks and alert the admins.
[Edit] OK, I'm running fewer tasks than I should, so task creation is stopped. WMagent is fine and jobs are being issued to running tasks. I'll e-mail the crew... [/Edit]
ID: 33646 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 881
Credit: 5,850,679
RAC: 295
Message 33649 - Posted: 4 Jan 2018, 14:37:45 UTC - in response to Message 33646.  

Running job numbers are falling as tasks complete and new ones aren't served. This is a bit more benign than having tasks but no jobs, but set No New Tasks anyway if you wish.
ID: 33649 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1514
Credit: 44,221,636
RAC: 46,895
Message 33650 - Posted: 4 Jan 2018, 15:17:47 UTC - in response to Message 33649.  

... new ones aren't served.
:-(
ID: 33650 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 881
Credit: 5,850,679
RAC: 295
Message 33653 - Posted: 4 Jan 2018, 17:36:18 UTC - in response to Message 33650.  

No response yet, guess everybody's working flat out on patching the Meltdown vulnerability: http://www.theregister.co.uk/2018/01/04/intel_amd_arm_cpu_vulnerability/.
Looks like we'll all have to download patched VMs, too.
...and I'll be busy patching my array of servers just as soon as the patches arrive...
ID: 33653 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1514
Credit: 44,221,636
RAC: 46,895
Message 33667 - Posted: 5 Jan 2018, 8:35:02 UTC - in response to Message 33653.  

...and I'll be busy patching my array of servers just as soon as the patches arrive...
the bad news is that this patch will cause all Intel processors to slow down considerably :-(
ID: 33667 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 881
Credit: 5,850,679
RAC: 295
Message 33668 - Posted: 5 Jan 2018, 9:09:17 UTC - in response to Message 33667.  

...and I'll be busy patching my array of servers just as soon as the patches arrive...
the bad news is that this patch will cause all Intel processors to slow down considerably :-(

One of my cow-orkers says that the UK LHC grid community is considering specifying AMD only from now on (worryingly, the Register article suggests they are also vulnerable to Spectre, if not Meltdown). This is a problem as we have a tender out at the moment for kit that needs to be delivered by the end of March to be paid by our grant -- "Use it or lose it!".
ID: 33668 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 881
Credit: 5,850,679
RAC: 295
Message 33669 - Posted: 5 Jan 2018, 9:14:54 UTC

There's a hint we may have tasks again. My jobs monitor is showing an upwards tick. The publicly-accessible server status page and job status plots are only updated hourly, so it's too soon to be sure. I'm off to work now, more later as the story unfolds...
ID: 33669 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 881
Credit: 5,850,679
RAC: 295
Message 33670 - Posted: 5 Jan 2018, 9:42:56 UTC - in response to Message 33669.  
Last modified: 5 Jan 2018, 9:51:22 UTC

Looks like a false alarm, just a blip on the graphs. I need to check what CERN's Christmas/New Year closure dates are...
[Edit] Oops, looks like CERN is closed until Monday! [/Edit]
ID: 33670 · Report as offensive     Reply Quote
tullio

Send message
Joined: 19 Feb 08
Posts: 703
Credit: 4,244,064
RAC: 325
Message 33671 - Posted: 5 Jan 2018, 9:56:18 UTC

Maybe the Three Magis (Wizards?) will bring some tasks on the Epiphany. Their bones were in Sant'Eustorgio Church in Milan, but a German Emperor abducted them to Koln.
Tullio
ID: 33671 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1514
Credit: 44,221,636
RAC: 46,895
Message 33690 - Posted: 6 Jan 2018, 17:09:46 UTC - in response to Message 33670.  

Looks like a false alarm, just a blip on the graphs. I need to check what CERN's Christmas/New Year closure dates are...
[Edit] Oops, looks like CERN is closed until Monday! [/Edit]
Ivan, how come that the Project Status Page still shows 0 unsent tasks, and the dashboard of running jobs (https://lhcathomedev.cern.ch/lhcathome-dev/cms_job.php) still shows a continuous number of o/a 1000 tasks?
ID: 33690 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 881
Credit: 5,850,679
RAC: 295
Message 33692 - Posted: 6 Jan 2018, 19:41:37 UTC - in response to Message 33690.  
Last modified: 6 Jan 2018, 19:44:46 UTC

Looks like a false alarm, just a blip on the graphs. I need to check what CERN's Christmas/New Year closure dates are...
[Edit] Oops, looks like CERN is closed until Monday! [/Edit]
Ivan, how come that the Project Status Page still shows 0 unsent tasks, and the dashboard of running jobs (https://lhcathomedev.cern.ch/lhcathome-dev/cms_job.php) still shows a continuous number of o/a 1000 tasks?

Yes, I thought someone would ask that...
Laurence maintains a farm of VMs at CERN that runs jobs that volunteer machines cannot -- basically anything beyond the first-stage Monte Carlo simulations, but especially the "merge" jobs that combine the ~60 MB result files into ~2.5 GB final files to ease the problems of file distribution and handling. But, they run anything the HTCondor server dispatches, the caveat being that the latter-stage jobs are only presented to the local CERN machines -- they will still run "normal" jobs if they are available. Laurence has been slightly coy to me about how many VMs he actually controls -- they all come out of a central CERN allocation to CMS that we are not otherwise using -- but now we know that it's currently about 1,000! :-)
ID: 33692 · Report as offensive     Reply Quote
PHILIPPE

Send message
Joined: 24 Jul 16
Posts: 88
Credit: 239,917
RAC: 0
Message 33700 - Posted: 7 Jan 2018, 11:31:46 UTC - in response to Message 33692.  

I don't know if there is a link with this opportunistic farm of computers and a discrepancy noticed between informations displayed on project status and application page.
On status project :
Current GigaFLOPS 59378.42
Task data as of 7 Jan 2018, 11:04:59 UTC
on application page :
Total average computing: 48,523 GigaFLOPS

We deduce a difference of nearly 11 000 GigaFLOPS (variable from 9 000 to 11 000 , since 2 weeks ago~, average 10 000 GigaFlops)

Does it mean that the opportunistic farm has this powerfullness ?

By the way , it would be good to add lines written "other" in each sub project in application page to include "platform unknown or other platform" to avoid this discrepancy in GigaFLOPS.
ID: 33700 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1514
Credit: 44,221,636
RAC: 46,895
Message 33703 - Posted: 7 Jan 2018, 13:06:12 UTC

Ivan, any chance for new CMS tasks soon?
ID: 33703 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 881
Credit: 5,850,679
RAC: 295
Message 33714 - Posted: 8 Jan 2018, 9:47:45 UTC - in response to Message 33703.  
Last modified: 8 Jan 2018, 9:53:10 UTC

Ivan, any chance for new CMS tasks soon?

There appear to be some now! I'm still waking up so it will take a few minutes to be sure but the server status page says tasks are available, and my monitors are starting to inch upwards.
[Edit] Yep! I got new tasks at 0754, looks like CERN is back from holidays. [/Edit]
ID: 33714 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1514
Credit: 44,221,636
RAC: 46,895
Message 33997 - Posted: 21 Jan 2018, 6:56:36 UTC

Ivan, are you aware that no CMS tasks are available?
ID: 33997 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 13 · Next

Message boards : CMS Application : no new WUs available


©2022 CERN