Message boards : ATLAS application : queue is empty
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · Next

AuthorMessage
David Cameron
Project administrator
Project developer
Project scientist

Send message
Joined: 13 May 14
Posts: 368
Credit: 13,488,588
RAC: 7,504
Message 44487 - Posted: 15 Mar 2021, 9:32:47 UTC - in response to Message 44481.  

One of my ATLAS colleagues is commissioning a new supercomputer and thought it would be fun to try ATLAS@Home on 50k cores :) As you saw this caused some problems in filling the queue with tasks and also distributing the tasks due to network limitations. They have stopped the test now so things should go back to normal.

One thing we want to try is running much longer tasks (1000 events instead of 200) for volunteers with dedicated machines. Even though the output data size increases with the number of events, the input data size is independent so this will help reduce the network traffic out of the BOINC servers.
ID: 44487 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 2017
Credit: 147,821,342
RAC: 115,850
Message 44488 - Posted: 15 Mar 2021, 10:18:59 UTC - in response to Message 44487.  

According to the computer list of that "volunteer" his cluster has more than 1000 computers with 256 cores each.
That totals to more than 250k cores.

Fortunately he tortured LHC@home with "only" 50k.
;-D

... running much longer tasks (1000 events instead of 200) for volunteers with dedicated machines...

How will the machines be selected?
Automatically or will there be an opt-in-button?
ID: 44488 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1584
Credit: 65,379,660
RAC: 229,274
Message 44489 - Posted: 15 Mar 2021, 10:24:55 UTC - in response to Message 44487.  

One thing we want to try is running much longer tasks (1000 events instead of 200) for volunteers with dedicated machines. Even though the output data size increases with the number of events, the input data size is independent so this will help reduce the network traffic out of the BOINC servers.

Thanks David for the Info.
How is the Registration for this dedicated machines possible? The most of us have up to 16 or 32 Core only ;-)
ID: 44489 · Report as offensive     Reply Quote
David Cameron
Project administrator
Project developer
Project scientist

Send message
Joined: 13 May 14
Posts: 368
Credit: 13,488,588
RAC: 7,504
Message 44491 - Posted: 15 Mar 2021, 12:54:52 UTC - in response to Message 44489.  

I am going to create a separate beta app for the long tasks which people can choose to run if they want. I'll let everyone know via the message boards when there is something ready to test.
ID: 44491 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 728
Credit: 491,716,910
RAC: 298,547
Message 44497 - Posted: 15 Mar 2021, 22:07:01 UTC

Sounds good for me, I can run the bigger ones.
ID: 44497 · Report as offensive     Reply Quote
djoser
Avatar

Send message
Joined: 30 Aug 14
Posts: 145
Credit: 10,847,070
RAC: 0
Message 44500 - Posted: 17 Mar 2021, 14:27:35 UTC - in response to Message 44491.  

I am going to create a separate beta app for the long tasks which people can choose to run if they want. I'll let everyone know via the message boards when there is something ready to test.


Will this be a native-App, or will it be vbox?
Why mine when you can research? - GRIDCOIN - Real cryptocurrency without wasting hashes! https://gridcoin.us
ID: 44500 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1584
Credit: 65,379,660
RAC: 229,274
Message 44501 - Posted: 17 Mar 2021, 15:37:12 UTC - in response to Message 44500.  

We have to wait until David give us the Infos about it.
You can see the new entry on the Server-Statuspage and in the lhc@home-prefs.
-native is a one core Atlas. This mean a runtime of 5 days!
ID: 44501 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 2017
Credit: 147,821,342
RAC: 115,850
Message 44502 - Posted: 17 Mar 2021, 16:12:30 UTC - in response to Message 44501.  

...-native is a one core Atlas. This mean a runtime of 5 days!

Only the job setup and the stage-out are singlecore.
If ATLAS is configured as n-core it will run n worker threads to transfer EVNTs to HITS.

This applies to VBox as well as native.

Which "n" would be the best?
Often discussed. It depends on many factors.
Best would be to do individual tests on each computer.
VBox: 1-8
native: 1-12
ID: 44502 · Report as offensive     Reply Quote
djoser
Avatar

Send message
Joined: 30 Aug 14
Posts: 145
Credit: 10,847,070
RAC: 0
Message 44503 - Posted: 17 Mar 2021, 17:24:04 UTC - in response to Message 44501.  

You can see the new entry on the Server-Statuspage and in the lhc@home-prefs.


Yes, but it is not in the applications list yet.
So no information about native, vbox or both...
Why mine when you can research? - GRIDCOIN - Real cryptocurrency without wasting hashes! https://gridcoin.us
ID: 44503 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1584
Credit: 65,379,660
RAC: 229,274
Message 44504 - Posted: 17 Mar 2021, 17:51:59 UTC
Last modified: 17 Mar 2021, 18:25:32 UTC

Our part is only to wait for the answer from David in the next time.
Btw in Nov.2017 was the change from 50 to 200 Collisions.
ID: 44504 · Report as offensive     Reply Quote
David Cameron
Project administrator
Project developer
Project scientist

Send message
Joined: 13 May 14
Posts: 368
Credit: 13,488,588
RAC: 7,504
Message 44505 - Posted: 17 Mar 2021, 20:18:17 UTC - in response to Message 44504.  

The new app here is only a placeholder for now. I am going to test the long tasks on the LHC-dev project first, so if any of you want to try it please head over there and select "ATLAS very long simulation" from the app list. It is native linux-only for now. The current test tasks there are very short, but we should have long tasks there tomorrow. https://lhcathomedev.cern.ch/lhcathome-dev/
ID: 44505 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1584
Credit: 65,379,660
RAC: 229,274
Message 44506 - Posted: 17 Mar 2021, 20:59:38 UTC - in response to Message 44505.  

Download-Error in -dev. Answer is there in the Message-Folder for Atlas.
ID: 44506 · Report as offensive     Reply Quote
djoser
Avatar

Send message
Joined: 30 Aug 14
Posts: 145
Credit: 10,847,070
RAC: 0
Message 44519 - Posted: 19 Mar 2021, 18:33:40 UTC - in response to Message 44505.  

I am going to test the long tasks on the LHC-dev project first, so if any of you want to try it please head over there and select "ATLAS very long simulation" from the app list.

I would like to try it out, but -dev is invitation only.
Since i'm not a developer or project admin, i guess i'm not wanted over there!?
https://lhcathomedev.cern.ch/lhcathome-dev/forum_thread.php?id=436&postid=5646#5646
Why mine when you can research? - GRIDCOIN - Real cryptocurrency without wasting hashes! https://gridcoin.us
ID: 44519 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 590
Credit: 21,977,299
RAC: 486
Message 44520 - Posted: 19 Mar 2021, 20:58:56 UTC - in response to Message 44519.  
Last modified: 19 Mar 2021, 21:00:57 UTC

I would like to try it out, but -dev is invitation only.
Since i'm not a developer or project admin, i guess i'm not wanted over there!?

No one ever invited me. I am crunching native Theory now, and have several long native ATLAS in the buffer.

Just paste the URL in the BOINC address field:
https://lhcathomedev.cern.ch/lhcathome-dev/
ID: 44520 · Report as offensive     Reply Quote
djoser
Avatar

Send message
Joined: 30 Aug 14
Posts: 145
Credit: 10,847,070
RAC: 0
Message 44522 - Posted: 20 Mar 2021, 10:48:29 UTC - in response to Message 44520.  

Just paste the URL in the BOINC address field:
https://lhcathomedev.cern.ch/lhcathome-dev/

I tried that and BOINC Manager displayed a message that only already registered accounts can connect to that project. So you need to register on the website first and to do so you need an invitation code. This was established in 2018 to avoid spammers.
Why mine when you can research? - GRIDCOIN - Real cryptocurrency without wasting hashes! https://gridcoin.us
ID: 44522 · Report as offensive     Reply Quote
David Cameron
Project administrator
Project developer
Project scientist

Send message
Joined: 13 May 14
Posts: 368
Credit: 13,488,588
RAC: 7,504
Message 44532 - Posted: 22 Mar 2021, 13:14:15 UTC - in response to Message 44522.  

If anyone would like to join the dev project to help with testing please send me a PM and I'll give you an invitation code.
ID: 44532 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1584
Credit: 65,379,660
RAC: 229,274
Message 45112 - Posted: 8 Jul 2021, 18:08:51 UTC

Atlas have only 2 Tasks in the queue shown:
https://lhcathome.cern.ch/lhcathome/server_status.php
ID: 45112 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1584
Credit: 65,379,660
RAC: 229,274
Message 45122 - Posted: 13 Jul 2021, 5:44:59 UTC - in response to Message 45112.  

Atlas have only 2 Tasks in the queue shown:
https://lhcathome.cern.ch/lhcathome/server_status.php

+1
ID: 45122 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1584
Credit: 65,379,660
RAC: 229,274
Message 45128 - Posted: 15 Jul 2021, 18:33:27 UTC - in response to Message 45122.  

Atlas have only 2 Tasks in the queue shown:
https://lhcathome.cern.ch/lhcathome/server_status.php

Once again no new tasks.
ID: 45128 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1516
Credit: 46,216,930
RAC: 57,920
Message 45129 - Posted: 16 Jul 2021, 10:03:02 UTC - in response to Message 45128.  
Last modified: 16 Jul 2021, 10:03:16 UTC

Atlas have only 2 Tasks in the queue shown:
https://lhcathome.cern.ch/lhcathome/server_status.php

Once again no new tasks.
still no tasks available.
Major disruption somewhere there ?
ID: 45129 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · Next

Message boards : ATLAS application : queue is empty


©2022 CERN