Message boards :
Number crunching :
ATLAS Simulation.
Message board moderation
Author | Message |
---|---|
Send message Joined: 29 Sep 04 Posts: 187 Credit: 705,487 RAC: 0 |
I have an ATLAS simulation task running on my system. I was alerted to the issue I'm seeing because I could see a lot of waiting to run tasks, and eventually came across the ATLAS, which says it is running on 8 CPU's, ie. all of them, (multithreaded). I have removed this task class from my profile, as I am not happy with the way it works. Question is, is that the only task class which does this, or am I better off just dropping LHC from my projects list? Wave upon wave of demented avengers march cheerfully out of obscurity into the dream. |
Send message Joined: 2 Sep 04 Posts: 455 Credit: 200,463,118 RAC: 53,203 |
Sixtrack is easy to run All other Subprojects need VirtualBox. At the moment so far as I know is Atlas the only one with MulticoreApps, but others are preparing MultiCoreApps. If you want to run these Apps, you can work through my checklist for Atlas and other VB-Apps: https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=4161&postid=29359#29359 Supporting BOINC, a great concept ! |
Send message Joined: 27 Sep 08 Posts: 831 Credit: 688,852,034 RAC: 129,090 |
The Theory task are less intensive on computer resources, somewhere in between Altas and Sixtrack. http://lhcathome.web.cern.ch/what-specification-each-application |
Send message Joined: 29 Sep 04 Posts: 187 Credit: 705,487 RAC: 0 |
I have only removed ATLAS from my sub-projects list, so far. I need to find out more about how BOINC handles multithreaded applications. If it treats a task running on 8 cores for an hour the same as a task running on one core for 8 hours for example. Wave upon wave of demented avengers march cheerfully out of obscurity into the dream. |
Send message Joined: 27 Sep 08 Posts: 831 Credit: 688,852,034 RAC: 129,090 |
You can set your web prefernces to only allow 1 core, to test once your happy then you can get into more advanced if you desire. |
Send message Joined: 29 Sep 04 Posts: 187 Credit: 705,487 RAC: 0 |
That sounds good, I'll look for that, maybe I can continue the project. Wave upon wave of demented avengers march cheerfully out of obscurity into the dream. |
Send message Joined: 18 Dec 15 Posts: 1788 Credit: 117,698,907 RAC: 82,594 |
... I need to find out more about how BOINC handles multithreaded applications. If it treats a task running on 8 cores for an hour the same as a task running on one core for 8 hours for example. What exactly do you mean by "how BOINC handles ..." I have had single-core and multi-core tasks running - from a BOINC point of view, I couldn't notice any difference. |
Send message Joined: 29 Sep 04 Posts: 187 Credit: 705,487 RAC: 0 |
You might not notice any difference, but I might. The example I gave earlier in the thread, which you quote, illustrates a difference I want to find out more about, the task runs for an hour on 8 CPU's, stopping all other projects - does the work scheduler class that as an hour or eight. I can think of numerous situations which I would like to know more about. Wave upon wave of demented avengers march cheerfully out of obscurity into the dream. |
Send message Joined: 15 Jun 08 Posts: 2521 Credit: 252,538,917 RAC: 137,700 |
ATLAS WUs have (simply spoken) 3 main phases. Phase 1 VM setup and download of the ATLAS job. This phase uses 1 core although your BOINC client marks all configured cores as busy and therefore not usable by other projects. This phase needs a walltime between 5 min and >30 min depending on your internet bandwidth. Phase 2 Calculation phase This phase runs (normaly) 50 subjobs and uses all configured cores. Each subjob runs between 60 s and (very rare) 1200 s. At the end of this phase 1 or more cores may be idle as there are no more subjobs to be calculated. Phase 3 Stage Out This phase uses only 1 core and prepares the upload file. Other cores are not usable by other projects. Conclusion ATLAS WUs with a low core setting are more efficient. ATLAS WUs with a high core setting are faster. The initial phase highly depends on your internet bandwidth. NB: Other LHC subproject (CMS, LHCb, Theory) use a time based calculation scheme and are not comparable to ATLAS. |
Send message Joined: 29 Sep 04 Posts: 187 Credit: 705,487 RAC: 0 |
I have changed the project to use at most 25% CPU's. I'll watch that and see if it is acceptable. Wave upon wave of demented avengers march cheerfully out of obscurity into the dream. |
Send message Joined: 29 Sep 04 Posts: 187 Credit: 705,487 RAC: 0 |
Sorry, it would not let me edit my earlier post. Why does the project make nultithreaded app? The deadlines are fairly long, so it can't be a time issue. The way the app works there are times when it cannot possibly use all the resources it has allocated, therefore wasting them and denying them to other projects. There are folk out there that see the issue I've seen and rather than resolving it, just drop the project. Wave upon wave of demented avengers march cheerfully out of obscurity into the dream. |
Send message Joined: 15 Jun 08 Posts: 2521 Credit: 252,538,917 RAC: 137,700 |
Why does the project make nultithreaded app? ... The ATLAS multithreaded app (x cores) needs less RAM compared to x 1-core apps. Example: 8 1-core apps request 8x3.4 GB => 27.2 GB => needs a computer with 32 GB RAM 2 4-core apps request 2x5.8 GB => 11.6 GB => runs on a computer with 16 GB RAM That is a very short explanation as there are a couple of additional pitfalls. You may read the MB and the project documentation to get more information. Yeti's checklist would be a good starting point. In general it can be said that the multithreaded app allows volunteers to optimize ATLAS for the use on their computer. The way the app works there are times when it cannot possibly use all the resources it has allocated, therefore wasting them and denying them to other projects. There are folk out there that see the issue I've seen and rather than resolving it, just drop the project. I'm sure that the project team knows this and tries to satisfy both, the project's needs to solve the scientific problems as well as the volunteer's request for an easy to use application. |
Send message Joined: 29 Sep 04 Posts: 187 Credit: 705,487 RAC: 0 |
>>> Example: >>> 8 1-core apps request 8x3.4 GB => 27.2 GB => needs a computer with 32 GB RAM >>> 2 4-core apps request 2x5.8 GB => 11.6 GB => runs on a computer with 16 GB RAM No. You are making a totally incorrect comparison here, you are assuming that the 8 1 core apps are all running at the same time. With a regular BOINC set up with a collection of projects running at the same priority, that would not happen. I have the checklist open in another tab and have been working my way through it. I have limited the project to 2 cores, at least, I believe I have understood the control mechanism sufficiently to have done that. I'll see. The ATLAS job class is re-enabled. >>> Use at most 25% of the CPUs Wave upon wave of demented avengers march cheerfully out of obscurity into the dream. |
Send message Joined: 15 Jun 08 Posts: 2521 Credit: 252,538,917 RAC: 137,700 |
With a regular BOINC set up with a collection of projects ... What if I decide to setup my computer exclusively for ATLAS? Who/What will deny it? ... you are assuming that the 8 1 core apps are all running at the same time ... Why not? The original question was: Why does the project make nultithreaded app? My example wasn't thought to be a complete real setup ("additional pitfalls"). It should point out that ATLAS can be configured in different ways to satisfy different needs. The multicore app is just an option that supports flexibility. |
Send message Joined: 2 Sep 04 Posts: 455 Credit: 200,463,118 RAC: 53,203 |
You can easily make Atlas running 1-Core-WUs: Go to Project-Preferences and edit the used venue Change "Max # of CPUs for this project" to 1 and new downloaded WUs will be 1-Core-WUs Supporting BOINC, a great concept ! |
Send message Joined: 29 Sep 04 Posts: 187 Credit: 705,487 RAC: 0 |
As you can see, I have already done that by changing it to use at most 25% of CPU's, it should only use 2 cores, I can live with that. Wave upon wave of demented avengers march cheerfully out of obscurity into the dream. |
Send message Joined: 18 Dec 15 Posts: 1788 Credit: 117,698,907 RAC: 82,594 |
>>> Example: Why is the comparison totally incorrect? I have had 8 1-core ATLAS tasks besides 2 GPUGRID tasks. It worked well. |
Send message Joined: 29 Sep 04 Posts: 187 Credit: 705,487 RAC: 0 |
>>> Who/What will deny it? Nobodys is trying to deny you anything. My gripe is that it seemed to be assumed that everyone would want to be like that. Like probably 99% of BOINC users, I am attached to multiple projects. Makes sense, sometimes a server is down, or job generation was interrupted, etc. Always makes sense to run a group of different projects from different servers. The alternative can be periods running nothing just consuming electricity for no reason. >>> Why not? Because on systems with multiple projects attached running at comparable quota levels the schedulaer doesn't do that. You tell me how or why it should. Wave upon wave of demented avengers march cheerfully out of obscurity into the dream. |
Send message Joined: 26 Jul 12 Posts: 18 Credit: 2,456,826 RAC: 0 |
I have couple of 16/24 cores computers. I'd like to enforce Atlas application to use almost all of them - say, 14 cores or 22 depending of a host. However, I'm receiving only 8C WUs. Is it kind of limit for Atlas? I've enough RAM and I have set everything I have found on preference pages to maximum except number of CPUs. |
Send message Joined: 9 Dec 14 Posts: 202 Credit: 2,533,875 RAC: 0 |
I have couple of 16/24 cores computers. I'd like to enforce Atlas application to use almost all of them - say, 14 cores or 22 depending of a host. However, I'm receiving only 8C WUs. Is it kind of limit for Atlas? I've enough RAM and I have set everything I have found on preference pages to maximum except number of CPUs. The maximum core number per task, i.e. atlas vm, is 8. you may consider running e.g. 2 or 3 8 core vms at the same time (if you have enough ram). But the efficiency of 8 core wus is not the best (as far as i can remember) so you may also consider running for example 4 4core tasks (again if there is enough ram in your system) instead. There are a lot of posts here how u can achive that (app_config.xml) |
©2024 CERN