Message boards : ATLAS application : issues with app config/running multiple tasks
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
BRG

Send message
Joined: 23 Dec 16
Posts: 26
Credit: 776,007
RAC: 0
Message 30117 - Posted: 29 Apr 2017, 21:18:16 UTC - in response to Message 30115.  

On my PC with 12 cores 24 threads, I can max out 64GB if there is too many ATLAS tasks.

I've seen it very high on my 10 core 20 thread machine too.

My other PC's with more ram I haven't seen so many concurrent ATLAS task.

I have the number of task set to 10 concurrent for 64GB to see if that is a bit better as 12 made the maxed one slow.


I have set cpu and tasks to no limit to try fix this issue I'm having... doesn't seem to be working :(
ID: 30117 · Report as offensive     Reply Quote
BRG

Send message
Joined: 23 Dec 16
Posts: 26
Credit: 776,007
RAC: 0
Message 30118 - Posted: 29 Apr 2017, 21:58:54 UTC - in response to Message 30117.  

On my PC with 12 cores 24 threads, I can max out 64GB if there is too many ATLAS tasks.

I've seen it very high on my 10 core 20 thread machine too.

My other PC's with more ram I haven't seen so many concurrent ATLAS task.

I have the number of task set to 10 concurrent for 64GB to see if that is a bit better as 12 made the maxed one slow.


I have set cpu and tasks to no limit to try fix this issue I'm having... doesn't seem to be working :(


removed <project_max_concurrent>1</project_max_concurrent> all fixed :)
ID: 30118 · Report as offensive     Reply Quote
BRG

Send message
Joined: 23 Dec 16
Posts: 26
Credit: 776,007
RAC: 0
Message 30119 - Posted: 30 Apr 2017, 1:56:38 UTC - in response to Message 30118.  

On my PC with 12 cores 24 threads, I can max out 64GB if there is too many ATLAS tasks.

I've seen it very high on my 10 core 20 thread machine too.

My other PC's with more ram I haven't seen so many concurrent ATLAS task.

I have the number of task set to 10 concurrent for 64GB to see if that is a bit better as 12 made the maxed one slow.


I have set cpu and tasks to no limit to try fix this issue I'm having... doesn't seem to be working :(


removed <project_max_concurrent>1</project_max_concurrent> all fixed :)


Is there a magic way to make Bionic preference the Atlas units over Sixtrack?
ID: 30119 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 798
Credit: 644,784,477
RAC: 231,895
Message 30122 - Posted: 30 Apr 2017, 6:35:09 UTC

dissable sixtrack in project preferences
ID: 30122 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,962,415
RAC: 136,861
Message 30132 - Posted: 30 Apr 2017, 11:24:30 UTC

You got trapped in 2 pitfalls.

1. sixtrack is also a subproject of LHC and therefore affected by the <project_max_concurrent> setting although it is not mentioned in your app_config.xml

But you managed it as you removed the <project_max_concurrent> entry.


2. You may check more than one subprojects in your preferences but you are not able to influence which of them sends WUs to your host.
Together with the "unlimited" setting your host is now flooded with WUs.

Until you have a clear picture of how many multicore ATLAS WUs you are able to run concurrently you may not check another subproject.
ID: 30132 · Report as offensive     Reply Quote
BRG

Send message
Joined: 23 Dec 16
Posts: 26
Credit: 776,007
RAC: 0
Message 30134 - Posted: 30 Apr 2017, 13:21:40 UTC - in response to Message 30132.  

You got trapped in 2 pitfalls.

1. sixtrack is also a subproject of LHC and therefore affected by the <project_max_concurrent> setting although it is not mentioned in your app_config.xml

But you managed it as you removed the <project_max_concurrent> entry.


2. You may check more than one subprojects in your preferences but you are not able to influence which of them sends WUs to your host.
Together with the "unlimited" setting your host is now flooded with WUs.

Until you have a clear picture of how many multicore ATLAS WUs you are able to run concurrently you may not check another subproject.


1, I have never used the max_concurrent till this post.

2, Ah, that's a bit of a shame :( I can honestly say I have never had so many tasks download at once! it seems with the following I can run 4 tasks, 5th needs slightly more ran :(

<app_config>
<app>
<name>ATLAS</name>
<max_concurrent>4</max_concurrent>
<fraction_done_exact/>
</app>
<app_version>
<app_name>ATLAS</app_name>
<plan_class>vbox64_mt_mcore_atlas</plan_class>
<avg_ncpus>2.0</avg_ncpus>
<cmdline>--memory_size_mb 4800</cmdline>
</app_version>
</app_config>
ID: 30134 · Report as offensive     Reply Quote
Previous · 1 · 2

Message boards : ATLAS application : issues with app config/running multiple tasks


©2024 CERN