Message boards : Theory Application : Limit number of jobs running
Message board moderation

To post messages, you must log in.

AuthorMessage
Ryan Munro

Send message
Joined: 17 Aug 17
Posts: 81
Credit: 6,770,932
RAC: 24,675
Message 49523 - Posted: 12 Feb 2024, 9:43:56 UTC

Is there any way to limit the number of units that can be run at the same time? at the moment it's downloading a load and running up to 32 at a time which is causing the machine to grind to a halt forcing me to reboot which then causes a lot of the tasks to fail.

I have tried the following config but no joy

<app_config>
<app_version>
<app_name>Theory</app_name>
<plan_class>vbox64_mt_mcore_theory</plan_class>
<avg_ncpus>16.0</avg_ncpus>
</app_version>
</app_config>
ID: 49523 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2158
Credit: 162,606,373
RAC: 123,635
Message 49524 - Posted: 12 Feb 2024, 9:49:48 UTC - in response to Message 49523.  

You can testing this parameter:
<max_concurrent>x</max_concurrent>
ID: 49524 · Report as offensive     Reply Quote
Crystal Pellet
Volunteer moderator
Volunteer tester

Send message
Joined: 14 Jan 10
Posts: 1330
Credit: 8,761,505
RAC: 5,803
Message 49525 - Posted: 12 Feb 2024, 9:52:42 UTC - in response to Message 49523.  

Just an example:
<app_config>
 <project_max_concurrent>3</project_max_concurrent>
 <app>
  <name>ATLAS</name>
  <max_concurrent>1</max_concurrent>
 </app>
 <app>
  <name>CMS</name>
  <max_concurrent>1</max_concurrent>
 </app>
 <app>
  <name>Theory</name>
  <max_concurrent>1</max_concurrent>
 </app>
 <app_version>
  <app_name>ATLAS</app_name>
  <plan_class>vbox64_mt_mcore_atlas</plan_class>
  <avg_ncpus>4</avg_ncpus>
  <cmdline>--memory_size_mb 4096 --nthreads 4</cmdline>
 </app_version>
 <app_version>
  <app_name>CMS</app_name>
  <plan_class>vbox64</plan_class>
  <cmdline>--memory_size_mb 2048 --nthreads 1</cmdline>
 </app_version>
 <app_version>
  <app_name>Theory</app_name>
  <plan_class>vbox64_theory</plan_class>
  <avg_ncpus>1</avg_ncpus>
  <cmdline>--memory_size_mb 768 --nthreads 1</cmdline>
 </app_version>
</app_config>

Be aware that app_config don't have influence how much tasks are downloaded from the server.
You have to reduce that with the buffer setting with BOINC Manager.
ID: 49525 · Report as offensive     Reply Quote
Ryan Munro

Send message
Joined: 17 Aug 17
Posts: 81
Credit: 6,770,932
RAC: 24,675
Message 49529 - Posted: 12 Feb 2024, 10:40:31 UTC - in response to Message 49524.  

Cheers, that will teach me to troubleshoot before caffeine, ill see how I get along with it.
Does anyone know why loading up 32 VM Theory tasks lags out the PC? I saw an old thread from 2020 about it but couldn't see a resolution.
ID: 49529 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2158
Credit: 162,606,373
RAC: 123,635
Message 49530 - Posted: 12 Feb 2024, 10:45:45 UTC - in response to Message 49529.  

The Scheduler from Theory have the default .xml
ID: 49530 · Report as offensive     Reply Quote
kotenok2000
Avatar

Send message
Joined: 21 Feb 11
Posts: 65
Credit: 548,171
RAC: 298
Message 49534 - Posted: 13 Feb 2024, 2:19:20 UTC - in response to Message 49523.  

My system also was grinding to halt with virtualbox.
I had to use vmware workstation linux vm to run lhcathome.
ID: 49534 · Report as offensive     Reply Quote

Message boards : Theory Application : Limit number of jobs running


©2024 CERN