Message boards : ATLAS application : Task configurations
Message board moderation

To post messages, you must log in.

AuthorMessage
UAM-LCG2

Send message
Joined: 30 Oct 18
Posts: 16
Credit: 150,672,451
RAC: 107,027
Message 37899 - Posted: 1 Feb 2019, 12:24:49 UTC

Hi everybody;

I would be interested to know if there is any way to receive smaller tasks or some parameter to adjust the remaining time of the tasks. I have multiple computer and one of this have a remaining time around 4 hours and others around 1 day.
ID: 37899 · Report as offensive     Reply Quote
bronco

Send message
Joined: 13 Apr 18
Posts: 443
Credit: 8,438,885
RAC: 0
Message 37901 - Posted: 1 Feb 2019, 16:09:05 UTC - in response to Message 37899.  

There is no way to receive smaller tasks.
ID: 37901 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 568
Credit: 17,796,973
RAC: 24,770
Message 37902 - Posted: 1 Feb 2019, 16:15:05 UTC - in response to Message 37899.  

If you want to receive fewer tasks (for less remaining time), then just reduce the size of the buffer in BOINC Computing preferences.
I use the default of 0.1 + 0.5 days.
ID: 37902 · Report as offensive     Reply Quote
UAM-LCG2

Send message
Joined: 30 Oct 18
Posts: 16
Credit: 150,672,451
RAC: 107,027
Message 37915 - Posted: 4 Feb 2019, 10:01:05 UTC - in response to Message 37902.  

If you want to receive fewer tasks (for less remaining time), then just reduce the size of the buffer in BOINC Computing preferences.
I use the default of 0.1 + 0.5 days.


Okey, thank you! I'll try to change this parameters.
ID: 37915 · Report as offensive     Reply Quote
bronco

Send message
Joined: 13 Apr 18
Posts: 443
Credit: 8,438,885
RAC: 0
Message 37917 - Posted: 4 Feb 2019, 14:00:11 UTC - in response to Message 37915.  
Last modified: 4 Feb 2019, 14:01:02 UTC

If you want to receive fewer tasks (for less remaining time), then just reduce the size of the buffer in BOINC Computing preferences.
I use the default of 0.1 + 0.5 days.


Okey, thank you! I'll try to change this parameters.


That will get you fewer tasks but they will not be smaller tasks.
All ATLAS task consist of 200 events. There is no way to get ATLAS tasks that have less than 200 events. The time required to process the 200 varies and is not predictable.
ID: 37917 · Report as offensive     Reply Quote
UAM-LCG2

Send message
Joined: 30 Oct 18
Posts: 16
Credit: 150,672,451
RAC: 107,027
Message 37926 - Posted: 5 Feb 2019, 9:42:09 UTC - in response to Message 37917.  

If you want to receive fewer tasks (for less remaining time), then just reduce the size of the buffer in BOINC Computing preferences.
I use the default of 0.1 + 0.5 days.


Okey, thank you! I'll try to change this parameters.


That will get you fewer tasks but they will not be smaller tasks.
All ATLAS task consist of 200 events. There is no way to get ATLAS tasks that have less than 200 events. The time required to process the 200 varies and is not predictable.


Bronco is right, i tried yesterday and i had the same result. So i've been searching in BOINC documentation and i found a tag in app_config.xml file that maybe could work. The tag is <cmdline>--memory_size_mb N</cmdline>, i only try this tag with <cmdline>--nthreads 1</cmdline>, but worked fine, so i'll try with the other option. Somebody knows more options for <cmdline> tag?
ID: 37926 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1817
Credit: 122,728,713
RAC: 75,830
Message 37927 - Posted: 5 Feb 2019, 10:34:59 UTC - in response to Message 37926.  

Are you still looking for a method to get smaller tasks?
As bronco already explained, there is no method.

The only thing you can do is to change the basic settings (#cpus, RAM size) already given by the server.
This makes sense if the basic settings lead to computation errors or make your computer sluggish.
Otherwise it's recommended to leave them untouched.
ID: 37927 · Report as offensive     Reply Quote
UAM-LCG2

Send message
Joined: 30 Oct 18
Posts: 16
Credit: 150,672,451
RAC: 107,027
Message 37928 - Posted: 5 Feb 2019, 10:54:27 UTC - in response to Message 37927.  

Are you still looking for a method to get smaller tasks?
As bronco already explained, there is no method.

The only thing you can do is to change the basic settings (#cpus, RAM size) already given by the server.
This makes sense if the basic settings lead to computation errors or make your computer sluggish.
Otherwise it's recommended to leave them untouched.


Yes, but i only supposed that could works. Just as you say, i can change the Computing preference parameters.

Thanks for your time!
ID: 37928 · Report as offensive     Reply Quote
bronco

Send message
Joined: 13 Apr 18
Posts: 443
Credit: 8,438,885
RAC: 0
Message 37930 - Posted: 5 Feb 2019, 11:17:47 UTC - in response to Message 37926.  
Last modified: 5 Feb 2019, 11:20:14 UTC

Your strategy seems to be to reduce the task run time by assigning more CPUs to tasks. That can work but only if the host has enough memory.
The following app_config.xml should work to run max 1 ATLAS vbox task at a time with 2 CPUs per task if the host has enough memory.
If it works then you could try 2 tasks concurrently by increasing the <max_concurrent> (not <project_max_concurrent>) value to 2.

The <project_max_concurrent> is commented out between <!-- and --> tags because it is optional.
Some of the other lines are optional too but I am not sure how those work. I think (maybe) <avg_ncpus> overrides the <cmdline>--nthreads</cmdline> which would mean you can eliminate the <cmdline>--nthreads</cmdline> if you include the <avg_ncpus>. Or maybe it's the opposite. If both lines are included then their values should match. As far as I know it does no harm to include both.

<app_config>
   <!-- <project_max_concurrent>4</project_max_concurrent> -->
   <app>
     <name>ATLAS</name>
     <max_concurrent>1</max_concurrent>
   </app>
   <app_version>
     <app_name>ATLAS</app_name>
     <plan_class>vbox64_mt_mcore_atlas</plan_class>
     <avg_ncpus>2</avg_ncpus>
     <cmdline>--nthreads 2 </cmdline>
     <!-- RAM formula: RAM = 3000 + 900 * ncpus -->
     <cmdline>--memory_size_mb 4800 </cmdline>
   </app_version>
</app_config>
ID: 37930 · Report as offensive     Reply Quote
UAM-LCG2

Send message
Joined: 30 Oct 18
Posts: 16
Credit: 150,672,451
RAC: 107,027
Message 37944 - Posted: 6 Feb 2019, 10:45:26 UTC - in response to Message 37930.  

Your strategy seems to be to reduce the task run time by assigning more CPUs to tasks. That can work but only if the host has enough memory.
The following app_config.xml should work to run max 1 ATLAS vbox task at a time with 2 CPUs per task if the host has enough memory.
If it works then you could try 2 tasks concurrently by increasing the <max_concurrent> (not <project_max_concurrent>) value to 2.

The <project_max_concurrent> is commented out between <!-- and --> tags because it is optional.
Some of the other lines are optional too but I am not sure how those work. I think (maybe) <avg_ncpus> overrides the <cmdline>--nthreads</cmdline> which would mean you can eliminate the <cmdline>--nthreads</cmdline> if you include the <avg_ncpus>. Or maybe it's the opposite. If both lines are included then their values should match. As far as I know it does no harm to include both.

<app_config>
   <!-- <project_max_concurrent>4</project_max_concurrent> -->
   <app>
     <name>ATLAS</name>
     <max_concurrent>1</max_concurrent>
   </app>
   <app_version>
     <app_name>ATLAS</app_name>
     <plan_class>vbox64_mt_mcore_atlas</plan_class>
     <avg_ncpus>2</avg_ncpus>
     <cmdline>--nthreads 2 </cmdline>
     <!-- RAM formula: RAM = 3000 + 900 * ncpus -->
     <cmdline>--memory_size_mb 4800 </cmdline>
   </app_version>
</app_config>



Thank you very much bronco;

I was reading the BOINC Client configuration documentation and i understood that <app> tag is the same that <app_name>, but for older BOINC versions. Finally, i have chosen to use ATLAS native app. Because i think that singularity could be better in performance than VirtualBox.
So now i have ATLAS native tasks with 2-4h of remaining time.
ID: 37944 · Report as offensive     Reply Quote

Message boards : ATLAS application : Task configurations


©2021 CERN