Message boards : LHCb Application : Memory usage of LHCb tasks
Message board moderation

To post messages, you must log in.

AuthorMessage
Harri Liljeroos
Avatar

Send message
Joined: 28 Sep 04
Posts: 473
Credit: 25,100,022
RAC: 14,941
Message 28358 - Posted: 6 Jan 2017, 10:35:58 UTC

While running LHCb tasks I see a possible problem with the memory consumption that is seen by Boinc. My understanding is that LHCb requires 2 GB memory when running (same as CMS tasks) but Boinc sees that LHCb is using about 480 MB memory (same as Theory tasks). This may lead to a situation where Boinc allows too many LHCb tasks to be run concurrrently and eventually running out of memory (start to use HDD as memory extension).

Of course you can prevent this with the account settings on the web pages or using app_config.xml but I think that LHCb application should be set up same as CMS so that Boinc can see the actual memory used and prevent memory over usage.
ID: 28358 · Report as offensive     Reply Quote
metalius
Avatar

Send message
Joined: 3 Oct 06
Posts: 99
Credit: 8,152,957
RAC: 0
Message 28387 - Posted: 8 Jan 2017, 1:31:33 UTC - in response to Message 28358.  

Very good comment, Harri! Thank You!
ID: 28387 · Report as offensive     Reply Quote
Harri Liljeroos
Avatar

Send message
Joined: 28 Sep 04
Posts: 473
Credit: 25,100,022
RAC: 14,941
Message 28582 - Posted: 20 Jan 2017, 16:00:03 UTC

Bump!

Any news/info on this?
ID: 28582 · Report as offensive     Reply Quote
BRG

Send message
Joined: 23 Dec 16
Posts: 26
Credit: 776,007
RAC: 0
Message 28717 - Posted: 29 Jan 2017, 18:01:50 UTC

I too have the same issue, 24 cores but 32g of ram. I have to set, say 8 LHCb tasks to run then the remainder of my cores to run six track...
ID: 28717 · Report as offensive     Reply Quote
Profile James

Send message
Joined: 26 Nov 10
Posts: 18
Credit: 3,015,497
RAC: 0
Message 28826 - Posted: 8 Feb 2017, 8:08:41 UTC - in response to Message 28717.  

Hi,

Can you explain how to limit the LHCb app to only run eight VM's? And allow othe Sixtrack to still run.
ID: 28826 · Report as offensive     Reply Quote
Harri Liljeroos
Avatar

Send message
Joined: 28 Sep 04
Posts: 473
Credit: 25,100,022
RAC: 14,941
Message 28827 - Posted: 8 Feb 2017, 8:37:14 UTC - in response to Message 28826.  

https://boinc.berkeley.edu/wiki/Client_configuration#Application_configuration

You have to create an app_config.xml file and place it in the projects/lhcathome folder. The location of that folder depends on OS and your selections when you installed BOINC. Mine is in c:\ProgramData\BOINC\projects\lhcathome.cern.ch_lhcathome\ (this is on a win7 computer). See the above link and use max_concurrent and project_max_concurrent elements to set what you want. Unfortunately I don't have an example at hand. To read the file just restart BOINC.
ID: 28827 · Report as offensive     Reply Quote
Harri Liljeroos
Avatar

Send message
Joined: 28 Sep 04
Posts: 473
Credit: 25,100,022
RAC: 14,941
Message 30243 - Posted: 7 May 2017, 8:45:08 UTC

Why the <rsc_memory_bound>500000000.000000</rsc_memory_bound> is still in the init_data.xml in the new app? The tasks are using about 2 GB memory but LHCb reports to Boinc 476 MB. This may lead to unexpected memory problems because Boinc cannot see correctly the memory usage. Please fix this!
ID: 30243 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1545
Credit: 88,254,255
RAC: 92,438
Message 30244 - Posted: 7 May 2017, 9:27:16 UTC - in response to Message 30243.  

I agree with Harri that <rsc_memory_bound> should be set according to <memory_size_mb>.
This has to be fixed in the plan_class template on the project server.
ID: 30244 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 599
Credit: 378,950,811
RAC: 34,202
Message 30246 - Posted: 8 May 2017, 6:00:25 UTC

Will be fixed soon.
ID: 30246 · Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer

Send message
Joined: 20 Jun 14
Posts: 337
Credit: 237,918
RAC: 0
Message 30256 - Posted: 9 May 2017, 11:47:35 UTC - in response to Message 30244.  

I could not find this parameter specified in any of the configuration files. In any case I have set it in the LHCb job template to be the same as for CMS (2.5GB).
ID: 30256 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1545
Credit: 88,254,255
RAC: 92,438
Message 30257 - Posted: 9 May 2017, 12:46:43 UTC - in response to Message 30256.  

I could not find this parameter specified in any of the configuration files. ...

??
Aah, there's a default value of 5e8!!
See: https://boinc.berkeley.edu/trac/wiki/JobSubmission
ID: 30257 · Report as offensive     Reply Quote
Harri Liljeroos
Avatar

Send message
Joined: 28 Sep 04
Posts: 473
Credit: 25,100,022
RAC: 14,941
Message 30259 - Posted: 9 May 2017, 14:32:22 UTC - in response to Message 30257.  
Last modified: 9 May 2017, 14:33:18 UTC

I could not find this parameter specified in any of the configuration files. ...

??
Aah, there's a default value of 5e8!!
See: https://boinc.berkeley.edu/trac/wiki/JobSubmission


That explains why Theory and LHCb have the same memory value in Boinc (476.84 MB). VM Manager shows LHCb memory setting to be 2048 MB and Theory 630 MB. With Theory tasks this is quite close to the default 476.84 MB so it usually doesn't create problems but it should also be set correctly for smooth ride.
ID: 30259 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 599
Credit: 378,950,811
RAC: 34,202
Message 30292 - Posted: 11 May 2017, 17:03:35 UTC

My new ones show 2.33GB as expected. Thanks for updating
ID: 30292 · Report as offensive     Reply Quote

Message boards : LHCb Application : Memory usage of LHCb tasks


©2020 CERN