log in

Memory full then froze.


Advanced search

Message boards : Theory Application : Memory full then froze.

Author Message
Sandman192
Send message
Joined: 8 Oct 07
Posts: 3
Credit: 288,231
RAC: 50
Message 28982 - Posted: 27 Feb 2017, 23:24:20 UTC

Running LHCb Simulation v1.00. When running 12 of them on all 12 cores tend to fill my memory all the way up and freeze my computer if left alone. The last thing I see is a full memory when my computer froze.


Another think it doesn't seem to know what my internet speed is or do speed tests. It's running 12 LHC trying to stream which apparently 3Mps is not fast enough for all 12.

Solution have it do a speed test of my internet or ask me what my internet speed is to have it do so many at a time.

12 Gigs of memory.

Crystal Pellet
Volunteer moderator
Volunteer tester
Send message
Joined: 14 Jan 10
Posts: 384
Credit: 2,997,020
RAC: 1,945
Message 28984 - Posted: 28 Feb 2017, 8:29:44 UTC

First step: Install version 5.1.14 of VirtualBox and also the extension pack. You can get it here: https://www.virtualbox.org/wiki/Downloads

gyllic
Send message
Joined: 9 Dec 14
Posts: 93
Credit: 1,093,009
RAC: 4,770
Message 28985 - Posted: 28 Feb 2017, 8:47:12 UTC - in response to Message 28982.
Last modified: 28 Feb 2017, 9:01:53 UTC

You have 16gigs of ram (according to your pc specs). Each LHCb tasks needs about 2gigs of ram. So if you use all 12 cores, its 12*2=24gb of ram, but you have only 16.

This is why your computer freezes. Unfortunately BOINC does not recognize the actual amount of ram used by one LHCb tasks and therefore starts more tasks than your ram settings would allow.

To solve this problem, set your max amount of tasks to 6 or something like this (6*2=12gb , but your OS still also needs some ram) in your lhc preferences or change the cpu usage in boinc to 50%.
You also can place a app_config.xml file in your project folder and specify the max concurrent running tasks.

If you want to use all of your 12 cores, you also can either run the Theory tasks (they only use about 600mb ram each) or some multicore ATLAS tasks.

These virtual machines are downloading some data within the virtual machine which they need to successfully process the tasks, therefore I think that the max speed limit you can change in BOINC wont effect the download speed of the VM (but I am not entirely sure about that). The speed should not be a problem, the only thing you will recognize is that your efficiency (cpu time/running time) will not be as high as for other people with faster internet speeds.

And as crystal pellet already said: upgrade your virtualbox and your virtualbox extension pack to the latest version

Toby Broom
Volunteer moderator
Send message
Joined: 27 Sep 08
Posts: 376
Credit: 88,646,317
RAC: 173,571
Message 28991 - Posted: 28 Feb 2017, 19:51:42 UTC

You an limit the number of tasks in the preferences now too vs app config.

I can run 24 LHCb with 64Gb, and 80% ram usage so 32GB would be fine for 12.

With 16Gb I can only run 7 LHCb, this uses 96%.

Sandman192
Send message
Joined: 8 Oct 07
Posts: 3
Credit: 288,231
RAC: 50
Message 29213 - Posted: 13 Mar 2017, 1:59:21 UTC - in response to Message 28985.

This is why your computer freezes. Unfortunately BOINC does not recognize the actual amount of ram used by one LHCb tasks and therefore starts more tasks than your ram settings would allow.

Sorry but changing anything to get it to run right is a work around and NOT a permanent solution. It ran fine for years until now. It should run without changing a thing when BOINC is not doing its job. BOINC should know how much RAM I have and how much is running in the background before it runs any work units but that doesn't seem to be the case.

BOINC should be set it and forget it. That's what BOINC does. But it seems to have a bug.

BOINC is not utilizing the ram I have and what is using right now before it runs the work units.

TLP and ATLAS both have this problem. BOINC ran 12 TLP GARLI each required 6.5Gigs totaling 120Gigs. Suspending all but one ran fine and nearly filled all my ram with the rest running work units on the rest of the cores.

Sandman192
Send message
Joined: 8 Oct 07
Posts: 3
Credit: 288,231
RAC: 50
Message 29214 - Posted: 13 Mar 2017, 2:06:55 UTC - in response to Message 28991.
Last modified: 13 Mar 2017, 2:47:40 UTC

Tru I can run 7 but BOINC starts to run 10 meaning BOINC is not seeing my max ram and what is running in the background before BOINC starts running any work units or checking the work units to see how much ram it needs before BOINC starts running it.

Note it should be set it and forget it. It did for years and now all of a sudden I come to find my computer froze and the memory is maxed out.

It also did it on TLP GARLI and ATLAS.

Profile MAGIC Quantum Mechanic
Avatar
Send message
Joined: 24 Oct 04
Posts: 512
Credit: 14,661,078
RAC: 3,859
Message 29217 - Posted: 13 Mar 2017, 8:47:32 UTC - in response to Message 29214.

https://lhcathome.cern.ch/lhcathome/results.php?hostid=10356388
____________
Volunteer Mad Scientist For Life

Message boards : Theory Application : Memory full then froze.