Message boards : Number crunching : Daily quota exceeded
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
olebole

Send message
Joined: 18 Sep 04
Posts: 4
Credit: 98,994
RAC: 0
Message 7421 - Posted: 4 May 2005, 15:38:38 UTC

Hi!

I might be beating a dead horse, but could you please raise the daily quota? Especially with these relatively short WU's, my dual-cpu PC can chew through more than it is allowed to download pr. day. Maybe you could set the limit to X WU's per CPU - not per host?

ID: 7421 · Report as offensive     Reply Quote
Profile Markku Degerholm

Send message
Joined: 3 Sep 04
Posts: 212
Credit: 4,545
RAC: 0
Message 7422 - Posted: 4 May 2005, 18:26:45 UTC - in response to Message 7421.  

> Hi!
>
> I might be beating a dead horse, but could you please raise the daily quota?
> Especially with these relatively short WU's, my dual-cpu PC can chew through
> more than it is allowed to download pr. day. Maybe you could set the limit to
> X WU's per CPU - not per host?

Per-CPU quota is not supported by BOINC so it's unlikely that we would do it. Increasing quota is problematic in the sense that some older machines can then download too much work at once (and possibly never finish it). But we'll think about it.

Can you give an estimate on how many workunits your dual-CPU machine can process in a day?

Markku Degerholm
LHC@home admin
ID: 7422 · Report as offensive     Reply Quote
Profile sysfried

Send message
Joined: 27 Sep 04
Posts: 282
Credit: 1,415,417
RAC: 0
Message 7423 - Posted: 4 May 2005, 19:12:35 UTC - in response to Message 7422.  


> Per-CPU quota is not supported by BOINC so it's unlikely that we would do it.
> Increasing quota is problematic in the sense that some older machines can then
> download too much work at once (and possibly never finish it). But we'll think
> about it.
>
> Can you give an estimate on how many workunits your dual-CPU machine can
> process in a day?
>
Dear Markku

Afaik, he has Athlon MP 2800+ cpu's....
They should be comparable to my 244 Opterons... And my machine does about 80 WU's per day.

I do not have that problem. I have enough work left... :-)
ID: 7423 · Report as offensive     Reply Quote
Profile Paul D. Buck

Send message
Joined: 2 Sep 04
Posts: 545
Credit: 148,912
RAC: 0
Message 7424 - Posted: 4 May 2005, 19:29:06 UTC

This is mostly an issue to people that are single project oriented.

And I am most assuridly not saying that is wrong, just that it does "bend" the BOINC concept a little.

We still do not have a real good mechanism to allow people to customize their participation well (yet).

Like:
1) LHC@Home - run @ 50% when work is available

2) CPDN - download and maintain minimum 1 WU per CPU as insurance, normal share 30% of time left after LHC@Home has its share

3) Einstein@Home 35% after LHC@Home has its share

4) SETI@Home 50% after 1-3 have their share

5) Predictor@Home 50% after 1-3 have their share

or something like that. I probably won't see that for a week or two ...
ID: 7424 · Report as offensive     Reply Quote
Profile sysfried

Send message
Joined: 27 Sep 04
Posts: 282
Credit: 1,415,417
RAC: 0
Message 7425 - Posted: 4 May 2005, 20:43:39 UTC - in response to Message 7424.  

> This is mostly an issue to people that are single project oriented.
>
> And I am most assuridly not saying that is wrong, just that it does
> "bend" the BOINC concept a little.

Dear Paul.

I agree. And I haven't complained about it. I have at least 1 alternative project. And one thing: If my host runs out of work... my power bill relaxes a bit... might want to keep that in mind as well.

Cheers,

Sysfried
ID: 7425 · Report as offensive     Reply Quote
STE\/E

Send message
Joined: 2 Sep 04
Posts: 352
Credit: 1,393,150
RAC: 0
Message 7426 - Posted: 4 May 2005, 20:55:24 UTC

Can you give an estimate on how many workunits your dual-CPU machine can process in a day?
==========

Any one of my P4 HT CPU's can due a minimum of 50 per day running in HT Mode even if they are all the longer ones ... Of course this is for the shorter ones & not the boince type WU's... I've noticed I'm starting to run into a problem with keeping enough WU's on each PC also ...

I thought the Daily Quota was at 100 or even more & then all of a sudden I started getting the Exceeded Daily Quota Messages on all my PC's ...
ID: 7426 · Report as offensive     Reply Quote
Profile littleBouncer
Avatar

Send message
Joined: 23 Oct 04
Posts: 358
Credit: 1,439,205
RAC: 0
Message 7427 - Posted: 4 May 2005, 21:18:50 UTC
Last modified: 4 May 2005, 21:27:11 UTC

Maybe Cern will also add a line with your 'daily-quota' as PAH does.
(I would appreciate that.)

So you know from which number you talk, ...
I report in average more than 100 WU's/day with my HT-box (stats from boinclogX)
It depends also how many 's16_' and 's18_' you got to crunch.....

greetz littleBouncer
calculated: 0.6 hour/WU on a HT = 80 WU's/day....
ID: 7427 · Report as offensive     Reply Quote
Profile Bruno G. Olsen & ESEA @ greenh...
Avatar

Send message
Joined: 17 Sep 04
Posts: 52
Credit: 247,983
RAC: 0
Message 7428 - Posted: 4 May 2005, 21:53:29 UTC

Markku:

"Increasing quota is problematic in the sense that some older machines can then download too much work at once (and possibly never finish it)"

Isn't deadlines, benchmarks and estimated cpu time used to prevent this?


ID: 7428 · Report as offensive     Reply Quote
Profile Markku Degerholm

Send message
Joined: 3 Sep 04
Posts: 212
Credit: 4,545
RAC: 0
Message 7430 - Posted: 4 May 2005, 22:11:14 UTC - in response to Message 7428.  
Last modified: 4 May 2005, 22:11:55 UTC

> Markku:
>
> "Increasing quota is problematic in the sense that some older machines can
> then download too much work at once (and possibly never finish it)"
>
> Isn't deadlines, benchmarks and estimated cpu time used to prevent this?

They should but I'm not sure if they actually work that way. Can anybody confirm..? In addition, estimates are only good as long as a BOINC CC is doing work 100% of time. If the BOINC client is shut down, there is no much that can be done.

Markku Degerholm
LHC@home admin
ID: 7430 · Report as offensive     Reply Quote
STE\/E

Send message
Joined: 2 Sep 04
Posts: 352
Credit: 1,393,150
RAC: 0
Message 7432 - Posted: 5 May 2005, 0:20:50 UTC

Well it's confusing as heck to just what the daily quota is supposed to be anyways ... I only have 7 PC's & 4 of them got 100 WU's today ... 1 got 70 & 2 got 50 before they received the Exceeded Daily Quota Message ... ???

ID: 7432 · Report as offensive     Reply Quote
Profile mark

Send message
Joined: 25 Oct 04
Posts: 9
Credit: 69,445
RAC: 0
Message 7433 - Posted: 5 May 2005, 0:22:27 UTC

> Can you give an estimate on how many workunits your dual-CPU machine can process in a day?

I use a dual Athlon MP 2800+ with 1GB Ram since Monday for LHC (100%) and it computed 280 results within that time. => 280/3 days = 93 WUs per day

But every day this PC reached the quota (~16 times per day), so there is the possibility to compute more WUs.

> Isn't deadlines, benchmarks and estimated cpu time used to prevent this?
I think that's right: On the first day my client downloaded about 90 WUs after benchmarking.
Other machines download less than that: I use a 600MHz machine too and that only fetches 10 WUs.

I think that the quota can be doubled without problems.

Another solution: doesn't the scheduler know how much WUs were sent and received? So when there are zero left, it can send more.

<a href="http://lhcathome.cern.ch/team_display.php?teamid=478">
<img src="http://boinc.mundayweb.com/lhc/stats.php?userID=294"></a>
ID: 7433 · Report as offensive     Reply Quote
olebole

Send message
Joined: 18 Sep 04
Posts: 4
Credit: 98,994
RAC: 0
Message 7439 - Posted: 5 May 2005, 9:36:52 UTC - in response to Message 7422.  


> Per-CPU quota is not supported by BOINC so it's unlikely that we would do it.
> Increasing quota is problematic in the sense that some older machines can then
> download too much work at once (and possibly never finish it). But we'll think
> about it.
>
> Can you give an estimate on how many workunits your dual-CPU machine can
> process in a day?
I dont have the exact number, but each WU usually takes 35 minutes, so somewhere between 80 and 90 per day
ID: 7439 · Report as offensive     Reply Quote
ric

Send message
Joined: 17 Sep 04
Posts: 190
Credit: 649,637
RAC: 0
Message 7440 - Posted: 5 May 2005, 11:22:04 UTC - in response to Message 7439.  

dear Markku

It looks like, it's my turn to ask for higher daily quotas

The superfast machines above, thats the high end world.

Depending very of the actual processing stuff, me to, hitting the limit.
This not only with the faster hosts,
also with host of class pentium 2.66, several 3.0 GHz and the amds 2400/2800 are also offering the message.
They still do have some work, but can't "refuel"

The fastest host running, shoes this messages first time short bevor 12h00
now it 13:10 and this host has right now only 4 or 5 WUs (from LHC)left.

Now this host has to "wait" until midnight (nearly 12hours from now) until he got his "refuel".
It's rather cold outside, so this single cpu based Intel Host is running with 3.905 GHz right now.
The average time for a "normal" WU for this host is about 44 Minutes. It takes 2 at time (HT mode) so the returning is 8 WUs done in 3 Hours,
(the theoretical troughput is at least 64 LHC WUs per 24 Hours, not counting the very short ones).

Even faster single cpu based hosts are hitting with out problems the limit,
several slower hosts are also hitting the limit.

May I subscribe to the wishlist of higher limit, please?

At least until the mountain of WUs still to be processed, is done.

regard

ric

ID: 7440 · Report as offensive     Reply Quote
Profile Chrulle

Send message
Joined: 27 Jul 04
Posts: 182
Credit: 1,880
RAC: 0
Message 7442 - Posted: 5 May 2005, 12:06:26 UTC

The ideal situation would be for the scheduler to keep statistics on how many WU a given machine has been able to process in a day and then supply use that amount of WUs and a bit more to allow for fluctuations as the quota. The problem is that it will take far too long for the scheduler to handle those request.

cheers,
Chrulle
Research Assistant &amp; Ex-LHC@home developer
Niels Bohr Institute
ID: 7442 · Report as offensive     Reply Quote
STE\/E

Send message
Joined: 2 Sep 04
Posts: 352
Credit: 1,393,150
RAC: 0
Message 7443 - Posted: 5 May 2005, 12:30:17 UTC - in response to Message 7442.  
Last modified: 5 May 2005, 12:35:04 UTC

> The ideal situation would be for the scheduler to keep statistics on how many
> WU a given machine has been able to process in a day and then supply use that
> amount of WUs and a bit more to allow for fluctuations as the quota. The
> problem is that it will take far too long for the scheduler to handle those
> request.
>
> cheers,
===========

Another problem with trying to do that is the great variance between the length of time it takes to run the different s types (s6 through s18) ... The scheduler would have to know how long each one is going to take to for each individual WU I would think in order to send the proper amount of WU's for each CPU ...

And since each s type can take a different amount of time to process theres no way for the scheduler to send the correct amount of WU's ...
A definite Quagmire to say the least ... hehe
ID: 7443 · Report as offensive     Reply Quote
Profile Markku Degerholm

Send message
Joined: 3 Sep 04
Posts: 212
Credit: 4,545
RAC: 0
Message 7447 - Posted: 5 May 2005, 13:58:54 UTC - in response to Message 7445.  

> That’s strange. According to Bruce Allen, on Einstein “The 'Daily Result
> Quota' is normally 8 workunits (per CPU, with a 4 CPU maximmum)”

Interesting. Either a) I'm wrong b) we are using too old version of the scheduler or c)instein project has done custom modifications.

Guess I need to find out which:)

Markku Degerholm
LHC@home admin
ID: 7447 · Report as offensive     Reply Quote
Profile Paul D. Buck

Send message
Joined: 2 Sep 04
Posts: 545
Credit: 148,912
RAC: 0
Message 7450 - Posted: 5 May 2005, 15:23:26 UTC - in response to Message 7445.  
Last modified: 5 May 2005, 15:27:20 UTC

> > Per-CPU quota is not supported by BOINC so it's unlikely that we would do
> it.
> >
>
> That’s strange. According to Bruce Allen, on Einstein “The 'Daily Result
> Quota' is normally 8 workunits (per CPU, with a 4 CPU maximmum)”
>
> http://einstein.phys.uwm.edu/faq.php#daily_quota

THe daily quota is a project set number.

On Einstein@Home: Maximum daily WU quota 8/day
Predictor@Home: Quota 65
Seti@Home: Maximum daily WU quota 100/day

This number also can fluctuate up and down, with client side problems causing the system to lower the number because of the failures to complete work. Conversly, successes will raise the number to the cap, which should be the number listed herein ...

The number is now part of the Computer Summary screen and should be set by the later generation scheduleers.
ID: 7450 · Report as offensive     Reply Quote
Profile Bruno G. Olsen & ESEA @ greenh...
Avatar

Send message
Joined: 17 Sep 04
Posts: 52
Credit: 247,983
RAC: 0
Message 7451 - Posted: 5 May 2005, 19:32:22 UTC - in response to Message 7430.  

> They should but I'm not sure if they actually work that way. Can anybody
> confirm..? In addition, estimates are only good as long as a BOINC CC is doing
> work 100% of time. If the BOINC client is shut down, there is no much that can
> be done.

I suspected as much with the estimates. In the end though I guess the uptime percentage messurements for each host are ment to take this into consideration, at least to further make sure clients don't get more work than they can handle in time.


ID: 7451 · Report as offensive     Reply Quote
Profile Paul D. Buck

Send message
Joined: 2 Sep 04
Posts: 545
Credit: 148,912
RAC: 0
Message 7452 - Posted: 5 May 2005, 20:42:27 UTC - in response to Message 7451.  

> I suspected as much with the estimates. In the end though I guess the uptime
> percentage messurements for each host are ment to take this into
> consideration, at least to further make sure clients don't get more work than
> they can handle in time.

THe real problem is that it is something of a random walk...

We have an estimate of the runtime of an unstable simulation so that, the real processing time is one second to actual run completion time.

We have the computer on time, resource share, fate, ill-winds, and other daemons.

:)

When I was still working one of my tirades was "the estimate is not the schedule". In software development whenever an estimate is given, that is the OUTSIDE limit on the development time ... sigh ...

ANd I see from the front page we are blowing through the work too ... drat! :)
ID: 7452 · Report as offensive     Reply Quote
Profile Yeti
Volunteer moderator
Avatar

Send message
Joined: 2 Sep 04
Posts: 455
Credit: 198,682,585
RAC: 75,657
Message 7454 - Posted: 5 May 2005, 21:22:23 UTC
Last modified: 5 May 2005, 21:35:15 UTC

HM, my faster boxes are also out of work:

Host ID 26239

Host ID 31646

And, these boxes aren't allowed to bring their full power ! With HT, they have each 4 processors, but BOINC may only use 2 !



Supporting BOINC, a great concept !
ID: 7454 · Report as offensive     Reply Quote
1 · 2 · 3 · Next

Message boards : Number crunching : Daily quota exceeded


©2024 CERN