Message boards : Number crunching : Even shorter deadlines?
Message board moderation

To post messages, you must log in.

AuthorMessage
klasm

Send message
Joined: 22 Jul 05
Posts: 31
Credit: 2,909
RAC: 0
Message 9513 - Posted: 20 Aug 2005, 21:47:53 UTC

Just curious here. Why not make the deadline for LHC WUs even shorter? 3-4 days? I guess there might be technical reason for not making it that short, but that would be interesting to hear too.

As we have seen there are those who would compalin about not being able to keep a big cacheof WUs. However, since LHC is really a throughput project wouldn't it be best for the project with many users and more or less no caches? No caches at all might of course lead to higher load on the servers and not be practical for that reason.
ID: 9513 · Report as offensive     Reply Quote
Pete49

Send message
Joined: 18 Sep 04
Posts: 35
Credit: 250,303
RAC: 0
Message 9520 - Posted: 21 Aug 2005, 10:58:10 UTC - in response to Message 9513.  

<blockquote>Just curious here. Why not make the deadline for LHC WUs even shorter? 3-4 days? I guess there might be technical reason for not making it that short, but that would be interesting to hear too.

As we have seen there are those who would compalin about not being able to keep a big cacheof WUs. However, since LHC is really a throughput project wouldn't it be best for the project with many users and more or less no caches? No caches at all might of course lead to higher load on the servers and not be practical for that reason.</blockquote>

Unless the general preference "maximum days to connect" is reduced as well, I foresee work actually taking longer as results expire before return and the WU takes forever to validate.

Shorter cues would result but, all projects must accommodate dial-up volunteers. They need a moderately long cue to minimize the use of their line.


<img src="http://www.boincstats.com/stats/teambanner.php?teamname=GasBuddy"> <img src="http://www.boincstats.com/stats/banner.php?cpid=84c0cf7846cbf28338406e54b3eb8a83">
ID: 9520 · Report as offensive     Reply Quote
klasm

Send message
Joined: 22 Jul 05
Posts: 31
Credit: 2,909
RAC: 0
Message 9523 - Posted: 21 Aug 2005, 15:59:15 UTC
Last modified: 21 Aug 2005, 16:00:17 UTC

>Unless the general preference "maximum days to connect" is reduced as well, I
>foresee work actually taking longer as results expire before return and the WU
>takes forever to validate.

Will boinc download more WUs than the machine is estimated to be able to finish before their deadline? If it does not then this problem shouldn't occur.
Even if some WUs expire my impression is that the shorter deadline should cause them to be resent to new hosts fairly quickly.

>Shorter cues would result but, all projects must accommodate dial-up
>volunteers. They need a moderately long cue to minimize the use of their line.

Unless a single WU takes 4 days, and you only connect every 4 days, this shouldn't be a problem for those on dial-up either.


As I said earlier deadlines this short might not be practical for many reasons, but I'm curiosu to find out what the limiting factors are.
ID: 9523 · Report as offensive     Reply Quote
Gaspode the UnDressed

Send message
Joined: 1 Sep 04
Posts: 506
Credit: 118,619
RAC: 0
Message 9524 - Posted: 21 Aug 2005, 16:53:32 UTC

One limiting factor is the deadlines of other BOINC projects. I have had to micromanage the balance between LHC and Einstein until recently because Einstein used a deadline of seven days. The result was that I dropped einstein because the scheduling was too time-consuming to manage.

I suspect that the shorter deadlines now used by LHC and 14 day deadline used by Einstein will precipitate similar issues in reverse.

Gaspode the UnDressed
http://www.littlevale.co.uk
ID: 9524 · Report as offensive     Reply Quote
Profile Keck_Komputers

Send message
Joined: 1 Sep 04
Posts: 275
Credit: 2,652,452
RAC: 0
Message 9527 - Posted: 21 Aug 2005, 17:26:57 UTC - in response to Message 9524.  

<blockquote>One limiting factor is the deadlines of other BOINC projects. I have had to micromanage the balance between LHC and Einstein until recently because Einstein used a deadline of seven days. The result was that I dropped einstein because the scheduling was too time-consuming to manage.

I suspect that the shorter deadlines now used by LHC and 14 day deadline used by Einstein will precipitate similar issues in reverse.
</blockquote>
Client versions 4.45 and later don't need the micromanaging to meet the deadlines (or at least get close to them).
BOINC WIKI

BOINCing since 2002/12/8
ID: 9527 · Report as offensive     Reply Quote
dre
Avatar

Send message
Joined: 24 Jul 05
Posts: 12
Credit: 29,949
RAC: 0
Message 9530 - Posted: 21 Aug 2005, 18:54:11 UTC

For people with continual access to the internet, a shorter limit would not be a problem. However, dial-up users who infrequently access the net may be locked out. As was pointed out in this thread, a boinc project must accomadate everyone.
ID: 9530 · Report as offensive     Reply Quote
Gaspode the UnDressed

Send message
Joined: 1 Sep 04
Posts: 506
Credit: 118,619
RAC: 0
Message 9533 - Posted: 21 Aug 2005, 21:20:53 UTC - in response to Message 9527.  


<blockquote>
Client versions 4.45 and later don't need the micromanaging to meet the deadlines (or at least get close to them). </blockquote>

I'm running 4.45 and 4.72. With the combination of CPU, deadlines, differing run times of the two projects, and my chosen allocation of CPU time (70:30 LHC:Einstein) I couldn't complete an Einstein unit in the time available without micromanaging BOINC, or basically allowing BOINC to run Einstein all the time. I could have changed the allocation to 50:50, or maybe 30:70, but I prefer to run LHC. Since BOINC couldn't cope with the short Einstein deadlines I dropped it. For what it's worth all my machines are running Einstein while LHC is out of work. I'll switch back when LHC restarts.

Gaspode the UnDressed
http://www.littlevale.co.uk
ID: 9533 · Report as offensive     Reply Quote
Profile MJKelleher

Send message
Joined: 14 Jul 05
Posts: 3
Credit: 1,172,093
RAC: 222
Message 9534 - Posted: 21 Aug 2005, 23:34:16 UTC - in response to Message 9533.  

<blockquote>I'm running 4.45 and 4.72. With the combination of CPU, deadlines, differing run times of the two projects, and my chosen allocation of CPU time (70:30 LHC:Einstein) I couldn't complete an Einstein unit in the time available without micromanaging BOINC, or basically allowing BOINC to run Einstein all the time. I could have changed the allocation to 50:50, or maybe 30:70, but I prefer to run LHC. Since BOINC couldn't cope with the short Einstein deadlines I dropped it. For what it's worth all my machines are running Einstein while LHC is out of work. I'll switch back when LHC restarts.
</blockquote>
If you leave BOINC alone to manage the resources, it'll meet the Einsten deadlines, then not download more from E@H until it's needed to meet your resource allocation goals. On a given day, it might not be the 70/30 or whatever split you define, but over the long run, it'll honor your allocation. You just have to leave it alone to do it!

MJ
BOINC Wiki Thanks to Paul D. Buck and associates

ID: 9534 · Report as offensive     Reply Quote
Gaspode the UnDressed

Send message
Joined: 1 Sep 04
Posts: 506
Credit: 118,619
RAC: 0
Message 9536 - Posted: 22 Aug 2005, 6:08:48 UTC - in response to Message 9534.  

<blockquote>
If you leave BOINC alone to manage the resources, it'll meet the Einsten deadlines, then not download more from E@H until it's needed to meet your resource allocation goals. On a given day, it might not be the 70/30 or whatever split you define, but over the long run, it'll honor your allocation. You just have to leave it alone to do it!

MJ</blockquote>

Mostly I do just leave BOINC to get on with it. The theory is good, but with computers actually missing deadlines it seems that the practice isn't quite there yet.
Gaspode the UnDressed
http://www.littlevale.co.uk
ID: 9536 · Report as offensive     Reply Quote
Antjest

Send message
Joined: 30 Sep 04
Posts: 21
Credit: 1,442,034
RAC: 0
Message 9557 - Posted: 22 Aug 2005, 18:17:03 UTC - in response to Message 9536.  

<blockquote>

Mostly I do just leave BOINC to get on with it. The theory is good, but with computers actually missing deadlines it seems that the practice isn't quite there yet.</blockquote>



Then my guess is, you are still using too large queue for this computer.

And as a long time dial-up user I see no difference in connecting once a week for 35mins or every day for 5mins. You do check your e-mail daily ?

Except for the holidays. But then your computer can have one too :)
ID: 9557 · Report as offensive     Reply Quote
Gaspode the UnDressed

Send message
Joined: 1 Sep 04
Posts: 506
Credit: 118,619
RAC: 0
Message 9559 - Posted: 22 Aug 2005, 18:55:49 UTC - in response to Message 9557.  

<blockquote>

Then my guess is, you are still using too large queue for this computer.

</blockquote>

Queue usually set to 0.5 day...



Gaspode the UnDressed
http://www.littlevale.co.uk
ID: 9559 · Report as offensive     Reply Quote
Angus

Send message
Joined: 3 Oct 04
Posts: 19
Credit: 46,312
RAC: 0
Message 9560 - Posted: 22 Aug 2005, 19:17:21 UTC

It's the problem that's been beat to death over on the SETI boards -

The "Cache Size" and the "Connect Every xx Days" need to be separate parameters.

That will let people size their cache as desired and still be able to connect and upload/download/report on a timely basis.


ID: 9560 · Report as offensive     Reply Quote
Profile Contact
Avatar

Send message
Joined: 17 Sep 04
Posts: 53
Credit: 1,752,363
RAC: 1,265
Message 9563 - Posted: 22 Aug 2005, 19:52:15 UTC

Most dial-up users that run more than 1 project will agree that shorter deadlines require more attention. The reasons are many.
The client side scheduler has made this problem far less severe, but shorter deadlines can still cause sweat on the forehead.

The "Cache Size" and the "Connect Every xx Days" need to be separate parameters.
This is very tempting, but may cause more problems than exist now if parameters are not chosen correctly.

I still feel more comfortable with longer deadlines. In the expected life for any project, I can’t see that a few days will slow things down that much.
ID: 9563 · Report as offensive     Reply Quote
klasm

Send message
Joined: 22 Jul 05
Posts: 31
Credit: 2,909
RAC: 0
Message 9567 - Posted: 22 Aug 2005, 21:21:14 UTC

>I still feel more comfortable with longer deadlines. In the expected life
>for any project, I can’t see that a few days will slow things down that much.

For most BOINC projects I agree.

This will wary a lot between different projects. Most current BOINC projects don't rely on getting one bacth of work completely done before a new one can be generated. The current extremes seems to be CPN, for which a single WU can take months to complete, and LHC, for which one needs to analyse the results of one batch before the next can be started.

For CPDN alsmot anything is fine as long as the WU eventually gets done. For LHC the ideal situation as far as the science is concerned would be to have everyone download 1 wu, process it, send it back and download 1 new WU.
This isn't practical for most users, but those wishing be as helpful as possible for the science of the LHC-project should try to keep caches small and connect often instead.
ID: 9567 · Report as offensive     Reply Quote

Message boards : Number crunching : Even shorter deadlines?


©2024 CERN