Message boards : Number crunching : Resigning due to short deadlines
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
Angus

Send message
Joined: 3 Oct 04
Posts: 19
Credit: 46,312
RAC: 0
Message 9838 - Posted: 2 Sep 2005, 1:55:05 UTC - in response to Message 9807.  

<blockquote>This is again a problem with longterm and short term view of things.

GasGiant you want your machines not to run out of work, which is understandable, but if we give long deadlines we will have a very long tail of jobs that do not finish. This will then lead to a very long time for a study to finish, and therefore a much longer time between runs where you will have work outages from us.

I think we all noticed that the last work outage was on the order of days and not weeks or months as we have seen before.

I agree that maybe the current deadline is a bit short, but it is what the statistics say will give us the best turnaround time(well it is actually two standard deviations more to not give a too low deadline), if too many people drop out and stop crunching the statistics will automatically detect this and raise the deadline again. I might incorporate a minimum deadline of say 6-7 days. I do not think that a 5 day deadline is way too low but it is about the smallest reasonable amount.



</blockquote>

Why can't you have multiple runs going at once, with staggered starts?

I'm sure the physicists and engineers can come up with more than one scenario to test at the same time...

Then nobody would be in the position of running out of work while they decide what to test next.
ID: 9838 · Report as offensive     Reply Quote
Profile The Gas Giant

Send message
Joined: 2 Sep 04
Posts: 309
Credit: 715,258
RAC: 0
Message 9839 - Posted: 2 Sep 2005, 5:29:10 UTC - in response to Message 9807.  
Last modified: 2 Sep 2005, 5:34:51 UTC

<blockquote>This is again a problem with longterm and short term view of things.

GasGiant you want your machines not to run out of work, which is understandable, but if we give long deadlines we will have a very long tail of jobs that do not finish. This will then lead to a very long time for a study to finish, and therefore a much longer time between runs where you will have work outages from us.

</blockquote>
Chrulle,

I really only want enough work to last from 5pm Friday to 8:30am Monday. With the current LHC deadlines, wu estimations and BOINC operation this cannot occur. Is it so unreasonable to try and keep 2.75 days of actual work on my machine if you can be guaranteed it will be returned within 4 to 5 days? If your basically happy with this then you need to start to lobby the BOINC devs to change the max cached work before EDF mode is hit to be increased from 50% of the earliest deadline to something higher like 80%. This is where there is a basic fault with BOINC which then causes major swings in project allocation, wu caching and user frustration. This whole discussion might have been avoided IF this constraint was at 80% and not at 50%.

Live long and crunch.

Paul.
ID: 9839 · Report as offensive     Reply Quote
Profile adrianxw

Send message
Joined: 29 Sep 04
Posts: 187
Credit: 705,487
RAC: 0
Message 9845 - Posted: 2 Sep 2005, 8:15:30 UTC
Last modified: 2 Sep 2005, 8:16:39 UTC

If they cannot analyse the results until all of the wu's are crunched, AND you have hoarders and slowpokes delaying the end of the run, then dropping the deadline seems perfectly reasonable. Remember, they have a job of work to do and we are helping them with it. It is not they that are helping us.

As I understand the newer BOINC cores, if a project loads a wu which needs to be crunched at higher than normal priority to meet a deadline, then the project as a whole gets a debt hit so it will not download any more wu's until that debt hit has been cleared. Thus the other projects get xactly the quota YOU asked for. How, therefore is LHC being "greedy".

Just to add, the new deadline doesn't affect me at all. I download 1 wu at a time, crunch it and upload it again, typically 2 wu's per day with a quota of 20%

Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 9845 · Report as offensive     Reply Quote
Heffed

Send message
Joined: 2 Sep 04
Posts: 71
Credit: 8,657
RAC: 0
Message 9877 - Posted: 3 Sep 2005, 8:15:06 UTC

Not every project is going to be perfect for everyone. The project developers are the only people who can determine what project settings meet their needs. If you can't run a project due to short deadlines, I'm sure that's a risk they've factored in to their reasoning. A shorter deadline definitely rules out some machines, but if the machines are more a hindrance to the expected progress than a help, then I would expect them to do what they've done. To call them greedy or say they're trying to take over your machines is just stupid...
ID: 9877 · Report as offensive     Reply Quote
Profile Contact
Avatar

Send message
Joined: 17 Sep 04
Posts: 53
Credit: 1,752,329
RAC: 1,476
Message 9895 - Posted: 3 Sep 2005, 17:22:45 UTC - in response to Message 9877.  

Hi Heffed. Very much agree with your statements here except
<blockquote>To call them greedy or say they're trying to take over your machines is just stupid...</blockquote>
I don’t think it’s stupid, just too harsh to call them greedy etc.
I guess it’s 1 of the BOINC hazards to consider wu’s as entities.
To download a wu and then immediately have to process it because of deadline does make that wu appear rude. I can understand anyone being upset at seeing this behavior.
Most of us understand the unique needs of this project and trust the folks involved to make the right decisions.
I hope 5 day deadlines aren’t absolutely necessary but I am not in this for my own comfort and will try to contribute within the constraints.
I still think all projects should be encouraged to strive for 14 day slack :-)

ID: 9895 · Report as offensive     Reply Quote
Ross Morgan

Send message
Joined: 24 Jul 05
Posts: 8
Credit: 4,296
RAC: 0
Message 9897 - Posted: 3 Sep 2005, 20:03:41 UTC

The deadlines seem to be getting longer again. Just got one for the 12/09/05 today.


ID: 9897 · Report as offensive     Reply Quote
madmac
Avatar

Send message
Joined: 25 Aug 05
Posts: 42
Credit: 3,518
RAC: 0
Message 9898 - Posted: 3 Sep 2005, 20:14:31 UTC

Same here I have just received on deadline the 12th

ID: 9898 · Report as offensive     Reply Quote
Profile Contact
Avatar

Send message
Joined: 17 Sep 04
Posts: 53
Credit: 1,752,329
RAC: 1,476
Message 9900 - Posted: 3 Sep 2005, 20:36:26 UTC

With pref set to 4 day connect I noticed that hosts updated here in past 24hrs each downloaded 1 wu due in 4 days and 1 due in 9 days.
An interesting attempt at compromise?
ID: 9900 · Report as offensive     Reply Quote
Previous · 1 · 2

Message boards : Number crunching : Resigning due to short deadlines


©2024 CERN