Message boards : Number crunching : Failed to download
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Uffe F

Send message
Joined: 9 Jan 08
Posts: 66
Credit: 727,923
RAC: 0
Message 24220 - Posted: 10 Jul 2012, 14:52:09 UTC

I'm getting the following report now when trying to get work:

10-07-2012 16:39:55 | LHC@home 1.0 | Sending scheduler request: To fetch work.
10-07-2012 16:39:55 | LHC@home 1.0 | Requesting new tasks for CPU
10-07-2012 16:39:57 | LHC@home 1.0 | Scheduler request completed: got 8 new tasks
10-07-2012 16:39:59 | LHC@home 1.0 | Started download of w1jul_niebb1d__26__s__64.28_59.31__11.2_11.4__6__49_1_sixvf_boinc45973.zip
10-07-2012 16:39:59 | LHC@home 1.0 | Started download of w1jul_niebb0d__30__s__64.28_59.31__10_10.2__6__46_1_sixvf_boinc52556.zip
10-07-2012 16:40:00 | LHC@home 1.0 | Giving up on download of w1jul_niebb1d__26__s__64.28_59.31__11.2_11.4__6__49_1_sixvf_boinc45973.zip: permanent HTTP error
10-07-2012 16:40:00 | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__30__s__64.28_59.31__10_10.2__6__46_1_sixvf_boinc52556.zip: permanent HTTP error
10-07-2012 16:40:00 | LHC@home 1.0 | Started download of w1jul_niebb0d__2__s__64.28_59.31__8.6_8.8__6__43_1_sixvf_boinc2090.zip
10-07-2012 16:40:00 | LHC@home 1.0 | Started download of w1jul_niebb0d__4__s__64.28_59.31__8.4_8.6__6__81_1_sixvf_boinc5599.zip
10-07-2012 16:40:01 | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__2__s__64.28_59.31__8.6_8.8__6__43_1_sixvf_boinc2090.zip: permanent HTTP error
10-07-2012 16:40:01 | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__4__s__64.28_59.31__8.4_8.6__6__81_1_sixvf_boinc5599.zip: permanent HTTP error
10-07-2012 16:40:01 | LHC@home 1.0 | Started download of w1jul_niebb1d__3__s__64.28_59.31__9.8_10__6__74_1_sixvf_boinc4435.zip
10-07-2012 16:40:01 | LHC@home 1.0 | Started download of w1jul_niebb0d__28__s__64.28_59.31__11.2_11.4__6__4_1_sixvf_boinc49488.zip
10-07-2012 16:40:02 | LHC@home 1.0 | Giving up on download of w1jul_niebb1d__3__s__64.28_59.31__9.8_10__6__74_1_sixvf_boinc4435.zip: permanent HTTP error
10-07-2012 16:40:02 | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__28__s__64.28_59.31__11.2_11.4__6__4_1_sixvf_boinc49488.zip: permanent HTTP error
10-07-2012 16:40:02 | LHC@home 1.0 | Started download of w1jul_niebb0d__10__s__64.28_59.31__8.2_8.4__6__84_1_sixvf_boinc16193.zip
10-07-2012 16:40:02 | LHC@home 1.0 | Started download of w1jul_niebb0d__28__s__64.28_59.31__11.4_11.6__6__61_1_sixvf_boinc49634.zip
10-07-2012 16:40:03 | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__10__s__64.28_59.31__8.2_8.4__6__84_1_sixvf_boinc16193.zip: permanent HTTP error
10-07-2012 16:40:03 | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__28__s__64.28_59.31__11.4_11.6__6__61_1_sixvf_boinc49634.zip: permanent HTTP error
10-07-2012 16:49:34 | LHC@home 1.0 | update requested by user
10-07-2012 16:49:35 | LHC@home 1.0 | Sending scheduler request: Requested by user.
10-07-2012 16:49:35 | LHC@home 1.0 | Reporting 8 completed tasks, requesting new tasks for CPU
10-07-2012 16:49:37 | LHC@home 1.0 | Scheduler request completed: got 8 new tasks
10-07-2012 16:49:39 | LHC@home 1.0 | Started download of w1jul_niebb1d__28__s__64.28_59.31__10.8_11__6__52_1_sixvf_boinc49358.zip
10-07-2012 16:49:39 | LHC@home 1.0 | Started download of w1jul_niebb1d__9__s__64.28_59.31__9.6_9.8__6__7_1_sixvf_boinc14959.zip
10-07-2012 16:49:40 | LHC@home 1.0 | Giving up on download of w1jul_niebb1d__28__s__64.28_59.31__10.8_11__6__52_1_sixvf_boinc49358.zip: permanent HTTP error
10-07-2012 16:49:40 | LHC@home 1.0 | Giving up on download of w1jul_niebb1d__9__s__64.28_59.31__9.6_9.8__6__7_1_sixvf_boinc14959.zip: permanent HTTP error
10-07-2012 16:49:40 | LHC@home 1.0 | Started download of w1jul_niebb1d__29__s__64.28_59.31__10.8_11__6__43_1_sixvf_boinc51129.zip
10-07-2012 16:49:40 | LHC@home 1.0 | Started download of w1jul_niebb0d__29__s__64.28_59.31__10_10.2__6__74_1_sixvf_boinc50804.zip
10-07-2012 16:49:41 | LHC@home 1.0 | Giving up on download of w1jul_niebb1d__29__s__64.28_59.31__10.8_11__6__43_1_sixvf_boinc51129.zip: permanent HTTP error
10-07-2012 16:49:41 | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__29__s__64.28_59.31__10_10.2__6__74_1_sixvf_boinc50804.zip: permanent HTTP error
10-07-2012 16:49:41 | LHC@home 1.0 | Started download of w1jul_niebb1d__30__s__64.28_59.31__8.6_8.8__6__53_1_sixvf_boinc51940.zip
10-07-2012 16:49:41 | LHC@home 1.0 | Started download of w1jul_niebb0d__28__s__64.28_59.31__11.8_12__6__20_1_sixvf_boinc49771.zip
10-07-2012 16:49:42 | LHC@home 1.0 | Giving up on download of w1jul_niebb1d__30__s__64.28_59.31__8.6_8.8__6__53_1_sixvf_boinc51940.zip: permanent HTTP error
10-07-2012 16:49:42 | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__28__s__64.28_59.31__11.8_12__6__20_1_sixvf_boinc49771.zip: permanent HTTP error
10-07-2012 16:49:42 | LHC@home 1.0 | Started download of w1jul_niebb0d__12__s__64.28_59.31__8_8.2__6__21_1_sixvf_boinc19601.zip
10-07-2012 16:49:42 | LHC@home 1.0 | Started download of w1jul_niebb1d__27__s__64.28_59.31__10.4_10.6__6__45_1_sixvf_boinc47393.zip
10-07-2012 16:49:43 | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__12__s__64.28_59.31__8_8.2__6__21_1_sixvf_boinc19601.zip: permanent HTTP error
10-07-2012 16:49:43 | LHC@home 1.0 | Giving up on download of w1jul_niebb1d__27__s__64.28_59.31__10.4_10.6__6__45_1_sixvf_boinc47393.zip: permanent HTTP error
ID: 24220 · Report as offensive     Reply Quote
Profile Bambi

Send message
Joined: 9 Sep 08
Posts: 3
Credit: 441,779
RAC: 0
Message 24221 - Posted: 10 Jul 2012, 15:00:12 UTC

I have seen a fair few of these since the weekend too, all with a permanent HTTP error.
ID: 24221 · Report as offensive     Reply Quote
Profile Robert Pick

Send message
Joined: 1 Dec 05
Posts: 62
Credit: 11,441,610
RAC: 0
Message 24222 - Posted: 10 Jul 2012, 15:04:52 UTC
Last modified: 10 Jul 2012, 15:09:48 UTC

Same here!!!! But 13 downloaded, don't know how many failed. Kept updating and different ones kept failing. The ones that made it through are running fine!
ID: 24222 · Report as offensive     Reply Quote
T.J.

Send message
Joined: 17 Feb 07
Posts: 86
Credit: 968,855
RAC: 0
Message 24223 - Posted: 10 Jul 2012, 15:18:32 UTC

There are a lot of problems with the HTTP, but nothing is done yet.
I try to upload for week now but no actions what so ever.
At Einstein@home issues are resolved within a day!
That's wht they are my main project for ever.

My LHC WU's must be in tomorrow 11 July for the deadline, that will not work and then I leave.
Greetings from,
TJ
ID: 24223 · Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 1156
Credit: 52,507,530
RAC: 60,098
Message 24236 - Posted: 10 Jul 2012, 18:43:47 UTC
Last modified: 10 Jul 2012, 18:45:25 UTC

Getting the same thing the last few days.

Good thing I still have tasks on a couple of my hosts.



7/10/2012 11:41:02 AM | LHC@home 1.0 | update requested by user
7/10/2012 11:41:04 AM | LHC@home 1.0 | Sending scheduler request: Requested by user.
7/10/2012 11:41:04 AM | LHC@home 1.0 | Requesting new tasks for CPU
7/10/2012 11:41:06 AM | LHC@home 1.0 | Scheduler request completed: got 8 new tasks
7/10/2012 11:41:08 AM | LHC@home 1.0 | Started download of sixtrack_windows_gen
7/10/2012 11:41:08 AM | LHC@home 1.0 | Started download of w1jul_niebb0d__28__s__64.28_59.31__9_9.2__6__26_1_sixvf_boinc48531.zip
7/10/2012 11:41:09 AM | LHC@home 1.0 | Giving up on download of sixtrack_windows_gen: permanent HTTP error
7/10/2012 11:41:09 AM | LHC@home 1.0 | Started download of w1jul_niebb0d__26__s__64.28_59.31__9.6_9.8__6__72_1_sixvf_boinc45284.zip
7/10/2012 11:41:10 AM | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__26__s__64.28_59.31__9.6_9.8__6__72_1_sixvf_boinc45284.zip: permanent HTTP error
7/10/2012 11:41:10 AM | LHC@home 1.0 | Started download of w1jul_niebb1d__28__s__64.28_59.31__8.8_9__6__58_1_sixvf_boinc48474.zip
7/10/2012 11:41:11 AM | LHC@home 1.0 | Finished download of w1jul_niebb0d__28__s__64.28_59.31__9_9.2__6__26_1_sixvf_boinc48531.zip
7/10/2012 11:41:11 AM | LHC@home 1.0 | Giving up on download of w1jul_niebb1d__28__s__64.28_59.31__8.8_9__6__58_1_sixvf_boinc48474.zip: permanent HTTP error
7/10/2012 11:41:11 AM | LHC@home 1.0 | Started download of w1jul_niebb1d__30__s__64.28_59.31__9.2_9.4__6__43_1_sixvf_boinc52197.zip
7/10/2012 11:41:11 AM | LHC@home 1.0 | Started download of w1jul_niebb0d__27__s__64.28_59.31__9.4_9.6__6__64_1_sixvf_boinc46967.zip
7/10/2012 11:41:13 AM | LHC@home 1.0 | Giving up on download of w1jul_niebb1d__30__s__64.28_59.31__9.2_9.4__6__43_1_sixvf_boinc52197.zip: permanent HTTP error
7/10/2012 11:41:13 AM | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__27__s__64.28_59.31__9.4_9.6__6__64_1_sixvf_boinc46967.zip: permanent HTTP error
7/10/2012 11:41:13 AM | LHC@home 1.0 | Started download of w1jul_niebb1d__26__s__64.28_59.31__11.8_12__6__19_1_sixvf_boinc46210.zip
7/10/2012 11:41:13 AM | LHC@home 1.0 | Started download of w1jul_niebb0d__26__s__64.28_59.31__9.4_9.6__6__60_1_sixvf_boinc45183.zip
7/10/2012 11:41:14 AM | LHC@home 1.0 | Giving up on download of w1jul_niebb1d__26__s__64.28_59.31__11.8_12__6__19_1_sixvf_boinc46210.zip: permanent HTTP error
7/10/2012 11:41:14 AM | LHC@home 1.0 | Temporarily failed download of w1jul_niebb0d__26__s__64.28_59.31__9.4_9.6__6__60_1_sixvf_boinc45183.zip: transient HTTP error
7/10/2012 11:41:14 AM | LHC@home 1.0 | Backing off 2 min 54 sec on download of w1jul_niebb0d__26__s__64.28_59.31__9.4_9.6__6__60_1_sixvf_boinc45183.zip
7/10/2012 11:41:14 AM | LHC@home 1.0 | Started download of w1jul_niebb0d__29__s__64.28_59.31__9_9.2__6__4_1_sixvf_boinc50289.zip
7/10/2012 11:41:15 AM | LHC@home 1.0 | Giving up on download of w1jul_niebb0d__29__s__64.28_59.31__9_9.2__6__4_1_sixvf_boinc50289.zip: permanent HTTP error
7/10/2012 11:41:20 AM | LHC@home 1.0 | File w1jul_niebb0d__26__s__64.28_59.31__9.4_9.6__6__60_1_sixvf_boinc45183.zip exists already, skipping download
Volunteer Mad Scientist For Life
ID: 24236 · Report as offensive     Reply Quote
Swordfish

Send message
Joined: 2 Oct 11
Posts: 4
Credit: 30,680
RAC: 0
Message 24247 - Posted: 11 Jul 2012, 5:19:32 UTC

Another 2 arrived today with same http error
ID: 24247 · Report as offensive     Reply Quote
Profile Vesper

Send message
Joined: 3 Mar 11
Posts: 3
Credit: 560,746
RAC: 0
Message 24248 - Posted: 11 Jul 2012, 6:52:16 UTC

Same here. LHC@home was great, even when there were almost zero tasks, until recently. Do fix your upload/download server, otherwise you will only get failures, and even you can break the LHC itself with this. Grrrr.
ID: 24248 · Report as offensive     Reply Quote
Profile Gary Roberts

Send message
Joined: 22 Jul 05
Posts: 72
Credit: 3,962,626
RAC: 0
Message 24249 - Posted: 11 Jul 2012, 7:50:49 UTC - in response to Message 24248.  

There's not much point getting angry and blaming the servers. 'Fixing' a server will not allow it to transfer a non-existent file.

When your client requests work, it is handed the URL(s) for any data file(s) associated with any task(s) allocated to your host. Having received such a URL, your client attempts to initiate a download of the file at the specified location. The problem is that the file simply doesn't exist at the specified location. It's not a problem of an overloaded or unavailable server. If it were, it would be classified as a temporary failure and BOINC would keep retrying until the transfer succeeded.

In the current situation, the non-existent file(s) leads to an immediate permanent failure. BOINC is 'smart enough' (?) to give up completely if a file doesn't exist at all.

This is having an unfortunate consequence. There is a limit of 10 tasks per quorum and in a lot of cases, some days ago, hosts were able to download the data before these files became 'lost'. So a lot of people did invest time and effort in crunching such tasks before the problem arose. In quite a few cases, extra tasks were needed (to resolve incompatible answers or replace compute failures, etc) so now that the data files no longer exist, the permanent download failures will eventually push each quorum to the limit of 10 at which point any completed 'pending' tasks will be no longer able to be used and their pending status will change to 'can't validate'. If you have any such tasks in your list, drill down through the WUID link on the website and you will see all the download failures making up a full list of 10 instances of that task. The whole thing fails when the system tries to generate the 11th copy of the task and then discovers that the limit is exceeded.

Eric is certainly trying to rectify things - see his post in the News forum late last night. He said there that he will reassess the situation first thing this morning so we just need to be patient until he has time to do that.

Cheers,
Gary.
ID: 24249 · Report as offensive     Reply Quote
Eric Mcintosh
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 12 Jul 11
Posts: 857
Credit: 1,619,050
RAC: 0
Message 24253 - Posted: 11 Jul 2012, 9:31:03 UTC

Thanks Gary; penetrating comment. I was about to try and
find some Apache/WWW expertise but I think we should closer
to home. Database, work units etc. More news soonest. Eric.
ID: 24253 · Report as offensive     Reply Quote
Eric Mcintosh
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 12 Jul 11
Posts: 857
Credit: 1,619,050
RAC: 0
Message 24254 - Posted: 11 Jul 2012, 9:33:26 UTC - in response to Message 24223.  

Fighting to meet your deadline! Have been working solidly
on this and dropped everythingelse, weekends and nights
included. Doing our best even if clearly not good enough.
More work is ready once problem is solved. Eri.
ID: 24254 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 27 Oct 07
Posts: 186
Credit: 3,297,640
RAC: 0
Message 24255 - Posted: 11 Jul 2012, 10:08:28 UTC

Forgive me for interrupting from the peanut gallery while you're busy, but I'm hoping this might give a clue:

The most recent files on my computers - such as sixtrack_windows_sse3, the v444.01 executable - were downloaded from

http://lhcathomeclassic.cern.ch/sixtrack/download/

That url is accessible using a browser, and contains the usual 'fanout' structure of folders named 0 through 3ff.

But I can see no files at all - neither the executables and sundry files (normally in the root), nor any data files in subfolders 'touched' within the last few minutes.

Either something/someone has wiped your file storage area clean, or the url is pointing to somewhere other than the place where the files are currently stored.
ID: 24255 · Report as offensive     Reply Quote
Profile pete
Volunteer moderator
Project administrator
Project developer
Project tester

Send message
Joined: 4 Aug 11
Posts: 12
Credit: 1,982,950
RAC: 0
Message 24256 - Posted: 11 Jul 2012, 14:51:15 UTC

I have tasks running on my Windows PC
ID: 24256 · Report as offensive     Reply Quote
Profile [AF>Libristes] nico8313
Avatar

Send message
Joined: 27 Jan 11
Posts: 1
Credit: 111,428
RAC: 0
Message 24258 - Posted: 11 Jul 2012, 15:01:17 UTC

Hi,

Very good,
me too on my gnu/linux and windo :-)

Thank you
ID: 24258 · Report as offensive     Reply Quote
Profile sysfried

Send message
Joined: 27 Sep 04
Posts: 282
Credit: 1,415,417
RAC: 0
Message 24259 - Posted: 11 Jul 2012, 15:11:21 UTC - in response to Message 24256.  

Happy, Thank you, more please! :-)
ID: 24259 · Report as offensive     Reply Quote
Uffe F

Send message
Joined: 9 Jan 08
Posts: 66
Credit: 727,923
RAC: 0
Message 24260 - Posted: 11 Jul 2012, 15:16:46 UTC

I got a lot of WU's now, thanks for the hard work.

Got all tasks as SSE3 except one, so it seams that the PNI mark is choosen also now :)
ID: 24260 · Report as offensive     Reply Quote
Uffe F

Send message
Joined: 9 Jan 08
Posts: 66
Credit: 727,923
RAC: 0
Message 24261 - Posted: 11 Jul 2012, 15:16:48 UTC

I got a lot of WU's now, thanks for the hard work.

Got all tasks as SSE3 except one, so it seams that the PNI mark is choosen also now :)
ID: 24261 · Report as offensive     Reply Quote
Tazz

Send message
Joined: 2 Oct 11
Posts: 1
Credit: 14,683,228
RAC: 0
Message 24267 - Posted: 11 Jul 2012, 16:53:58 UTC

after so many of this messages i think the problem is solved:

11/07/2012 19:50:54 | LHC@home 1.0 | This computer has finished a daily quota of 1 tasks

:)
ID: 24267 · Report as offensive     Reply Quote
Profile littleBouncer
Avatar

Send message
Joined: 23 Oct 04
Posts: 358
Credit: 1,439,205
RAC: 0
Message 24277 - Posted: 11 Jul 2012, 19:20:11 UTC

My too, Failed to download, after a few worthless work done by CPUs..:(
I have no plan what is wrong...


greetz littleBouncer
ID: 24277 · Report as offensive     Reply Quote
Eric Mcintosh
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 12 Jul 11
Posts: 857
Credit: 1,619,050
RAC: 0
Message 24278 - Posted: 11 Jul 2012, 19:31:48 UTC - in response to Message 24255.  

Yes; "Somebody" has changed WWWW URLs I don't know what........
Just what we don't need right now! I'll try and figure it out.
I think you need to look again for lhc@home and see what you get.
What a mess. I wonder who is running this project. I feel responsible but have
no authority, budget or anything. Just over 40 tears of experience
and a desire to make this work! Eric.
ID: 24278 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 27 Oct 07
Posts: 186
Credit: 3,297,640
RAC: 0
Message 24283 - Posted: 11 Jul 2012, 20:56:17 UTC - in response to Message 24278.  

Yes; "Somebody" has changed WWWW URLs I don't know what........
Just what we don't need right now! I'll try and figure it out.
I think you need to look again for lhc@home and see what you get.
What a mess. I wonder who is running this project. I feel responsible but have
no authority, budget or anything. Just over 40 tears of experience
and a desire to make this work! Eric.

Yes, your hard work this afternoon has certainly paid off.

The host where I pulled that 'http://lhcathomeclassic.cern.ch/sixtrack/download/' url has been allocated new work, and successfully downloaded the datafiles from that same url: looking at it in this browser, it seems to have a full complement of executables and data folders.

But did you see my note about an apparent server mis-configuration in New work, but a configuration problem?
ID: 24283 · Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Failed to download


©2024 CERN