Message boards :
Number crunching :
Downloads have stalled
Message board moderation
Author | Message |
---|---|
![]() Send message Joined: 28 Sep 04 Posts: 739 Credit: 50,747,826 RAC: 37,149 ![]() ![]() ![]() |
Both Atlas and sixtrack tasks are not downloading. They have stalled or advance very slowly. ![]() |
![]() ![]() Send message Joined: 2 Sep 04 Posts: 455 Credit: 204,240,019 RAC: 130,035 ![]() ![]() ![]() |
|
Send message Joined: 24 Jul 05 Posts: 17 Credit: 2,404,844 RAC: 0 ![]() ![]() |
I have one that as I write this has been downloading for over 12 hours. At this rate, it won't have finished downloading before the completion deadline. Haven't seen this before. |
Send message Joined: 2 May 07 Posts: 2257 Credit: 174,366,760 RAC: 20,027 ![]() ![]() ![]() |
Have tested: Boinc -> Activity -> Network interrup and than Network always enabled. Than Download is new connected and running with normal speed and finishing. Have no explanation why. More info from People who know more about it. |
Send message Joined: 26 Aug 05 Posts: 68 Credit: 545,660 RAC: 0 ![]() ![]() |
Have tested: Thank you maeax! That made a big difference, download now on is over 1000 kBps. |
Send message Joined: 24 Jul 05 Posts: 17 Credit: 2,404,844 RAC: 0 ![]() ![]() |
Thanks for the information. It works. |
Send message Joined: 26 Aug 05 Posts: 68 Credit: 545,660 RAC: 0 ![]() ![]() |
Yes download works ok now but upload is still a disaster, only 15 KBps while uploading ATLAS result file. |
Send message Joined: 5 Apr 15 Posts: 18 Credit: 5,910,849 RAC: 0 ![]() ![]() |
Same issue here, one Atlas item downloading at 10 Kb/sec, while other Atlas downloads are suspended in parallel.... 311,75 MB of 355,60 MB (at 87,66 %) with 19h15:29 elapsed. Next Atlas one : 211,06 MB of 302,87 (at 69,68 %) dowloading at 9,97 Kbps at 06h01:51 Third Atlas one : 208,80 MB of 302,13 MB (69,11 %) at 17,3 Kbps, busy for 03h27:14... So first unit downloading nearly a full day, then gets suspended for no reason while others download now already to nearly 70 %. Not really logical... Why suspending the first one at nearly 90 % ? |
![]() Send message Joined: 15 Jul 05 Posts: 249 Credit: 5,974,599 RAC: 0 ![]() ![]() |
Download and upload times are like usual on our BOINC clients. Could this be local, or have been a temporary storage issue? As far as we can see from our monitoring data, I/O is normal over the last 7 days. |
Send message Joined: 26 Aug 05 Posts: 68 Credit: 545,660 RAC: 0 ![]() ![]() |
Maybe the problem is related to the VirtualBox? I was using that while running work units here. I have left this project now for Rosetta and have no problem with upload\download now. Maybe I will try this Project again if\when I build a Linux based computer. |
![]() Send message Joined: 15 Jun 08 Posts: 2570 Credit: 258,734,705 RAC: 119,508 ![]() ![]() |
Download and upload times are like usual on our BOINC clients. @ Nils Høimyr Thanks for investigating. Below please find some data from different hosts that may be helpful. As far as I can see it's only ATLAS that has problems. LHCb transfers at full speed. My internet connection: Download: 50 Mbit/s Upload: 10 Mbit/s Normal Di 26 Jun 2018 13:55:14 CEST | LHC@home | Started download of oywNDmTHyrsnlyackoJh5iwnABFKDmABFKDmxfGLDmABFKDmBbR5In_EVNT.14296450._000772.pool.root.1 Di 26 Jun 2018 13:56:26 CEST | LHC@home | Finished download of oywNDmTHyrsnlyackoJh5iwnABFKDmABFKDmxfGLDmABFKDmBbR5In_EVNT.14296450._000772.pool.root.1 Di 26 Jun 2018 14:13:07 CEST | LHC@home | Started download of YfOMDmbnyrsnlyackoJh5iwnABFKDmABFKDm7GVLDmABFKDm0jNZ0m_EVNT.14296450._000776.pool.root.1 Di 26 Jun 2018 14:14:19 CEST | LHC@home | Finished download of YfOMDmbnyrsnlyackoJh5iwnABFKDmABFKDm7GVLDmABFKDm0jNZ0m_EVNT.14296450._000776.pool.root.1 Di 26 Jun 2018 15:58:40 CEST | LHC@home | Started download of kSTKDmpsvrsnlyackoJh5iwnABFKDmABFKDmc7JKDmABFKDm4QXwRn_EVNT.14296450._000741.pool.root.1 Di 26 Jun 2018 15:59:51 CEST | LHC@home | Finished download of kSTKDmpsvrsnlyackoJh5iwnABFKDmABFKDmc7JKDmABFKDm4QXwRn_EVNT.14296450._000741.pool.root.1 Di 26 Jun 2018 19:34:08 CEST | LHC@home | Started download of F5MODmy22rsnyYickojUe11pABFKDmABFKDmLVOaDmABFKDmekAVRn_EVNT.14296450._000600.pool.root.1 Di 26 Jun 2018 19:37:44 CEST | LHC@home | Finished download of F5MODmy22rsnyYickojUe11pABFKDmABFKDmLVOaDmABFKDmekAVRn_EVNT.14296450._000600.pool.root.1 Di 26 Jun 2018 19:38:51 CEST | LHC@home | Started download of QLIMDm1d3rsnyYickojUe11pABFKDmABFKDmNXiaDmABFKDmP2qTkn_EVNT.14296450._000815.pool.root.1 Di 26 Jun 2018 19:41:44 CEST | LHC@home | Finished download of QLIMDm1d3rsnyYickojUe11pABFKDmABFKDmNXiaDmABFKDmP2qTkn_EVNT.14296450._000815.pool.root.1 Mi 27 Jun 2018 00:27:30 CEST | LHC@home | Started download of SJANDmFw8rsnlyackoJh5iwnABFKDmABFKDm0GoPDmABFKDmu6N5xm_EVNT.14296450._000855.pool.root.1 Mi 27 Jun 2018 00:29:48 CEST | LHC@home | Finished download of SJANDmFw8rsnlyackoJh5iwnABFKDmABFKDm0GoPDmABFKDmu6N5xm_EVNT.14296450._000855.pool.root.1 Mi 27 Jun 2018 02:53:25 CEST | LHC@home | Started download of 7GJLDmURAssnlyackoJh5iwnABFKDmABFKDmQFUQDmABFKDmr4Fpen_EVNT.14296450._000878.pool.root.1 Mi 27 Jun 2018 02:54:44 CEST | LHC@home | Finished download of 7GJLDmURAssnlyackoJh5iwnABFKDmABFKDmQFUQDmABFKDmr4Fpen_EVNT.14296450._000878.pool.root.1 Mi 27 Jun 2018 05:13:40 CEST | LHC@home | Started download of jWnLDmd3BssnlyackoJh5iwnABFKDmABFKDm2VLRDmABFKDm3jS6cn_EVNT.14296450._000892.pool.root.1 Mi 27 Jun 2018 05:14:52 CEST | LHC@home | Finished download of jWnLDmd3BssnlyackoJh5iwnABFKDmABFKDm2VLRDmABFKDm3jS6cn_EVNT.14296450._000892.pool.root.1 Mi 27 Jun 2018 05:16:06 CEST | LHC@home | Started download of L2JODm0rkrsnyYickojUe11pABFKDmABFKDm193SDmABFKDmY7AnRm_EVNT.14296450._000637.pool.root.1 Mi 27 Jun 2018 05:17:18 CEST | LHC@home | Finished download of L2JODm0rkrsnyYickojUe11pABFKDmABFKDm193SDmABFKDmY7AnRm_EVNT.14296450._000637.pool.root.1 Mi 27 Jun 2018 07:05:35 CEST | LHC@home | Started download of JrVLDm5uEssnyYickojUe11pABFKDmABFKDmXl1NDmABFKDmTh8tom_EVNT.14296450._000915.pool.root.1 Mi 27 Jun 2018 07:06:45 CEST | LHC@home | Finished download of JrVLDm5uEssnyYickojUe11pABFKDmABFKDmXl1NDmABFKDmTh8tom_EVNT.14296450._000915.pool.root.1 Mi 27 Jun 2018 12:19:59 CEST | LHC@home | Started download of u4tLDm4NIssnyYickojUe11pABFKDmABFKDm5lZPDmABFKDm4qO65n_EVNT.14296450._000963.pool.root.1 Mi 27 Jun 2018 12:21:09 CEST | LHC@home | Finished download of u4tLDm4NIssnyYickojUe11pABFKDmABFKDm5lZPDmABFKDm4qO65n_EVNT.14296450._000963.pool.root.1 Mi 27 Jun 2018 14:39:05 CEST | LHC@home | Started download of RbtLDm817rsnlyackoJh5iwnABFKDmABFKDm6gOPDmABFKDmAYxfLo_EVNT.14296450._000846.pool.root.1 Mi 27 Jun 2018 14:40:15 CEST | LHC@home | Finished download of RbtLDm817rsnlyackoJh5iwnABFKDmABFKDm6gOPDmABFKDmAYxfLo_EVNT.14296450._000846.pool.root.1 Mi 27 Jun 2018 16:03:56 CEST | LHC@home | Started download of TAXNDmnhMssnlyackoJh5iwnABFKDmABFKDm54rVDmABFKDmk739dn_EVNT.14296450._001035.pool.root.1 Mi 27 Jun 2018 16:06:41 CEST | LHC@home | Finished download of TAXNDmnhMssnlyackoJh5iwnABFKDmABFKDm54rVDmABFKDmk739dn_EVNT.14296450._001035.pool.root.1 Suspect (slow) Di 26 Jun 2018 21:32:01 CEST | LHC@home | Started download of JmBLDmJ60rsnlyackoJh5iwnABFKDmABFKDmsIQMDmABFKDmhb58Jm_EVNT.14296450._000799.pool.root.1 Di 26 Jun 2018 21:37:21 CEST | LHC@home | Finished download of JmBLDmJ60rsnlyackoJh5iwnABFKDmABFKDmsIQMDmABFKDmhb58Jm_EVNT.14296450._000799.pool.root.1 Mi 27 Jun 2018 01:10:55 CEST | LHC@home | Started download of wjLMDmSl8rsnlyackoJh5iwnABFKDmABFKDmpQhPDmABFKDmq2XqOm_EVNT.14296450._000650.pool.root.1 Mi 27 Jun 2018 01:28:07 CEST | LHC@home | Finished download of wjLMDmSl8rsnlyackoJh5iwnABFKDmABFKDmpQhPDmABFKDmq2XqOm_EVNT.14296450._000650.pool.root.1 Mi 27 Jun 2018 09:32:36 CEST | LHC@home | Started download of XtoNDmiPGssnyYickojUe11pABFKDmABFKDmgWvODmABFKDmsz8Hjn_EVNT.14296450._000943.pool.root.1 Mi 27 Jun 2018 09:46:42 CEST | LHC@home | Finished download of XtoNDmiPGssnyYickojUe11pABFKDmABFKDmgWvODmABFKDmsz8Hjn_EVNT.14296450._000943.pool.root.1 Mi 27 Jun 2018 16:53:41 CEST | LHC@home | Started download of zaZMDmmxMssnyYickojUe11pABFKDmABFKDmgfYRDmABFKDmYPsr6n_EVNT.14296450._001040.pool.root.1 Mi 27 Jun 2018 18:02:35 CEST | LHC@home | Finished download of zaZMDmmxMssnyYickojUe11pABFKDmABFKDmgfYRDmABFKDmYPsr6n_EVNT.14296450._001040.pool.root.1 Mi 27 Jun 2018 00:52:34 CEST | LHC@home | Started upload of vdQLDmKBZrsnlyackoJh5iwnABFKDmABFKDmRXjSDmABFKDmwBOh2m_0_r1315039484_ATLAS_result Mi 27 Jun 2018 01:09:48 CEST | LHC@home | Finished upload of vdQLDmKBZrsnlyackoJh5iwnABFKDmABFKDmRXjSDmABFKDmwBOh2m_0_r1315039484_ATLAS_result Mi 27 Jun 2018 12:43:15 CEST | LHC@home | Started upload of oywNDmTHyrsnlyackoJh5iwnABFKDmABFKDmxfGLDmABFKDmBbR5In_0_r777760364_ATLAS_result Mi 27 Jun 2018 14:38:06 CEST | LHC@home | Finished upload of oywNDmTHyrsnlyackoJh5iwnABFKDmABFKDmxfGLDmABFKDmBbR5In_0_r777760364_ATLAS_result Mi 27 Jun 2018 04:46:33 CEST | LHC@home | Started upload of qhxKDmM3drsnyYickojUe11pABFKDmABFKDmH8SQDmABFKDmxkqJMo_0_r1443118316_ATLAS_result Mi 27 Jun 2018 05:13:28 CEST | LHC@home | Finished upload of qhxKDmM3drsnyYickojUe11pABFKDmABFKDmH8SQDmABFKDmxkqJMo_0_r1443118316_ATLAS_result Mi 27 Jun 2018 16:24:17 CEST | LHC@home | Started upload of JmBLDmJ60rsnlyackoJh5iwnABFKDmABFKDmsIQMDmABFKDmhb58Jm_1_r1205014444_ATLAS_result Mi 27 Jun 2018 16:47:34 CEST | LHC@home | Finished upload of JmBLDmJ60rsnlyackoJh5iwnABFKDmABFKDmsIQMDmABFKDmhb58Jm_1_r1205014444_ATLAS_result Transfers with errors Di 26 Jun 2018 19:37:44 CEST | LHC@home | Started download of boinc_job_script.K56xWI Di 26 Jun 2018 19:38:51 CEST | LHC@home | Temporarily failed download of boinc_job_script.K56xWI: transient HTTP error Di 26 Jun 2018 19:38:51 CEST | LHC@home | Backing off 00:02:24 on download of boinc_job_script.K56xWI Di 26 Jun 2018 19:43:56 CEST | LHC@home | Started download of boinc_job_script.K56xWI Di 26 Jun 2018 19:45:51 CEST | LHC@home | Finished download of boinc_job_script.K56xWI Di 26 Jun 2018 21:22:15 CEST | LHC@home | Started download of FknKDmY74rsnyYickojUe11pABFKDmABFKDmzqKbDmABFKDmGAeiIm_EVNT.14296450._000621.pool.root.1 Di 26 Jun 2018 21:22:15 CEST | LHC@home | Started download of FknKDmY74rsnyYickojUe11pABFKDmABFKDmzqKbDmABFKDmGAeiIm_input.tar.gz Di 26 Jun 2018 21:24:20 CEST | LHC@home | Temporarily failed download of FknKDmY74rsnyYickojUe11pABFKDmABFKDmzqKbDmABFKDmGAeiIm_input.tar.gz: transient HTTP error Di 26 Jun 2018 21:24:20 CEST | LHC@home | Backing off 00:02:41 on download of FknKDmY74rsnyYickojUe11pABFKDmABFKDmzqKbDmABFKDmGAeiIm_input.tar.gz Di 26 Jun 2018 21:24:20 CEST | LHC@home | Started download of rte_FknKDmY74rsnyYickojUe11pABFKDmABFKDmzqKbDmABFKDmGAeiIm.tar.gz Di 26 Jun 2018 21:25:19 CEST | LHC@home | Finished download of FknKDmY74rsnyYickojUe11pABFKDmABFKDmzqKbDmABFKDmGAeiIm_EVNT.14296450._000621.pool.root.1 Di 26 Jun 2018 23:35:16 CEST | LHC@home | Started upload of jSPMDmVQirsnlyackoJh5iwnABFKDmABFKDmOjbWDmABFKDmW7h84n_0_r319569722_ATLAS_result Di 26 Jun 2018 23:44:20 CEST | LHC@home | Backing off 00:03:22 on upload of jSPMDmVQirsnlyackoJh5iwnABFKDmABFKDmOjbWDmABFKDmW7h84n_0_r319569722_ATLAS_result Di 26 Jun 2018 23:47:43 CEST | LHC@home | Started upload of jSPMDmVQirsnlyackoJh5iwnABFKDmABFKDmOjbWDmABFKDmW7h84n_0_r319569722_ATLAS_result Mi 27 Jun 2018 00:04:54 CEST | LHC@home | Backing off 00:07:23 on upload of jSPMDmVQirsnlyackoJh5iwnABFKDmABFKDmOjbWDmABFKDmW7h84n_0_r319569722_ATLAS_result Mi 27 Jun 2018 00:12:18 CEST | LHC@home | Started upload of jSPMDmVQirsnlyackoJh5iwnABFKDmABFKDmOjbWDmABFKDmW7h84n_0_r319569722_ATLAS_result Mi 27 Jun 2018 00:20:09 CEST | LHC@home | Finished upload of jSPMDmVQirsnlyackoJh5iwnABFKDmABFKDmOjbWDmABFKDmW7h84n_0_r319569722_ATLAS_result Mi 27 Jun 2018 04:43:12 CEST | LHC@home | Started upload of kSTKDmpsvrsnlyackoJh5iwnABFKDmABFKDmc7JKDmABFKDm4QXwRn_1_r711714321_ATLAS_result Mi 27 Jun 2018 04:48:52 CEST | LHC@home | Backing off 00:03:39 on upload of kSTKDmpsvrsnlyackoJh5iwnABFKDmABFKDmc7JKDmABFKDm4QXwRn_1_r711714321_ATLAS_result Mi 27 Jun 2018 04:52:33 CEST | LHC@home | Started upload of kSTKDmpsvrsnlyackoJh5iwnABFKDmABFKDmc7JKDmABFKDm4QXwRn_1_r711714321_ATLAS_result Mi 27 Jun 2018 05:13:28 CEST | LHC@home | Finished upload of kSTKDmpsvrsnlyackoJh5iwnABFKDmABFKDmc7JKDmABFKDm4QXwRn_1_r711714321_ATLAS_result Mi 27 Jun 2018 08:58:40 CEST | LHC@home | Started upload of F5MODmy22rsnyYickojUe11pABFKDmABFKDmLVOaDmABFKDmekAVRn_0_r1643114731_ATLAS_result Mi 27 Jun 2018 09:02:11 CEST | LHC@home | Backing off 00:03:09 on upload of F5MODmy22rsnyYickojUe11pABFKDmABFKDmLVOaDmABFKDmekAVRn_0_r1643114731_ATLAS_result Mi 27 Jun 2018 09:05:21 CEST | LHC@home | Started upload of F5MODmy22rsnyYickojUe11pABFKDmABFKDmLVOaDmABFKDmekAVRn_0_r1643114731_ATLAS_result Mi 27 Jun 2018 09:09:05 CEST | LHC@home | Backing off 00:04:51 on upload of F5MODmy22rsnyYickojUe11pABFKDmABFKDmLVOaDmABFKDmekAVRn_0_r1643114731_ATLAS_result Mi 27 Jun 2018 09:13:57 CEST | LHC@home | Started upload of F5MODmy22rsnyYickojUe11pABFKDmABFKDmLVOaDmABFKDmekAVRn_0_r1643114731_ATLAS_result Mi 27 Jun 2018 09:31:38 CEST | LHC@home | Finished upload of F5MODmy22rsnyYickojUe11pABFKDmABFKDmLVOaDmABFKDmekAVRn_0_r1643114731_ATLAS_result Mi 27 Jun 2018 14:11:45 CEST | LHC@home | Started upload of QLIMDm1d3rsnyYickojUe11pABFKDmABFKDmNXiaDmABFKDmP2qTkn_0_r768493418_ATLAS_result Mi 27 Jun 2018 14:19:20 CEST | LHC@home | Backing off 00:03:36 on upload of QLIMDm1d3rsnyYickojUe11pABFKDmABFKDmNXiaDmABFKDmP2qTkn_0_r768493418_ATLAS_result Mi 27 Jun 2018 14:22:58 CEST | LHC@home | Started upload of QLIMDm1d3rsnyYickojUe11pABFKDmABFKDmNXiaDmABFKDmP2qTkn_0_r768493418_ATLAS_result Mi 27 Jun 2018 16:03:30 CEST | LHC@home | Finished upload of QLIMDm1d3rsnyYickojUe11pABFKDmABFKDmNXiaDmABFKDmP2qTkn_0_r768493418_ATLAS_result |
Send message Joined: 27 Sep 04 Posts: 104 Credit: 8,243,180 RAC: 4,512 ![]() ![]() ![]() |
Still have the extremely slow downloads If I stop and re-enable network access I get around 450 - 600 KBps on two downloads. This eventually slows to 3-4KBps on each Stop/start access and it jumps back up again, for a while |
Send message Joined: 13 Apr 18 Posts: 443 Credit: 8,438,885 RAC: 0 ![]() ![]() |
Download and upload times are like usual on our BOINC clients. Not sure what you mean by "local" and "temporary storage issue" but whatever the problem is it hit here too and only on ATLAS tasks. If it's a problem on my end then it's odd that it seems to have struck so many of us simultaneously. As mentioned in other posts, turning network activity in BOINC Manager off for a few secs and then back on seemed to cure the problem but only temporarily meaning the transfer speed increased back to normal but then gradually degraded to ~300KBPS within ~ 60 seconds and eventually stalled. I don't normally do ATLAS, just Sixtrack, Theory and LHCB. I turned on ATLAS temporarily when I read about this problem just to test and possibly provide confirmation/feedback. I now have ATLAS turned off. I tested on this host. Regarding whether it's limited to VBox... VBox is installed on the host I was using and I believe the ATLAS tasks ran in VBox but I also tried to set that host up for native ATLAS which seemed to succeed but still the ATLAS tasks ran on VBox. Note I am not asking for advice/fix on that issue. I am just saying that if you are sifting through evidence and trying to decide if it's a VBox issue then I can't help there because my system is both. |
Send message Joined: 27 Sep 04 Posts: 104 Credit: 8,243,180 RAC: 4,512 ![]() ![]() ![]() |
Upon closer inspection,what happens is that after the network restart, downloads start, then stall and as a result,the through put steadily drops at that point, NO data is being transferred |
Send message Joined: 22 Jan 18 Posts: 32 Credit: 2,756,359 RAC: 0 ![]() ![]() |
Same here except a lot of my downloads are simply failing. I'm up to 42 Errors all due to "Error while downloading". I'm getting some downloads, have 10 results that can't upload. |
![]() Send message Joined: 15 Jun 08 Posts: 2570 Credit: 258,734,705 RAC: 119,508 ![]() ![]() |
Simplex0 wrote: Maybe the problem is related to the VirtualBox? bronco wrote: Regarding whether it's limited to VBox... My hosts run ATLAS (native), so the issue is not caused by VirtualBox. |
Send message Joined: 27 Aug 15 Posts: 27 Credit: 15,291,845 RAC: 49,330 ![]() ![]() ![]() |
To get 70 wu's with result, I aborted 120 wu's stucking at download. |
Send message Joined: 2 May 07 Posts: 2257 Credit: 174,366,760 RAC: 20,027 ![]() ![]() ![]() |
read this message in this thread: https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=4741&postid=35632#35632 Cern-It is working on this problem. |
![]() ![]() Send message Joined: 2 Sep 04 Posts: 455 Credit: 204,240,019 RAC: 130,035 ![]() ![]() ![]() |
maeax wrote: read this message in this thread: I don't see that they are working on it. They even can't see the problem Nils Høimyr wrote: Download and upload times are like usual on our BOINC clients. ![]() Supporting BOINC, a great concept ! |
![]() Send message Joined: 15 Jul 05 Posts: 249 Credit: 5,974,599 RAC: 0 ![]() ![]() |
Sorry, but as mentioned, on our BOINC clients upload speed is normal. In our file upload server logs, we had only 3 messages of this type today and 2 yesterday: _r743853275_ATLAS_result] returning error Before we migrated to a new storage back-end, we had a high frequency of these errors during high load periods. Half-uploaded ATLAS files will be cleaned after a while, and any remaining results should eventually upload correctly. Thanks for your crunching and contributions to LHC@home! |
©2025 CERN