Message boards : ATLAS application : Very slow task download
Message board moderation

To post messages, you must log in.

AuthorMessage
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1965
Credit: 139,421,395
RAC: 85,836
Message 35400 - Posted: 30 May 2018, 13:48:55 UTC

The last 2 downloads of ATLAS tasks from lhcathome-upload.cern.ch didn't reach more than 10% of the normal download speed.
May be investigated by the server team.
ID: 35400 · Report as offensive     Reply Quote
Crystal Pellet
Volunteer moderator
Volunteer tester

Send message
Joined: 14 Jan 10
Posts: 1093
Credit: 6,827,780
RAC: 791
Message 35401 - Posted: 31 May 2018, 8:57:43 UTC - in response to Message 35400.  

Not here (atm): 362 MB in 51 seconds

LHC@home 31 May 10:51:19 Started download of IMrKDmISVisnyYickojUe11pABFKDmABFKDmSBqQDmABFKDm3cZsVo_EVNT.14154093._002299.pool.root.1
LHC@home 31 May 10:52:10 Finished download of IMrKDmISVisnyYickojUe11pABFKDmABFKDmSBqQDmABFKDm3cZsVo_EVNT.14154093._002299.pool.root.1
ID: 35401 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1508
Credit: 48,234,707
RAC: 119,604
Message 35403 - Posted: 31 May 2018, 9:39:02 UTC - in response to Message 35401.  

+1
ID: 35403 · Report as offensive     Reply Quote
Profile Yeti
Volunteer moderator
Avatar

Send message
Joined: 2 Sep 04
Posts: 430
Credit: 117,525,067
RAC: 0
Message 35579 - Posted: 19 Jun 2018, 19:21:52 UTC

This problem has come back


Supporting BOINC, a great concept !
ID: 35579 · Report as offensive     Reply Quote
Simplex0

Send message
Joined: 26 Aug 05
Posts: 68
Credit: 545,660
RAC: 0
Message 35581 - Posted: 20 Jun 2018, 4:35:04 UTC

Upload speed varies between 7.48 - 14.78 here.
ID: 35581 · Report as offensive     Reply Quote
Profile Yeti
Volunteer moderator
Avatar

Send message
Joined: 2 Sep 04
Posts: 430
Credit: 117,525,067
RAC: 0
Message 35604 - Posted: 21 Jun 2018, 11:46:16 UTC

Downloads are still not working as they should !

They are very very slow, here is an example:



I have started to switch to Develop-Project


Supporting BOINC, a great concept !
ID: 35604 · Report as offensive     Reply Quote
Profile Yeti
Volunteer moderator
Avatar

Send message
Joined: 2 Sep 04
Posts: 430
Credit: 117,525,067
RAC: 0
Message 35606 - Posted: 21 Jun 2018, 16:41:30 UTC

Develop is not really better :-(


Supporting BOINC, a great concept !
ID: 35606 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1965
Credit: 139,421,395
RAC: 85,836
Message 35607 - Posted: 21 Jun 2018, 17:47:54 UTC - in response to Message 35606.  

Develop is not really better :-(

The task data is from the same pool.
ID: 35607 · Report as offensive     Reply Quote
Profile Yeti
Volunteer moderator
Avatar

Send message
Joined: 2 Sep 04
Posts: 430
Credit: 117,525,067
RAC: 0
Message 35608 - Posted: 21 Jun 2018, 19:50:11 UTC

Sorry Guys, but I don't have the time to babysit my clients, they have to run alone and self-sufficient

I will switch to other directions until you tell us that the problem was found and solved


Supporting BOINC, a great concept !
ID: 35608 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1508
Credit: 48,234,707
RAC: 119,604
Message 35613 - Posted: 22 Jun 2018, 9:27:13 UTC

Download have the same time as a task need for running (2 hours!).
But, only in Wondows not in native Linux!
ID: 35613 · Report as offensive     Reply Quote
Simplex0

Send message
Joined: 26 Aug 05
Posts: 68
Credit: 545,660
RAC: 0
Message 35615 - Posted: 22 Jun 2018, 9:48:50 UTC - in response to Message 35613.  

Download have the same time as a task need for running (2 hours!).
But, only in Wondows not in native Linux!


Interesting.
How long does it normally take to download an ATLAS work unit under Linux?
ID: 35615 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1511
Credit: 42,348,994
RAC: 41,049
Message 35616 - Posted: 22 Jun 2018, 10:44:27 UTC

As can be seen here: https://lhcathome.cern.ch/lhcathome/atlas_job.php

the number of running tasks has rapidly dropped from about 15.000 to 5.000 (values as of June 22 noon)
ID: 35616 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1965
Credit: 139,421,395
RAC: 85,836
Message 35619 - Posted: 22 Jun 2018, 11:44:38 UTC - in response to Message 35615.  

.. How long does it normally take to download an ATLAS work unit under Linux?

It doesn't matter whether you run windows or linux.
It depends on the size of the files to be transferred and your internet bandwidth.

Example (typical sizes and otherwise unused internet connection)

dl bw: 50 Mbit/s
dl size: 355 MB
dl time: 57 s

ul bw: 10 Mbit/s
ul size: 100 MB
ul time: 80 s
ID: 35619 · Report as offensive     Reply Quote
mrchips

Send message
Joined: 16 May 14
Posts: 11
Credit: 6,219,338
RAC: 3,227
Message 35623 - Posted: 22 Jun 2018, 18:43:49 UTC - in response to Message 35619.  

I have even tried to re-boot the computer, it did not help.
Very slow....
ID: 35623 · Report as offensive     Reply Quote
Profile MAGIC Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 1004
Credit: 47,154,290
RAC: 5,146
Message 35624 - Posted: 22 Jun 2018, 20:03:15 UTC - in response to Message 35400.  

The last 2 downloads of ATLAS tasks from lhcathome-upload.cern.ch didn't reach more than 10% of the normal download speed.
May be investigated by the server team.


About time that happened over there since it has been that way where I am since I started doing the Alpha testing for Atlas.

15 hours to d/l and 1 hour to run the tasks and then 30 mins to upload it.
ID: 35624 · Report as offensive     Reply Quote
Simplex0

Send message
Joined: 26 Aug 05
Posts: 68
Credit: 545,660
RAC: 0
Message 35630 - Posted: 23 Jun 2018, 8:46:17 UTC
Last modified: 23 Jun 2018, 9:17:52 UTC

I guess that the staff of LHC@home do not think this is a problem worth taking care of?
Rosetta here I come :), I doo hope that the Rosetta project works better than this one.

Thank you members of this message boards for your support anyway.
ID: 35630 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1511
Credit: 42,348,994
RAC: 41,049
Message 35643 - Posted: 26 Jun 2018, 19:16:07 UTC - in response to Message 35616.  

As can be seen here: https://lhcathome.cern.ch/lhcathome/atlas_job.php

the number of running tasks has rapidly dropped from about 15.000 to 5.000 (values as of June 22 noon)

same thing seems to happen again: drop from about 15.000 to less than 6.000 (values as of June 26 late evening):

https://lhcathome.cern.ch/lhcathome/atlas_job.php
ID: 35643 · Report as offensive     Reply Quote
Harri Liljeroos
Avatar

Send message
Joined: 28 Sep 04
Posts: 583
Credit: 32,458,577
RAC: 14,942
Message 35644 - Posted: 26 Jun 2018, 19:55:12 UTC - in response to Message 35643.  

As can be seen here: https://lhcathome.cern.ch/lhcathome/atlas_job.php

the number of running tasks has rapidly dropped from about 15.000 to 5.000 (values as of June 22 noon)

same thing seems to happen again: drop from about 15.000 to less than 6.000 (values as of June 26 late evening):

https://lhcathome.cern.ch/lhcathome/atlas_job.php

You can't read the last column on the right as it is still accumulating (currently at 7500). It takes about 8 hours for one column to gather values (if my estimate is right: 9 columns for 3 days 3*24/9=8).
ID: 35644 · Report as offensive     Reply Quote
Crystal Pellet
Volunteer moderator
Volunteer tester

Send message
Joined: 14 Jan 10
Posts: 1093
Credit: 6,827,780
RAC: 791
Message 35708 - Posted: 29 Jun 2018, 19:44:33 UTC
Last modified: 29 Jun 2018, 19:56:18 UTC

LHC@home nxyNDmJI9ssnlyackoJh5iwnABFKDmABFKDmFI5WDmABFKDmjv7aXn_EVNT.14296450._001584.pool.root.1 85.947% 309165.13 K 01:17:04 57.84 Kbps Downloading
LHC@home 7GSMDmO08ssnyYickojUe11pABFKDmABFKDmGVwRDmABFKDmmIx17m_EVNT.14296450._001062.pool.root.1 33.819% 312437.88 K 01:19:40 22.44 Kbps Downloading

Normal speed >5000 Kbps

12 minutes later:

LHC@home nxyNDmJI9ssnlyackoJh5iwnABFKDmABFKDmFI5WDmABFKDmjv7aXn_EVNT.14296450._001584.pool.root.1 86.022% 309165.13 K 01:29:40 50.02 Kbps Downloading
LHC@home 7GSMDmO08ssnyYickojUe11pABFKDmABFKDmGVwRDmABFKDmmIx17m_EVNT.14296450._001062.pool.root.1 34.066% 312437.88 K 01:32:15 19.52 Kbps Downloading
ID: 35708 · Report as offensive     Reply Quote
Matthias Lehmkuhl

Send message
Joined: 15 Jul 05
Posts: 21
Credit: 1,654,642
RAC: 1,112
Message 35725 - Posted: 1 Jul 2018, 8:27:52 UTC

count me in, the download stuck sometimes on very different percentage progress (mostly 80 to 90 % progress of the download)
LHC@home LeiNDmPLhtsnyYickojUe11pABFKDmABFKDmLNIMDmABFKDmsJuyan_EVNT.14296450._001903.pool.root.1 1,054 314106,06 K 00:22:22 2,53 Kbps Herunterladend
yesterday I've seen that the download runs with normal speed after restarting the boinc client.
My problem is, that other projects do not download on that windows machine (Boinc 7.10.2) too as long as the download of the Atlas task has not finished.
Will try to increase the buffer.
Matthias

ID: 35725 · Report as offensive     Reply Quote

Message boards : ATLAS application : Very slow task download


©2022 CERN