Message boards : ATLAS application : Tasks download 1.9 GB EVNT files
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · Next

AuthorMessage
David Cameron
Project administrator
Project developer
Project scientist

Send message
Joined: 13 May 14
Posts: 368
Credit: 13,472,138
RAC: 7,497
Message 45469 - Posted: 19 Oct 2021, 14:18:29 UTC

Hi all,

It seems this batch with the very large input files is a one-off caused by a misconfiguration on the ATLAS side. Apologies if it is causing problems and hopefully the next batches should be back to normal.
ID: 45469 · Report as offensive     Reply Quote
Harri Liljeroos
Avatar

Send message
Joined: 28 Sep 04
Posts: 588
Credit: 33,788,258
RAC: 19,593
Message 45470 - Posted: 19 Oct 2021, 14:49:47 UTC - in response to Message 45469.  

Currently downloading a file that is about 250 MB https://lhcathome.cern.ch/lhcathome/result.php?resultid=330691684 so looking ok.
ID: 45470 · Report as offensive     Reply Quote
mmonnin

Send message
Joined: 22 Mar 17
Posts: 51
Credit: 7,153,366
RAC: 0
Message 45472 - Posted: 19 Oct 2021, 22:22:08 UTC

Crazy 1.9GB file sizes even with Native Atlas.

I had a heck of a time getting a PC running again after my disk filled up from this. It's only on a 120GB drive. I tried deleting some executable and db files of other projects but BOINC Mgr in all of its wisdom thought I still needed them even w/o tasks for those apps/projects.
ID: 45472 · Report as offensive     Reply Quote
mmonnin

Send message
Joined: 22 Mar 17
Posts: 51
Credit: 7,153,366
RAC: 0
Message 45473 - Posted: 20 Oct 2021, 2:43:32 UTC
Last modified: 20 Oct 2021, 2:50:31 UTC

Still getting these really big tasks. And its causing other tasks to not download since these take sooo long.

Tasks finish faster than new ones can download. Moving production elsewhere.
ID: 45473 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1581
Credit: 64,857,107
RAC: 227,327
Message 45474 - Posted: 20 Oct 2021, 5:42:41 UTC

Have reduced to one W10pro and two CentOS (7and 8)-VM.
Squid is stopped therefore and will watching how fast the DL of the 1.9GByte now is!
ID: 45474 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1581
Credit: 64,857,107
RAC: 227,327
Message 45475 - Posted: 20 Oct 2021, 7:30:25 UTC - in response to Message 45474.  
Last modified: 20 Oct 2021, 7:36:40 UTC

W10pro 5 Min with 7000kps and WITHOUT squid!!
Same time for CentOS7 and CentOS8 VM!!
ID: 45475 · Report as offensive     Reply Quote
Crystal Pellet
Volunteer moderator
Volunteer tester

Send message
Joined: 14 Jan 10
Posts: 1120
Credit: 6,892,932
RAC: 605
Message 45476 - Posted: 20 Oct 2021, 12:18:11 UTC

That's a pity:

LHC@home 20 Oct 13:56:32 Aborting task ZkNODmXGKxznsSi4apGgGQJmABFKDmABFKDmMQeaDmABFKDmY3zyMn_0: exceeded disk limit: 12507.23MB > 9536.74MB

https://lhcathome.cern.ch/lhcathome/result.php?resultid=330750374
ID: 45476 · Report as offensive     Reply Quote
tullio

Send message
Joined: 19 Feb 08
Posts: 704
Credit: 4,268,342
RAC: 681
Message 45478 - Posted: 20 Oct 2021, 14:22:14 UTC

I have downloaded two 1.9 GB Atlas tasks. Completed and validated. Max disk usage 4.04 GB.
Tullio
ID: 45478 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 728
Credit: 490,967,742
RAC: 288,701
Message 45479 - Posted: 20 Oct 2021, 17:18:28 UTC - in response to Message 45476.  

I got few also.
ID: 45479 · Report as offensive     Reply Quote
greg_be

Send message
Joined: 28 Dec 08
Posts: 294
Credit: 2,612,601
RAC: 2,111
Message 45483 - Posted: 20 Oct 2021, 18:52:06 UTC

I had only 2 failures with these tasks.
1 invalid and 1 failure because I interrupted it upgrading Vbox.
Otherwise other than disk size I have had no problems and didn't even know there were problems.

BUT...something different... do these big files cause any problems with RAH?
They have a new project of tasks using VBOX and someone said maybe this had something to do with why I am not getting any Vbox tasks at RAH.

Any thoughts on this?
ID: 45483 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 590
Credit: 21,977,299
RAC: 592
Message 45485 - Posted: 20 Oct 2021, 20:55:29 UTC - in response to Message 45483.  

BUT...something different... do these big files cause any problems with RAH?
They have a new project of tasks using VBOX and someone said maybe this had something to do with why I am not getting any Vbox tasks at RAH.

Any thoughts on this?

At the moment, it is probably because Rosetta is out of pythons.
https://boinc.bakerlab.org/rosetta/server_status.php
ID: 45485 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 590
Credit: 21,977,299
RAC: 592
Message 45486 - Posted: 20 Oct 2021, 21:12:15 UTC - in response to Message 45446.  

I am downloading 14 of the native ATLAS now, and they are all almost 2 GB each.
I don't expect that to be a problem (I have 110 Mbps download). But with all the other things going on, it could potentially be a problem.

Thanks for noticing it. They should fix it for their own good.
ID: 45486 · Report as offensive     Reply Quote
greg_be

Send message
Joined: 28 Dec 08
Posts: 294
Credit: 2,612,601
RAC: 2,111
Message 45487 - Posted: 20 Oct 2021, 22:55:05 UTC - in response to Message 45485.  

BUT...something different... do these big files cause any problems with RAH?
They have a new project of tasks using VBOX and someone said maybe this had something to do with why I am not getting any Vbox tasks at RAH.

Any thoughts on this?

At the moment, it is probably because Rosetta is out of pythons.
https://boinc.bakerlab.org/rosetta/server_status.php


Earlier this week there were what 900 or something? I couldn't get any of them.
Have you ever heard of two projects that use Vbox causing one to not allow the other to run?
ID: 45487 · Report as offensive     Reply Quote
mmonnin

Send message
Joined: 22 Mar 17
Posts: 51
Credit: 7,153,366
RAC: 0
Message 45489 - Posted: 21 Oct 2021, 1:31:35 UTC
Last modified: 21 Oct 2021, 2:27:09 UTC

The BOINC Client does the communication and doesn't care what other projects are running. There are over 418k Rosetta tasks in progress atm and 9k are python. 2% chance.
ID: 45489 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 590
Credit: 21,977,299
RAC: 592
Message 45490 - Posted: 21 Oct 2021, 2:02:08 UTC - in response to Message 45487.  

Earlier this week there were what 900 or something? I couldn't get any of them.
Have you ever heard of two projects that use Vbox causing one to not allow the other to run?

I have never had exactly your problem. You will need to do some experimenting.
ID: 45490 · Report as offensive     Reply Quote
greg_be

Send message
Joined: 28 Dec 08
Posts: 294
Credit: 2,612,601
RAC: 2,111
Message 45491 - Posted: 21 Oct 2021, 7:22:50 UTC - in response to Message 45489.  

The BOINC Client does the communication and doesn't care what other projects are running. There are over 418k Rosetta tasks in progress atm and 9k are python. 2% chance.



Didn't think that was the issue. Thanks for the clarification.
ID: 45491 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1581
Credit: 64,857,107
RAC: 227,327
Message 45494 - Posted: 21 Oct 2021, 10:09:42 UTC

Now 1 GByte instead of 1.9. Time for download without squid 2.5 min!
ID: 45494 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1516
Credit: 46,082,699
RAC: 57,146
Message 45496 - Posted: 21 Oct 2021, 13:54:09 UTC - in response to Message 45494.  

Now 1 GByte instead of 1.9. Time for download ...
yes, indeed. The question is: will this new filesize stay for a while, or will it revert back to 1.9GB sometime?
ID: 45496 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 728
Credit: 490,967,742
RAC: 288,701
Message 45497 - Posted: 21 Oct 2021, 17:25:57 UTC - in response to Message 45496.  

David said it was a mistake on there side, my experience is that humans make mistakes, so sometime, yes.
ID: 45497 · Report as offensive     Reply Quote
mmonnin

Send message
Joined: 22 Mar 17
Posts: 51
Credit: 7,153,366
RAC: 0
Message 45498 - Posted: 21 Oct 2021, 22:12:30 UTC
Last modified: 21 Oct 2021, 22:13:33 UTC

Still huge at 1122482k. When there are 8x tasks per PC running on multiple machines plus the several hundred mb upload completing. It's too much transferring.
ID: 45498 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · Next

Message boards : ATLAS application : Tasks download 1.9 GB EVNT files


©2022 CERN