Message boards : ATLAS application : Latest ATLAS jobs getting much larger in download size?
Message board moderation

To post messages, you must log in.

AuthorMessage
wujj123456

Send message
Joined: 14 Sep 08
Posts: 52
Credit: 64,094,999
RAC: 25,539
Message 47898 - Posted: 25 Mar 2023, 19:28:57 UTC

I noticed today that since Mar 22, my boinc download increased dramatically. After correlating detailed traffic data on my hosts with boinc log, I confirmed they are from ATLAS downloads. Each ATLAS WU now downloads around 1.1GB of data for the *.pool.root.1 file. They used to be 250M each and I still have some of the smaller ones as comparison. The WU disk usage also reflects the change, likely after decompression.
Example old WU: https://lhcathome.cern.ch/lhcathome/result.php?resultid=389847635
Example new WU: https://lhcathome.cern.ch/lhcathome/result.php?resultid=390698043

I remember reading about LHC upgrades last year and I wonder if this is the result of the upgrade? Would be interesting to know what's added here. I wonder if it would make sense to re-introduce long simulation WUs to balance out the network and compute ratio, though it's not really causing a problem for me.
ID: 47898 · Report as offensive     Reply Quote
Toggleton

Send message
Joined: 4 Mar 17
Posts: 25
Credit: 10,262,043
RAC: 1,268
Message 47899 - Posted: 25 Mar 2023, 20:12:57 UTC - in response to Message 47898.  

https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5976&postid=47891
Probably a scientist added a batch to the ATLAS-queue not meant for BOINC, cause the root-file to download for 1 task is 1110MB.
ID: 47899 · Report as offensive     Reply Quote
wujj123456

Send message
Joined: 14 Sep 08
Posts: 52
Credit: 64,094,999
RAC: 25,539
Message 47900 - Posted: 25 Mar 2023, 21:37:21 UTC - in response to Message 47899.  

Thanks. Sorry missed that. Didn't expect that thread to contain the information I was looking for. Hopefully the returned results are still useful even though the WUs weren't intended for BOINC. :-)
ID: 47900 · Report as offensive     Reply Quote
wujj123456

Send message
Joined: 14 Sep 08
Posts: 52
Credit: 64,094,999
RAC: 25,539
Message 47904 - Posted: 26 Mar 2023, 6:23:37 UTC

Given there isn't really new science involved here as I thought, could moderator move this thread to ATLAS forum or just delete it? Thanks.
ID: 47904 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1821
Credit: 118,941,136
RAC: 22,064
Message 47905 - Posted: 26 Mar 2023, 8:27:18 UTC - in response to Message 47898.  

I noticed today that since Mar 22, my boinc download increased dramatically. After correlating detailed traffic data on my hosts with boinc log, I confirmed they are from ATLAS downloads. Each ATLAS WU now downloads around 1.1GB of data for the *.pool.root.1 file. ...
Hm, this made me curious and I wanted to see what's going on - however, no ATLAS tasks available for download :-(
ID: 47905 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2244
Credit: 173,902,375
RAC: 456
Message 47906 - Posted: 26 Mar 2023, 9:17:16 UTC - in response to Message 47905.  

We know it since a few days. CP had wrote a answer in -prod. Discussion is in -dev.
ID: 47906 · Report as offensive     Reply Quote
Profile Yeti
Volunteer moderator
Avatar

Send message
Joined: 2 Sep 04
Posts: 455
Credit: 201,268,029
RAC: 6,930
Message 47910 - Posted: 28 Mar 2023, 8:25:10 UTC - in response to Message 47899.  

https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5976&postid=47891
Probably a scientist added a batch to the ATLAS-queue not meant for BOINC, cause the root-file to download for 1 task is 1110MB.

I'm very disappointed not to hear anything more:

It may have been a mistake, but someone could tell us how and much more when it will be fixed !

Or will it stay as the new normal ?

I have just checked and my latest WUs are again with the 1,2 GB file

The answer from David is already 5 days old and no more info :-(

My clients will stay paused on Atlas


Supporting BOINC, a great concept !
ID: 47910 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2244
Credit: 173,902,375
RAC: 456
Message 47911 - Posted: 28 Mar 2023, 8:57:27 UTC - in response to Message 47910.  
Last modified: 28 Mar 2023, 8:59:54 UTC

Or will it stay as the new normal ?

For me it's normal size.
Last Sunday the pipeline was empty and on Monday refilled.
btw 600 GByte every day for 600 Tasks.
ID: 47911 · Report as offensive     Reply Quote

Message boards : ATLAS application : Latest ATLAS jobs getting much larger in download size?


©2024 CERN