Message boards : Number crunching : Upload data amounts
Message board moderation

To post messages, you must log in.

AuthorMessage
alvin
Avatar

Send message
Joined: 12 Mar 12
Posts: 128
Credit: 20,013,377
RAC: 0
Message 27588 - Posted: 8 Sep 2015, 2:13:21 UTC
Last modified: 8 Sep 2015, 2:15:02 UTC

I have currently running this project and its all fine except one thing
upload data amount
here is monthly report
address download upload total
cern.ch 6.58 GB (1.5 %) 25.9 GB (29 %) 32.5 GB (6.1 %)

as you can see it does 29% of my upload traffic and I have either terminate the project or ask you to pack results on client side if possible?
And these numbers are only for small amount of tasks we've executed recently
Could compressing data be an option in settings?

I suppose all those years ages ago noone cares about those amounts, but why the difference disbalance between incoming data and outcoming data is so huge?
Anyway I think some action either on project side or whole boinc side could be done to pursue the balance and minimise traffic.
ID: 27588 · Report as offensive     Reply Quote
Snow Crash

Send message
Joined: 29 May 11
Posts: 10
Credit: 2,810,862
RAC: 0
Message 27592 - Posted: 10 Sep 2015, 16:16:34 UTC - in response to Message 27588.  

Just a guess - I think that traffic may be from your participation in the vLHC project
http://lhcathome2.cern.ch/vLHCathome/hosts_user.php?userid=12567
ID: 27592 · Report as offensive     Reply Quote
alvin
Avatar

Send message
Joined: 12 Mar 12
Posts: 128
Credit: 20,013,377
RAC: 0
Message 27594 - Posted: 11 Sep 2015, 22:54:59 UTC - in response to Message 27592.  
Last modified: 11 Sep 2015, 23:18:08 UTC

naf.
the difference is 50 times)
ID: 27594 · Report as offensive     Reply Quote
kumiponi

Send message
Joined: 7 Jul 14
Posts: 1
Credit: 26,637
RAC: 0
Message 27598 - Posted: 3 Oct 2015, 9:36:02 UTC

I examined a couple of work units. The downloaded files (zipped) are about 349 KB, while the uploaded result files (not compressed) are about 44 KB. Simple zipping of the results reduces the size by almost 75%.

Zipping and unzipping take so little computing time that I think compressing the results for transfer would be justified.
ID: 27598 · Report as offensive     Reply Quote
mikey
Avatar

Send message
Joined: 30 Oct 11
Posts: 26
Credit: 4,940,164
RAC: 259
Message 27599 - Posted: 3 Oct 2015, 13:44:04 UTC - in response to Message 27598.  

I examined a couple of work units. The downloaded files (zipped) are about 349 KB, while the uploaded result files (not compressed) are about 44 KB. Simple zipping of the results reduces the size by almost 75%.

Zipping and unzipping take so little computing time that I think compressing the results for transfer would be justified.


You might make that suggestion to the Boinc discussion group and they could perhaps include in the next version so ALL projects could use it.
ID: 27599 · Report as offensive     Reply Quote
m

Send message
Joined: 6 Sep 08
Posts: 117
Credit: 12,438,551
RAC: 2,885
Message 27601 - Posted: 3 Oct 2015, 21:32:34 UTC - in response to Message 27599.  

I examined a couple of work units. The downloaded files (zipped) are about 349 KB, while the uploaded result files (not compressed) are about 44 KB. Simple zipping of the results reduces the size by almost 75%.

Zipping and unzipping take so little computing time that I think compressing the results for transfer would be justified.


You might make that suggestion to the Boinc discussion group and they could perhaps include in the next version so ALL projects could use it.


Is this what you mean?.
ID: 27601 · Report as offensive     Reply Quote
mikey
Avatar

Send message
Joined: 30 Oct 11
Posts: 26
Credit: 4,940,164
RAC: 259
Message 27602 - Posted: 4 Oct 2015, 13:02:27 UTC - in response to Message 27601.  

I examined a couple of work units. The downloaded files (zipped) are about 349 KB, while the uploaded result files (not compressed) are about 44 KB. Simple zipping of the results reduces the size by almost 75%.

Zipping and unzipping take so little computing time that I think compressing the results for transfer would be justified.


You might make that suggestion to the Boinc discussion group and they could perhaps include in the next version so ALL projects could use it.


Is this what you mean?.


Yes exactly! It seems that LHC doesn't know it's in there either!
ID: 27602 · Report as offensive     Reply Quote

Message boards : Number crunching : Upload data amounts


©2024 CERN