Message boards : ATLAS application : CVMFS proxy configuration for vbox hosts
Message board moderation

To post messages, you must log in.

AuthorMessage
David Cameron
Project administrator
Project developer
Project scientist

Send message
Joined: 13 May 14
Posts: 387
Credit: 15,314,184
RAC: 0
Message 38705 - Posted: 6 May 2019, 9:16:20 UTC

Hi all,

Today we changed ATLAS vbox so that if you configure a local squid proxy as your http proxy in BOINC, this will be used as the proxy for CVMFS too. This brings ATLAS into line with the other LHC vbox apps which already do this. The change should become effective in the next few hours. Thanks to computezrmle for the help implementing this change!
ID: 38705 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2071
Credit: 156,179,989
RAC: 105,256
Message 38709 - Posted: 6 May 2019, 18:59:17 UTC

SL610 or SL76 have the Script install_cvmfs_sin.sh from the old ATLAS-Server.
Line 2 cvmfs_config stat atlas.cern.ch give message atlas.cern.ch not mounted.
ID: 38709 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,995,968
RAC: 136,262
Message 38711 - Posted: 6 May 2019, 20:57:24 UTC - in response to Message 38705.  

Sorry David.

Unfortunately it doesn't work as expected.
I got an ATLAS vbox task in the evening (https://lhcathome.cern.ch/lhcathome/result.php?resultid=223718829) that still ignores the local proxy for CVMFS while frontier requests use it.
ID: 38711 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2071
Credit: 156,179,989
RAC: 105,256
Message 38723 - Posted: 7 May 2019, 13:40:05 UTC
Last modified: 7 May 2019, 14:08:11 UTC

Sorry, ISP disconnection!
This Atlas in Windows stopped after 12 Min.
https://lhcathome.cern.ch/lhcathome/result.php?resultid=223980771
ID: 38723 · Report as offensive     Reply Quote
David Cameron
Project administrator
Project developer
Project scientist

Send message
Joined: 13 May 14
Posts: 387
Credit: 15,314,184
RAC: 0
Message 38751 - Posted: 9 May 2019, 9:01:35 UTC

After some more iteration with computezrmle we have made some more changes to the CVMFS configuration which should mean that all CVMFS traffic is routed through the http proxy. These changes will become effective in a few hours.
ID: 38751 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,995,968
RAC: 136,262
Message 38919 - Posted: 20 May 2019, 14:23:07 UTC - in response to Message 38751.  

I agree.
It looks good now.


Some important hints for volunteers who want to try a proxy configuration via their BOINC client:


You may either
1. use a proxy inside your own LAN that is configured to serve BOINC projects (see: https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=4611&postid=36101) or
2. leave BOINC's proxy configuration blank.


It would be a bad idea to configure a public proxy from one of the lists that can be found anywhere as those proxies:
3. would just add latency (compared to openhtc.io which is now used for most requests)
4. are not prepared to handle the traffic caused by LHC
5. may deny connections to various other BOINC projects, e.g. WCG.
ID: 38919 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,995,968
RAC: 136,262
Message 38994 - Posted: 29 May 2019, 9:13:54 UTC

Based on the current ATLAS VM I ran a single ATLAS vbox task on a separate BOINC client to see how many internet requests are generated in total and how many of them could be sent via local squid.


Total # of requests: 4530
Sent direct: 486 (11%)
Sent via local squid: 4044 (89%)


To main target systems (3949 requests; 87%)
s1cern-cvmfs.openhtc.io: 2308 (51% of all requests)
lcgft-atlas.gridpp.rl.ac.uk: 1641 (36% of all requests)

Requests to those main targets promise a cache hit ratio up to 73% (s1cern-...) and 90% (lcgft-...).
ID: 38994 · Report as offensive     Reply Quote

Message boards : ATLAS application : CVMFS proxy configuration for vbox hosts


©2024 CERN