Message boards : Number crunching : Setting up a local Squid to work with LHC@home - Comments and Questions
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 5 · 6 · 7 · 8

AuthorMessage
kotenok2000
Avatar

Send message
Joined: 21 Feb 11
Posts: 59
Credit: 543,728
RAC: 4
Message 48453 - Posted: 16 Aug 2023, 16:52:29 UTC

Append CVMFS_QUOTA_LIMIT=10000 to /etc/cvmfs/default.local to make local cache 10000 mb. You can even set it to 100000.
ID: 48453 · Report as offensive     Reply Quote
Profile zepingouin
Avatar

Send message
Joined: 7 Jan 07
Posts: 41
Credit: 15,962,140
RAC: 41
Message 48454 - Posted: 17 Aug 2023, 5:28:09 UTC - in response to Message 48365.  

Is there an easier way to do this? I'm surprised I can't find a simple windows program to cache internet access from other computers on the local network.

I've tried squid twice. The first time was successfull for a time. I followed the instructions in here and it worked for a couple of months, then decided not to. I tried repairing it which failed, so I tried uninstalling it, and it refused. I deleted the squid folder and tried to reinstall and it still didn't work.

So I tried a second time today on a different computer which has never seen squid, I got stuck at the first instruction: "Open "Squid Terminal" as Administrator and run: squid -k shutdown"
I did this and it said "0 [main] squid 228 cygwin_exception::open_stackdumpfile: Dumping stack trace to squid.exe.stackdump"

Without following any further instructions, squid is not functioning out of the box for a browser on another computer directed to it as I would expect.

Is there an alternative cache which isn't a badly ported linux program?


I compiled Squid for use with Windows 10 and Cygwin, you may find binaries and instruction on this thread.
Latest is Squid-6.2 and works fine.
ID: 48454 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2439
Credit: 229,563,991
RAC: 135,961
Message 48461 - Posted: 19 Aug 2023, 7:28:44 UTC - in response to Message 48453.  

CVMFS_QUOTA_LIMIT is a config option for CVMFS.
It has nothing to do with Squid.


You can even set it to 100000

100 GB - far too much for the LHC@home use case.
Of course you can, but this would just waste disk space.
A quota between 4-10 GB results in a hitrate between 95-99 %.

Let the CVMFS client run a couple of days (may be a week).
Then check the hitrate of heavily used repos like cernvm-prod.cern.ch, sft.cern.ch (both Theory) or atlas.cern.ch (ATLAS - once it is back)
Run "cvmfs_config stat [repo_name]" to get some stats including the hitrate.
ID: 48461 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 811
Credit: 657,756,745
RAC: 231,638
Message 48629 - Posted: 23 Sep 2023, 1:18:39 UTC

ATLAS seem to have stopped uplaoding, is there something that I can check in the config files?
ID: 48629 · Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 418
Credit: 5,667,249
RAC: 0
Message 48630 - Posted: 23 Sep 2023, 1:55:04 UTC - in response to Message 48629.  

ATLAS seem to have stopped uplaoding, is there something that I can check in the config files?
I uploaded one 10 minutes after your post.
ID: 48630 · Report as offensive     Reply Quote
Toby Broom
Volunteer moderator

Send message
Joined: 27 Sep 08
Posts: 811
Credit: 657,756,745
RAC: 231,638
Message 48631 - Posted: 23 Sep 2023, 1:57:12 UTC

I found it the config was needed to be updated

https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5249
ID: 48631 · Report as offensive     Reply Quote
kotenok2000
Avatar

Send message
Joined: 21 Feb 11
Posts: 59
Credit: 543,728
RAC: 4
Message 48632 - Posted: 23 Sep 2023, 1:59:12 UTC
Last modified: 23 Sep 2023, 2:22:37 UTC

Someone needs to create a step by step guide for installing and configuring cvmfs, boinc and apptainer, without building from source.
ID: 48632 · Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 418
Credit: 5,667,249
RAC: 0
Message 48635 - Posted: 23 Sep 2023, 3:35:25 UTC - in response to Message 48632.  

Someone needs to create a step by step guide for installing and configuring cvmfs, boinc and apptainer, without building from source.
I keep saying this, but they don't like it. Apparently it's already simple?
ID: 48635 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2439
Credit: 229,563,991
RAC: 135,961
Message 48639 - Posted: 23 Sep 2023, 7:40:06 UTC - in response to Message 48632.  

In most cases there's no need to compile any of them from the sources.
Recent Linux distributions provide BOINC, VirtualBox, Runc, Apptainer, Squid.

CERN provides precompiled CVMFS packets as described here:
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5594&postid=48539

Most packets just need to be installed, except CVMFS and Squid which need to be configured as described here:
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5594&postid=48539
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5473


If this is too complex or the OS can't run native apps (Windows) install VirtualBox and let BOINC run vbox apps.
ID: 48639 · Report as offensive     Reply Quote
kotenok2000
Avatar

Send message
Joined: 21 Feb 11
Posts: 59
Credit: 543,728
RAC: 4
Message 48641 - Posted: 23 Sep 2023, 11:37:59 UTC

Then someone needs to unpin this thread
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=4840
ID: 48641 · Report as offensive     Reply Quote
kotenok2000
Avatar

Send message
Joined: 21 Feb 11
Posts: 59
Credit: 543,728
RAC: 4
Message 48642 - Posted: 23 Sep 2023, 12:17:37 UTC - in response to Message 48639.  

You should also add instructions for disabling cgroups v2 so Theory tasks don't crash.
ID: 48642 · Report as offensive     Reply Quote
Previous · 1 . . . 5 · 6 · 7 · 8

Message boards : Number crunching : Setting up a local Squid to work with LHC@home - Comments and Questions


©2024 CERN