Advanced search

Questions and Answers : Unix/Linux : Running virtualbox on LHC
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
stratos412

Send message
Joined: 18 Mar 20
Posts: 17
Credit: 16,510
RAC: 0
Message 48337 - Posted: 4 Aug 2023, 20:42:01 UTC

Hello all.

I am dealing with an issue after the major upgrade on linux mint 20.3 to mint 21. A few thing got broken unfortunately....

I had to install from Linux Mint Software Manager the BOINC(flatpack), since the classic BOINC packages refused to work properly....
I managed to make BOINC(flatpack) to work, but I am dealing an issue with Virtualbox.
First, I have installed the latest version (7.0) but it didn't work.
Then, I installed version 6.1.34 since it was the last one that worked properly with BOINC before the upgrade. Also installed the extension pack of virtualbox.
(link: https://www.virtualbox.org/wiki/Download_Old_Builds_6_1 // version 6.1.34 for Ubuntu 22.04)
Every time I get an error from BOINC: ''Message from server: Virtualbox is not isntalled".

Any idea how to fix it?
ID: 48337 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2244
Credit: 173,902,375
RAC: 456
Message 48338 - Posted: 4 Aug 2023, 20:59:32 UTC - in response to Message 48337.  

Please make your Computer visable for us in pref of LHC.
If you have an AMD SVM must be enabled in BIOS, for Intel VT-x is the Parameter in BIOS.
ID: 48338 · Report as offensive     Reply Quote
stratos412

Send message
Joined: 18 Mar 20
Posts: 17
Credit: 16,510
RAC: 0
Message 48339 - Posted: 4 Aug 2023, 21:16:37 UTC - in response to Message 48338.  
Last modified: 4 Aug 2023, 21:20:05 UTC

PC_1: https://lhcathome.cern.ch/lhcathome/show_host_detail.php?hostid=10834344

PC_2: https://lhcathome.cern.ch/lhcathome/show_host_detail.php?hostid=10834339


Edit: Virtualization is enabled in BIOS. I had the following before the Mint upgrade, on both PCs

Linux Mint 20.3 [5.4.0-150-generic|libc 2.31 (Ubuntu GLIBC 2.31-0ubuntu9.9)]
Virtualbox (6.1.38_Ubuntur153438) installed, CPU has hardware virtualization support and it is enabled
ID: 48339 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2244
Credit: 173,902,375
RAC: 456
Message 48340 - Posted: 4 Aug 2023, 21:27:34 UTC - in response to Message 48339.  
Last modified: 4 Aug 2023, 21:27:48 UTC

Virtualisierung Keines
Betriebssystem Linux GNOME
GNOME 44 (Flatpak runtime) [5.15.0-78-generic|libc 2.35]
Something must be wrong with Virtualisation.
If BIOS is ok, must be something with the OS.
ID: 48340 · Report as offensive     Reply Quote
stratos412

Send message
Joined: 18 Mar 20
Posts: 17
Credit: 16,510
RAC: 0
Message 48341 - Posted: 4 Aug 2023, 21:41:08 UTC - in response to Message 48340.  

I am going to try some different version of virtual box to see if I get lucky.

I also see in the system information that oracle vm box is there

The ''sudo virt-what'' returns null results... Something must be wrong
ID: 48341 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2244
Credit: 173,902,375
RAC: 456
Message 48342 - Posted: 4 Aug 2023, 21:51:04 UTC - in response to Message 48341.  

Is cgroup changed from V1 to V2?
This is a work for Cern-IT.
You can read it in the messages.
ID: 48342 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2541
Credit: 254,608,838
RAC: 34,609
Message 48343 - Posted: 5 Aug 2023, 6:00:27 UTC - in response to Message 48341.  

I am going to try some different version of virtual box to see if I get lucky.

I also see in the system information that oracle vm box is there

The ''sudo virt-what'' returns null results... Something must be wrong

From "man virt-what":
"virt-what" is a shell script which can be used to detect if the program is running in a virtual machine.

The program prints out a list of "facts" about the virtual machine, derived from heuristics.  One fact is printed per line.

If nothing is printed and the script exits with code 0 (no error), then it can mean either that the program is running on bare-metal or the program is running inside
a type of virtual machine which we don't know about or cannot detect.




Virtualization support by the CPU is a MUST to run vbox tasks from LHC@home.

As for this computer https://lhcathome.cern.ch/lhcathome/show_host_detail.php?hostid=10834339:
According to Intel the CPU does not support virtualization:
https://www.intel.com/content/www/us/en/products/sku/36503/intel-core2-duo-processor-e7500-3m-cache-2-93-ghz-1066-mhz-fsb/specifications.html

As for this computer https://lhcathome.cern.ch/lhcathome/show_host_detail.php?hostid=10834344:
According to Intel the CPU supports virtualization but it may be disabled in the BIOS:
https://www.intel.com/content/www/us/en/products/sku/27249/intel-core2-duo-processor-e6400-2m-cache-2-13-ghz-1066-mhz-fsb/specifications.html


Both computers have less than 4 GB RAM.
16 GB are the recommended minimum (8 GB may work but require expert knowledge).


Since your BOINC clients don't report virtualization support the project server sent some Theory native tasks.
Native tasks don't need VirtualBox but require a correctly configured local CVMFS client which is also not present on both computers.
Example log:
<core_client_version>7.22.1</core_client_version>
<![CDATA[
<message>
process exited with code 195 (0xc3, -61)</message>
<stderr_txt>
00:30:05 (143): wrapper (7.15.26016): starting
00:30:05 (143): wrapper (7.15.26016): starting
00:30:05 (143): wrapper: running ../../projects/lhcathome.cern.ch_lhcathome/cranky-0.0.32 ()
00:30:05 EEST +03:00 2023-08-05: cranky-0.0.32: [INFO] Detected Theory App
00:30:05 EEST +03:00 2023-08-05: cranky-0.0.32: [INFO] Checking CVMFS.
00:30:05 EEST +03:00 2023-08-05: cranky-0.0.32: [ERROR] 'which' could not locate the command 'cvmfs_config'.
00:30:06 (143): cranky exited; CPU time 0.020812
00:30:06 (143): app exit status: 0xce
00:30:06 (143): called boinc_finish(195)

</stderr_txt>
]]>
ID: 48343 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2244
Credit: 173,902,375
RAC: 456
Message 48344 - Posted: 5 Aug 2023, 6:11:15 UTC

Theory and sixtrack are ok for your PC's.
Atlas and CMS are atm without Tasks and can't be use with your two PC's.
ID: 48344 · Report as offensive     Reply Quote
stratos412

Send message
Joined: 18 Mar 20
Posts: 17
Credit: 16,510
RAC: 0
Message 48346 - Posted: 5 Aug 2023, 6:57:53 UTC

@meax.

About cgroup. I can see that the group is cgroup2fs


@computezrmle

Before the Mint upgrade and the installation of the latest BOINC(flatpak), those where my PCs clients:

1) https://lhcathome.cern.ch/lhcathome/show_host_detail.php?hostid=10822907
which change to https://lhcathome.cern.ch/lhcathome/show_host_detail.php?hostid=10834339

2) https://lhcathome.cern.ch/lhcathome/show_host_detail.php?hostid=10822906
which change to https://lhcathome.cern.ch/lhcathome/show_host_detail.php?hostid=10834344

Why on BOTH PCs I see "Virtualbox (6.1.38_Ubuntur153438) installed, CPU has hardware virtualization support and it is enabled" ?

Those where my last LHC tasks BEFORE Linux upgrade.
https://lhcathome.cern.ch/lhcathome/results.php?hostid=10822906
https://lhcathome.cern.ch/lhcathome/results.php?hostid=10822907

How do I configure local CVMFS and what it should be?
ID: 48346 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2244
Credit: 173,902,375
RAC: 456
Message 48347 - Posted: 5 Aug 2023, 7:09:31 UTC - in response to Message 48346.  

How do I configure local CVMFS and what it should be?

In the Folder number crunching https://lhcathome.cern.ch/lhcathome/forum_forum.php?id=3 you can find Infos.
ID: 48347 · Report as offensive     Reply Quote
stratos412

Send message
Joined: 18 Mar 20
Posts: 17
Credit: 16,510
RAC: 0
Message 48348 - Posted: 5 Aug 2023, 7:54:01 UTC - in response to Message 48347.  

Thanks for the help guys. So, I run a command to check what's wrong with cvmfs
If anyone can help...


Running /usr/bin/cvmfs_config atlas:
CVMFS_REPOSITORY_NAME=atlas.cern.ch
CERNVM_GRID_UI_VERSION=
CVMFS_ALIEN_CACHE=
CVMFS_ALT_ROOT_PATH=
CVMFS_AUTHZ_HELPER=
CVMFS_AUTHZ_SEARCH_PATH=
CVMFS_AUTO_UPDATE=
CVMFS_BACKOFF_INIT=2 # from /etc/cvmfs/default.conf
CVMFS_BACKOFF_MAX=10 # from /etc/cvmfs/default.conf
CVMFS_BASE_ENV=1 # from /etc/cvmfs/default.conf
CVMFS_CACHE_BASE=/var/lib/cvmfs # from /etc/cvmfs/default.conf
CVMFS_CACHE_DIR=/var/lib/cvmfs/shared
CVMFS_CACHE_PRIMARY=
CVMFS_CHECK_PERMISSIONS=yes # from /etc/cvmfs/default.conf
CVMFS_CLAIM_OWNERSHIP=yes # from /etc/cvmfs/default.conf
CVMFS_CLIENT_PROFILE= # from /etc/cvmfs/default.conf
CVMFS_CONFIG_REPO_REQUIRED=
CVMFS_CONFIG_REPOSITORY=cvmfs-config.cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DEBUGLOG=
CVMFS_DEFAULT_DOMAIN=cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DNS_RETRIES=
CVMFS_DNS_TIMEOUT=
CVMFS_EXTERNAL_FALLBACK_PROXY=
CVMFS_EXTERNAL_HTTP_PROXY=
CVMFS_EXTERNAL_SERVER_URL=
CVMFS_EXTERNAL_TIMEOUT=
CVMFS_EXTERNAL_TIMEOUT_DIRECT=
CVMFS_FALLBACK_PROXY=
CVMFS_FOLLOW_REDIRECTS=
CVMFS_HIDE_MAGIC_XATTRS=
CVMFS_HOST_RESET_AFTER=1800 # from /etc/cvmfs/default.conf
CVMFS_HTTP_PROXY=
CVMFS_IGNORE_SIGNATURE=
CVMFS_INITIAL_GENERATION=
CVMFS_IPFAMILY_PREFER=
CVMFS_KCACHE_TIMEOUT=2 # from /etc/cvmfs/default.local
CVMFS_KEYS_DIR=/etc/cvmfs/keys/cern.ch # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_LOW_SPEED_LIMIT=1024 # from /etc/cvmfs/default.conf
CVMFS_MAX_IPADDR_PER_PROXY=
CVMFS_MAX_RETRIES=3 # from /etc/cvmfs/default.local
CVMFS_MAX_TTL=
CVMFS_MEMCACHE_SIZE=
CVMFS_MOUNT_DIR=/cvmfs # from /etc/cvmfs/default.conf
CVMFS_MOUNT_RW=
CVMFS_NFILES=131072 # from /etc/cvmfs/default.conf
CVMFS_NFS_SHARED=
CVMFS_NFS_SOURCE=
CVMFS_OOM_SCORE_ADJ=
CVMFS_PROXY_RESET_AFTER=300 # from /etc/cvmfs/default.conf
CVMFS_PROXY_TEMPLATE=
CVMFS_PUBLIC_KEY=
CVMFS_QUOTA_LIMIT=4000 # from /etc/cvmfs/default.conf
CVMFS_RELOAD_SOCKETS=/var/run/cvmfs # from /etc/cvmfs/default.conf
CVMFS_REPOSITORIES=atlas,atlas-condb,grid,cernvm-prod,sft,alice # from /etc/cvmfs/default.local
CVMFS_REPOSITORY_DATE=
CVMFS_REPOSITORY_TAG=
CVMFS_ROOT_HASH=
CVMFS_SEND_INFO_HEADER=no # from /etc/cvmfs/default.conf
CVMFS_SERVER_CACHE_MODE=
CVMFS_SERVER_URL='http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch;http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch;http://s1bnl-cvmfs.openhtc.io/cvmfs/atlas.cern.ch;http://s1fnal-cvmfs.openhtc.io/cvmfs/atlas.cern.ch' # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_SHARED_CACHE=yes # from /etc/cvmfs/default.conf
CVMFS_STRICT_MOUNT=no # from /etc/cvmfs/default.conf
CVMFS_SYSLOG_FACILITY=
CVMFS_SYSLOG_LEVEL=
CVMFS_SYSTEMD_NOKILL=
CVMFS_TIMEOUT=5 # from /etc/cvmfs/default.conf
CVMFS_TIMEOUT_DIRECT=10 # from /etc/cvmfs/default.conf
CVMFS_TRACEFILE=
CVMFS_TRUSTED_CERTS=
CVMFS_USE_CDN=yes # from /etc/cvmfs/default.local
CVMFS_USE_GEOAPI=yes # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_USER=cvmfs # from /etc/cvmfs/default.conf
CVMFS_WORKSPACE=

Running /usr/bin/cvmfs_config atlas-condb:
CVMFS_REPOSITORY_NAME=atlas-condb.cern.ch
CERNVM_GRID_UI_VERSION=
CVMFS_ALIEN_CACHE=
CVMFS_ALT_ROOT_PATH=
CVMFS_AUTHZ_HELPER=
CVMFS_AUTHZ_SEARCH_PATH=
CVMFS_AUTO_UPDATE=
CVMFS_BACKOFF_INIT=2 # from /etc/cvmfs/default.conf
CVMFS_BACKOFF_MAX=10 # from /etc/cvmfs/default.conf
CVMFS_BASE_ENV=1 # from /etc/cvmfs/default.conf
CVMFS_CACHE_BASE=/var/lib/cvmfs # from /etc/cvmfs/default.conf
CVMFS_CACHE_DIR=/var/lib/cvmfs/shared
CVMFS_CACHE_PRIMARY=
CVMFS_CHECK_PERMISSIONS=yes # from /etc/cvmfs/default.conf
CVMFS_CLAIM_OWNERSHIP=yes # from /etc/cvmfs/default.conf
CVMFS_CLIENT_PROFILE= # from /etc/cvmfs/default.conf
CVMFS_CONFIG_REPO_REQUIRED=
CVMFS_CONFIG_REPOSITORY=cvmfs-config.cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DEBUGLOG=
CVMFS_DEFAULT_DOMAIN=cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DNS_RETRIES=
CVMFS_DNS_TIMEOUT=
CVMFS_EXTERNAL_FALLBACK_PROXY=
CVMFS_EXTERNAL_HTTP_PROXY=
CVMFS_EXTERNAL_SERVER_URL=
CVMFS_EXTERNAL_TIMEOUT=
CVMFS_EXTERNAL_TIMEOUT_DIRECT=
CVMFS_FALLBACK_PROXY=
CVMFS_FOLLOW_REDIRECTS=
CVMFS_HIDE_MAGIC_XATTRS=
CVMFS_HOST_RESET_AFTER=1800 # from /etc/cvmfs/default.conf
CVMFS_HTTP_PROXY=
CVMFS_IGNORE_SIGNATURE=
CVMFS_INITIAL_GENERATION=
CVMFS_IPFAMILY_PREFER=
CVMFS_KCACHE_TIMEOUT=2 # from /etc/cvmfs/default.local
CVMFS_KEYS_DIR=/etc/cvmfs/keys/cern.ch # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_LOW_SPEED_LIMIT=1024 # from /etc/cvmfs/default.conf
CVMFS_MAX_IPADDR_PER_PROXY=
CVMFS_MAX_RETRIES=3 # from /etc/cvmfs/default.local
CVMFS_MAX_TTL=
CVMFS_MEMCACHE_SIZE=
CVMFS_MOUNT_DIR=/cvmfs # from /etc/cvmfs/default.conf
CVMFS_MOUNT_RW=
CVMFS_NFILES=131072 # from /etc/cvmfs/default.conf
CVMFS_NFS_SHARED=
CVMFS_NFS_SOURCE=
CVMFS_OOM_SCORE_ADJ=
CVMFS_PROXY_RESET_AFTER=300 # from /etc/cvmfs/default.conf
CVMFS_PROXY_TEMPLATE=
CVMFS_PUBLIC_KEY=
CVMFS_QUOTA_LIMIT=4000 # from /etc/cvmfs/default.conf
CVMFS_RELOAD_SOCKETS=/var/run/cvmfs # from /etc/cvmfs/default.conf
CVMFS_REPOSITORIES=atlas,atlas-condb,grid,cernvm-prod,sft,alice # from /etc/cvmfs/default.local
CVMFS_REPOSITORY_DATE=
CVMFS_REPOSITORY_TAG=
CVMFS_ROOT_HASH=
CVMFS_SEND_INFO_HEADER=no # from /etc/cvmfs/default.conf
CVMFS_SERVER_CACHE_MODE=
CVMFS_SERVER_URL='http://s1cern-cvmfs.openhtc.io/cvmfs/atlas-condb.cern.ch;http://s1ral-cvmfs.openhtc.io/cvmfs/atlas-condb.cern.ch;http://s1bnl-cvmfs.openhtc.io/cvmfs/atlas-condb.cern.ch;http://s1fnal-cvmfs.openhtc.io/cvmfs/atlas-condb.cern.ch' # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_SHARED_CACHE=yes # from /etc/cvmfs/default.conf
CVMFS_STRICT_MOUNT=no # from /etc/cvmfs/default.conf
CVMFS_SYSLOG_FACILITY=
CVMFS_SYSLOG_LEVEL=
CVMFS_SYSTEMD_NOKILL=
CVMFS_TIMEOUT=5 # from /etc/cvmfs/default.conf
CVMFS_TIMEOUT_DIRECT=10 # from /etc/cvmfs/default.conf
CVMFS_TRACEFILE=
CVMFS_TRUSTED_CERTS=
CVMFS_USE_CDN=yes # from /etc/cvmfs/default.local
CVMFS_USE_GEOAPI=yes # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_USER=cvmfs # from /etc/cvmfs/default.conf
CVMFS_WORKSPACE=

Running /usr/bin/cvmfs_config grid:
CVMFS_REPOSITORY_NAME=grid.cern.ch
CERNVM_GRID_UI_VERSION=
CVMFS_ALIEN_CACHE=
CVMFS_ALT_ROOT_PATH=
CVMFS_AUTHZ_HELPER=
CVMFS_AUTHZ_SEARCH_PATH=
CVMFS_AUTO_UPDATE=
CVMFS_BACKOFF_INIT=2 # from /etc/cvmfs/default.conf
CVMFS_BACKOFF_MAX=10 # from /etc/cvmfs/default.conf
CVMFS_BASE_ENV=1 # from /etc/cvmfs/default.conf
CVMFS_CACHE_BASE=/var/lib/cvmfs # from /etc/cvmfs/default.conf
CVMFS_CACHE_DIR=/var/lib/cvmfs/shared
CVMFS_CACHE_PRIMARY=
CVMFS_CHECK_PERMISSIONS=yes # from /etc/cvmfs/default.conf
CVMFS_CLAIM_OWNERSHIP=yes # from /etc/cvmfs/default.conf
CVMFS_CLIENT_PROFILE= # from /etc/cvmfs/default.conf
CVMFS_CONFIG_REPO_REQUIRED=
CVMFS_CONFIG_REPOSITORY=cvmfs-config.cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DEBUGLOG=
CVMFS_DEFAULT_DOMAIN=cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DNS_RETRIES=
CVMFS_DNS_TIMEOUT=
CVMFS_EXTERNAL_FALLBACK_PROXY=
CVMFS_EXTERNAL_HTTP_PROXY=
CVMFS_EXTERNAL_SERVER_URL=
CVMFS_EXTERNAL_TIMEOUT=
CVMFS_EXTERNAL_TIMEOUT_DIRECT=
CVMFS_FALLBACK_PROXY=
CVMFS_FOLLOW_REDIRECTS=
CVMFS_HIDE_MAGIC_XATTRS=
CVMFS_HOST_RESET_AFTER=1800 # from /etc/cvmfs/default.conf
CVMFS_HTTP_PROXY=
CVMFS_IGNORE_SIGNATURE=
CVMFS_INITIAL_GENERATION=
CVMFS_IPFAMILY_PREFER=
CVMFS_KCACHE_TIMEOUT=2 # from /etc/cvmfs/default.local
CVMFS_KEYS_DIR=/etc/cvmfs/keys/cern.ch # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_LOW_SPEED_LIMIT=1024 # from /etc/cvmfs/default.conf
CVMFS_MAX_IPADDR_PER_PROXY=
CVMFS_MAX_RETRIES=3 # from /etc/cvmfs/default.local
CVMFS_MAX_TTL=
CVMFS_MEMCACHE_SIZE=
CVMFS_MOUNT_DIR=/cvmfs # from /etc/cvmfs/default.conf
CVMFS_MOUNT_RW=
CVMFS_NFILES=131072 # from /etc/cvmfs/default.conf
CVMFS_NFS_SHARED=
CVMFS_NFS_SOURCE=
CVMFS_OOM_SCORE_ADJ=
CVMFS_PROXY_RESET_AFTER=300 # from /etc/cvmfs/default.conf
CVMFS_PROXY_TEMPLATE=
CVMFS_PUBLIC_KEY=
CVMFS_QUOTA_LIMIT=4000 # from /etc/cvmfs/default.conf
CVMFS_RELOAD_SOCKETS=/var/run/cvmfs # from /etc/cvmfs/default.conf
CVMFS_REPOSITORIES=atlas,atlas-condb,grid,cernvm-prod,sft,alice # from /etc/cvmfs/default.local
CVMFS_REPOSITORY_DATE=
CVMFS_REPOSITORY_TAG=
CVMFS_ROOT_HASH=
CVMFS_SEND_INFO_HEADER=no # from /etc/cvmfs/default.conf
CVMFS_SERVER_CACHE_MODE=
CVMFS_SERVER_URL='http://s1cern-cvmfs.openhtc.io/cvmfs/grid.cern.ch;http://s1ral-cvmfs.openhtc.io/cvmfs/grid.cern.ch;http://s1bnl-cvmfs.openhtc.io/cvmfs/grid.cern.ch;http://s1fnal-cvmfs.openhtc.io/cvmfs/grid.cern.ch' # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_SHARED_CACHE=yes # from /etc/cvmfs/default.conf
CVMFS_STRICT_MOUNT=no # from /etc/cvmfs/default.conf
CVMFS_SYSLOG_FACILITY=
CVMFS_SYSLOG_LEVEL=
CVMFS_SYSTEMD_NOKILL=
CVMFS_TIMEOUT=5 # from /etc/cvmfs/default.conf
CVMFS_TIMEOUT_DIRECT=10 # from /etc/cvmfs/default.conf
CVMFS_TRACEFILE=
CVMFS_TRUSTED_CERTS=
CVMFS_USE_CDN=yes # from /etc/cvmfs/default.local
CVMFS_USE_GEOAPI=yes # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_USER=cvmfs # from /etc/cvmfs/default.conf
CVMFS_WORKSPACE=

Running /usr/bin/cvmfs_config cernvm-prod:
CVMFS_REPOSITORY_NAME=cernvm-prod.cern.ch
CERNVM_GRID_UI_VERSION=
CVMFS_ALIEN_CACHE=
CVMFS_ALT_ROOT_PATH=
CVMFS_AUTHZ_HELPER=
CVMFS_AUTHZ_SEARCH_PATH=
CVMFS_AUTO_UPDATE=
CVMFS_BACKOFF_INIT=2 # from /etc/cvmfs/default.conf
CVMFS_BACKOFF_MAX=10 # from /etc/cvmfs/default.conf
CVMFS_BASE_ENV=1 # from /etc/cvmfs/default.conf
CVMFS_CACHE_BASE=/var/lib/cvmfs # from /etc/cvmfs/default.conf
CVMFS_CACHE_DIR=/var/lib/cvmfs/shared
CVMFS_CACHE_PRIMARY=
CVMFS_CHECK_PERMISSIONS=yes # from /etc/cvmfs/default.conf
CVMFS_CLAIM_OWNERSHIP=yes # from /etc/cvmfs/default.conf
CVMFS_CLIENT_PROFILE= # from /etc/cvmfs/default.conf
CVMFS_CONFIG_REPO_REQUIRED=
CVMFS_CONFIG_REPOSITORY=cvmfs-config.cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DEBUGLOG=
CVMFS_DEFAULT_DOMAIN=cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DNS_RETRIES=
CVMFS_DNS_TIMEOUT=
CVMFS_EXTERNAL_FALLBACK_PROXY=
CVMFS_EXTERNAL_HTTP_PROXY=
CVMFS_EXTERNAL_SERVER_URL=
CVMFS_EXTERNAL_TIMEOUT=
CVMFS_EXTERNAL_TIMEOUT_DIRECT=
CVMFS_FALLBACK_PROXY=
CVMFS_FOLLOW_REDIRECTS=
CVMFS_HIDE_MAGIC_XATTRS=
CVMFS_HOST_RESET_AFTER=1800 # from /etc/cvmfs/default.conf
CVMFS_HTTP_PROXY=
CVMFS_IGNORE_SIGNATURE=
CVMFS_INITIAL_GENERATION=
CVMFS_IPFAMILY_PREFER=
CVMFS_KCACHE_TIMEOUT=2 # from /etc/cvmfs/default.local
CVMFS_KEYS_DIR=/etc/cvmfs/keys/cern.ch # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_LOW_SPEED_LIMIT=1024 # from /etc/cvmfs/default.conf
CVMFS_MAX_IPADDR_PER_PROXY=
CVMFS_MAX_RETRIES=3 # from /etc/cvmfs/default.local
CVMFS_MAX_TTL=
CVMFS_MEMCACHE_SIZE=
CVMFS_MOUNT_DIR=/cvmfs # from /etc/cvmfs/default.conf
CVMFS_MOUNT_RW=
CVMFS_NFILES=131072 # from /etc/cvmfs/default.conf
CVMFS_NFS_SHARED=
CVMFS_NFS_SOURCE=
CVMFS_OOM_SCORE_ADJ=
CVMFS_PROXY_RESET_AFTER=300 # from /etc/cvmfs/default.conf
CVMFS_PROXY_TEMPLATE=
CVMFS_PUBLIC_KEY=
CVMFS_QUOTA_LIMIT=4000 # from /etc/cvmfs/default.conf
CVMFS_RELOAD_SOCKETS=/var/run/cvmfs # from /etc/cvmfs/default.conf
CVMFS_REPOSITORIES=atlas,atlas-condb,grid,cernvm-prod,sft,alice # from /etc/cvmfs/default.local
CVMFS_REPOSITORY_DATE=
CVMFS_REPOSITORY_TAG=
CVMFS_ROOT_HASH=
CVMFS_SEND_INFO_HEADER=no # from /etc/cvmfs/default.conf
CVMFS_SERVER_CACHE_MODE=
CVMFS_SERVER_URL='http://s1cern-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch;http://s1ral-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch;http://s1bnl-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch;http://s1fnal-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch' # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_SHARED_CACHE=yes # from /etc/cvmfs/default.conf
CVMFS_STRICT_MOUNT=no # from /etc/cvmfs/default.conf
CVMFS_SYSLOG_FACILITY=
CVMFS_SYSLOG_LEVEL=
CVMFS_SYSTEMD_NOKILL=
CVMFS_TIMEOUT=5 # from /etc/cvmfs/default.conf
CVMFS_TIMEOUT_DIRECT=10 # from /etc/cvmfs/default.conf
CVMFS_TRACEFILE=
CVMFS_TRUSTED_CERTS=
CVMFS_USE_CDN=yes # from /etc/cvmfs/default.local
CVMFS_USE_GEOAPI=yes # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_USER=cvmfs # from /etc/cvmfs/default.conf
CVMFS_WORKSPACE=

Running /usr/bin/cvmfs_config sft:
CVMFS_REPOSITORY_NAME=sft.cern.ch
CERNVM_GRID_UI_VERSION=
CVMFS_ALIEN_CACHE=
CVMFS_ALT_ROOT_PATH=
CVMFS_AUTHZ_HELPER=
CVMFS_AUTHZ_SEARCH_PATH=
CVMFS_AUTO_UPDATE=
CVMFS_BACKOFF_INIT=2 # from /etc/cvmfs/default.conf
CVMFS_BACKOFF_MAX=10 # from /etc/cvmfs/default.conf
CVMFS_BASE_ENV=1 # from /etc/cvmfs/default.conf
CVMFS_CACHE_BASE=/var/lib/cvmfs # from /etc/cvmfs/default.conf
CVMFS_CACHE_DIR=/var/lib/cvmfs/shared
CVMFS_CACHE_PRIMARY=
CVMFS_CHECK_PERMISSIONS=yes # from /etc/cvmfs/default.conf
CVMFS_CLAIM_OWNERSHIP=yes # from /etc/cvmfs/default.conf
CVMFS_CLIENT_PROFILE= # from /etc/cvmfs/default.conf
CVMFS_CONFIG_REPO_REQUIRED=
CVMFS_CONFIG_REPOSITORY=cvmfs-config.cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DEBUGLOG=
CVMFS_DEFAULT_DOMAIN=cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DNS_RETRIES=
CVMFS_DNS_TIMEOUT=
CVMFS_EXTERNAL_FALLBACK_PROXY=
CVMFS_EXTERNAL_HTTP_PROXY=
CVMFS_EXTERNAL_SERVER_URL=
CVMFS_EXTERNAL_TIMEOUT=
CVMFS_EXTERNAL_TIMEOUT_DIRECT=
CVMFS_FALLBACK_PROXY=
CVMFS_FOLLOW_REDIRECTS=
CVMFS_HIDE_MAGIC_XATTRS=
CVMFS_HOST_RESET_AFTER=1800 # from /etc/cvmfs/default.conf
CVMFS_HTTP_PROXY=
CVMFS_IGNORE_SIGNATURE=
CVMFS_INITIAL_GENERATION=
CVMFS_IPFAMILY_PREFER=
CVMFS_KCACHE_TIMEOUT=2 # from /etc/cvmfs/default.local
CVMFS_KEYS_DIR=/etc/cvmfs/keys/cern.ch # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_LOW_SPEED_LIMIT=1024 # from /etc/cvmfs/default.conf
CVMFS_MAX_IPADDR_PER_PROXY=
CVMFS_MAX_RETRIES=3 # from /etc/cvmfs/default.local
CVMFS_MAX_TTL=
CVMFS_MEMCACHE_SIZE=
CVMFS_MOUNT_DIR=/cvmfs # from /etc/cvmfs/default.conf
CVMFS_MOUNT_RW=
CVMFS_NFILES=131072 # from /etc/cvmfs/default.conf
CVMFS_NFS_SHARED=
CVMFS_NFS_SOURCE=
CVMFS_OOM_SCORE_ADJ=
CVMFS_PROXY_RESET_AFTER=300 # from /etc/cvmfs/default.conf
CVMFS_PROXY_TEMPLATE=
CVMFS_PUBLIC_KEY=
CVMFS_QUOTA_LIMIT=4000 # from /etc/cvmfs/default.conf
CVMFS_RELOAD_SOCKETS=/var/run/cvmfs # from /etc/cvmfs/default.conf
CVMFS_REPOSITORIES=atlas,atlas-condb,grid,cernvm-prod,sft,alice # from /etc/cvmfs/default.local
CVMFS_REPOSITORY_DATE=
CVMFS_REPOSITORY_TAG=
CVMFS_ROOT_HASH=
CVMFS_SEND_INFO_HEADER=no # from /etc/cvmfs/default.conf
CVMFS_SERVER_CACHE_MODE=
CVMFS_SERVER_URL='http://s1cern-cvmfs.openhtc.io/cvmfs/sft.cern.ch;http://s1ral-cvmfs.openhtc.io/cvmfs/sft.cern.ch;http://s1bnl-cvmfs.openhtc.io/cvmfs/sft.cern.ch;http://s1fnal-cvmfs.openhtc.io/cvmfs/sft.cern.ch' # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_SHARED_CACHE=yes # from /etc/cvmfs/default.conf
CVMFS_STRICT_MOUNT=no # from /etc/cvmfs/default.conf
CVMFS_SYSLOG_FACILITY=
CVMFS_SYSLOG_LEVEL=
CVMFS_SYSTEMD_NOKILL=
CVMFS_TIMEOUT=5 # from /etc/cvmfs/default.conf
CVMFS_TIMEOUT_DIRECT=10 # from /etc/cvmfs/default.conf
CVMFS_TRACEFILE=
CVMFS_TRUSTED_CERTS=
CVMFS_USE_CDN=yes # from /etc/cvmfs/default.local
CVMFS_USE_GEOAPI=yes # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_USER=cvmfs # from /etc/cvmfs/default.conf
CVMFS_WORKSPACE=

Running /usr/bin/cvmfs_config alice:
CVMFS_REPOSITORY_NAME=alice.cern.ch
CERNVM_GRID_UI_VERSION=
CVMFS_ALIEN_CACHE=
CVMFS_ALT_ROOT_PATH=
CVMFS_AUTHZ_HELPER=
CVMFS_AUTHZ_SEARCH_PATH=
CVMFS_AUTO_UPDATE=
CVMFS_BACKOFF_INIT=2 # from /etc/cvmfs/default.conf
CVMFS_BACKOFF_MAX=10 # from /etc/cvmfs/default.conf
CVMFS_BASE_ENV=1 # from /etc/cvmfs/default.conf
CVMFS_CACHE_BASE=/var/lib/cvmfs # from /etc/cvmfs/default.conf
CVMFS_CACHE_DIR=/var/lib/cvmfs/shared
CVMFS_CACHE_PRIMARY=
CVMFS_CHECK_PERMISSIONS=yes # from /etc/cvmfs/default.conf
CVMFS_CLAIM_OWNERSHIP=yes # from /etc/cvmfs/default.conf
CVMFS_CLIENT_PROFILE= # from /etc/cvmfs/default.conf
CVMFS_CONFIG_REPO_REQUIRED=
CVMFS_CONFIG_REPOSITORY=cvmfs-config.cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DEBUGLOG=
CVMFS_DEFAULT_DOMAIN=cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DNS_RETRIES=
CVMFS_DNS_TIMEOUT=
CVMFS_EXTERNAL_FALLBACK_PROXY=
CVMFS_EXTERNAL_HTTP_PROXY=
CVMFS_EXTERNAL_SERVER_URL=
CVMFS_EXTERNAL_TIMEOUT=
CVMFS_EXTERNAL_TIMEOUT_DIRECT=
CVMFS_FALLBACK_PROXY=
CVMFS_FOLLOW_REDIRECTS=
CVMFS_HIDE_MAGIC_XATTRS=
CVMFS_HOST_RESET_AFTER=1800 # from /etc/cvmfs/default.conf
CVMFS_HTTP_PROXY=
CVMFS_IGNORE_SIGNATURE=
CVMFS_INITIAL_GENERATION=
CVMFS_IPFAMILY_PREFER=
CVMFS_KCACHE_TIMEOUT=2 # from /etc/cvmfs/default.local
CVMFS_KEYS_DIR=/etc/cvmfs/keys/cern.ch # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_LOW_SPEED_LIMIT=1024 # from /etc/cvmfs/default.conf
CVMFS_MAX_IPADDR_PER_PROXY=
CVMFS_MAX_RETRIES=3 # from /etc/cvmfs/default.local
CVMFS_MAX_TTL=
CVMFS_MEMCACHE_SIZE=
CVMFS_MOUNT_DIR=/cvmfs # from /etc/cvmfs/default.conf
CVMFS_MOUNT_RW=
CVMFS_NFILES=131072 # from /etc/cvmfs/default.conf
CVMFS_NFS_SHARED=
CVMFS_NFS_SOURCE=
CVMFS_OOM_SCORE_ADJ=
CVMFS_PROXY_RESET_AFTER=300 # from /etc/cvmfs/default.conf
CVMFS_PROXY_TEMPLATE=
CVMFS_PUBLIC_KEY=
CVMFS_QUOTA_LIMIT=4000 # from /etc/cvmfs/default.conf
CVMFS_RELOAD_SOCKETS=/var/run/cvmfs # from /etc/cvmfs/default.conf
CVMFS_REPOSITORIES=atlas,atlas-condb,grid,cernvm-prod,sft,alice # from /etc/cvmfs/default.local
CVMFS_REPOSITORY_DATE=
CVMFS_REPOSITORY_TAG=
CVMFS_ROOT_HASH=
CVMFS_SEND_INFO_HEADER=no # from /etc/cvmfs/default.conf
CVMFS_SERVER_CACHE_MODE=
CVMFS_SERVER_URL='http://s1cern-cvmfs.openhtc.io/cvmfs/alice.cern.ch;http://s1ral-cvmfs.openhtc.io/cvmfs/alice.cern.ch;http://s1bnl-cvmfs.openhtc.io/cvmfs/alice.cern.ch;http://s1fnal-cvmfs.openhtc.io/cvmfs/alice.cern.ch' # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_SHARED_CACHE=yes # from /etc/cvmfs/default.conf
CVMFS_STRICT_MOUNT=no # from /etc/cvmfs/default.conf
CVMFS_SYSLOG_FACILITY=
CVMFS_SYSLOG_LEVEL=
CVMFS_SYSTEMD_NOKILL=
CVMFS_TIMEOUT=5 # from /etc/cvmfs/default.conf
CVMFS_TIMEOUT_DIRECT=10 # from /etc/cvmfs/default.conf
CVMFS_TRACEFILE=
CVMFS_TRUSTED_CERTS=
CVMFS_USE_CDN=yes # from /etc/cvmfs/default.local
CVMFS_USE_GEOAPI=yes # from /etc/cvmfs/domain.d/cern.ch.conf
CVMFS_USER=cvmfs
ID: 48348 · Report as offensive     Reply Quote
stratos412

Send message
Joined: 18 Mar 20
Posts: 17
Credit: 16,510
RAC: 0
Message 48349 - Posted: 5 Aug 2023, 9:32:51 UTC
Last modified: 5 Aug 2023, 9:48:19 UTC

i got also errors.


Probing /cvmfs/atlas.cern.ch... Failed!
Probing /cvmfs/atlas-condb.cern.ch... Failed!
Probing /cvmfs/grid.cern.ch... Failed!
Probing /cvmfs/cernvm-prod.cern.ch... Failed!
Probing /cvmfs/sft.cern.ch... Failed!
Probing /cvmfs/alice.cern.ch... Failed!


Also this


Warning: CernVM-FS map is not referenced from autofs maps (/etc/auto.master)
Warning: failed to access http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1cern-cvmfs.openhtc.io
Warning: failed to access http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1ral-cvmfs.openhtc.io
Warning: failed to access http://s1bnl-cvmfs.openhtc.io/cvmfs/atlas.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1bnl-cvmfs.openhtc.io
Warning: failed to access http://s1fnal-cvmfs.openhtc.io/cvmfs/atlas.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1fnal-cvmfs.openhtc.io
Warning: failed to access http://s1cern-cvmfs.openhtc.io/cvmfs/atlas-condb.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1cern-cvmfs.openhtc.io
Warning: failed to access http://s1ral-cvmfs.openhtc.io/cvmfs/atlas-condb.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1ral-cvmfs.openhtc.io
Warning: failed to access http://s1bnl-cvmfs.openhtc.io/cvmfs/atlas-condb.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1bnl-cvmfs.openhtc.io
Warning: failed to access http://s1fnal-cvmfs.openhtc.io/cvmfs/atlas-condb.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1fnal-cvmfs.openhtc.io
Warning: failed to access http://s1cern-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1cern-cvmfs.openhtc.io
Warning: failed to access http://s1ral-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1ral-cvmfs.openhtc.io
Warning: failed to access http://s1bnl-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1bnl-cvmfs.openhtc.io
Warning: failed to access http://s1fnal-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1fnal-cvmfs.openhtc.io
Warning: failed to access http://s1cern-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1cern-cvmfs.openhtc.io
Warning: failed to access http://s1ral-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1ral-cvmfs.openhtc.io
Warning: failed to access http://s1bnl-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1bnl-cvmfs.openhtc.io
Warning: failed to access http://s1fnal-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1fnal-cvmfs.openhtc.io
Warning: failed to access http://s1cern-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1cern-cvmfs.openhtc.io
Warning: failed to access http://s1ral-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1ral-cvmfs.openhtc.io
Warning: failed to access http://s1bnl-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1bnl-cvmfs.openhtc.io
Warning: failed to access http://s1fnal-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1fnal-cvmfs.openhtc.io
Warning: failed to access http://s1cern-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1cern-cvmfs.openhtc.io
Warning: failed to access http://s1ral-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1ral-cvmfs.openhtc.io
Warning: failed to access http://s1bnl-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1bnl-cvmfs.openhtc.io
Warning: failed to access http://s1fnal-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished through proxy http://squid:3128
Warning: failed to use Geo-API with s1fnal-cvmfs.openhtc.io
[/quote]
ID: 48349 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2244
Credit: 173,902,375
RAC: 456
Message 48351 - Posted: 6 Aug 2023, 6:24:58 UTC - in response to Message 48347.  

How do I configure local CVMFS and what it should be?

In the Folder number crunching https://lhcathome.cern.ch/lhcathome/forum_forum.php?id=3 you can find Infos.

Have you checked through CVMFS Installation Guide?
ID: 48351 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2541
Credit: 254,608,838
RAC: 34,609
Message 48353 - Posted: 6 Aug 2023, 7:34:05 UTC - in response to Message 48349.  

Most of the following instructions are already posted in the HowTo.
Did you go through it?



Get cvmfs and cvmfs-config from here (both!):
https://cernvm.cern.ch/fs/
http://ecsft.cern.ch/dist/cvmfs/cvmfs-config/

Download the packages that are made for your Linux distro (or as close as possible).
Hence, most likely:
cvmfs_2.10.1~1+ubuntu22.04_amd64.deb
cvmfs-config-default_latest_all.deb


After installation you must run once "cvmfs_config setup".
Looks like you forgot this.


In /etc/cvmfs never modify a *.conf file.
Instead add your modifications to a corresponding *.local file, e.g.
/etc/cvmfs/default.conf # do not modify this file
/etc/cvmfs/default.local # add your modifications here


That said, create/modify the following files

/etc/cvmfs/default.local
CVMFS_HTTP_PROXY="auto;DIRECT"
CVMFS_KCACHE_TIMEOUT=30
CVMFS_MAX_RETRIES=3
CVMFS_MOUNT_RW=yes
CVMFS_QUOTA_LIMIT=6144
CVMFS_REPOSITORIES="atlas,atlas-condb,grid,cernvm-prod,sft,alice"
CVMFS_USE_CDN=yes

/etc/cvmfs/config.d/cvmfs-config.cern.ch.local
CVMFS_CONFIG_REPO_REQUIRED=no

/etc/cvmfs/domain.d/cern.ch.local
CVMFS_CONFIG_REPO_REQUIRED=yes


Now reboot (sometimes it needs 2 reboots), then run "cvmfs_config probe".

If this doesn't succeed, don't post the output of "cvmfs_config showconfig".
Instead, post the output of:
cvmfs_config showconfig -s atlas
cvmfs_config showconfig -s cvmfs-config



Finally a few other requests:
Make your computers visible in the prefs: https://lhcathome.cern.ch/lhcathome/prefs.php?subset=project
Use the forum tags to mark URLs.
ID: 48353 · Report as offensive     Reply Quote
stratos412

Send message
Joined: 18 Mar 20
Posts: 17
Credit: 16,510
RAC: 0
Message 48361 - Posted: 6 Aug 2023, 21:19:01 UTC - in response to Message 48353.  

@computezrmle

I will try step-by-step your instructions and I will post again the results.
Some of them I have forgotten.
ID: 48361 · Report as offensive     Reply Quote
stratos412

Send message
Joined: 18 Mar 20
Posts: 17
Credit: 16,510
RAC: 0
Message 48362 - Posted: 7 Aug 2023, 7:56:43 UTC - in response to Message 48361.  
Last modified: 7 Aug 2023, 8:04:15 UTC

OK. I followed the instructions.

1) Installed cvmfs_2.10.1~1+ubuntu22.04_amd64.deb + cvmfs-config-default_latest_all.deb from the links.
2) Run in terminal "cvmfs_config setup". That required root privilage, so I did "sudo su" and then run it.
It didn't seem to do anything, so I waited a while.
3) Create/ Modify the files a) /etc/cvmfs/default.local b) /etc/cvmfs/config.d/cvmfs-config.cern.ch.local c) /etc/cvmfs/domain.d/cern.ch.local


The cvmfs_config probe show this


Probing /cvmfs/atlas.cern.ch... OK
Probing /cvmfs/atlas-condb.cern.ch... OK
Probing /cvmfs/grid.cern.ch... OK
Probing /cvmfs/cernvm-prod.cern.ch... OK
Probing /cvmfs/sft.cern.ch... OK
Probing /cvmfs/alice.cern.ch... OK


The cvmfs_config showconfig - s atlas show this


VMFS_REPOSITORY_NAME=atlas.cern.ch
CVMFS_BACKOFF_INIT=2 # from /etc/cvmfs/default.conf
CVMFS_BACKOFF_MAX=10 # from /etc/cvmfs/default.conf
CVMFS_BASE_ENV=1 # from /etc/cvmfs/default.conf
CVMFS_CACHE_BASE=/var/lib/cvmfs # from /etc/cvmfs/default.conf
CVMFS_CACHE_DIR=/var/lib/cvmfs/shared
CVMFS_CHECK_PERMISSIONS=yes # from /etc/cvmfs/default.conf
CVMFS_CLAIM_OWNERSHIP=yes # from /etc/cvmfs/default.conf
CVMFS_CLIENT_PROFILE= # from /etc/cvmfs/default.conf
CVMFS_CONFIG_REPO_DEFAULT_ENV=1 # from /cvmfs/cvmfs-config.cern.ch/etc/cvmfs/default.conf
CVMFS_CONFIG_REPO_REQUIRED= # from /etc/cvmfs/domain.d/cern.ch.local
CVMFS_CONFIG_REPOSITORY=cvmfs-config.cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DEFAULT_DOMAIN=cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_FALLBACK_PROXY= # from /cvmfs/cvmfs-config.cern.ch/etc/cvmfs/domain.d/cern.ch.conf
CVMFS_HIDE_MAGIC_XATTRS=yes # from /cvmfs/cvmfs-config.cern.ch/etc/cvmfs/default.conf
CVMFS_HOST_RESET_AFTER=1800 # from /etc/cvmfs/default.conf
CVMFS_HTTP_PROXY='auto;DIRECT' # from /cvmfs/cvmfs-config.cern.ch/etc/cvmfs/domain.d/cern.ch.conf
CVMFS_KCACHE_TIMEOUT=30 # from /etc/cvmfs/default.local
CVMFS_KEYS_DIR=/cvmfs/cvmfs-config.cern.ch/etc/cvmfs/keys/cern.ch # from /etc/cvmfs/domain.d/cern.ch.local
CVMFS_LOW_SPEED_LIMIT=1024 # from /etc/cvmfs/default.conf
CVMFS_MAGIC_XATTRS_VISIBILITY=rootonly # from /cvmfs/cvmfs-config.cern.ch/etc/cvmfs/default.conf
CVMFS_MAX_RETRIES=3 # from /etc/cvmfs/default.local
CVMFS_MOUNT_DIR=/cvmfs # from /etc/cvmfs/default.conf
CVMFS_MOUNT_RW=yes # from /etc/cvmfs/default.local
CVMFS_NFILES=131072 # from /etc/cvmfs/default.conf
CVMFS_PAC_URLS='http://grid-wpad/wpad.dat;http://wpad/wpad.dat;http://cernvm-wpad.fnal.gov/wpad.dat;http://cernvm-wpad.cern.ch/wpad.dat' # from /cvmfs/cvmfs-config.cern.ch/etc/cvmfs/default.conf
CVMFS_PROXY_RESET_AFTER=300 # from /etc/cvmfs/default.conf
CVMFS_QUOTA_LIMIT=6144 # from /etc/cvmfs/default.local
CVMFS_RELOAD_SOCKETS=/var/run/cvmfs # from /etc/cvmfs/default.conf
CVMFS_REPOSITORIES=atlas,atlas-condb,grid,cernvm-prod,sft,alice # from /etc/cvmfs/default.local
CVMFS_SEND_INFO_HEADER=yes # from /cvmfs/cvmfs-config.cern.ch/etc/cvmfs/domain.d/cern.ch.conf
CVMFS_SERVER_URL='http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch;http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch;http://s1bnl-cvmfs.openhtc.io/cvmfs/atlas.cern.ch;http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch;http://s1asgc-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch;http://s1ihep-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch;http://s1swinburne-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch' # from /etc/cvmfs/domain.d/cern.ch.local
CVMFS_SHARED_CACHE=yes # from /etc/cvmfs/default.conf
CVMFS_STRICT_MOUNT=no # from /etc/cvmfs/default.conf
CVMFS_TIMEOUT=5 # from /etc/cvmfs/default.conf
CVMFS_TIMEOUT_DIRECT=10 # from /etc/cvmfs/default.conf
CVMFS_USE_CDN=yes # from /etc/cvmfs/default.local
CVMFS_USE_GEOAPI=yes # from /etc/cvmfs/domain.d/cern.ch.local
CVMFS_USER=cvmfs # from /etc/cvmfs/default.conf



The cvmfs_config showconfig -s cvmfs-config show this


CVMFS_REPOSITORY_NAME=cvmfs-config.cern.ch
CVMFS_BACKOFF_INIT=2 # from /etc/cvmfs/default.conf
CVMFS_BACKOFF_MAX=10 # from /etc/cvmfs/default.conf
CVMFS_BASE_ENV=1 # from /etc/cvmfs/default.conf
CVMFS_CACHE_BASE=/var/lib/cvmfs # from /etc/cvmfs/default.conf
CVMFS_CACHE_DIR=/var/lib/cvmfs/shared
CVMFS_CHECK_PERMISSIONS=yes # from /etc/cvmfs/default.conf
CVMFS_CLAIM_OWNERSHIP=yes # from /etc/cvmfs/default.conf
CVMFS_CLIENT_PROFILE= # from /etc/cvmfs/default.conf
CVMFS_CONFIG_REPO_REQUIRED=no # from /etc/cvmfs/config.d/cvmfs-config.cern.ch.local
CVMFS_CONFIG_REPOSITORY=cvmfs-config.cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_DEFAULT_DOMAIN=cern.ch # from /etc/cvmfs/default.d/50-cern-debian.conf
CVMFS_HOST_RESET_AFTER=1800 # from /etc/cvmfs/default.conf
CVMFS_HTTP_PROXY='auto;DIRECT' # from /etc/cvmfs/config.d/cvmfs-config.cern.ch.local
CVMFS_KCACHE_TIMEOUT=30 # from /etc/cvmfs/default.local
CVMFS_KEYS_DIR=/etc/cvmfs/keys/cern.ch # from /etc/cvmfs/domain.d/cern.ch.local
CVMFS_LOW_SPEED_LIMIT=1024 # from /etc/cvmfs/default.conf
CVMFS_MAX_RETRIES=3 # from /etc/cvmfs/default.local
CVMFS_MOUNT_DIR=/cvmfs # from /etc/cvmfs/default.conf
CVMFS_MOUNT_RW=yes # from /etc/cvmfs/default.local
CVMFS_NFILES=131072 # from /etc/cvmfs/default.conf
CVMFS_PROXY_RESET_AFTER=300 # from /etc/cvmfs/default.conf
CVMFS_QUOTA_LIMIT=6144 # from /etc/cvmfs/default.local
CVMFS_RELOAD_SOCKETS=/var/run/cvmfs # from /etc/cvmfs/default.conf
CVMFS_REPOSITORIES=atlas,atlas-condb,grid,cernvm-prod,sft,alice # from /etc/cvmfs/default.local
CVMFS_SEND_INFO_HEADER=yes # from /etc/cvmfs/default.local
CVMFS_SERVER_URL='http://s1cern-cvmfs.openhtc.io/cvmfs/cvmfs-config.cern.ch;http://s1ral-cvmfs.openhtc.io/cvmfs/cvmfs-config.cern.ch;http://s1bnl-cvmfs.openhtc.io/cvmfs/cvmfs-config.cern.ch;http://s1fnal-cvmfs.openhtc.io/cvmfs/cvmfs-config.cern.ch' # from /etc/cvmfs/domain.d/cern.ch.local
CVMFS_SHARED_CACHE=yes # from /etc/cvmfs/default.conf
CVMFS_STRICT_MOUNT=no # from /etc/cvmfs/default.conf
CVMFS_TIMEOUT=5 # from /etc/cvmfs/default.conf
CVMFS_TIMEOUT_DIRECT=10 # from /etc/cvmfs/default.conf
CVMFS_USE_CDN=yes # from /etc/cvmfs/default.local
CVMFS_USE_GEOAPI=yes # from /etc/cvmfs/domain.d/cern.ch.local
CVMFS_USER=cvmfs # from /etc/cvmfs/default.conf



Still get error for LHC ATLAS

https://lhcathome.cern.ch/lhcathome/show_host_detail.php?hostid=10834339[/quote]

Also, any suggestionS what version of virtual box to install with Mint 21 (kernel 5.150.78-generic x86_64)?
I currently have 6.1.38, but it doesn't seem to work with BOINC(flatpak).
ID: 48362 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2541
Credit: 254,608,838
RAC: 34,609
Message 48363 - Posted: 7 Aug 2023, 12:59:09 UTC - in response to Message 48362.  

You are about to enable some computers to run native apps from LHC@home.
Those apps were originally not made for BOINC use.
Hence, before you continue you may think about a few facts:

- they require permanent (24/7) internet access
- pausing/resuming is either not supported (ATLAS) or painful to configure (Theory)
- some sort of tasks, e.g. Theory madgraph, ignore the #core setting from BOINC and will always start 2 threads
- some sort of tasks will need up to 7 GB RAM; don't know if they even start on computers having less - at least this will cause heavy swapping and much longer runtimes (days!)
- some sort of tasks will run just a few minutes while others will run for a couple of days; this completely confuses BOINC's runtime/progress estimation.



As for your CVMFS configuration

This (atlas) output shows you may have forgotten a line in /etc/cvmfs/domain.d/cern.ch.local
CVMFS_CONFIG_REPO_REQUIRED= # from /etc/cvmfs/domain.d/cern.ch.local
set this to
CVMFS_CONFIG_REPO_REQUIRED=yes

This ensures the client mounts the config repo before all other repos.
Of course the same option must be set to "no" in /etc/cvmfs/config.d/cvmfs-config.cern.ch.local to avoid a deadlock.



As for "cvmfs_config"

Run "which cvmfs_config"
- as root
- as normal user
- as user "boinc"

Your previous post shows cvmfs_config is installed and should be usable by all users.
OTOH the last logs show your tasks can't find it.
Hence, check the path settings.



Cgroups option

Recent Linux versions mostly use cgroups v2 but Theory native still requires cgroups v1.
The following boot parameter sets cgroups v1 but do this on your own risk since it may have unexpected side effects on other processes running on the system:
systemd.unified_cgroup_hierarchy=0


As for VirtualBox

6.1 or 7.0 both work fine with tasks from LHC@home.
I would not recommend any older version (like 5.x).
Best would be to install the recent version from your Linux vendor.
ID: 48363 · Report as offensive     Reply Quote
stratos412

Send message
Joined: 18 Mar 20
Posts: 17
Credit: 16,510
RAC: 0
Message 48364 - Posted: 7 Aug 2023, 20:14:04 UTC - in response to Message 48363.  

OK. A few things
The command ''which cvmfs_config' gave this for both root and normal user (my acount) :
/usr/bin/cvmfs_config

For BOINC user I don't know how to switch. I suppose I have to type in terminal sudo su boinc (????)
If so, I came up with "This account is currently not available."


About the file : /etc/cvmfs/config.d/cvmfs-config.cern.ch.local // this is what inside


# In order to bootstrap the network connection, we use a DIRECT proxy
# for the config repository only if no other proxy has been set.
CVMFS_HTTP_PROXY="${CVMFS_HTTP_PROXY:=DIRECT}"

CVMFS_CONFIG_REPO_REQUIRED=NO


About the file : /etc/cvmfs/domain.d/cern.ch.local // this is what inside


# Don't edit here. Create /etc/cvmfs/domain.d/cern.ch.local.
# As a rule of thumb, overwrite only parameters you find in here.
# If you look for any other parameter, check /etc/cvmfs/default.(conf|local)
# and /etc/cvmfs/config.d/<your_repository>.(conf|local)
#
# Parameter files are sourced in the following order
#
# /etc/cvmfs/default.conf
# /etc/cvmfs/default.d/*.conf (in alphabetical order)
# $CVMFS_CONFIG_REPOSITORY/etc/cvmfs/default.conf (if config repository is set)
# /etc/cvmfs/default.local
#
# $CVMFS_CONFIG_REPOSITORY/etc/cvmfs/domain.d/<your_domain>.conf (if config repository is set)
# /etc/cvmfs/domain.d/<your_domain>.conf
# /etc/cvmfs/domain.d/<your_domain>.local
#
# $CVMFS_CONFIG_REPOSITORY/etc/cvmfs/config.d/<your_repository>.conf (if config repository is set)
# /etc/cvmfs/config.d/<your_repository>.conf
# /etc/cvmfs/config.d/<your_repository>.local
#
# Use cvmfs_config showconfig to get the effective parameters.
#

# The CVMFS_CONFIG_REPO_DEFAULT_ENV parameter is set in
# /cvmfs/cvmfs-config.cern.ch/etc/cvmfs/default.conf
if [ "$CVMFS_CONFIG_REPO_DEFAULT_ENV" = "" ]; then
# Use the configuration in this package only if the config repository is not
# mounted. Note that in this case the cvmfs client writes a warning to syslog
# because CVMFS_CONFIG_REPOSITORY is set.

# Stratum 1 servers for the cern.ch domain.
if [ "$CVMFS_USE_CDN" = "yes" ]; then
CVMFS_SERVER_URL="http://s1cern-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1ral-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1bnl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1fnal-cvmfs.openhtc.io/cvmfs/@fqrn@"
else
CVMFS_SERVER_URL="http://cvmfs-stratum-one.cern.ch/cvmfs/@fqrn@;http://cernvmfs.gridpp.rl.ac.uk/cvmfs/@fqrn@;http://cvmfs-s1bnl.opensciencegrid.org/cvmfs/@fqrn@;http://cvmfs-s1fnal.opensciencegrid.org/cvmfs/@fqrn@"
fi

# Key chain with public signing keys for repositories in the cern.ch domain
CVMFS_KEYS_DIR=/etc/cvmfs/keys/cern.ch
CVMFS_CONFIG_REPO_REQUIRED=yes

# The cern.ch stratum 1 servers support the Geo-API
CVMFS_USE_GEOAPI=yes

fi



P.S.
I think I have to get a master in computer science to understand and configure all these Mint 21 and BOINC dogs.
This is the third time that things got broken (First install mint 18.3, upgrade from mint 18.3 to 20.3 and upgrade from 20.3 to 21)
ID: 48364 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2541
Credit: 254,608,838
RAC: 34,609
Message 48386 - Posted: 8 Aug 2023, 9:09:48 UTC - in response to Message 48364.  

Looks like you misunderstood what has to be in the *.local files.
Do not copy the whole *.conf files to *.local.
Only add the options you want to be activated/modified.
Hence, put just 1 line in each of your *.local files.

In /etc/cvmfs/domain.d/cern.ch.local:
CVMFS_CONFIG_REPO_REQUIRED=yes

In /etc/cvmfs/config.d/cvmfs-config.cern.ch.local:
CVMFS_CONFIG_REPO_REQUIRED=no


Then run "sudo cvmfs_config reload".


sudo su boinc (????)

You tried to switch to a user "su" which is not on your system.

Anyway, the goal of the test was to check if cvmfs_config is available.
It is.

Let's do another test.
Enter both commands (give root password after the 1st) and post the output of command 2.
su root
su -c "cvmfs_config probe alice && cvmfs_config stat alice && ls -hal /cvmfs/cvmfs-config.cern.ch/etc/cvmfs/" boinc


Should be something like:
Probing /cvmfs/alice.cern.ch... OK
VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2.10.0.0 29425 1 40864 16302 2 1 5607403 6291456 0 261632 0 0 100.000 4 2 http://s1cern-cvmfs.openhtc.io/cvmfs/alice.cern.ch DIRECT 1
total 5.0K
drwxr-xr-x  5 cvmfs cvmfs   34 Apr  5  2022 .
drwxr-xr-x  3 cvmfs cvmfs   19 Sep 15  2020 ..
-rw-r--r--  1 cvmfs cvmfs  972 Sep 15  2020 common.conf
drwxr-xr-x  2 cvmfs cvmfs   32 Oct 24  2022 config.d
-rw-r--r--  1 cvmfs cvmfs 1.1K Apr  5  2022 default.conf
drwxr-xr-x  2 cvmfs cvmfs   54 Jul 10 21:25 domain.d
drwxr-xr-x 12 cvmfs cvmfs   22 Jul 10 21:25 keys
ID: 48386 · Report as offensive     Reply Quote
stratos412

Send message
Joined: 18 Mar 20
Posts: 17
Credit: 16,510
RAC: 0
Message 48389 - Posted: 8 Aug 2023, 19:17:42 UTC - in response to Message 48386.  

@computezrmle.

Thanks for your patience and instructions. :)
Something I am missing though... :/

root@SDMINT64:~# su -c "cvmfs_config probe alice && cvmfs_config stat alice && ls -hal /cvmfs/cvmfs-config.cern.ch/etc/cvmfs/" boinc
This account is currently not available


cvmfs_config probe

Probing /cvmfs/atlas.cern.ch... OK
Probing /cvmfs/atlas-condb.cern.ch... OK
Probing /cvmfs/grid.cern.ch... OK
Probing /cvmfs/cernvm-prod.cern.ch... OK
Probing /cvmfs/sft.cern.ch... OK
Probing /cvmfs/alice.cern.ch... OK

stratos@SDMINT64:~$ which cvmfs_config
/usr/bin/cvmfs_config

root@SDMINT64:~# which cvmfs_config
/usr/bin/cvmfs_config
ID: 48389 · Report as offensive     Reply Quote
1 · 2 · Next

Questions and Answers : Unix/Linux : Running virtualbox on LHC


©2024 CERN