Questions and Answers : Unix/Linux : Cvmfs_config probe fails on archlinux
Message board moderation

To post messages, you must log in.

AuthorMessage
J_Rantanen

Send message
Joined: 21 Mar 17
Posts: 3
Credit: 391,714
RAC: 0
Message 41926 - Posted: 16 Mar 2020, 21:11:58 UTC

[user@archlinux ~]$ neofetch
                   -`                    user@archlinux 
                  .o+`                   -------------------- 
                 `ooo/                   OS: Arch Linux x86_64 
                `+oooo:                  Kernel: 5.5.9-arch1-2 
               `+oooooo:                 Uptime: 59 mins 
               -+oooooo+:                Packages: 948 (pacman) 
             `/:-:++oooo+:               Shell: bash 5.0.16 
            `/++++/+++++++:              Resolution: 3440x1440 
           `/++++++++++++++:             DE: Plasma 
          `/+++ooooooooooooo/`           WM: KWin 
         ./ooosssso++osssssso+`          WM Theme: Glassy 
        .oossssso-````/ossssss+`         Theme: Breeze Dark [Plasma], Breeze [GTK2/3] 
       -osssssso.      :ssssssso.        Icons: breeze-dark [Plasma], breeze-dark [GTK2/3] 
      :osssssss/        osssso+++.       Terminal: konsole 
     /ossssssss/        +ssssooo/-       CPU: AMD Ryzen 7 2700X (16) @ 4.000GHz 
   `/ossssso+/:-        -:/+osssso+-     GPU: NVIDIA GeForce GTX 1080 
  `+sso+:-`                 `.-/+oso:    GPU: AMD ATI Radeon RX Vega 56/64 
 `++:.                           `-/+/   Memory: 7562MiB / 32079MiB 
 .`                                 `/
                                                                 
                                                                 
[user@archlinux etc]$ cvmfs_config probe
Probing /cvmfs/atlas.cern.ch... Failed!
Probing /cvmfs/atlas-condb.cern.ch... Failed!
Probing /cvmfs/grid.cern.ch... Failed!
Probing /cvmfs/cernvm-prod.cern.ch... Failed!
Probing /cvmfs/sft.cern.ch... Failed!
Probing /cvmfs/alice.cern.ch... Failed!
[user@archlinux etc]$ sudo cvmfs_config chksetup
Error: /etc/auto.cvmfs is not executable


I believe I have a broken cvmfs installation, but am a bit unsure how to actually fix this to run theory and atlas applications on my computer.
ID: 41926 · Report as offensive     Reply Quote
Greger

Send message
Joined: 9 Jan 15
Posts: 151
Credit: 431,596,822
RAC: 0
Message 41927 - Posted: 16 Mar 2020, 21:26:49 UTC

is autofs added and installed in package? https://wiki.archlinux.org/index.php/Autofs
Does it need squashtools?

Would would like to test in arch but no experience. Do we have a guide to install? Only found package at aur https://aur.archlinux.org/packages/cvmfs/
ID: 41927 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2411
Credit: 226,078,139
RAC: 126,763
Message 41928 - Posted: 16 Mar 2020, 21:38:31 UTC - in response to Message 41926.  

Did you install both packages?
cvmfs
cvmfs-config-default

After installation, did you run (only once) "cvmfs_config setup"?


If this is done you should have a link "/etc/auto.cvmfs" pointing to "/usr/libexec/cvmfs/auto.cvmfs" and having executable flags set.

/etc/auto.master requires an uncommented line:
/cvmfs /etc/auto.cvmfs



Then follow this post to enable the required repositories and switch the CVMFS_SERVERS to openhtc.io:
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5342&postid=41861


If all is done, reboot your computer and check if "cvmfs_config probe" returns "OKs".
ID: 41928 · Report as offensive     Reply Quote
J_Rantanen

Send message
Joined: 21 Mar 17
Posts: 3
Credit: 391,714
RAC: 0
Message 41929 - Posted: 16 Mar 2020, 22:12:41 UTC - in response to Message 41928.  

Did you install both packages?
cvmfs
cvmfs-config-default

After installation, did you run (only once) "cvmfs_config setup"?


If this is done you should have a link "/etc/auto.cvmfs" pointing to "/usr/libexec/cvmfs/auto.cvmfs" and having executable flags set.

/etc/auto.master requires an uncommented line:
/cvmfs /etc/auto.cvmfs



Then follow this post to enable the required repositories and switch the CVMFS_SERVERS to openhtc.io:
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5342&postid=41861


If all is done, reboot your computer and check if "cvmfs_config probe" returns "OKs".


I had ran "cvmfs_config setup", but seems like that failed to create the proper symlink to "/etc/auto.cvmfs". I managed to manually create a symlink to "/usr/lib/cvmfs/auto.cvmfs" to the correct location. rebooted and seems to return all OKs now.

So, seems like this issue got resolved, thank you.
ID: 41929 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2411
Credit: 226,078,139
RAC: 126,763
Message 41930 - Posted: 17 Mar 2020, 7:59:20 UTC - in response to Message 41929.  

ATLAS requires the squashfs package to expand the singularity image.
Gunde already mentioned that but it looks like it isn't installed on your computer:
[2020-03-17 00:15:54] FATAL:   while extracting /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img: root filesystem extraction failed: could not extract squashfs data, unsquashfs not found
ID: 41930 · Report as offensive     Reply Quote
J_Rantanen

Send message
Joined: 21 Mar 17
Posts: 3
Credit: 391,714
RAC: 0
Message 41934 - Posted: 17 Mar 2020, 15:38:05 UTC - in response to Message 41930.  

I'm a bit unsure if I managed to install squashfs, but I did at least manage to install singularity version 7ad654b, which led to me having a successful run on ATLAS, so do I still need to install something else?

https://lhcathome.cern.ch/lhcathome/result.php?resultid=268234127
ID: 41934 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2411
Credit: 226,078,139
RAC: 126,763
Message 41935 - Posted: 17 Mar 2020, 17:24:27 UTC - in response to Message 41934.  

This line shows that the task succeeded:
[2020-03-17 17:16:29] HITS file was successfully produced:


Singularity should not be installed locally any more unless you need it to run other apps than ATLAS.
The reason is that the ATLAS image is created with a distinct singularity version and there is no guarantee it runs under the locally installed version.
If no local singularity can be found ATLAS will use the right version from a CVMFS repository.
ID: 41935 · Report as offensive     Reply Quote
NEO83
Avatar

Send message
Joined: 31 Jan 07
Posts: 2
Credit: 872,841
RAC: 0
Message 44435 - Posted: 5 Mar 2021, 6:19:19 UTC

Morning,

i have the same problem to solve, but i don't know how to get the cvmfs-config-default ... its not in AUR and all other packages i found are not for arch :/
The Symlink for autofs i did by myself, i executed the "cvmfs_config setup" but nothing happend?

Probing /cvmfs/atlas.cern.ch... Failed!
Probing /cvmfs/atlas-condb.cern.ch... Failed!
Probing /cvmfs/grid.cern.ch... Failed!
Probing /cvmfs/cernvm-prod.cern.ch... Failed!
Probing /cvmfs/sft.cern.ch... Failed!
Probing /cvmfs/alice.cern.ch... Failed!


I am new in arch, seems to be the biggest problem :P
ID: 44435 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2411
Credit: 226,078,139
RAC: 126,763
Message 44436 - Posted: 5 Mar 2021, 7:02:07 UTC - in response to Message 44435.  

CVMFS has an excellent manual site here:
https://cvmfs.readthedocs.io/en/stable/cpt-overview.html
https://cvmfs.readthedocs.io/en/stable/cpt-quickstart.html

The 2nd page includes a link to the official download page where you get the core packages as well as the config packages (https://ecsft.cern.ch/dist/cvmfs/cvmfs-config).

Be aware:
A few options must be changed to map your local needs.
This post describes what to do and shows some examples:
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5594



Additional hint:
Your computer page lists 4 computers with 32 cores each.
If all of them are running ATLAS/Theory/CMS this would count as 128 "worker nodes".
The CVMFS manual (see above) clearly recommends to use an HTTP proxy for clusters > 5 worker nodes.
This post shows what to do:
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5473
ID: 44436 · Report as offensive     Reply Quote
NEO83
Avatar

Send message
Joined: 31 Jan 07
Posts: 2
Credit: 872,841
RAC: 0
Message 44439 - Posted: 5 Mar 2021, 8:48:04 UTC - in response to Message 44436.  
Last modified: 5 Mar 2021, 8:48:46 UTC

did my very best to install cvmfs-config-default but i got a failure installing cvmfs & cvmfs-config-default

: cvmfs und cvmfs-config-default stehen miteinander in Konflikt. cvmfs-config-default entfernen? [j/N] n
Fehler: Nicht auflösbare Paketkonflikte gefunden
Fehler: Konnte den Vorgang nicht vorbereiten (In Konflikt stehende Abhängigkeiten)
:: cvmfs und cvmfs-config-default stehen miteinander in Konflikt


i used the cvmfs from the AUR and made the cvmfs-config-default debian package with debtap to an arch usable package ...
Installation itself was no problem but told me there conflicts between those packages :/

As i told i am new in arch :P

maybe @J_Rantanen can help here ...
ID: 44439 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2411
Credit: 226,078,139
RAC: 126,763
Message 44441 - Posted: 5 Mar 2021, 9:30:39 UTC - in response to Message 44439.  

If you use recent versions from the core packet and the config packet try to tell your packet manager to ignore the conflict.
If this doesn't work you would have to compile CVMFS from the source packets.


The main purpose of the config packet is to
- copy recent config files and keys to the /etc/cvmfs tree and to
- install /etc/auto.cvmfs which is required for the fuse automounter.

All of that can easily be done manually.


As already pointed out the configuration may work but is not completely finished after the installation.
ID: 44441 · Report as offensive     Reply Quote

Questions and Answers : Unix/Linux : Cvmfs_config probe fails on archlinux


©2024 CERN