Message boards : Theory Application : Native Theory and macOS
Message board moderation

To post messages, you must log in.

AuthorMessage
[AF>Le_Pommier] Jerome_C2005

Send message
Joined: 12 Jul 11
Posts: 41
Credit: 439,090
RAC: 443
Message 38575 - Posted: 18 Apr 2019, 14:15:56 UTC

Hi all

CernVM-FS has a version for macOS, installation and configuration seem to work, but you will not generate tasks for macOS ? the app is not "portable" ?


Other question : on a linux debian Virtual Machine (AWS) I could not do the setup of CernVM-FS, : installation and setup seemed OK (explanations from the CernVM-FS page) but then at the "probe" step of the explanation topic here I only get errors.

Thanks.
ID: 38575 · Report as offensive     Reply Quote
[AF>Le_Pommier] Jerome_C2005

Send message
Joined: 12 Jul 11
Posts: 41
Credit: 439,090
RAC: 443
Message 38589 - Posted: 20 Apr 2019, 9:55:40 UTC
Last modified: 20 Apr 2019, 9:55:59 UTC

For my linux VM issue : in default.local I have this

CVMFS_REPOSITORIES=atlas.cern.ch,atlas-condb.cern.ch,grid.cern.ch,cernvm-prod.cern.ch,sft.cern.ch,alice.cern.ch
CVMFS_QUOTA_LIMIT=4096
CVMFS_CACHE_BASE=/scratch/cvmfs
CVMFS_HTTP_PROXY=DIRECT

but then

cvmfs_config probe
Probing /cvmfs/atlas.cern.ch... Failed!
Probing /cvmfs/atlas-condb.cern.ch... Failed!
Probing /cvmfs/grid.cern.ch... Failed!
Probing /cvmfs/cernvm-prod.cern.ch... Failed!
Probing /cvmfs/sft.cern.ch... Failed!
Probing /cvmfs/alice.cern.ch... Failed!

Is it because "you cannot run a VM in a VM" ?
ID: 38589 · Report as offensive     Reply Quote
computezrmle

Send message
Joined: 15 Jun 08
Posts: 968
Credit: 33,066,882
RAC: 97,250
Message 38590 - Posted: 20 Apr 2019, 11:18:18 UTC - in response to Message 38589.  

Is it because "you cannot run a VM in a VM" ?

This shouldn't be necessary.
Just run a linux VM directly on the host.

What could be an issue:
- Do you use bridged or NAT network?
- Did you set your firewall accordingly?
- Did you check the VM's automounter setup?
(see: https://cvmfs.readthedocs.io/en/stable/cpt-quickstart.html)
ID: 38590 · Report as offensive     Reply Quote
[AF>Le_Pommier] Jerome_C2005

Send message
Joined: 12 Jul 11
Posts: 41
Credit: 439,090
RAC: 443
Message 38591 - Posted: 20 Apr 2019, 17:03:09 UTC
Last modified: 20 Apr 2019, 17:09:22 UTC

I don't know much about all this, I use a small "preinstalled" linux VM from a cloud provider (OVH) but I don't really know how to check and/or "configure" any of these...

However with your comment I realized that maybe I had missed some steps and I ran again

cvmfs_config setup
sed -i 's%#+dir:/etc/auto.master.d%+dir:/etc/auto.master.d%' /etc/auto.master
systemctl restart autofs

and after that the probe was a success, all OK !

So I gave it a try again with another task

<core_client_version>7.6.33</core_client_version>
<![CDATA[
<message>
process exited with code 195 (0xc3, -61)
</message>
<stderr_txt>
18:55:05 (28422): wrapper (7.15.26016): starting
18:55:05 (28422): wrapper (7.15.26016): starting
18:55:05 (28422): wrapper: running ../../projects/lhcathome.cern.ch_lhcathome/cranky-0.0.28 ()
16:55:05 2019-04-20: cranky-0.0.28: [INFO] Detected TheoryN App
16:55:05 2019-04-20: cranky-0.0.28: [INFO] Checking CVMFS.
16:55:05 2019-04-20: cranky-0.0.28: [INFO] Checking runc.
16:55:05 2019-04-20: cranky-0.0.28: [INFO] Creating the filesystem.
16:55:05 2019-04-20: cranky-0.0.28: [INFO] Using /cvmfs/cernvm-prod.cern.ch/cvm3
16:55:05 2019-04-20: cranky-0.0.28: [INFO] Updating config.json.
16:55:05 2019-04-20: cranky-0.0.28: [INFO] Running Container 'runc'.
nsenter: failed to unshare user namespace: Operation not permitted
container_linux.go:336: starting container process caused "process_linux.go:279: running exec setns process for init caused \"exit status 39\""

16:55:05 2019-04-20: cranky-0.0.28: [ERROR] Container 'runc' terminated with status code 1.
18:55:06 (28422): cranky exited; CPU time 0.008000
18:55:06 (28422): app exit status: 0xce
18:55:06 (28422): called boinc_finish(195)

</stderr_txt>
]]>

I also tried this :
cvmfs_config chksetup
/usr/bin/cvmfs_config: line 694: uuidgen: command not found
Warning: failed to use Geo-API with cvmfs-stratum-one.cern.ch
Warning: failed to use Geo-API with cernvmfs.gridpp.rl.ac.uk
Warning: failed to use Geo-API with cvmfs-s1bnl.opensciencegrid.org
Warning: failed to use Geo-API with cvmfs-s1fnal.opensciencegrid.org

It did that looping the same errors a number of times and stopped...

I also tried this from the doc you mention :
mkdir -p /mnt/cvmfs
mount -t cvmfs repository.cern.ch /mnt/cvmfs
CernVM-FS: running with credentials 108:112
CernVM-FS: loading Fuse module... Failed to initialize root file catalog (16 - file catalog failure)

I think all this is way too "raw" for me and my beta testing will end here :)
ID: 38591 · Report as offensive     Reply Quote
STE\/E

Send message
Joined: 2 Sep 04
Posts: 352
Credit: 1,019,850
RAC: 143
Message 38592 - Posted: 20 Apr 2019, 18:19:20 UTC

lsof /var/lib/dpkg/lock-frontend... doesn't show or do anything when entered in the terminal

steve@pboyztoy99:~$ sudo wget https://lhcathome.cern.ch/lhcathome/download/default.local -O /etc/cvmfs/default.local
[sudo] password for steve:
--2019-04-20 14:11:25-- https://lhcathome.cern.ch/lhcathome/download/default.local
Resolving lhcathome.cern.ch (lhcathome.cern.ch)... 137.138.156.174
Connecting to lhcathome.cern.ch (lhcathome.cern.ch)|137.138.156.174|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 191
Saving to: ‘/etc/cvmfs/default.local’

/etc/cvmfs/default. 100%[===================>] 191 --.-KB/s in 0s

2019-04-20 14:11:26 (6.42 MB/s) - ‘/etc/cvmfs/default.local’ saved [191/191]

steve@pboyztoy99:~$ sudo cvmfs_config reload
steve@pboyztoy99:~$ cvmfs_config probe
Probing /cvmfs/atlas.cern.ch... Failed!
Probing /cvmfs/atlas-condb.cern.ch... Failed!
Probing /cvmfs/grid.cern.ch... Failed!
Probing /cvmfs/cernvm-prod.cern.ch... Failed!
Probing /cvmfs/sft.cern.ch... Failed!
Probing /cvmfs/alice.cern.ch... Failed!
steve@pboyztoy99:~$
ID: 38592 · Report as offensive     Reply Quote
computezrmle

Send message
Joined: 15 Jun 08
Posts: 968
Credit: 33,066,882
RAC: 97,250
Message 38593 - Posted: 20 Apr 2019, 21:03:58 UTC - in response to Message 38592.  

Did you configure/restart the automounter service?
See Jerome's post and https://cvmfs.readthedocs.io/en/stable/cpt-quickstart.html.

In addition:
You may unhide your computers on the web preferences page to make debugging easier.
ID: 38593 · Report as offensive     Reply Quote
STE\/E

Send message
Joined: 2 Sep 04
Posts: 352
Credit: 1,019,850
RAC: 143
Message 38594 - Posted: 20 Apr 2019, 23:01:02 UTC

steve@pboyztoy99:~$ wget https://ecsft.cern.ch/dist/cvmfs/cvmfs-release/cvmfs-release-latest_all.deb
--2019-04-20 18:57:14-- https://ecsft.cern.ch/dist/cvmfs/cvmfs-release/cvmfs-release-latest_all.deb
Resolving ecsft.cern.ch (ecsft.cern.ch)... 188.184.161.78
Connecting to ecsft.cern.ch (ecsft.cern.ch)|188.184.161.78|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 4724 (4.6K)
Saving to: ‘cvmfs-release-latest_all.deb.1’

cvmfs-release-lates 100%[===================>] 4.61K --.-KB/s in 0s

2019-04-20 18:57:16 (10.3 MB/s) - ‘cvmfs-release-latest_all.deb.1’ saved [4724/4724]

steve@pboyztoy99:~$ sudo dpkg -i cvmfs-release-latest_all.deb
[sudo] password for steve:
Sorry, try again.
[sudo] password for steve:
(Reading database ... 167330 files and directories currently installed.)
Preparing to unpack cvmfs-release-latest_all.deb ...
Unpacking cvmfs-release (2.1-2) over (2.1-2) ...
Setting up cvmfs-release (2.1-2) ...
steve@pboyztoy99:~$ cvmfs_config setup
root privileges required
steve@pboyztoy99:~$ iceman48458
iceman48458: command not found
steve@pboyztoy99:~$ sed -i 's%#+dir:/etc/auto.master.d%+dir:/etc/auto.master.d%' /etc/auto.master
sed: couldn't open temporary file /etc/sedGH6pZ3: Permission denied
steve@pboyztoy99:~$ systemctl restart autofs
ID: 38594 · Report as offensive     Reply Quote
computezrmle

Send message
Joined: 15 Jun 08
Posts: 968
Credit: 33,066,882
RAC: 97,250
Message 38595 - Posted: 21 Apr 2019, 9:30:01 UTC - in response to Message 38594.  

Sent you a PM.
Read it and you will know why!
ID: 38595 · Report as offensive     Reply Quote
[AF>Le_Pommier] Jerome_C2005

Send message
Joined: 12 Jul 11
Posts: 41
Credit: 439,090
RAC: 443
Message 38621 - Posted: 24 Apr 2019, 7:51:33 UTC
Last modified: 24 Apr 2019, 7:52:25 UTC

With a little help from my friends I was able to make it work in my Linux VPS.

One of l'AF member wrote a Linux Debian memo (Debian 9 Stretch) and it worked for me, I think some steps were missing in the provided instructions here (and cvmfs website) :

1. CVMFS Installation

su (switch to root superuser) (*)
wget https://ecsft.cern.ch/dist/cvmfs/cvmfs-release/cvmfs-release-latest_all.deb
dpkg -i cvmfs-release-latest_all.deb
rm -f cvmfs-release-latest_all.deb
apt update
apt install cvmfs

2. Various setups (superuser also)

wget https://lhcathomedev.cern.ch/lhcathome-dev/download/default.local -O /etc/cvmfs/default.local
mkdir -p /etc/auto.master.d/
echo "/cvmfs /etc/auto.cvmfs" > /etc/auto.master.d/cvmfs.autofs
systemctl restart autofs
cvmfs_config probe
echo "kernel.unprivileged_userns_clone = 1" >> /etc/sysctl.conf
sysctl -p
gpasswd -a boinc cvmfs

3. Restart BOINC client

systemctl restart boinc-client


I got 12 tasks successfully calculated since yesterday evening.

Big thanks to ElGrande (one of) our Linux guru :)

Considering all the setup and the difficulty to make this application work, this is frankly not a beta, it is an alpha app !!


(*) I was not able to do this, my password would always fail and I know it is the right password, so I prefixed all the above commands with "sudo" and then it worked
ID: 38621 · Report as offensive     Reply Quote

Message boards : Theory Application : Native Theory and macOS


©2019 CERN