LHC@home

ATLAS native workunits are hard to come by. I've finally been able to test a native setup using my new Ubuntu install, since I can't get it to work with VirtualBox on Ubuntu and VirtualBox on Windows 11 isn't compatible with HyperV. I can't get Theory native workunits to work because of the whole cgroups v2 issue. I'm waiting patiently for it to be updated. So I've relied on ATLAS native to see if this setup is correct. I managed to get one workunit to test my setup. I think it's mostly working (at least it talks to CERN), but I errored out:

<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 195 (0xc3, -61)</message>
<stderr_txt>
15:04:23 (10496): wrapper (7.7.26015): starting
15:04:23 (10496): wrapper: running run_atlas (--nthreads 6)
[2023-11-16 15:04:23] Arguments: --nthreads 6
[2023-11-16 15:04:23] Threads: 6
[2023-11-16 15:04:23] Checking for CVMFS
[2023-11-16 15:04:23] Probing /cvmfs/atlas.cern.ch... OK
[2023-11-16 15:04:23] Probing /cvmfs/atlas-condb.cern.ch... OK
[2023-11-16 15:04:23] Running cvmfs_config stat atlas.cern.ch
[2023-11-16 15:04:24] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2023-11-16 15:04:24] 2.11.2.0 8050 6 25896 125972 1 1 201322 4096001 0 130560 0 0 0.000 962 304 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1
[2023-11-16 15:04:24] CVMFS is ok
[2023-11-16 15:04:24] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2023-11-16 15:04:24] Small home clusters do not require a local http proxy but it is suggested if
[2023-11-16 15:04:24] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
[2023-11-16 15:04:24] Further information can be found at the LHC@home message board.
[2023-11-16 15:04:24] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2023-11-16 15:04:24] Checking for apptainer binary...
[2023-11-16 15:04:24] apptainer is not installed, using version from CVMFS
[2023-11-16 15:04:24] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2023-11-16 15:04:25] apptainer isnt working: WARNING: Unable to retrieve information for /home/boinc/.apptainer: stat /home/boinc/.apptainer: permission denied
[2023-11-16 15:04:25] INFO: Try appending ':ro' to your overlay image or using '--fakeroot'
[2023-11-16 15:04:25] FATAL: container creation failed: mount hook function failure: hook function for tag prelayer returns error: failed to create /home/boinc directory: mkdir /home/boinc: permission denied
15:14:26 (10496): run_atlas exited; CPU time 0.220969
15:14:26 (10496): app exit status: 0x1
15:14:26 (10496): called boinc_finish(195)

</stderr_txt>
]]>

[2023-11-16 15:04:24] Checking for apptainer binary...
[2023-11-16 15:04:24] apptainer is not installed, using version from CVMFS
[2023-11-16 15:04:24] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2023-11-16 15:04:25] apptainer isnt working: WARNING: Unable to retrieve information for /home/boinc/.apptainer: stat /home/boinc/.apptainer: permission denied
[2023-11-16 15:04:25] INFO: Try appending ':ro' to your overlay image or using '--fakeroot'
[2023-11-16 15:04:25] FATAL: container creation failed: mount hook function failure: hook function for tag prelayer returns error: failed to create /home/boinc directory: mkdir /home/boinc: permission denied

The issue was with Apptainer (previously Singularity? Is that the same thing?). I'm not sure how to proceed with this. It wasn't installed locally on my computer. It says it used the version from CERN, but that didn't work either, with permission errors. Should I install the non-setuid version or the setuid version? It seems using Ubuntu 22.04 is tricky with LHC. Any help is appreciated.

(previously Singularity? Is that the same thing?)

Yes.

It says it used the version from CERN, but that didn't work either

If available it is recommended to install a local apptainer version from the distro repos.
As for Ubuntu a package can be found at launchpad.

Should I install the non-setuid version or the setuid version?

setuid

Thanks for the assistance. I tried reinstalling CVMFS and Apptainer-suid and running ATLAS, and it still won't work. Looking at the reported issues from the Apptainer Github site, it looks like there might be a problem with Ubuntu 22.04 and Apptainer. https://github.com/apptainer/apptainer/issues/1674 So I'll see if there's anything that comes out of that.

That being said, I did finally get around to re-enabling cgroups v1 for Ubuntu, so I can run Theory apps again.