Message boards : Number crunching : Atlas Nativ, CVMFS and Apptainer with Ubuntu 22.04.1
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Yeti
Volunteer moderator
Avatar

Send message
Joined: 2 Sep 04
Posts: 453
Credit: 193,369,412
RAC: 10,065
Message 47203 - Posted: 30 Aug 2022, 11:29:33 UTC

I wanted to setup a new Sytem for Atlas Native with Ubuntu 22.04.1

Somewhere I had seen several questions about is Apptainer / cvmfs working with Ubuntu 22.04.1, but never found an answer.

So I have upgraded a working machine to Ubuntu 22.04.1 and for me, it looks as if all is working fine.

cvmfs tells ok
apptainer tells ok
Hitfile is produced

So, is there more that I should check ?

Or, can someone check my results from this box: https://lhcathome.cern.ch/lhcathome/show_host_detail.php?hostid=10813571

Thanks in Advance

Yeti


Supporting BOINC, a great concept !
ID: 47203 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2071
Credit: 156,130,430
RAC: 104,897
Message 47204 - Posted: 30 Aug 2022, 12:21:24 UTC - in response to Message 47203.  

In Production is singularity active and multiattach.
Only in -dev is apptainer in use, but there is no new work (Holiday?).
ID: 47204 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,948,035
RAC: 137,183
Message 47205 - Posted: 30 Aug 2022, 12:23:13 UTC - in response to Message 47203.  

Looks fine.

The most important log entry is:
HITS file was successfully produced

Beside that there are no obvious errors at the beginning of the log.
Nonetheless, if you occasionally see failed/invalid tasks with runtimes of just a few minutes you may check whether they also fail on your wingcomputers.
ID: 47205 · Report as offensive     Reply Quote
Profile Yeti
Volunteer moderator
Avatar

Send message
Joined: 2 Sep 04
Posts: 453
Credit: 193,369,412
RAC: 10,065
Message 47206 - Posted: 30 Aug 2022, 12:26:30 UTC - in response to Message 47204.  

In Production is singularity active and multiattach.
Only in -dev is apptainer in use, but there is no new work (Holiday?).


From the logfile in production:

[2022-08-30 06:15:06] Using singularity image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2022-08-30 06:15:06] Checking for singularity binary...
[2022-08-30 06:15:06] Using singularity found in PATH at /usr/bin/singularity
[2022-08-30 06:15:06] Running /usr/bin/singularity --version
[2022-08-30 06:15:06] apptainer version 1.1.0-rc.2
[2022-08-30 06:15:06] Checking singularity works with /usr/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2022-08-30 06:15:06] mannivl22
[2022-08-30 06:15:06] Singularity works

From the Logfile in DEV:

[2022-08-29 23:17:50] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2022-08-29 23:17:50] Checking for apptainer binary...
[2022-08-29 23:17:50] Using apptainer found in PATH at /usr/bin/apptainer
[2022-08-29 23:17:50] Running /usr/bin/apptainer --version
[2022-08-29 23:17:50] apptainer version 1.1.0-rc.2
[2022-08-29 23:17:50] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2022-08-29 23:17:50] mannivl22
[2022-08-29 23:17:50] apptainer works

My boxes get sporadic 1 WU in DEV


Supporting BOINC, a great concept !
ID: 47206 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,948,035
RAC: 137,183
Message 47207 - Posted: 30 Aug 2022, 12:42:32 UTC - in response to Message 47206.  

The check for the command is here:
2022-08-30 06:15:06] Running /usr/bin/singularity --version

It returns:
[2022-08-30 06:15:06] apptainer version 1.1.0-rc.2

This means your system is running Apptainer.



The line:
[2022-08-30 06:15:06] Singularity works
is a hardcoded String that the script prints to the log.

It could also print "Wuppdibragglkennsdmined works" and it would still run Apptainer.



On -dev David tests an updated script that prints the hardcoded string "apptainer works".


ATM " /usr/bin/singularity" and " /usr/bin/apptainer" start the very same program but since the name "singularity" will sooner or later disappear all scripts using it need to be modified to use "apptainer".


Regarding the lack of tasks on -dev.
Yes they are intentionally very small and for testing the process rather than for productive work.
ID: 47207 · Report as offensive     Reply Quote
Profile Yeti
Volunteer moderator
Avatar

Send message
Joined: 2 Sep 04
Posts: 453
Credit: 193,369,412
RAC: 10,065
Message 47208 - Posted: 30 Aug 2022, 12:46:45 UTC - in response to Message 47207.  

The line:
[2022-08-30 06:15:06] Singularity works
is a hardcoded String that the script prints to the log.

It could also print "Wuppdibragglkennsdmined works" and it would still run Apptainer.

But hopefully it prints this only to the log if it really works


Supporting BOINC, a great concept !
ID: 47208 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2071
Credit: 156,130,430
RAC: 104,897
Message 47209 - Posted: 30 Aug 2022, 13:21:33 UTC - in response to Message 47208.  

@David Cameron:
I have reverted back to v2.87. Many tasks were failing with errors creating temporary files like this:
Failed to execute payload:mktemp: failed to create file via template '/tmp/asetup_XXXXXX.sh': Read-only file system
which may be related to the change in the way directories are mounted in the container. I'm investigating.
ID: 47209 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,948,035
RAC: 137,183
Message 47210 - Posted: 30 Aug 2022, 13:56:57 UTC - in response to Message 47208.  

<not_really_serious>
1st valid that was processed under the new container app clone:
https://lhcathome.cern.ch/lhcathome/result.php?resultid=364616724
[2022-08-30 09:23:09] CVMFS is ok
[2022-08-30 09:23:09] Using wuppdibragglkennsdmined image /cvmfs/atlas.cern.ch/repo/containers/fs/wuppdibragglkennsdmined/x86_64-centos7
[2022-08-30 09:23:09] Checking for wuppdibragglkennsdmined binary...
[2022-08-30 09:23:09] Using wuppdibragglkennsdmined found in PATH at /usr/bin/wuppdibragglkennsdmined
[2022-08-30 09:23:09] Running /usr/bin/wuppdibragglkennsdmined --version
[2022-08-30 09:23:09] wuppdibragglkennsdmined version 1.0.2-1.2
[2022-08-30 09:23:09] Checking wuppdibragglkennsdmined works with /usr/bin/wuppdibragglkennsdmined exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/wuppdibragglkennsdmined/x86_64-centos7 hostname
[2022-08-30 09:23:09] s4
[2022-08-30 09:23:09] wuppdibragglkennsdmined works
[2022-08-30 09:23:09] Set ATHENA_PROC_NUMBER=2
[2022-08-30 09:23:09] Starting ATLAS job with PandaID=5577578530
[2022-08-30 09:23:09] Running command: /usr/bin/wuppdibragglkennsdmined exec --pwd /home/boinc4/BOINC_ATLAS/slots/0 -B /cvmfs,/home /cvmfs/atlas.cern.ch/repo/containers/fs/wuppdibragglkennsdmined/x86_64-centos7 sh start_atlas.sh

</not_really_serious>
ID: 47210 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2071
Credit: 156,130,430
RAC: 104,897
Message 47211 - Posted: 30 Aug 2022, 14:14:39 UTC - in response to Message 47209.  

In English it's the same name "Kindergarten".
ID: 47211 · Report as offensive     Reply Quote

Message boards : Number crunching : Atlas Nativ, CVMFS and Apptainer with Ubuntu 22.04.1


©2024 CERN