Message boards : ATLAS application : ATLAS native version 2.87
Message board moderation

To post messages, you must log in.

AuthorMessage
David Cameron
Project administrator
Project developer
Project scientist

Send message
Joined: 13 May 14
Posts: 354
Credit: 12,041,535
RAC: 3,823
Message 45242 - Posted: 23 Aug 2021, 14:37:51 UTC

Hi all,

We just released native version 2.87. This version uses an "unpacked" Singularity image file instead of a sif file. This means tasks start quicker because there is no need to unpack the image (which can take up to a minute), and also there is no longer any need to install squashfs-tools, which was only used for this unpacking step.

As usual let us know if there are any problems!

(in case you need to debug any problems, the image changed from /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img to /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7)
ID: 45242 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1301
Credit: 39,583,517
RAC: 11,358
Message 45251 - Posted: 24 Aug 2021, 17:32:25 UTC - in response to Message 45242.  

Thank you David and your Team,
all native are running well.
squashfs is now history, this is a good idea.
ID: 45251 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1818
Credit: 122,903,014
RAC: 76,336
Message 45259 - Posted: 26 Aug 2021, 7:30:46 UTC

Since ATLAS native has been updated I get lots of messages like:
Do 26 Aug 2021 09:09:27 CEST | LHC@home | No tasks are available for ATLAS Simulation

although the server status page shows 4346 unsent ATLAS tasks.


In the past this error was caused by the fact that LHC's BOINC service runs on 2 (sometimes more) machines, currently:
lhcathome.cern.ch.      60      IN      A       137.138.148.247
lhcathome.cern.ch.      60      IN      A       137.138.156.174



It looks like only 1 of the BOINC service instances - or the corresponding ATLAS queue behind the service - is correctly configured to send out work for the recent ATLAS version v2.87.
The other service/queue may require a restart.
ID: 45259 · Report as offensive     Reply Quote
David Cameron
Project administrator
Project developer
Project scientist

Send message
Joined: 13 May 14
Posts: 354
Credit: 12,041,535
RAC: 3,823
Message 45264 - Posted: 26 Aug 2021, 19:17:15 UTC - in response to Message 45259.  

Thanks for pointing this out. Hopefully the power outage this afternoon in the CERN data centre took care of restarting the other machine.
ID: 45264 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1818
Credit: 122,903,014
RAC: 76,336
Message 45265 - Posted: 27 Aug 2021, 4:58:00 UTC - in response to Message 45264.  

There's still a mix of work requests on all clients that succeed and others that don't.
Merged from different clients:
27-Aug-2021 00:32:31 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 01:09:53 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 01:28:52 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 01:43:06 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 01:59:17 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 01:59:28 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 02:02:26 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 02:13:01 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 02:27:11 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 02:37:32 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 02:37:43 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 02:40:19 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 03:13:04 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 03:15:12 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 03:24:54 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 03:50:53 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 05:05:13 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 05:14:59 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 05:15:11 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 05:17:47 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 05:37:13 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 05:47:02 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 05:47:13 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 05:49:49 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 05:50:00 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 05:52:22 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 05:52:33 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 05:55:55 [LHC@home] Scheduler request completed: got 1 new tasks
27-Aug-2021 06:22:23 [LHC@home] No tasks are available for ATLAS Simulation
27-Aug-2021 06:22:44 [LHC@home] No tasks are available for ATLAS Simulation



May be the cleaning lady/guy pulled the wrong plug yesterday.
ID: 45265 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1301
Credit: 39,583,517
RAC: 11,358
Message 45266 - Posted: 27 Aug 2021, 8:02:41 UTC

XXX.YYY 3128 - - [27/Aug/2021:09:59:13 +0200] "GET http://s1nikhef-cvmfs.openhtc.io/cvmfs/singularity.opensciencegrid.org/.cvmfspublished HTTP/1.1" 200 1830 "-" "cvmfs Fuse 2.4.4 49b2fac1-df25-48d2-a4ee-4612ca6a31f8" TCP_REFRESH_MODIFIED:HIER_DIRECT
Is this a normal entry for squid?
ID: 45266 · Report as offensive     Reply Quote
David Cameron
Project administrator
Project developer
Project scientist

Send message
Joined: 13 May 14
Posts: 354
Credit: 12,041,535
RAC: 3,823
Message 45267 - Posted: 27 Aug 2021, 8:12:34 UTC - in response to Message 45265.  

May be the cleaning lady/guy pulled the wrong plug yesterday.


Actually it was a planned power test which went slightly wrong...

I think I found the other host and restarted the services there.
ID: 45267 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1818
Credit: 122,903,014
RAC: 76,336
Message 45268 - Posted: 27 Aug 2021, 8:19:48 UTC - in response to Message 45266.  

... Is this a normal entry for squid?

Yes.
Have them too.


Within 1 week:
Destination #requests #bytes
s1nikhef-cvmfs.openhtc.io 132506 2.53 GB
ID: 45268 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1818
Credit: 122,903,014
RAC: 76,336
Message 45269 - Posted: 27 Aug 2021, 18:49:43 UTC - in response to Message 45267.  

I think I found the other host and restarted the services there.

Thanks.
Since then work requests are running fine.
ID: 45269 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1301
Credit: 39,583,517
RAC: 11,358
Message 45270 - Posted: 28 Aug 2021, 5:52:07 UTC

[2021-08-27 13:59:51] CVMFS is ok
[2021-08-27 13:59:51] Using singularity image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2021-08-27 13:59:51] Checking for singularity binary...
[2021-08-27 13:59:51] Using singularity found in PATH at /usr/bin/singularity
[2021-08-27 13:59:51] Running /usr/bin/singularity --version
[2021-08-27 13:59:51] singularity version 3.8.1-1.el8
[2021-08-27 13:59:51] Checking singularity works with /usr/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2021-08-27 13:59:52] WARNING: While bind mounting '/cvmfs:/cvmfs': destination is already in the mount point list fx8s
[2021-08-27 13:59:52] Singularity works
Need this Info a correction for Singularity installation of the CentOS8-VM?
ID: 45270 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1301
Credit: 39,583,517
RAC: 11,358
Message 45271 - Posted: 29 Aug 2021, 18:01:20 UTC - in response to Message 45270.  

WARNING: While bind mounting '/cvmfs:/cvmfs': destination is already in the mount point list.
CentOS8-VM with Singularity version 3.8.0-1.el8 don't have this warning,
only CentOS8-VM with Singularity version 3.8.1-1.el8.
ID: 45271 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 1301
Credit: 39,583,517
RAC: 11,358
Message 45342 - Posted: 15 Sep 2021, 10:21:18 UTC

When four native-Tasks for a maximum is reached, Boinc (7.16.11) get this News text every time:

LHC@Home: Notice from server
VirtualBox is not installed

Is it possible to stop this News text in Boinc, because this is only for News.
ID: 45342 · Report as offensive     Reply Quote

Message boards : ATLAS application : ATLAS native version 2.87


©2021 CERN