Message boards : ATLAS application : Debian 11
Message board moderation

To post messages, you must log in.

AuthorMessage
[AF] Hydrosaure
Avatar

Send message
Joined: 8 May 17
Posts: 12
Credit: 11,235,723
RAC: 1,153
Message 45219 - Posted: 17 Aug 2021, 17:12:23 UTC

Happy to report a working and completed ATLAS job on a fresh Debian 11 install.

Did you the same .deb as from a Debian 10.

https://lhcathome.cern.ch/lhcathome/result.php?resultid=323787719
ID: 45219 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1818
Credit: 122,899,693
RAC: 76,554
Message 45220 - Posted: 17 Aug 2021, 19:03:25 UTC - in response to Message 45219.  
Last modified: 17 Aug 2021, 19:04:18 UTC

Very nice.



Nonetheless I'd like to make you aware of some issues.

1. This line in your logfile:
[2021-08-16 12:55:48] This job has been restarted, cleaning up previous attempt

ATLAS native must not be paused or restarted.
The logfile tells you why - at restart it drops all intermediate results and starts the task from scratch.



2. Misconfigured CVMFS clients.
Well, definitely not your new Debian 11 computer.
That one shows the following line in it's log, hence it's configuration may be used as template:
[2021-08-16 10:43:03] 2.8.1.0 1299 10 31052 90348 1 1 26005 4194305 0 130560 0 0 0.000 530 644 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1

Here the requests are retrieved via this chain:
(1.) your computer <--> (2.) openhtc proxy closest to your location <--> (3.)repository server closest to the openhtc proxy


At least some of your computers show lines like this:
[2021-08-16 03:17:15] 2.8.1.0 4040 207 44656 90331 1 66 3236924 4194305 0 130560 0 24070 84.495 514410 837 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://128.142.248.156:3126 1

Here the CVMFS client uses a fallback proxy at CERN which causes the requests to be retrieved via this chain:
(1.) your computer <--> (2.) fallback proxy at CERN <--> (3.) openhtc proxy closest to CERN <--> (4.)repository server closest to the openhtc proxy


Since you are running a cluster with in total much more than 5 cores the project recommends a local proxy to be used.
Should be set up in less than 1h, especially since a Squid is usually included in all recent Linux distributions.
See:
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5473

As a result the request chain would look like this:
(1.) your computer <--> (2.) your local proxy <--> (3.) openhtc proxy closest to your location <--> (4.)repository server closest to the openhtc proxy
The benefit would be that the local proxy returns most of the requests out of it's cache.
ID: 45220 · Report as offensive     Reply Quote

Message boards : ATLAS application : Debian 11


©2021 CERN