LHC@home

Happy to report a working and completed ATLAS job on a fresh Debian 11 install.

Did you the same .deb as from a Debian 10.

https://lhcathome.cern.ch/lhcathome/result.php?resultid=323787719

Very nice.



Nonetheless I'd like to make you aware of some issues.

1. This line in your logfile:

[2021-08-16 12:55:48] This job has been restarted, cleaning up previous attempt

ATLAS native must not be paused or restarted.
The logfile tells you why - at restart it drops all intermediate results and starts the task from scratch.



2. Misconfigured CVMFS clients.
Well, definitely not your new Debian 11 computer.
That one shows the following line in it's log, hence it's configuration may be used as template:

[2021-08-16 10:43:03] 2.8.1.0 1299 10 31052 90348 1 1 26005 4194305 0 130560 0 0 0.000 530 644 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1

Here the requests are retrieved via this chain:
(1.) your computer <--> (2.) openhtc proxy closest to your location <--> (3.)repository server closest to the openhtc proxy


At least some of your computers show lines like this:

[2021-08-16 03:17:15] 2.8.1.0 4040 207 44656 90331 1 66 3236924 4194305 0 130560 0 24070 84.495 514410 837 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://128.142.248.156:3126 1

Here the CVMFS client uses a fallback proxy at CERN which causes the requests to be retrieved via this chain:
(1.) your computer <--> (2.) fallback proxy at CERN <--> (3.) openhtc proxy closest to CERN <--> (4.)repository server closest to the openhtc proxy


Since you are running a cluster with in total much more than 5 cores the project recommends a local proxy to be used.
Should be set up in less than 1h, especially since a Squid is usually included in all recent Linux distributions.
See:
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5473

As a result the request chain would look like this:
(1.) your computer <--> (2.) your local proxy <--> (3.) openhtc proxy closest to your location <--> (4.)repository server closest to the openhtc proxy
The benefit would be that the local proxy returns most of the requests out of it's cache.