1) Questions and Answers : Unix/Linux : Atlas receiving error at the 10 minute mark (Message 49776)
Posted 16 Mar 2024 by mmonnin
Post:
Installing CVMFS and Singularity from repository packages:

sudo apt-get install lsb-release
wget https://ecsft.cern.ch/dist/cvmfs/cvmfs-release/cvmfs-release-latest_all.deb
sudo dpkg -i cvmfs-release-latest_all.deb
rm -f cvmfs-release-latest_all.deb
sudo apt-get update

sudo apt install cvmfs

sudo mkdir -p /scratch/cvmfs

sudo nano /etc/cvmfs/default.local


ADD the following lines to the file:

CVMFS_REPOSITORIES=atlas.cern.ch,atlas-condb.cern.ch,grid.cern.ch
CVMFS_USE_CDN=yes
CVMFS_CACHE_BASE=/scratch/cvmfs
CVMFS_HTTP_PROXY=DIRECT


Save the file.

sudo cvmfs_config setup


Testing:

cvmfs_config probe


Output:
mark@linux-x24:~$ cvmfs_config probe
Probing /cvmfs/atlas.cern.ch... OK
Probing /cvmfs/atlas-condb.cern.ch... OK
Probing /cvmfs/grid.cern.ch... OK

install Singularity

For debian and derivatives:

wget https://github.com/apptainer/singularity/releases/download/v3.8.7/singularity-container_3.8.7_amd64.deb
sudo dpkg -i singularity-container_3.8.7_amd64.deb


The instructions are a bit old and mention Mint 21 needing CVMFS to be built but may have changed by now.
2) Questions and Answers : Unix/Linux : Is virtualbox needed for Linux and LHC? (Message 48440)
Posted 14 Aug 2023 by mmonnin
Post:
You can't cd, make a new folder, paste some text into a new file and run a setup command? All just copy/paste.
3) Questions and Answers : Unix/Linux : Is virtualbox needed for Linux and LHC? (Message 48425)
Posted 11 Aug 2023 by mmonnin
Post:
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=4840#36880

That has the instructions for setting up the native apps.

Squid is something else.
4) Questions and Answers : Unix/Linux : Is virtualbox needed for Linux and LHC? (Message 48419)
Posted 10 Aug 2023 by mmonnin
Post:
You must install the other programs needed to run the tasks that are included in the VBox image to run them as native tasks. CVMFS and Singularity but dont follow the hilariously complex instructions to download/compile. Just use a repository for them then do the few commands to configure.
5) Message boards : ATLAS application : Tasks download 1.9 GB EVNT files (Message 45698)
Posted 14 Nov 2021 by mmonnin
Post:
More 1.12GB task downloads.
6) Message boards : ATLAS application : Bad WUs? (Message 45549)
Posted 26 Oct 2021 by mmonnin
Post:
1.1GB and 250MB downloads just for them to be invalid in 3 min.

The download speed is slow as people are constantly downloading huge files. I had a PC with plenty of work last night now waiting on downloads as they were completing before more work could be downloaded.
7) Message boards : ATLAS application : Boinc 7.16.20 - Windows (Message 45513)
Posted 23 Oct 2021 by mmonnin
Post:
You'll get this time of message when referencing an app name in an app_config file until you've gotten a task for the named app. The message does no harm. Ignore it.
8) Message boards : ATLAS application : Tasks download 1.9 GB EVNT files (Message 45498)
Posted 21 Oct 2021 by mmonnin
Post:
Still huge at 1122482k. When there are 8x tasks per PC running on multiple machines plus the several hundred mb upload completing. It's too much transferring.
9) Message boards : ATLAS application : Tasks download 1.9 GB EVNT files (Message 45489)
Posted 21 Oct 2021 by mmonnin
Post:
The BOINC Client does the communication and doesn't care what other projects are running. There are over 418k Rosetta tasks in progress atm and 9k are python. 2% chance.
10) Message boards : ATLAS application : Tasks download 1.9 GB EVNT files (Message 45473)
Posted 20 Oct 2021 by mmonnin
Post:
Still getting these really big tasks. And its causing other tasks to not download since these take sooo long.

Tasks finish faster than new ones can download. Moving production elsewhere.
11) Message boards : ATLAS application : Tasks download 1.9 GB EVNT files (Message 45472)
Posted 19 Oct 2021 by mmonnin
Post:
Crazy 1.9GB file sizes even with Native Atlas.

I had a heck of a time getting a PC running again after my disk filled up from this. It's only on a 120GB drive. I tried deleting some executable and db files of other projects but BOINC Mgr in all of its wisdom thought I still needed them even w/o tasks for those apps/projects.
12) Message boards : Sixtrack Application : SIXTRACKTEST (Message 39572)
Posted 10 Aug 2019 by mmonnin
Post:
The clue might be in the name. sixtrackTEST, therefore jobs may not work as expected or even at all. If you only want to run reliable jobs then uncheck the "Run test applications" box. You might also consider turning down your work buffer so you don't get so many. Aborting hundreds of tasks isn't helpful.
I have only been able to get 12 of these. Some have been short, some are over 30hrs. The short ones (unstable beam parameters) can be just as useful as the long ones. Any failures can be used to refine the setup and result in better performance of future tasks.


I have a buffer of 0.10 days or 2.4 hours. Barely any buffer at all. But the ETA was only several seconds and hundreds downloaded on a 32t system. I can't help that the project did not set realistic ETA for the longer tasks. Instead of wasting my PCs time and electricity for them to just end up in an error state I sent them back for someone else to hopefully complete. I ran my TEST for sixtractTEST so unless you have suggestions to fix the errors on the one PC (others PCs are still running) ya can step down off your pedestal.
13) Message boards : Sixtrack Application : SIXTRACKTEST (Message 39551)
Posted 9 Aug 2019 by mmonnin
Post:
Have a Computer with only sixtracktest for the Moment:
The wingman had this Error:
exceeded elapsed time limit 13480.39 (1920000000.00G/109981.44G)</message>
https://lhcathome.cern.ch/lhcathome/result.php?resultid=238806725


I have a lot of these today on one PC. Some complete, some error at the same time. Most successful ones complete in a couple of seconds.
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 17457.49 (1920000000.00G/109981.44G)</message>
<stderr_txt>

</stderr_txt>
]]>

They quickly progress to about 50% then go back to 0% and then very slowly progress. Dumped the rest on that PC.
14) Message boards : News : BOINC Pentathlon - Sixtrack sprint (Message 38870)
Posted 16 May 2019 by mmonnin
Post:
There's no assumption. Every project is inquired before hand. If they don't reply (like MilkyWay) they are left out.

Glad to see some new Atlas tasks being sent out still instead of 5 second SixTrack.
15) Message boards : Theory Application : Theory queue currently drying out (Message 38526)
Posted 3 Apr 2019 by mmonnin
Post:
Yet another request to not send tasks w/o jobs...
16) Message boards : ATLAS application : Native Atlas: "Output file missing" (Message 38422)
Posted 24 Mar 2019 by mmonnin
Post:
Hmmm not right now.

When following the guide I mentioned in my first post re: Singularity, it all falls apart after that slightly modified download is unzipped into the /home/username folder. I have been looking around for what and where to cd to in order to "./configure --prefix=/usr/local"


Singularity install:

sudo wget -O- http://neuro.debian.net/lists/xenial.us-ca.full | sudo tee /etc/apt/sources.list.d/neurodebian.sources.list
sudo apt-get install -y singularity-container


And a
singularity --version

will return the version if installed correctly.
17) Message boards : Theory Application : Installation of CVMFS (Message 38421)
Posted 24 Mar 2019 by mmonnin
Post:
The server scheduler is sometimes confused, how to interpret the max # settings.
...

Yeah I already suspected that. As soon as I changed it back enough tasks went in.
Thanks for the app_config but unfortunately when I want to save the file with gedit in the project directory Ubuntu doesn't let me access the 'projects'-folder for some reason...


To open the file manager with elevated access:

sudo nautilus


Or
sudo gedit /var/lib/boinc-client/lhcathome.cern.ch_lhcathome


I run the Theory Native tasks as single threaded with app_config since the only use about 1.1-1.5 threads but are scheduled by default to use 2.[/code]
18) Message boards : News : Warning: possible shortage of CMS jobs - set No New Tasks as a precaution (Message 38389)
Posted 23 Mar 2019 by mmonnin
Post:
[1] How many times do I have to tell people not to touch critical systems on a Friday -- especially Friday afternoon!?


How many times do we have to ask that tasks not be sent to users w/o jobs...
19) Message boards : Theory Application : Installation of CVMFS (Message 38382)
Posted 22 Mar 2019 by mmonnin
Post:
Well, thanks for the tips but I couldn't get this damn CVMFS installed at all no matter what I tried meanwhile. :-\
I'm too inexperienced with Linux to dig into this even more and don't have the time either so I give up here.
Too bad... I hope a Windows app for this will come out sooner or later, if not then so be it...


If you want to try Ubuntu you can use the instructions I gave to my team. It's worked for me on several 18.04 installs. The instructions given at LHC forums are way overly complicated for no reason when CVFMS can be installed from a repository. It's also much quicker than compiling it.

https://www.overclock.net/forum/365-overclock-net-boinc-team/1721752-projects-month-march-2019-a.html#post27876964


Our instructions for the Theory app point to the official CVMFS documentation. Please let me know if you think any improvements are required.


I was referring to the Native ATLAS instructions, which also need CVFMS, but instruct the user to D/L and make the BOINC, CVFMS and singularity apps from source.
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=4840

The official CVFMS instructions are the ones I used at OCN.
20) Message boards : Theory Application : Issues Native Theory application (Message 38369)
Posted 21 Mar 2019 by mmonnin
Post:
I see that the maximum runtime of last 100 tasks is 25.06 hours.

Would be interesting to know what job and result-id it was.


I aborted this one. Running for 2 days while the longest one I've completed was 8 hours.
https://lhcathome.cern.ch/lhcathome/workunit.php?wuid=109410751


Next 20


©2024 CERN