Message boards : ATLAS application : ATLAS native version 2.73
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 · Next

AuthorMessage
David Cameron
Project administrator
Project developer
Project scientist

Send message
Joined: 13 May 14
Posts: 387
Credit: 15,314,184
RAC: 0
Message 40181 - Posted: 17 Oct 2019, 12:25:57 UTC

We just released 2.73 which has the following improvements:


    A better check whether singularity is installed, by looking for it in the PATH instead of running it and looking for "not found" in the output. Thanks to computezrmle for pointing out the problems with the old approach

    Logging of stderr messages when the main singularity command fails

    Logging of error codes from the ATLAS pilot (like is done in the vbox version)

ID: 40181 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 602
Credit: 24,371,321
RAC: 0
Message 40200 - Posted: 18 Oct 2019, 19:15:44 UTC - in response to Message 40181.  
Last modified: 18 Oct 2019, 19:16:50 UTC

After wiping out my Ubuntu machine and starting from scratch, 2.73 is working fine for me. I installed only CVMFS, and didn't do anything more with Singularity.
https://lhcathome.cern.ch/lhcathome/results.php?hostid=10618939

But I see that a lot of other people have errors on 2.72 that were like mine. That is, both CVMFS and Singularity seem to be installed OK, but they get errors, typically
"195 (0x000000C3) EXIT_CHILD_FAILED". So there is some hidden incompatibility it would seem. Everyone may need to start over if it can't be identified.
ID: 40200 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2071
Credit: 156,179,989
RAC: 105,256
Message 40205 - Posted: 19 Oct 2019, 7:37:36 UTC

Seem that native Atlas get work now, Cern-(Agile Boincers) is running native Atlas.
ID: 40205 · Report as offensive     Reply Quote
Profile zepingouin
Avatar

Send message
Joined: 7 Jan 07
Posts: 41
Credit: 15,959,427
RAC: 271
Message 40387 - Posted: 10 Nov 2019, 12:12:35 UTC

On my Debian GNU/Linux 9.11 (stretch), I have needed to install this missing package : squashfs-tools
ID: 40387 · Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jun 18
Posts: 126
Credit: 52,457,949
RAC: 23,953
Message 40458 - Posted: 14 Nov 2019, 19:36:25 UTC
Last modified: 14 Nov 2019, 19:54:22 UTC

I've been trying to Native DL ATLAS WUs. Server status says there are 1000s but unlike Theory it does separate native from the VB version. Maybe there are no native ATLAS WUs available.

My OS is Linux Mint 19.2 and the Additional Repositories lists two versions: CERN / bionic-prod and CERN / bionic-testing. The first was checked so I also checked the second. Not sure I'm supposed to use just one of them or both.

I also ran: sudo cvmfs_config reload

How can I know if I'm ready for 2.73???

Edit: I did not have the Run Test Applications box checked in my LHC Preferences. Now I'm starting to get some.
ID: 40458 · Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jun 18
Posts: 126
Credit: 52,457,949
RAC: 23,953
Message 40460 - Posted: 14 Nov 2019, 20:23:30 UTC

All ATLAS 2.73 WUs are failing:
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<message>
process exited with code 195 (0xc3, -61)</message>
<stderr_txt>
12:08:47 (19257): wrapper (7.7.26015): starting
12:08:47 (19257): wrapper: running run_atlas (--nthreads 4)
2019-11-14 12:08:47,929: singularity image is /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img
2019-11-14 12:08:47,929: sys.argv = ['run_atlas', '--nthreads', '4']
2019-11-14 12:08:47,930: THREADS=4
2019-11-14 12:08:47,931: Checking for CVMFS
2019-11-14 12:08:51,037: CVMFS is installed
2019-11-14 12:08:51,038: Checking for singularity binary...
2019-11-14 12:08:51,038: Found singularity at /usr/local/bin/singularity
2019-11-14 12:08:51,038: Running singularity --version
2019-11-14 12:08:51,050: Singularity version is 2.6.0-dist
2019-11-14 12:08:51,050: Testing the function of Singularity...
2019-11-14 12:08:51,050: Checking singularity with cmd:singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img hostname
2019-11-14 12:08:51,074: Singularity isnt working: ERROR : Unknown image format/type: /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img
ABORT : Retval = 255

2019-11-14 12:08:53,085: running start_atlas return value is 3
2019-11-14 12:18:53,129: parent process exit 3
2019-11-14 12:18:53,130: child process exit 3
12:18:54 (19257): run_atlas exited; CPU time 0.692866
12:18:54 (19257): app exit status: 0x3
12:18:54 (19257): called boinc_finish(195)
</stderr_txt>]]>
ID: 40460 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,995,889
RAC: 136,270
Message 40461 - Posted: 14 Nov 2019, 20:58:02 UTC - in response to Message 40460.  

Fortunately you posted the relevant logfile line although it would be better to keep the posts short and make the hosts visible:
2019-11-14 12:08:51,050: Singularity version is 2.6.0-dist

ATLAS' singularity image requires singularity v3.x
If you don't need singularity to run other containers the best solution would be to completely remove it.
This would force ATLAS to run the correct singularity version from CVMFS.
ID: 40461 · Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jun 18
Posts: 126
Credit: 52,457,949
RAC: 23,953
Message 40462 - Posted: 14 Nov 2019, 21:02:43 UTC - in response to Message 40461.  
Last modified: 14 Nov 2019, 21:05:56 UTC

Thanks. Nice avatar.
Do I just delete my /home/aurum/singularity-2.6.0 folder or do I need to run a command ???
I also run native Theory. Does it need singularity 2.6 ???
ID: 40462 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,995,889
RAC: 136,270
Message 40463 - Posted: 14 Nov 2019, 21:23:42 UTC - in response to Message 40462.  

Do I just delete my /home/aurum/singularity-2.6.0 folder or do I need to run a command ???

See this post:
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5161&postid=40129
You may also follow the link mentioned there.

I also run native Theory. Does it need singularity 2.6 ???

No.
Theory just needs a running CVMFS client.
ID: 40463 · Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jun 18
Posts: 126
Credit: 52,457,949
RAC: 23,953
Message 40474 - Posted: 15 Nov 2019, 19:36:44 UTC
Last modified: 15 Nov 2019, 19:37:32 UTC

Below I list the steps I used to update native LHC applications. It's been running better than I've seen before and plays nice with others. I'm running native ATLAS, native Theory, Sixtrack plus running out Universe WUs and they time-slice in an orderly manner. Since updating I have not had a single native ATLAS WU fail and all but one are valid.

For reinstalls:
Delete the folder singularity-2.6.0 and also:
sudo rm -rf \
/usr/local/libexec/singularity \
/usr/local/var/singularity \
/usr/local/etc/singularity \
/usr/local/bin/singularity \
/usr/local/bin/run-singularity \
/usr/local/etc/bash_completion.d/singularity

For new & reinstalls:
wget https://ecsft.cern.ch/dist/cvmfs/cvmfs-release/cvmfs-release-latest_all.deb ; sudo dpkg -i cvmfs-release-latest_all.deb ; rm -f cvmfs-release-latest_all.deb ; sudo apt-get update ; sudo apt-get install cvmfs ; sudo apt install glibc-doc open-iscsi watchdog

sudo wget https://lhcathomedev.cern.ch/lhcathome-dev/download/default.local -O /etc/cvmfs/default.local ; sudo cvmfs_config setup ; sudo echo "/cvmfs /etc/auto.cvmfs" > /etc/auto.master.d/cvmfs.autofs ; sudo systemctl restart autofs ; cvmfs_config probe

sudo cvmfs_config reload

No longer needed:
wget https://github.com/singularityware/singularity/releases/download/2.6.0/singularity-2.6.0.tar.gz ; tar xvf singularity-2.6.0.tar.gz ; cd singularity-2.6.0 ; sudo apt install libarchive-dev ; ./configure --prefix=/usr/local ; make ; sudo make install

sudo xed /etc/cvmfs/default.local
CVMFS_SEND_INFO_HEADER=yes

sudo xed /etc/cvmfs/domain.d/cern.ch.local
CVMFS_SERVER_URL="http://s1cern-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1ral-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1bnl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1fnal-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1unl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1asgc-cvmfs.openhtc.io:8080/cvmfs/@fqrn@;http://s1ihep-cvmfs.openhtc.io/cvmfs/@fqrn@"
ID: 40474 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 602
Credit: 24,371,321
RAC: 0
Message 40533 - Posted: 19 Nov 2019, 18:05:15 UTC
Last modified: 19 Nov 2019, 18:09:13 UTC

I find that the way I install BOINC from the repository (Ubuntu 18.04), I need to again grant permissions to the boinc-client folder after all the CVMFS files are installed, or native ATLAS won't function.
sudo chmod -R 777 /var/lib/boinc-client
ID: 40533 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 602
Credit: 24,371,321
RAC: 0
Message 40534 - Posted: 19 Nov 2019, 18:36:45 UTC

No longer needed:
.................
sudo xed /etc/cvmfs/default.local
CVMFS_SEND_INFO_HEADER=yes

sudo xed /etc/cvmfs/domain.d/cern.ch.local
CVMFS_SERVER_URL="http://s1cern-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1ral-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1bnl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1fnal-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1unl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1asgc-cvmfs.openhtc.io:8080/cvmfs/@fqrn@;http://s1ihep-cvmfs.openhtc.io/cvmfs/@fqrn@"

I normally include these, and wonder what difference it makes if I leave them out. I am not using a local proxy, and maybe they still help?
ID: 40534 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,995,889
RAC: 136,270
Message 40536 - Posted: 19 Nov 2019, 19:00:43 UTC - in response to Message 40534.  

No longer needed:
.................
sudo xed /etc/cvmfs/default.local
CVMFS_SEND_INFO_HEADER=yes

sudo xed /etc/cvmfs/domain.d/cern.ch.local
CVMFS_SERVER_URL="http://s1cern-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1ral-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1bnl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1fnal-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1unl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1asgc-cvmfs.openhtc.io:8080/cvmfs/@fqrn@;http://s1ihep-cvmfs.openhtc.io/cvmfs/@fqrn@"

I normally include these, and wonder what difference it makes if I leave them out. I am not using a local proxy, and maybe they still help?


/etc/cvmfs/default.local
CVMFS_SEND_INFO_HEADER=yes

You will not see any difference if you switch it "off" but
it's a requirement from Dave Dykstra (Fermilab) that this is set to "yes".
As far as I understand this helps Cloudflare and CERN/Fermilab to identify errors and to optimize their internal settings.


/etc/cvmfs/domain.d/cern.ch.local
CVMFS_SERVER_URL="http://s1cern-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1ral-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1bnl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1fnal-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1unl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1asgc-cvmfs.openhtc.io:8080/cvmfs/@fqrn@;http://s1ihep-cvmfs.openhtc.io/cvmfs/@fqrn@"

This list defines which server your local CVMFS client will ask for files stored at the *.cern.ch repositories.
Under normal circumstances all of them point to the same "nearest" Cloudflare server but the names map the stratum 1 server that Cloudflare asks for data if their cache has a miss.

Keeping all of them in the list makes sense since they are automatically used as failover routes.
ID: 40536 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 602
Credit: 24,371,321
RAC: 0
Message 40537 - Posted: 19 Nov 2019, 19:03:33 UTC - in response to Message 40536.  

Thanks. I was hoping to get your opinion.
I now am putting native ATLAS, native Theory and SixTrack all together on a Ryzen 3700x, and am just getting it set up, so I want to do it as right as possible.
ID: 40537 · Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jun 18
Posts: 126
Credit: 52,457,949
RAC: 23,953
Message 40539 - Posted: 19 Nov 2019, 20:31:27 UTC - in response to Message 40474.  
Last modified: 19 Nov 2019, 20:32:29 UTC

No longer needed:
sudo xed /etc/cvmfs/default.local
CVMFS_SEND_INFO_HEADER=yes

sudo xed /etc/cvmfs/domain.d/cern.ch.local
CVMFS_SERVER_URL="http://s1cern-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1ral-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1bnl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1fnal-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1unl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1asgc-cvmfs.openhtc.io:8080/cvmfs/@fqrn@;http://s1ihep-cvmfs.openhtc.io/cvmfs/@fqrn@"
To clarify, I only meant that the commands to install 2.73 in For new & reinstalls: created them and there is no need for me to create them myself.
ID: 40539 · Report as offensive     Reply Quote
[AF] Hydrosaure
Avatar

Send message
Joined: 8 May 17
Posts: 13
Credit: 37,406,902
RAC: 28,075
Message 40600 - Posted: 22 Nov 2019, 18:17:49 UTC - in response to Message 40539.  

Any idea what could be the issue here ?

https://lhcathome.cern.ch/lhcathome/result.php?resultid=252658162

2019-11-22 15:36:27,522: Checking singularity with cmd:/cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/current/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img hostname
2019-11-22 15:37:43,370: Singularity isnt working: INFO:    Convert SIF file to sandbox...
INFO:    Cleaning up image...
FATAL:   container creation failed: mount ->/cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc error: can't remount /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc: invalid argument
2019-11-22 15:37:45,377: running start_atlas return value is 3
2019-11-22 15:47:45,448: parent process exit 3
2019-11-22 15:47:45,449: child process exit 3


Yet if I manually try to execute this command line

boinc@boinc-z87:~$ /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/current/bin/singularity --debug exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img hostname
VERBOSE [U=1000,P=5653]    execStarter()                 starter-suid not found, using user namespace
VERBOSE [U=1000,P=5653]    execStarter()                 User namespace requested, convert image /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img to sandbox
INFO    [U=1000,P=5653]    execStarter()                 Convert SIF file to sandbox...
DEBUG   [U=1000,P=5653]    Init()                        Entering image format intializer
DEBUG   [U=1000,P=5653]    Init()                        Check for image format sif
VERBOSE [U=1000,P=5653]    print()                       Set messagelevel to: 5
DEBUG   [U=1000,P=5653]    init()                        PIPE_EXEC_FD value: 7
VERBOSE [U=1000,P=5653]    init()                        Container runtime
VERBOSE [U=1000,P=5653]    is_suid()                     Check if we are running as setuid
DEBUG   [U=1000,P=5653]    init()                        Read json configuration from pipe
DEBUG   [U=1000,P=5653]    init()                        Set child signal mask
DEBUG   [U=1000,P=5653]    init()                        Wait completion of stage1
DEBUG   [U=1000,P=15975]   set_parent_death_signal()     Set parent death signal to 9
VERBOSE [U=1000,P=15975]   init()                        Spawn stage 1
VERBOSE [U=1000,P=15975]   startup()                     Execute stage 1
DEBUG   [U=1000,P=15975]   Stage()                       Entering stage 1
DEBUG   [U=1000,P=15975]   prepareFd()                   Open file descriptor for /cvmfs
DEBUG   [U=1000,P=15975]   Init()                        Entering image format intializer
DEBUG   [U=1000,P=15975]   Init()                        Check for image format sif
DEBUG   [U=1000,P=15975]   Init()                        sif format initializer returns: not a SIF file image
DEBUG   [U=1000,P=15975]   Init()                        Check for image format sandbox
DEBUG   [U=1000,P=5653]    init()                        Create socketpair for master communication channel
DEBUG   [U=1000,P=5653]    cleanup_fd()                  Check file descriptor /proc/self/fd/3 pointing to /cvmfs
DEBUG   [U=1000,P=5653]    cleanup_fd()                  Check file descriptor /proc/self/fd/4 pointing to anon_inode:[eventpoll]
DEBUG   [U=1000,P=5653]    cleanup_fd()                  Closing /proc/self/fd/4
DEBUG   [U=1000,P=5653]    cleanup_fd()                  Check file descriptor /proc/self/fd/5 pointing to /tmp/rootfs-490992350
VERBOSE [U=1000,P=5653]    user_namespace_init()         Create user namespace
DEBUG   [U=65534,P=5653]   setup_userns_mappings()       Write deny to set group file
DEBUG   [U=65534,P=5653]   setup_userns_mappings()       Write to GID map
DEBUG   [U=65534,P=5653]   setup_userns_mappings()       Write to UID map
VERBOSE [U=1000,P=5653]    create_namespace()            Create mount namespace
DEBUG   [U=1000,P=5653]    init()                        Create RPC socketpair for communication between stage 2 and RPC server
VERBOSE [U=1000,P=5653]    init()                        Spawn master process
DEBUG   [U=1000,P=16013]   set_parent_death_signal()     Set parent death signal to 9
VERBOSE [U=1000,P=16013]   create_namespace()            Create mount namespace
DEBUG   [U=1000,P=16013]   set_parent_death_signal()     Set parent death signal to 9
DEBUG   [U=1000,P=16013]   prepare_stage()               Entering in stage 2
VERBOSE [U=1000,P=16014]   init()                        Spawn RPC server
VERBOSE [U=1000,P=16014]   startup()                     Serve RPC requests
VERBOSE [U=1000,P=5653]    startup()                     Execute master process
DEBUG   [U=1000,P=5653]    setupSessionLayout()          Attempting to use underlay (enable underlay = yes)
DEBUG   [U=1000,P=5653]    setupUnderlayLayout()         Creating underlay SESSIONDIR layout
DEBUG   [U=1000,P=5653]    addRootfsMount()              Mount rootfs in read-only mode
DEBUG   [U=1000,P=5653]    addRootfsMount()              Mounting directory rootfs: /tmp/rootfs-490992350
DEBUG   [U=1000,P=5653]    addKernelMount()              Checking configuration file for 'mount proc'
DEBUG   [U=1000,P=5653]    addKernelMount()              Adding proc to mount list
VERBOSE [U=1000,P=5653]    addKernelMount()              Default mount: /proc:/proc
DEBUG   [U=1000,P=5653]    addKernelMount()              Checking configuration file for 'mount sys'
DEBUG   [U=1000,P=5653]    addKernelMount()              Adding sysfs to mount list
VERBOSE [U=1000,P=5653]    addKernelMount()              Default mount: /sys:/sys
DEBUG   [U=1000,P=5653]    addDevMount()                 Checking configuration file for 'mount dev'
DEBUG   [U=1000,P=5653]    addDevMount()                 Adding dev to mount list
VERBOSE [U=1000,P=5653]    addDevMount()                 Default mount: /dev:/dev
DEBUG   [U=1000,P=5653]    addHostMount()                Not mounting host file systems per configuration
VERBOSE [U=1000,P=5653]    addBindsMount()               Found 'bind path' = /etc/localtime, /etc/localtime
VERBOSE [U=1000,P=5653]    addBindsMount()               Found 'bind path' = /etc/hosts, /etc/hosts
DEBUG   [U=1000,P=5653]    addHomeStagingDir()           Staging home directory (/home/boinc) at /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc
DEBUG   [U=1000,P=5653]    addHomeMount()                Adding home directory mount [/cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc:/home/boinc] to list using layer: underlay
DEBUG   [U=1000,P=5653]    isLayerEnabled()              Using Layer system: underlay
DEBUG   [U=1000,P=5653]    addUserbindsMount()           Adding /cvmfs to mount list
DEBUG   [U=1000,P=5653]    addUserbindsMount()           Checking for 'user bind control' in configuration file
DEBUG   [U=1000,P=5653]    addTmpMount()                 Checking for 'mount tmp' in configuration file
VERBOSE [U=1000,P=5653]    addTmpMount()                 Default mount: /tmp:/tmp
VERBOSE [U=1000,P=5653]    addTmpMount()                 Default mount: /var/tmp:/var/tmp
DEBUG   [U=1000,P=5653]    addScratchMount()             Not mounting scratch directory: Not requested
VERBOSE [U=1000,P=5653]    addCwdMount()                 Default mount: /home/boinc: to the container
DEBUG   [U=1000,P=5653]    addLibsMount()                Checking for 'user bind control' in configuration file
DEBUG   [U=1000,P=5653]    addResolvConfMount()          Adding /etc/resolv.conf to mount list
VERBOSE [U=1000,P=5653]    addResolvConfMount()          Default mount: /etc/resolv.conf:/etc/resolv.conf
DEBUG   [U=1000,P=5653]    addHostnameMount()            Skipping hostname mount, not virtualizing UTS namespace on user request
DEBUG   [U=1000,P=5653]    create()                      Mount all
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting tmpfs to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /tmp/rootfs-490992350 to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/.singularity.d to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/.singularity.d
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/alrb to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/alrb
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/anaconda-post.log to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/anaconda-post.log
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/cvmfs to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/cvmfs
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/dev to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/dev
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/docker-creation-date to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/docker-creation-date
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/etc to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/etc
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/gpfs to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/gpfs
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/media to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/media
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/mnt to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/mnt
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/opt to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/opt
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/proc to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/proc
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/root to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/root
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/run to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/run
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/scratch to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/scratch
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/singularity-creation-date to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/singularity-creation-date
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/srv to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/srv
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/sys to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/sys
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/tmp to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/tmp
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/usr to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/usr
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/var to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/var
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final
DEBUG   [U=1000,P=5653]    mountGeneric()                Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final
DEBUG   [U=1000,P=5653]    setPropagationMount()         Set RPC mount propagation flag to SLAVE
VERBOSE [U=1000,P=5653]    Passwd()                      Checking for template passwd file: /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/etc/passwd
VERBOSE [U=1000,P=5653]    Passwd()                      Creating passwd content
VERBOSE [U=1000,P=5653]    Passwd()                      Creating template passwd file and appending user data: /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/etc/passwd
DEBUG   [U=1000,P=5653]    addIdentityMount()            Adding /etc/passwd to mount list
VERBOSE [U=1000,P=5653]    addIdentityMount()            Default mount: /etc/passwd:/etc/passwd
VERBOSE [U=1000,P=5653]    Group()                       Checking for template group file: /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/etc/group
VERBOSE [U=1000,P=5653]    Group()                       Creating group content
DEBUG   [U=1000,P=5653]    addIdentityMount()            Adding /etc/group to mount list
VERBOSE [U=1000,P=5653]    addIdentityMount()            Default mount: /etc/group:/etc/group
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /dev to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/dev
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /etc/localtime to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/usr/share/zoneinfo/UTC
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /etc/hosts to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/etc/hosts
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/etc/singularity/actions to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/.singularity.d/actions
DEBUG   [U=1000,P=5653]    mountGeneric()                Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/.singularity.d/actions
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /proc to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/proc
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /sys to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/sys
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /home/boinc to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc
DEBUG   [U=1000,P=5653]    mountGeneric()                Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/home/boinc
DEBUG   [U=1000,P=5653]    mountGeneric()                Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/home/boinc
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /tmp to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/tmp
DEBUG   [U=1000,P=5653]    mountGeneric()                Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/tmp
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /var/tmp to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/var/tmp
DEBUG   [U=1000,P=5653]    mountGeneric()                Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/var/tmp
DEBUG   [U=1000,P=5653]    mountGeneric()                Skipping mount /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/home/boinc, /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/home/boinc already mounted
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/etc/resolv.conf to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/etc/resolv.conf
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/etc/passwd to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/etc/passwd
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/etc/group to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/etc/group
DEBUG   [U=1000,P=5653]    mountGeneric()                Mounting /cvmfs to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/cvmfs
DEBUG   [U=1000,P=5653]    mountGeneric()                Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/cvmfs
DEBUG   [U=1000,P=5653]    create()                      Chroot into /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final
DEBUG   [U=1000,P=16014]   Chroot()                      Change current directory to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final
DEBUG   [U=1000,P=16014]   Chroot()                      Hold reference to host / directory
DEBUG   [U=1000,P=16014]   Chroot()                      Called pivot_root on /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final
DEBUG   [U=1000,P=16014]   Chroot()                      Change current directory to host / directory
DEBUG   [U=1000,P=16014]   Chroot()                      Apply slave mount propagation for host / directory
DEBUG   [U=1000,P=16014]   Chroot()                      Called unmount(/, syscall.MNT_DETACH)
DEBUG   [U=1000,P=16014]   Chroot()                      Changing directory to / to avoid getpwd issues
DEBUG   [U=1000,P=5653]    create()                      Chdir into / to avoid errors
VERBOSE [U=1000,P=16013]   startup()                     Execute stage 2
DEBUG   [U=1000,P=16013]   Stage()                       Entering stage 2
DEBUG   [U=1000,P=5653]    PostStartProcess()            Post start process
boinc-z87
DEBUG   [U=1000,P=5653]    CleanupContainer()            Cleanup container
VERBOSE [U=1000,P=5653]    CleanupContainer()            Removing image /tmp/rootfs-490992350
INFO    [U=1000,P=5653]    CleanupContainer()            Cleaning up image...
DEBUG   [U=1000,P=5653]    Master()                      Child exited with exit status 0
boinc@boinc-z87:~$
ID: 40600 · Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jun 18
Posts: 126
Credit: 52,457,949
RAC: 23,953
Message 40614 - Posted: 23 Nov 2019, 16:55:51 UTC
Last modified: 23 Nov 2019, 17:12:58 UTC

Should clients be adding a line to our ATLAS app_config files???
Would better be asked in the ATLAS threads.
The lower the #threads the more efficient an ATLAS task will be.
2 reasons lead to higher #threads:
- ATLAS (vbox) requires lots of RAM per task
- less #threads ==> higher overall runtimes

If your web preferences are set to "unlimited" then control the #threads using <avg_ncpus> in your app_config.xml
The server will set up the task as an n-core task with n = the number of reported CPUs but with an upper limit of 12.
This affects only ATLAS as meanwhile all other LHC@home apps are singlecore.
Might it look like this???
<app>
    <name>ATLAS</name>
    <app_version>
        <app_name>ATLAS</app_name>
        <plan_class>native_mt</plan_class>
        <avg_ncpus>4</avg_ncpus>
        <cmdline>--nthreads 4</cmdline>
    </app_version>
</app>
And is the last <cmdline> needed??? I saw it in my client_state file.
Edit: Guess not. I tried it with Preferences set to No Limit/No Limit and it DLed ten 12c ATLAS WUs.
Edit 2: From my client_state after rebooting:
<app_version>
    <app_name>ATLAS</app_name>
    <version_num>273</version_num>
    <platform>x86_64-pc-linux-gnu</platform>
    <avg_ncpus>12.000000</avg_ncpus>
    <flops>934943727.616815</flops>
    <plan_class>native_mt</plan_class>
    <api_version>7.7.0</api_version>
    <cmdline>--nthreads 12</cmdline>

ID: 40614 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,995,889
RAC: 136,270
Message 40617 - Posted: 23 Nov 2019, 18:07:08 UTC - in response to Message 40614.  

This would be a correct example:
<app_config>
  <app_version>
    <app_name>ATLAS</app_name>
    <plan_class>native_mt</plan_class>
    <avg_ncpus>2.0</avg_ncpus>
    <cmdline>--nthreads 2</cmdline>
  </app_version>
  <project_max_concurrent>2</project_max_concurrent>
  <report_results_immediately/>
</app_config>


It is important to strictly follow the template given here:
https://boinc.berkeley.edu/wiki/Client_configuration

Your example encloses the <app_version> tags with <app> tags what results in a malformed app_config.xml.
Beside that:
Did you post the complete file?
If yes then the <app_config> tags are missing.

Regarding <cmdline>--nthreads ... I'm not 100% sure if this is redundant.
Just try to only use <avg_ncpus> and check the stderr.txt of a freshly started ATLAS native task.
If the thread value there corresponds with <avg_ncpus> --nthreads would not be necessary.
ID: 40617 · Report as offensive     Reply Quote
Aurum
Avatar

Send message
Joined: 12 Jun 18
Posts: 126
Credit: 52,457,949
RAC: 23,953
Message 40618 - Posted: 23 Nov 2019, 18:24:18 UTC

Works like magic!!! DLed ten 4c WUs.
<app_config>
<app>
    <name>ATLAS</name>
</app>
<app_version>
    <app_name>ATLAS</app_name>
    <plan_class>native_mt</plan_class>
    <avg_ncpus>4.0</avg_ncpus>
    <cmdline>--nthreads 4</cmdline>
</app_version>
<app>
    <name>sixtrack</name>
</app>
<app>
    <name>TheoryN</name>
</app>
</app_config>
Clicked reboot before deleting nthreads. I'll test that on the next rig.
ID: 40618 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2386
Credit: 222,995,889
RAC: 136,270
Message 40621 - Posted: 23 Nov 2019, 19:29:57 UTC - in response to Message 40618.  

This can be removed if no options are set but it doesn't hurt if you don't delete it.
<app>
    <name>sixtrack</name>
</app>
<app>
    <name>TheoryN</name>
</app>
ID: 40621 · Report as offensive     Reply Quote
1 · 2 · 3 · 4 · Next

Message boards : ATLAS application : ATLAS native version 2.73


©2024 CERN