Message boards :
ATLAS application :
ATLAS native version 2.73
Message board moderation
Author | Message |
---|---|
Send message Joined: 13 May 14 Posts: 387 Credit: 15,314,184 RAC: 0 |
We just released 2.73 which has the following improvements: A better check whether singularity is installed, by looking for it in the PATH instead of running it and looking for "not found" in the output. Thanks to computezrmle for pointing out the problems with the old approach Logging of stderr messages when the main singularity command fails Logging of error codes from the ATLAS pilot (like is done in the vbox version) |
Send message Joined: 15 Nov 14 Posts: 602 Credit: 24,371,321 RAC: 0 |
After wiping out my Ubuntu machine and starting from scratch, 2.73 is working fine for me. I installed only CVMFS, and didn't do anything more with Singularity. https://lhcathome.cern.ch/lhcathome/results.php?hostid=10618939 But I see that a lot of other people have errors on 2.72 that were like mine. That is, both CVMFS and Singularity seem to be installed OK, but they get errors, typically "195 (0x000000C3) EXIT_CHILD_FAILED". So there is some hidden incompatibility it would seem. Everyone may need to start over if it can't be identified. |
Send message Joined: 2 May 07 Posts: 2071 Credit: 156,179,989 RAC: 105,256 |
Seem that native Atlas get work now, Cern-(Agile Boincers) is running native Atlas. |
Send message Joined: 7 Jan 07 Posts: 41 Credit: 15,959,427 RAC: 271 |
On my Debian GNU/Linux 9.11 (stretch), I have needed to install this missing package : squashfs-tools |
Send message Joined: 12 Jun 18 Posts: 126 Credit: 52,457,949 RAC: 23,953 |
I've been trying to Native DL ATLAS WUs. Server status says there are 1000s but unlike Theory it does separate native from the VB version. Maybe there are no native ATLAS WUs available. My OS is Linux Mint 19.2 and the Additional Repositories lists two versions: CERN / bionic-prod and CERN / bionic-testing. The first was checked so I also checked the second. Not sure I'm supposed to use just one of them or both. I also ran: sudo cvmfs_config reload How can I know if I'm ready for 2.73??? Edit: I did not have the Run Test Applications box checked in my LHC Preferences. Now I'm starting to get some. |
Send message Joined: 12 Jun 18 Posts: 126 Credit: 52,457,949 RAC: 23,953 |
All ATLAS 2.73 WUs are failing: <core_client_version>7.9.3</core_client_version> <![CDATA[ <message> process exited with code 195 (0xc3, -61)</message> <stderr_txt> 12:08:47 (19257): wrapper (7.7.26015): starting 12:08:47 (19257): wrapper: running run_atlas (--nthreads 4) 2019-11-14 12:08:47,929: singularity image is /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img 2019-11-14 12:08:47,929: sys.argv = ['run_atlas', '--nthreads', '4'] 2019-11-14 12:08:47,930: THREADS=4 2019-11-14 12:08:47,931: Checking for CVMFS 2019-11-14 12:08:51,037: CVMFS is installed 2019-11-14 12:08:51,038: Checking for singularity binary... 2019-11-14 12:08:51,038: Found singularity at /usr/local/bin/singularity 2019-11-14 12:08:51,038: Running singularity --version 2019-11-14 12:08:51,050: Singularity version is 2.6.0-dist 2019-11-14 12:08:51,050: Testing the function of Singularity... 2019-11-14 12:08:51,050: Checking singularity with cmd:singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img hostname 2019-11-14 12:08:51,074: Singularity isnt working: [91mERROR : Unknown image format/type: /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img [0m[31mABORT : Retval = 255 [0m 2019-11-14 12:08:53,085: running start_atlas return value is 3 2019-11-14 12:18:53,129: parent process exit 3 2019-11-14 12:18:53,130: child process exit 3 12:18:54 (19257): run_atlas exited; CPU time 0.692866 12:18:54 (19257): app exit status: 0x3 12:18:54 (19257): called boinc_finish(195) </stderr_txt>]]> |
Send message Joined: 15 Jun 08 Posts: 2386 Credit: 222,995,889 RAC: 136,270 |
Fortunately you posted the relevant logfile line although it would be better to keep the posts short and make the hosts visible: 2019-11-14 12:08:51,050: Singularity version is 2.6.0-dist ATLAS' singularity image requires singularity v3.x If you don't need singularity to run other containers the best solution would be to completely remove it. This would force ATLAS to run the correct singularity version from CVMFS. |
Send message Joined: 12 Jun 18 Posts: 126 Credit: 52,457,949 RAC: 23,953 |
Thanks. Nice avatar. Do I just delete my /home/aurum/singularity-2.6.0 folder or do I need to run a command ??? I also run native Theory. Does it need singularity 2.6 ??? |
Send message Joined: 15 Jun 08 Posts: 2386 Credit: 222,995,889 RAC: 136,270 |
Do I just delete my /home/aurum/singularity-2.6.0 folder or do I need to run a command ??? See this post: https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5161&postid=40129 You may also follow the link mentioned there. I also run native Theory. Does it need singularity 2.6 ??? No. Theory just needs a running CVMFS client. |
Send message Joined: 12 Jun 18 Posts: 126 Credit: 52,457,949 RAC: 23,953 |
Below I list the steps I used to update native LHC applications. It's been running better than I've seen before and plays nice with others. I'm running native ATLAS, native Theory, Sixtrack plus running out Universe WUs and they time-slice in an orderly manner. Since updating I have not had a single native ATLAS WU fail and all but one are valid. For reinstalls: Delete the folder singularity-2.6.0 and also: sudo rm -rf \ /usr/local/libexec/singularity \ /usr/local/var/singularity \ /usr/local/etc/singularity \ /usr/local/bin/singularity \ /usr/local/bin/run-singularity \ /usr/local/etc/bash_completion.d/singularity For new & reinstalls: wget https://ecsft.cern.ch/dist/cvmfs/cvmfs-release/cvmfs-release-latest_all.deb ; sudo dpkg -i cvmfs-release-latest_all.deb ; rm -f cvmfs-release-latest_all.deb ; sudo apt-get update ; sudo apt-get install cvmfs ; sudo apt install glibc-doc open-iscsi watchdog sudo wget https://lhcathomedev.cern.ch/lhcathome-dev/download/default.local -O /etc/cvmfs/default.local ; sudo cvmfs_config setup ; sudo echo "/cvmfs /etc/auto.cvmfs" > /etc/auto.master.d/cvmfs.autofs ; sudo systemctl restart autofs ; cvmfs_config probe sudo cvmfs_config reload No longer needed: wget https://github.com/singularityware/singularity/releases/download/2.6.0/singularity-2.6.0.tar.gz ; tar xvf singularity-2.6.0.tar.gz ; cd singularity-2.6.0 ; sudo apt install libarchive-dev ; ./configure --prefix=/usr/local ; make ; sudo make install sudo xed /etc/cvmfs/default.local CVMFS_SEND_INFO_HEADER=yes sudo xed /etc/cvmfs/domain.d/cern.ch.local CVMFS_SERVER_URL="http://s1cern-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1ral-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1bnl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1fnal-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1unl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1asgc-cvmfs.openhtc.io:8080/cvmfs/@fqrn@;http://s1ihep-cvmfs.openhtc.io/cvmfs/@fqrn@" |
Send message Joined: 15 Nov 14 Posts: 602 Credit: 24,371,321 RAC: 0 |
I find that the way I install BOINC from the repository (Ubuntu 18.04), I need to again grant permissions to the boinc-client folder after all the CVMFS files are installed, or native ATLAS won't function. sudo chmod -R 777 /var/lib/boinc-client |
Send message Joined: 15 Nov 14 Posts: 602 Credit: 24,371,321 RAC: 0 |
No longer needed: I normally include these, and wonder what difference it makes if I leave them out. I am not using a local proxy, and maybe they still help? |
Send message Joined: 15 Jun 08 Posts: 2386 Credit: 222,995,889 RAC: 136,270 |
No longer needed: /etc/cvmfs/default.local CVMFS_SEND_INFO_HEADER=yes You will not see any difference if you switch it "off" but it's a requirement from Dave Dykstra (Fermilab) that this is set to "yes". As far as I understand this helps Cloudflare and CERN/Fermilab to identify errors and to optimize their internal settings. /etc/cvmfs/domain.d/cern.ch.local CVMFS_SERVER_URL="http://s1cern-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1ral-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1bnl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1fnal-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1unl-cvmfs.openhtc.io/cvmfs/@fqrn@;http://s1asgc-cvmfs.openhtc.io:8080/cvmfs/@fqrn@;http://s1ihep-cvmfs.openhtc.io/cvmfs/@fqrn@" This list defines which server your local CVMFS client will ask for files stored at the *.cern.ch repositories. Under normal circumstances all of them point to the same "nearest" Cloudflare server but the names map the stratum 1 server that Cloudflare asks for data if their cache has a miss. Keeping all of them in the list makes sense since they are automatically used as failover routes. |
Send message Joined: 15 Nov 14 Posts: 602 Credit: 24,371,321 RAC: 0 |
Thanks. I was hoping to get your opinion. I now am putting native ATLAS, native Theory and SixTrack all together on a Ryzen 3700x, and am just getting it set up, so I want to do it as right as possible. |
Send message Joined: 12 Jun 18 Posts: 126 Credit: 52,457,949 RAC: 23,953 |
No longer needed:To clarify, I only meant that the commands to install 2.73 in For new & reinstalls: created them and there is no need for me to create them myself. |
Send message Joined: 8 May 17 Posts: 13 Credit: 37,406,902 RAC: 28,075 |
Any idea what could be the issue here ? https://lhcathome.cern.ch/lhcathome/result.php?resultid=252658162 2019-11-22 15:36:27,522: Checking singularity with cmd:/cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/current/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img hostname 2019-11-22 15:37:43,370: Singularity isnt working: [34mINFO: [0m Convert SIF file to sandbox... [34mINFO: [0m Cleaning up image... [31mFATAL: [0m container creation failed: mount ->/cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc error: can't remount /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc: invalid argument 2019-11-22 15:37:45,377: running start_atlas return value is 3 2019-11-22 15:47:45,448: parent process exit 3 2019-11-22 15:47:45,449: child process exit 3 Yet if I manually try to execute this command line boinc@boinc-z87:~$ /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/current/bin/singularity --debug exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img hostname VERBOSE [U=1000,P=5653] execStarter() starter-suid not found, using user namespace VERBOSE [U=1000,P=5653] execStarter() User namespace requested, convert image /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img to sandbox INFO [U=1000,P=5653] execStarter() Convert SIF file to sandbox... DEBUG [U=1000,P=5653] Init() Entering image format intializer DEBUG [U=1000,P=5653] Init() Check for image format sif VERBOSE [U=1000,P=5653] print() Set messagelevel to: 5 DEBUG [U=1000,P=5653] init() PIPE_EXEC_FD value: 7 VERBOSE [U=1000,P=5653] init() Container runtime VERBOSE [U=1000,P=5653] is_suid() Check if we are running as setuid DEBUG [U=1000,P=5653] init() Read json configuration from pipe DEBUG [U=1000,P=5653] init() Set child signal mask DEBUG [U=1000,P=5653] init() Wait completion of stage1 DEBUG [U=1000,P=15975] set_parent_death_signal() Set parent death signal to 9 VERBOSE [U=1000,P=15975] init() Spawn stage 1 VERBOSE [U=1000,P=15975] startup() Execute stage 1 DEBUG [U=1000,P=15975] Stage() Entering stage 1 DEBUG [U=1000,P=15975] prepareFd() Open file descriptor for /cvmfs DEBUG [U=1000,P=15975] Init() Entering image format intializer DEBUG [U=1000,P=15975] Init() Check for image format sif DEBUG [U=1000,P=15975] Init() sif format initializer returns: not a SIF file image DEBUG [U=1000,P=15975] Init() Check for image format sandbox DEBUG [U=1000,P=5653] init() Create socketpair for master communication channel DEBUG [U=1000,P=5653] cleanup_fd() Check file descriptor /proc/self/fd/3 pointing to /cvmfs DEBUG [U=1000,P=5653] cleanup_fd() Check file descriptor /proc/self/fd/4 pointing to anon_inode:[eventpoll] DEBUG [U=1000,P=5653] cleanup_fd() Closing /proc/self/fd/4 DEBUG [U=1000,P=5653] cleanup_fd() Check file descriptor /proc/self/fd/5 pointing to /tmp/rootfs-490992350 VERBOSE [U=1000,P=5653] user_namespace_init() Create user namespace DEBUG [U=65534,P=5653] setup_userns_mappings() Write deny to set group file DEBUG [U=65534,P=5653] setup_userns_mappings() Write to GID map DEBUG [U=65534,P=5653] setup_userns_mappings() Write to UID map VERBOSE [U=1000,P=5653] create_namespace() Create mount namespace DEBUG [U=1000,P=5653] init() Create RPC socketpair for communication between stage 2 and RPC server VERBOSE [U=1000,P=5653] init() Spawn master process DEBUG [U=1000,P=16013] set_parent_death_signal() Set parent death signal to 9 VERBOSE [U=1000,P=16013] create_namespace() Create mount namespace DEBUG [U=1000,P=16013] set_parent_death_signal() Set parent death signal to 9 DEBUG [U=1000,P=16013] prepare_stage() Entering in stage 2 VERBOSE [U=1000,P=16014] init() Spawn RPC server VERBOSE [U=1000,P=16014] startup() Serve RPC requests VERBOSE [U=1000,P=5653] startup() Execute master process DEBUG [U=1000,P=5653] setupSessionLayout() Attempting to use underlay (enable underlay = yes) DEBUG [U=1000,P=5653] setupUnderlayLayout() Creating underlay SESSIONDIR layout DEBUG [U=1000,P=5653] addRootfsMount() Mount rootfs in read-only mode DEBUG [U=1000,P=5653] addRootfsMount() Mounting directory rootfs: /tmp/rootfs-490992350 DEBUG [U=1000,P=5653] addKernelMount() Checking configuration file for 'mount proc' DEBUG [U=1000,P=5653] addKernelMount() Adding proc to mount list VERBOSE [U=1000,P=5653] addKernelMount() Default mount: /proc:/proc DEBUG [U=1000,P=5653] addKernelMount() Checking configuration file for 'mount sys' DEBUG [U=1000,P=5653] addKernelMount() Adding sysfs to mount list VERBOSE [U=1000,P=5653] addKernelMount() Default mount: /sys:/sys DEBUG [U=1000,P=5653] addDevMount() Checking configuration file for 'mount dev' DEBUG [U=1000,P=5653] addDevMount() Adding dev to mount list VERBOSE [U=1000,P=5653] addDevMount() Default mount: /dev:/dev DEBUG [U=1000,P=5653] addHostMount() Not mounting host file systems per configuration VERBOSE [U=1000,P=5653] addBindsMount() Found 'bind path' = /etc/localtime, /etc/localtime VERBOSE [U=1000,P=5653] addBindsMount() Found 'bind path' = /etc/hosts, /etc/hosts DEBUG [U=1000,P=5653] addHomeStagingDir() Staging home directory (/home/boinc) at /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc DEBUG [U=1000,P=5653] addHomeMount() Adding home directory mount [/cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc:/home/boinc] to list using layer: underlay DEBUG [U=1000,P=5653] isLayerEnabled() Using Layer system: underlay DEBUG [U=1000,P=5653] addUserbindsMount() Adding /cvmfs to mount list DEBUG [U=1000,P=5653] addUserbindsMount() Checking for 'user bind control' in configuration file DEBUG [U=1000,P=5653] addTmpMount() Checking for 'mount tmp' in configuration file VERBOSE [U=1000,P=5653] addTmpMount() Default mount: /tmp:/tmp VERBOSE [U=1000,P=5653] addTmpMount() Default mount: /var/tmp:/var/tmp DEBUG [U=1000,P=5653] addScratchMount() Not mounting scratch directory: Not requested VERBOSE [U=1000,P=5653] addCwdMount() Default mount: /home/boinc: to the container DEBUG [U=1000,P=5653] addLibsMount() Checking for 'user bind control' in configuration file DEBUG [U=1000,P=5653] addResolvConfMount() Adding /etc/resolv.conf to mount list VERBOSE [U=1000,P=5653] addResolvConfMount() Default mount: /etc/resolv.conf:/etc/resolv.conf DEBUG [U=1000,P=5653] addHostnameMount() Skipping hostname mount, not virtualizing UTS namespace on user request DEBUG [U=1000,P=5653] create() Mount all DEBUG [U=1000,P=5653] mountGeneric() Mounting tmpfs to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session DEBUG [U=1000,P=5653] mountGeneric() Mounting /tmp/rootfs-490992350 to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/.singularity.d to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/.singularity.d DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/alrb to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/alrb DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/anaconda-post.log to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/anaconda-post.log DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/cvmfs to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/cvmfs DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/dev to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/dev DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/docker-creation-date to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/docker-creation-date DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/etc to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/etc DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/gpfs to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/gpfs DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/media to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/media DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/mnt to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/mnt DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/opt to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/opt DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/proc to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/proc DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/root to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/root DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/run to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/run DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/scratch to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/scratch DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/singularity-creation-date to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/singularity-creation-date DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/srv to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/srv DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/sys to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/sys DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/tmp to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/tmp DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/usr to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/usr DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/var to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay/var DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/underlay to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final DEBUG [U=1000,P=5653] mountGeneric() Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final DEBUG [U=1000,P=5653] setPropagationMount() Set RPC mount propagation flag to SLAVE VERBOSE [U=1000,P=5653] Passwd() Checking for template passwd file: /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/etc/passwd VERBOSE [U=1000,P=5653] Passwd() Creating passwd content VERBOSE [U=1000,P=5653] Passwd() Creating template passwd file and appending user data: /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/etc/passwd DEBUG [U=1000,P=5653] addIdentityMount() Adding /etc/passwd to mount list VERBOSE [U=1000,P=5653] addIdentityMount() Default mount: /etc/passwd:/etc/passwd VERBOSE [U=1000,P=5653] Group() Checking for template group file: /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/rootfs/etc/group VERBOSE [U=1000,P=5653] Group() Creating group content DEBUG [U=1000,P=5653] addIdentityMount() Adding /etc/group to mount list VERBOSE [U=1000,P=5653] addIdentityMount() Default mount: /etc/group:/etc/group DEBUG [U=1000,P=5653] mountGeneric() Mounting /dev to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/dev DEBUG [U=1000,P=5653] mountGeneric() Mounting /etc/localtime to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/usr/share/zoneinfo/UTC DEBUG [U=1000,P=5653] mountGeneric() Mounting /etc/hosts to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/etc/hosts DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/etc/singularity/actions to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/.singularity.d/actions DEBUG [U=1000,P=5653] mountGeneric() Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/.singularity.d/actions DEBUG [U=1000,P=5653] mountGeneric() Mounting /proc to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/proc DEBUG [U=1000,P=5653] mountGeneric() Mounting /sys to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/sys DEBUG [U=1000,P=5653] mountGeneric() Mounting /home/boinc to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc DEBUG [U=1000,P=5653] mountGeneric() Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/home/boinc to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/home/boinc DEBUG [U=1000,P=5653] mountGeneric() Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/home/boinc DEBUG [U=1000,P=5653] mountGeneric() Mounting /tmp to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/tmp DEBUG [U=1000,P=5653] mountGeneric() Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/tmp DEBUG [U=1000,P=5653] mountGeneric() Mounting /var/tmp to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/var/tmp DEBUG [U=1000,P=5653] mountGeneric() Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/var/tmp DEBUG [U=1000,P=5653] mountGeneric() Skipping mount /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/home/boinc, /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/home/boinc already mounted DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/etc/resolv.conf to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/etc/resolv.conf DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/etc/passwd to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/etc/passwd DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/etc/group to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/etc/group DEBUG [U=1000,P=5653] mountGeneric() Mounting /cvmfs to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/cvmfs DEBUG [U=1000,P=5653] mountGeneric() Remounting /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final/cvmfs DEBUG [U=1000,P=5653] create() Chroot into /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final DEBUG [U=1000,P=16014] Chroot() Change current directory to /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final DEBUG [U=1000,P=16014] Chroot() Hold reference to host / directory DEBUG [U=1000,P=16014] Chroot() Called pivot_root on /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/3.2.1/var/singularity/mnt/session/final DEBUG [U=1000,P=16014] Chroot() Change current directory to host / directory DEBUG [U=1000,P=16014] Chroot() Apply slave mount propagation for host / directory DEBUG [U=1000,P=16014] Chroot() Called unmount(/, syscall.MNT_DETACH) DEBUG [U=1000,P=16014] Chroot() Changing directory to / to avoid getpwd issues DEBUG [U=1000,P=5653] create() Chdir into / to avoid errors VERBOSE [U=1000,P=16013] startup() Execute stage 2 DEBUG [U=1000,P=16013] Stage() Entering stage 2 DEBUG [U=1000,P=5653] PostStartProcess() Post start process boinc-z87 DEBUG [U=1000,P=5653] CleanupContainer() Cleanup container VERBOSE [U=1000,P=5653] CleanupContainer() Removing image /tmp/rootfs-490992350 INFO [U=1000,P=5653] CleanupContainer() Cleaning up image... DEBUG [U=1000,P=5653] Master() Child exited with exit status 0 boinc@boinc-z87:~$ |
Send message Joined: 12 Jun 18 Posts: 126 Credit: 52,457,949 RAC: 23,953 |
Might it look like this???Should clients be adding a line to our ATLAS app_config files???Would better be asked in the ATLAS threads. <app> <name>ATLAS</name> <app_version> <app_name>ATLAS</app_name> <plan_class>native_mt</plan_class> <avg_ncpus>4</avg_ncpus> <cmdline>--nthreads 4</cmdline> </app_version> </app>And is the last <cmdline> needed??? I saw it in my client_state file. Edit: Guess not. I tried it with Preferences set to No Limit/No Limit and it DLed ten 12c ATLAS WUs. Edit 2: From my client_state after rebooting: <app_version> <app_name>ATLAS</app_name> <version_num>273</version_num> <platform>x86_64-pc-linux-gnu</platform> <avg_ncpus>12.000000</avg_ncpus> <flops>934943727.616815</flops> <plan_class>native_mt</plan_class> <api_version>7.7.0</api_version> <cmdline>--nthreads 12</cmdline> |
Send message Joined: 15 Jun 08 Posts: 2386 Credit: 222,995,889 RAC: 136,270 |
This would be a correct example: <app_config> <app_version> <app_name>ATLAS</app_name> <plan_class>native_mt</plan_class> <avg_ncpus>2.0</avg_ncpus> <cmdline>--nthreads 2</cmdline> </app_version> <project_max_concurrent>2</project_max_concurrent> <report_results_immediately/> </app_config> It is important to strictly follow the template given here: https://boinc.berkeley.edu/wiki/Client_configuration Your example encloses the <app_version> tags with <app> tags what results in a malformed app_config.xml. Beside that: Did you post the complete file? If yes then the <app_config> tags are missing. Regarding <cmdline>--nthreads ... I'm not 100% sure if this is redundant. Just try to only use <avg_ncpus> and check the stderr.txt of a freshly started ATLAS native task. If the thread value there corresponds with <avg_ncpus> --nthreads would not be necessary. |
Send message Joined: 12 Jun 18 Posts: 126 Credit: 52,457,949 RAC: 23,953 |
Works like magic!!! DLed ten 4c WUs. <app_config> <app> <name>ATLAS</name> </app> <app_version> <app_name>ATLAS</app_name> <plan_class>native_mt</plan_class> <avg_ncpus>4.0</avg_ncpus> <cmdline>--nthreads 4</cmdline> </app_version> <app> <name>sixtrack</name> </app> <app> <name>TheoryN</name> </app> </app_config>Clicked reboot before deleting nthreads. I'll test that on the next rig. |
Send message Joined: 15 Jun 08 Posts: 2386 Credit: 222,995,889 RAC: 136,270 |
This can be removed if no options are set but it doesn't hurt if you don't delete it. <app> <name>sixtrack</name> </app> <app> <name>TheoryN</name> </app> |
©2024 CERN