Message boards : CMS Application : New version v47.70
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Laurence
Project administrator
Project developer

Send message
Joined: 20 Jun 14
Posts: 335
Credit: 237,918
RAC: 0
Message 33215 - Posted: 6 Dec 2017, 10:31:26 UTC

This new version contains a configuration improvement for CVMFS which will hopefully result in the VMs booting quicker.
ID: 33215 · Report as offensive     Reply Quote
Profile MAGIC Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 919
Credit: 39,377,007
RAC: 4,199
Message 33216 - Posted: 6 Dec 2017, 10:56:52 UTC - in response to Message 33215.  

Thanks Laurence,I'll give it a try right now.
ID: 33216 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1255
Credit: 22,993,374
RAC: 3,505
Message 33217 - Posted: 6 Dec 2017, 10:57:14 UTC - in response to Message 33215.  

Thanks, Laurence, for the Information.
I was wondering anyway when CMS_2017_11_30.vdi was downloading a few minutes ago :-)

Question: can the file CMS_2017_10_31.vdi now be deleted from the LHC project folder?
ID: 33217 · Report as offensive     Reply Quote
Crystal Pellet
Volunteer moderator
Volunteer tester

Send message
Joined: 14 Jan 10
Posts: 932
Credit: 6,284,444
RAC: 719
Message 33219 - Posted: 6 Dec 2017, 18:20:27 UTC - in response to Message 33217.  
Last modified: 6 Dec 2017, 18:21:00 UTC

Question: can the file CMS_2017_10_31.vdi now be deleted from the LHC project folder?

The deletion of that file should be initiated by the project.
If it's still mentioned in client_state.xml and you delete it manually, it will be downloaded again from the server.
ID: 33219 · Report as offensive     Reply Quote
Profile MAGIC Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 919
Credit: 39,377,007
RAC: 4,199
Message 33220 - Posted: 6 Dec 2017, 18:36:47 UTC

I aborted all the CMS tasks I had from the previous version v47.60

And as you can imagine since the vdi is almost 1GB and I am d/ling it on 3 of my newer 8-core pc's it is going to take a long time to do this d/l (so far about 6hrs to get to 35% each) (982.17MB each) approx. 16hrs each to d/l)

but I'm used to this.

Now I could most likely do this faster if I did this at the start of my contracts month via satellite when my speed is much faster......but then it would use up that data d/l speed which I need and use to start all these tasks........as I have discussed many times over the last 7 years doing these VB tasks.(and as I said a squid would not help at all doing this)
Volunteer Mad Scientist For Life
ID: 33220 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jun 08
Posts: 1422
Credit: 72,663,601
RAC: 106,277
Message 33221 - Posted: 6 Dec 2017, 20:16:48 UTC

After a project reset the download of the project files cause permanent HTTP errors.
The reason may be a malformed URL (double slash after "/download").

Example:
<download_url>http://lhcathome-upload.cern.ch/lhcathome/download//CMS_2016_03_22.xml</download_url>
<error_msg>
permanent HTTP error
</error_msg>


I observe this at least for CMS and LHCb.
ID: 33221 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1255
Credit: 22,993,374
RAC: 3,505
Message 33222 - Posted: 7 Dec 2017, 8:52:45 UTC

two changes I am observing with v47.70 vice the former Version v47.60:

- the total runtime of a task is about double compared to what it was was before.

- the RAM usage is about 400-500MB higher than before (which, unfortunately, in case of one of my machines, makes it impossible to run CMS now).
ID: 33222 · Report as offensive     Reply Quote
Profile MAGIC Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 919
Credit: 39,377,007
RAC: 4,199
Message 33228 - Posted: 8 Dec 2017, 5:35:38 UTC

https://lhcathome.cern.ch/lhcathome/results.php?userid=5472&offset=0&show_names=0&state=0&appid=11

No problem with any of my CMS tasks with the new version.

(but I did have a fast internet connection at the time when I started all of them)
Volunteer Mad Scientist For Life
ID: 33228 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 415
Credit: 11,878,875
RAC: 4,033
Message 33229 - Posted: 8 Dec 2017, 6:28:03 UTC - in response to Message 33222.  
Last modified: 8 Dec 2017, 6:29:13 UTC

two changes I am observing with v47.70 vice the former Version v47.60:
- the total runtime of a task is about double compared to what it was was before.
- the RAM usage is about 400-500MB higher than before (which, unfortunately, in case of one of my machines, makes it impossible to run CMS now).

That is strange. The runtime is the same for both on my Ubuntu 16.04.3 machine (i7-4770), though the credit is higher for 47.70.
https://lhcathome.cern.ch/lhcathome/results.php?userid=437988&offset=0&show_names=0&state=0&appid=11

And the memory usage, as shown by BoincTasks, is the same for both: 2384.19 MB.
Depending on your mix of work, maybe the new ones need more cache memory and are slowing down your CPU?
ID: 33229 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1255
Credit: 22,993,374
RAC: 3,505
Message 33230 - Posted: 8 Dec 2017, 7:28:59 UTC

the things now are different than shown yesterday.

It turned out that the runtime for CMS tasks is about same as before (i.e. some 12,5 hours) - although the BOINC Manager still shows totally wrong times:
for a task that has run for 3 hours, the "remaining" time in the BOINC Manager is shown as 2 days and 6 hours. No idea what is the cause for this confusion.

Also the RAM usage, which yesterday was much higher than before, after the first task of the new Version 47.70 had started, is now back to normal.

However, what concerns higher credit as mentioned by Jim - this I cannot confirm, here it's about same as before.
ID: 33230 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 415
Credit: 11,878,875
RAC: 4,033
Message 33232 - Posted: 8 Dec 2017, 7:38:01 UTC - in response to Message 33230.  

However, what concerns higher credit as mentioned by Jim - this I cannot confirm, here it's about same as before.

Credit is a strange beast anyway. No one knows why it acts the way it does most of the time. It probably has something to do with the other people running the work too.
ID: 33232 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 914
Credit: 33,692,829
RAC: 8,158
Message 33233 - Posted: 8 Dec 2017, 7:48:21 UTC - in response to Message 33230.  

for a task that has run for 3 hours, the "remaining" time in the BOINC Manager is shown as 2 days and 6 hours. No idea what is the cause for this confusion.

This is always, when a new Software-Version is starting. The Boinc-System is learning the exact time in a few days. So no panic. All is good.
ID: 33233 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1255
Credit: 22,993,374
RAC: 3,505
Message 33236 - Posted: 8 Dec 2017, 8:31:33 UTC - in response to Message 33233.  

This is always, when a new Software-Version is starting. The Boinc-System is learning the exact time in a few days. So no panic. All is good.

thanks, maeax, that's what I was suspecting finally :-)

There is another thing, though, which worries me to some extent:
it has nothing to do with the new CMS version 47.70, buth rather with the new LHC graphic interface which is on since yesterday; so all LHC sub-projects are concerned:
in the individual web-page settings, the maximum number of tasks which can be chosen has been reduced to 8 - vice 24 before. No idea why this has been done, but I guess that some crunchers will not be too pleased with this.
ID: 33236 · Report as offensive     Reply Quote
Profile MAGIC Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 919
Credit: 39,377,007
RAC: 4,199
Message 33241 - Posted: 8 Dec 2017, 10:16:36 UTC

Well after having perfect new CMS tasks I did the new Windows 10 Updates version 1709 and now nothing works here and all my tasks are computer error after a few seconds. (on 5 computers)

So......I am now going to reinstall Oracle VB on all of them......after 2am ......oh boy.....
Volunteer Mad Scientist For Life
ID: 33241 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 914
Credit: 33,692,829
RAC: 8,158
Message 33243 - Posted: 8 Dec 2017, 10:33:13 UTC

Yes Magic,
two steps forward and one step back!

This is my experience with the new Windows update:

https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=4518
ID: 33243 · Report as offensive     Reply Quote
Profile MAGIC Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 919
Credit: 39,377,007
RAC: 4,199
Message 33249 - Posted: 8 Dec 2017, 16:51:25 UTC - in response to Message 33243.  

Sure is strange that people around the planet already did that particular Windows update over a month ago and I am less than 40 miles NW of Microsoft and they decided to send me the Update and have it crash on half my computers several times.

But I'm up 4 hours later so I guess I better go see it that Update d/l is past 5% yet
ID: 33249 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 654
Credit: 4,937,401
RAC: 747
Message 33813 - Posted: 12 Jan 2018, 16:59:11 UTC - in response to Message 33249.  

I'd send you some bandwidth if I could. Wednesday night I had 5.5 Mbps down/1.0 Mbps up. Last night I had 40/10! :-) ...and I'm paying less...
ID: 33813 · Report as offensive     Reply Quote

Message boards : CMS Application : New version v47.70


©2020 CERN