Message boards :
CMS Application :
New version v47.80
Message board moderation
Author | Message |
---|---|
Send message Joined: 20 Jun 14 Posts: 381 Credit: 238,712 RAC: 0 |
This new version contains a configuration improvement for CVMFS which will hopefully result in the VMs booting quicker. |
Send message Joined: 18 Dec 15 Posts: 1835 Credit: 120,823,821 RAC: 79,586 |
hm, on December 6, 2017, you wrote exactly the same for the new version 47.70. What's the difference now between 47.70 and 47.80? |
Send message Joined: 15 Jun 08 Posts: 2563 Credit: 257,112,605 RAC: 112,922 |
I got the new vdi file on 1 of my hosts and it runs fine so far. What makes me wonder is that the filename codes a date before xmas (CMS_2017_12_20.vdi). It looks like the distribution of this version was postponed until today, was it? According to my network logs the this version introduces a couple of new CVMFS communication domains: s1bnl-cvmfs.openhtc.io s1cern-cvmfs.openhtc.io s1fnal-cvmfs.openhtc.io s1ral-cvmfs.openhtc.io Is this the expected change? Cheers |
Send message Joined: 20 Jun 14 Posts: 381 Credit: 238,712 RAC: 0 |
Version 47.70 didn't work as expected to we had to do a few more configuration changes. |
Send message Joined: 20 Jun 14 Posts: 381 Credit: 238,712 RAC: 0 |
Yes. This should now use a content delivery network so the proxies used for the file downloads should be closer and hence improve the performance of CVMFS. |
Send message Joined: 18 Dec 15 Posts: 1835 Credit: 120,823,821 RAC: 79,586 |
Thanks, Laurence, for the information :-) |
Send message Joined: 15 Jun 08 Posts: 2563 Credit: 257,112,605 RAC: 112,922 |
Meanwhile I got a couple of CMS WUs. 1st phase until cmsRun is completely set up needs less than 4:45 min. No obvious errors. Good job Laurence. |
Send message Joined: 20 Jun 14 Posts: 381 Credit: 238,712 RAC: 0 |
I will have to go through the results now to measure the performance improvement. |
Send message Joined: 15 Jun 08 Posts: 2563 Credit: 257,112,605 RAC: 112,922 |
To avoid confusion you may find it useful to know what I mean when I write "cmsRun is completely set up". It's the moment when the download of http://cmsfrontier.cern.ch:8000/FrontierProd/Frontier/type=frontier_request:1:DEFAULT&encoding=BLOBzip5&p1=eNptiz0KgDAMRq8ScgBx6OogyWcVrCltQZ1y-1tYcXV9PxU7pBFrjgrPEZYUrTItxRKxpOpih3oIl78Srdw8sJXZ5cs72aQ-TP-0XFFAvClPND6pWB3l appears in the (tailed and filtered) download log. This download is like a lighthouse because - it's size is much larger compared to the downloads before - it's always at the end of a download series - it's the last download for a while - the CPU usage stays stable near 100% after the download Cheers |
Send message Joined: 29 Aug 05 Posts: 1065 Credit: 8,134,418 RAC: 13,358 |
|
Send message Joined: 18 Dec 15 Posts: 1835 Credit: 120,823,821 RAC: 79,586 |
this is not directly related to the recent version changes, but still I'd like to ask this question, out of curiosity: since some time ago (I dont's know exactly since when, I guess several weeks ago or so), the network traffic when running CMS tasks got reduced to about one third compared to what is was before. Not that I am complaining about this - although for me the higher traffic (about 20GB per day for 8 CMS tasks running concurrently) was no problem at all, having an unlimited flat rate with my ISP (150Mbits down, 15Mbits up). Whereas I am sure that crunchers with limited internet ressources will, of course, be very pleased. What exactly has been changed, technically, with the CMS tasks, causing this marked reduction in internet traffic? |
Send message Joined: 15 Jun 08 Posts: 2563 Credit: 257,112,605 RAC: 112,922 |
Is it upload or download? How do you measure CMS transfers compared to other transfers, e.g. LHCb or even non LHC projects? |
Send message Joined: 18 Dec 15 Posts: 1835 Credit: 120,823,821 RAC: 79,586 |
I am measuring the total traffic of each of my PCs with DUMeter. Of course, this tool does not differentiate between the various programs running and their share of the total traffic. However, when in my previous posting I was talking about approx. 20GB per day, this was mainly CMS. The only other project that is running on the same PC is GPUGRID, the up- and download figure of which is max. 0,5 GB per day. DUMeter shows up- and downloads seperately, and from what I remember, about 2/3 to 3/4 of the total volume was upload, the rest was download (about same situation as it is now). |
©2025 CERN