Message boards : News : Server upgrade - file uploads paused
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile Nils Høimyr
Volunteer moderator
Project administrator
Project developer
Project tester

Send message
Joined: 15 Jul 05
Posts: 242
Credit: 5,800,306
RAC: 0
Message 34726 - Posted: 26 Mar 2018, 6:23:52 UTC
Last modified: 26 Mar 2018, 7:24:05 UTC

We will change the storage back-end on our BOINC servers today, and the file servers will be disabled during the operation.

Hence your BOINC clients will get not be able to upload or download files from LHC@home today for a few hours. Once our maintenance operation is finished, BOINC clients will be able to upload again.

Thanks for your understanding and happy crunching!
ID: 34726 · Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 24 Oct 04
Posts: 1114
Credit: 49,501,728
RAC: 4,157
Message 34727 - Posted: 26 Mar 2018, 6:28:55 UTC - in response to Message 34726.  

Thanks for the news Nils

Mine are all loaded and ready to keep on working
Volunteer Mad Scientist For Life
ID: 34727 · Report as offensive     Reply Quote
Profile Nils Høimyr
Volunteer moderator
Project administrator
Project developer
Project tester

Send message
Joined: 15 Jul 05
Posts: 242
Credit: 5,800,306
RAC: 0
Message 34728 - Posted: 26 Mar 2018, 14:36:08 UTC
Last modified: 26 Mar 2018, 15:28:57 UTC

Thanks! This is taking longer time than expected, sorry. Should be back in business now.
ID: 34728 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1686
Credit: 100,339,632
RAC: 101,854
Message 34733 - Posted: 26 Mar 2018, 18:44:48 UTC - in response to Message 34728.  

Should be back in business now.
Except for Sixtrack, no new tasks are available for download. Why so?
ID: 34733 · Report as offensive     Reply Quote
djoser
Avatar

Send message
Joined: 30 Aug 14
Posts: 145
Credit: 10,847,070
RAC: 0
Message 34734 - Posted: 26 Mar 2018, 19:01:48 UTC - in response to Message 34733.  
Last modified: 26 Mar 2018, 19:09:50 UTC

Even Sixtrack-WUs error out with

-186 (0xFFFFFF46) ERR_RESULT_DOWNLOAD
app_version download error: couldn't get input files

on my machines...
Why mine when you can research? - GRIDCOIN - Real cryptocurrency without wasting hashes! https://gridcoin.us
ID: 34734 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 602
Credit: 24,371,321
RAC: 0
Message 34736 - Posted: 26 Mar 2018, 20:23:19 UTC

Well things are a bit reversed for me, not unusually. I am getting CMS, LHCb and Theory fine, and they are finishing without a problem. But they must have just run out of them, because now I am getting only Sixtrack, even though I have not selected it. Three are running now, the longest for 3 1/2 hours (50%) with no problems.

I am sure things will straighten out before long; everyone is requesting work now anyway.
ID: 34736 · Report as offensive     Reply Quote
djoser
Avatar

Send message
Joined: 30 Aug 14
Posts: 145
Credit: 10,847,070
RAC: 0
Message 34742 - Posted: 27 Mar 2018, 6:33:38 UTC - in response to Message 34736.  

But they must have just run out of them, because now I am getting only Sixtrack, even though I have not selected it.


Same situation with me. I only selected LHCb-tasks, but getting Sixtrack.
I think this is because of the option "Accept work from other applications if no work is available".
Why mine when you can research? - GRIDCOIN - Real cryptocurrency without wasting hashes! https://gridcoin.us
ID: 34742 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 997
Credit: 6,264,307
RAC: 71
Message 34754 - Posted: 27 Mar 2018, 10:01:24 UTC - in response to Message 34742.  

But they must have just run out of them, because now I am getting only Sixtrack, even though I have not selected it.


Same situation with me. I only selected LHCb-tasks, but getting Sixtrack.
I think this is because of the option "Accept work from other applications if no work is available".

Yes, that will do it. :-)
CMS tasks/jobs may be problematic for a while. We're making some changes to get closer to true production, but we may get some of the configurations wrong over the next few days (and the Easter holidays won't help... Officially my institution is on holiday from tonight until Wednesday morning next week!). Keep an eye on the jobs graphs and the Server Status Page.
ID: 34754 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Nov 14
Posts: 602
Credit: 24,371,321
RAC: 0
Message 34756 - Posted: 27 Mar 2018, 14:10:58 UTC
Last modified: 27 Mar 2018, 15:07:59 UTC

In case anyone wants ATLAS in the meantime, there are some on LHC-dev. The native run OK for me.
https://lhcathomedev.cern.ch/lhcathome-dev/server_status.php

EDIT: It looks like all systems are go on LHC now; no need to run over to -dev.
ID: 34756 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2071
Credit: 156,084,313
RAC: 104,826
Message 34774 - Posted: 28 Mar 2018, 5:20:31 UTC

Sunday was the last stats-transfer to BOINCSTATS.COM or FREE-DC.ORG.
Maybe, it is because of the storage-backend change.
Thank you for help.
ID: 34774 · Report as offensive     Reply Quote
gyllic

Send message
Joined: 9 Dec 14
Posts: 202
Credit: 2,533,875
RAC: 0
Message 34788 - Posted: 29 Mar 2018, 13:21:34 UTC

just a small thing:
im not 100% sure but i think that since the new storage backend is in use this "behaviour" occurs:
if you go to https://lhcathome.cern.ch/ you get forwarded to a CERN login page.
before you got forwarded to https://lhcathome.cern.ch/lhcathome/index.php and thats how it should be
ID: 34788 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 997
Credit: 6,264,307
RAC: 71
Message 34789 - Posted: 29 Mar 2018, 13:44:43 UTC - in response to Message 34788.  
Last modified: 29 Mar 2018, 13:44:53 UTC

just a small thing:
im not 100% sure but i think that since the new storage backend is in use this "behaviour" occurs:
if you go to https://lhcathome.cern.ch/ you get forwarded to a CERN login page.
before you got forwarded to https://lhcathome.cern.ch/lhcathome/index.php and thats how it should be

Was that a transient fault? I just tried with a fresh Firefox instance (I normally use Chrome) and it got to the page I expected.
ID: 34789 · Report as offensive     Reply Quote
Profile Nils Høimyr
Volunteer moderator
Project administrator
Project developer
Project tester

Send message
Joined: 15 Jul 05
Posts: 242
Credit: 5,800,306
RAC: 0
Message 34790 - Posted: 29 Mar 2018, 13:48:54 UTC - in response to Message 34788.  

Thanks for spotting this! Should be fixed now, the redirect may stay for a while in your browser cache. (Access to the general site is on:http://cern.ch/lhcathome .)
ID: 34790 · Report as offensive     Reply Quote
mmonnin

Send message
Joined: 22 Mar 17
Posts: 55
Credit: 10,223,976
RAC: 2,477
Message 34798 - Posted: 29 Mar 2018, 22:38:07 UTC - in response to Message 34774.  

Sunday was the last stats-transfer to BOINCSTATS.COM or FREE-DC.ORG.
Maybe, it is because of the storage-backend change.
Thank you for help.


Came here to ask about this. Seems to be only post about it.
ID: 34798 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1686
Credit: 100,339,632
RAC: 101,854
Message 34799 - Posted: 30 Mar 2018, 5:38:25 UTC

no "unsent" tasks available at all, for any sub-project - according to the Project Status Page.

LHC closed down for Easter?
ID: 34799 · Report as offensive     Reply Quote
Profile Nils Høimyr
Volunteer moderator
Project administrator
Project developer
Project tester

Send message
Joined: 15 Jul 05
Posts: 242
Credit: 5,800,306
RAC: 0
Message 34802 - Posted: 30 Mar 2018, 9:20:22 UTC - in response to Message 34799.  

We have a network problem in the computer centre at CERN this morning, and have database connectivity issues. Hopefully fixed soon. At least VM tasks should be flowing again once this is fixed.
ID: 34802 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1686
Credit: 100,339,632
RAC: 101,854
Message 34804 - Posted: 30 Mar 2018, 9:35:24 UTC - in response to Message 34802.  

Nils, many thanks for the information :-)
ID: 34804 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 997
Credit: 6,264,307
RAC: 71
Message 34805 - Posted: 30 Mar 2018, 11:59:54 UTC - in response to Message 34802.  

We have a network problem in the computer centre at CERN this morning, and have database connectivity issues. Hopefully fixed soon. At least VM tasks should be flowing again once this is fixed.

Ah, that would explain the problems in the CMS graphs and lack of jobs. WMStats is still showing a problem with vocms0267 (our WMAgent) but a few jobs seem to be flowing again; I've mailed Alan and Seangchan about it.
ID: 34805 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1686
Credit: 100,339,632
RAC: 101,854
Message 34811 - Posted: 30 Mar 2018, 14:49:18 UTC - in response to Message 34805.  

... a problem with vocms0267 (our WMAgent)
oh no, not again :-)))
ID: 34811 · Report as offensive     Reply Quote
ivan
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar

Send message
Joined: 29 Aug 05
Posts: 997
Credit: 6,264,307
RAC: 71
Message 34816 - Posted: 30 Mar 2018, 19:16:33 UTC - in response to Message 34811.  

Relatively minor this time, the particular component wasn't affecting operations. From what I could see the network problems caused a lot of systems to fall into "impossible" states and recovery wasn't bullet-quick. Seems to be fine now, but we relied a lot on people working on what is a major religious holiday (when I was a kid in Oz, the two days of the year that you couldn't buy alcohol or petrol were Christmas Day and Good Friday).
ID: 34816 · Report as offensive     Reply Quote
1 · 2 · Next

Message boards : News : Server upgrade - file uploads paused


©2024 CERN