Message boards :
ATLAS application :
Panda failures
Message board moderation
Author | Message |
---|---|
Send message Joined: 13 Apr 18 Posts: 443 Credit: 8,438,885 RAC: 0 |
I created a Python script that scrapes the PandaIDs from my completed and verified ATLAS results, assembles the PandIDs into a URL like the one below and then opens a tab in my default webbrowser with that URL. For many weeks 99% of my ATLAS results have been passing the Panda test 99%. Suddenly both of my ATLAS crunchers are getting a lot of Panda errors. I ran the script today against this host and discovered that 11 of 25 results failed Panda's verification with errors like:
pilot, 1008: Failed in data staging: Failed to prepare destination
|
Send message Joined: 13 May 14 Posts: 387 Credit: 15,314,184 RAC: 0 |
We had some infrastructure problems on the ATLAS side, over last weekend and also yesterday evening. This led to the panda errors that you see. Hopefully things should be back to normal now. |
Send message Joined: 13 Apr 18 Posts: 443 Credit: 8,438,885 RAC: 0 |
Got another bunch of these "jobdispatcher, 100: lost heartbeat" errors. |
Send message Joined: 13 Apr 18 Posts: 443 Credit: 8,438,885 RAC: 0 |
We had some infrastructure problems on the ATLAS side, over last weekend and also yesterday evening. This led to the panda errors that you see. Hopefully things should be back to normal now. It seems things are not back to normal. Yet another batch of "jobdispatcher, 100: lost heartbeat" errors. Of the 58 reports requested in the URL below, 12 reports showed the error. That's a 21% failure rate. https://bigpanda.cern.ch/jobs?pandaid=4098545638,4098545517,4098247086,4098456438,4097325060,4097581515,4097424428,4097261160,4096781680,4097082501,4096781674,4095916301,4096322691,4096322465,4096256044,4095916308,4095495523,4094700041,4094977385,4094970660,4094970609,4094709859,4094650042,4094031735,4093322884,4093112779,4093642897,4093429317,4093269727,4092453725,4092810952,4092128400,4092778083,4092743128,4091816541,4092063731,4092055006,4092055008,4092032541,4092012638,4086248504,4081973117,4081973135,4081973115,4081973124,4082011072,4082011066,4089439346,4089396894,4089396758,4088478941,4089200246,4088909669,4088478854,4088214416,4088214329,4088181213,4088181176,4084839094 |
©2024 CERN