Message boards : ATLAS application : queue is empty
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 10 · 11 · 12 · 13

AuthorMessage
Crystal Pellet
Volunteer moderator
Volunteer tester

Send message
Joined: 14 Jan 10
Posts: 1417
Credit: 9,439,917
RAC: 1,165
Message 50906 - Posted: 25 Oct 2024, 7:31:11 UTC - in response to Message 50896.  
Last modified: 25 Oct 2024, 7:32:13 UTC

It was for him an uploadproblem, not a Taskproblem.
The Task finished correct.
If I remember correctly:
Even upload is not the problem, but is it a network buffer setting on the server.
The buffer seems to be smaller than 2,003,558,304 bytes
ID: 50906 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2528
Credit: 253,722,201
RAC: 62,755
Message 50907 - Posted: 25 Oct 2024, 7:50:25 UTC - in response to Message 50906.  

It was for him an uploadproblem, not a Taskproblem.
The Task finished correct.
If I remember correctly:
Even upload is not the problem, but is it a network buffer setting on the server.
The buffer seems to be smaller than 2,003,558,304 bytes

Right.
That's exactly the reason why uploads fail and the tasks get lost.
Now, before anybody asks for a greater buffer. This would just postpone the basic problem.

@ATLAS submitters
The only real solution is to keep the task parameters within the ranges that are known to work fine, especially:
- keep uploads and downloads as small as possible
- do not exceed 400 events to be processed

The latter ensures that tasks can be finished within a work day on average computers.
This is important since ATLAS (native) can't be suspended/resumed.
ID: 50907 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2240
Credit: 173,894,884
RAC: 3,757
Message 50909 - Posted: 25 Oct 2024, 7:56:42 UTC - in response to Message 50906.  

Had this night the same problem.
File was too big.
2 GByte is the limit.
Have no restrictions for Boinc or VDSL.
Don't know where this limit can be.
The only answer fo me is -native with CentOS.
<message>
upload failure: <file_xfer_error>
<file_name>VAnLDm049N6n9Rq4apOajLDm4fhM0noT9bVorHsSDmvT3KDmJZvwqm_0_r122375125_ATLAS_hits</file_name>
<error_code>-131 (file size too big)</error_code>
</file_xfer_error>
</message>
https://lhcathome.cern.ch/lhcathome/result.php?resultid=415212983
ID: 50909 · Report as offensive     Reply Quote
mmonnin

Send message
Joined: 22 Mar 17
Posts: 61
Credit: 14,576,403
RAC: 13,750
Message 50917 - Posted: 25 Oct 2024, 19:41:44 UTC

I had 8x Atlas tasks running (4 threads each) and only 2 completed w/o a file size too big. 15-16 hours on 24 threads wasted. :(
ID: 50917 · Report as offensive     Reply Quote
Harri Liljeroos
Avatar

Send message
Joined: 28 Sep 04
Posts: 728
Credit: 48,807,067
RAC: 22,384
Message 50960 - Posted: 28 Oct 2024, 18:49:24 UTC

The queue is dropping down again. 101 ready to send at the moment.
ID: 50960 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1810
Credit: 118,224,978
RAC: 26,910
Message 50961 - Posted: 28 Oct 2024, 19:12:46 UTC - in response to Message 50960.  

The queue is dropping down again. 101 ready to send at the moment.
down to 26 right now
ID: 50961 · Report as offensive     Reply Quote
Harri Liljeroos
Avatar

Send message
Joined: 28 Sep 04
Posts: 728
Credit: 48,807,067
RAC: 22,384
Message 51020 - Posted: 5 Nov 2024, 22:09:53 UTC

Down to 172 in the queue....
ID: 51020 · Report as offensive     Reply Quote
Harri Liljeroos
Avatar

Send message
Joined: 28 Sep 04
Posts: 728
Credit: 48,807,067
RAC: 22,384
Message 51231 - Posted: 30 Nov 2024, 22:29:38 UTC

And the queue is just about empty....
ID: 51231 · Report as offensive     Reply Quote
greg_be

Send message
Joined: 28 Dec 08
Posts: 339
Credit: 4,863,174
RAC: 607
Message 51232 - Posted: 1 Dec 2024, 8:13:35 UTC - in response to Message 51231.  

And the queue is just about empty....



After that round of bad tasks maybe they are taking a pause (except six track) to examine what went wrong.
I had a page full of CMS that went bad and a page of ATLAS that went invalid.This was brought up in another page.
ID: 51232 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1810
Credit: 118,224,978
RAC: 26,910
Message 51233 - Posted: 1 Dec 2024, 10:14:43 UTC - in response to Message 51231.  

And the queue is just about empty....
well, if the figures from the server status page are correct, 367 volunteers have downloaded 6.370 Atlas tasks, obviously to have enough on stock before the queue dries out again; which happened very quickly.
Too bad that all my hosts ran out of Atlas tasks during last night already :-(
ID: 51233 · Report as offensive     Reply Quote
Previous · 1 . . . 10 · 11 · 12 · 13

Message boards : ATLAS application : queue is empty


©2024 CERN