Message boards : ATLAS application : 2000 Events Threadripper 3995WX
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2532
Credit: 253,726,108
RAC: 30,334
Message 49637 - Posted: 24 Feb 2024, 11:36:04 UTC - in response to Message 49636.  

Read the kernel docs and the systemd docs.
ID: 49637 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2242
Credit: 173,902,375
RAC: 2,454
Message 49638 - Posted: 24 Feb 2024, 13:36:37 UTC - in response to Message 49634.  

This machine is running a 1000 events job on 4 cores and is already 26 hours busy and another 7 hours to go.

What's about a venue for Events in preferences?
four or five venues (100, 200, 500, 1000, 2000).

Got three 100 event Tasks:
Laufzeit 24 min. 40 sek.
CPU Zeit 2 min. 41 sek.

Is this useful?
ID: 49638 · Report as offensive     Reply Quote
Saturn911

Send message
Joined: 3 Nov 12
Posts: 58
Credit: 141,276,350
RAC: 74,475
Message 49639 - Posted: 24 Feb 2024, 15:35:21 UTC - in response to Message 49638.  

What about reactivation of the "Atlas long simulation" for the 24/7 systems?
It was something I liked.
ID: 49639 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2242
Credit: 173,902,375
RAC: 2,454
Message 49640 - Posted: 24 Feb 2024, 15:53:11 UTC - in response to Message 49639.  

+1
ID: 49640 · Report as offensive     Reply Quote
wujj123456

Send message
Joined: 14 Sep 08
Posts: 52
Credit: 63,339,601
RAC: 8,683
Message 49641 - Posted: 24 Feb 2024, 17:49:50 UTC - in response to Message 49639.  
Last modified: 24 Feb 2024, 17:54:08 UTC

Yep, ATLAS long seems to be the perfect answer to break this dilemma.

Another good part about ATLAS long is that it's a separate app. Now I can put in a different nthreads in app_config to throw more cores at the bigger problem without worrying about having 8 cores wait for 30 minutes just to do 10 minute of compute...
ID: 49641 · Report as offensive     Reply Quote
hadron

Send message
Joined: 4 Sep 22
Posts: 91
Credit: 15,749,158
RAC: 17,126
Message 49662 - Posted: 26 Feb 2024, 23:56:29 UTC - in response to Message 49637.  

Read the kernel docs and the systemd docs.

You remind me of the guy in the bad old days of DOS and no internet, who steadfastly refused to document his code.
His rationale? "People who can't read code have no business running a computer."
ID: 49662 · Report as offensive     Reply Quote
wujj123456

Send message
Joined: 14 Sep 08
Posts: 52
Credit: 63,339,601
RAC: 8,683
Message 49663 - Posted: 27 Feb 2024, 4:58:47 UTC - in response to Message 49662.  
Last modified: 27 Feb 2024, 5:01:10 UTC

Overloading a system most of the time just to make up the idle time is not a real solution anyway. Fixing the workload to not idle is generally the best solution. The 20 minute time is with local cvmfs installation using cloudflare CDN. If during the time, the workload is pulling lots of data down from cvmfs and limited by bandwidth or disk, then I can more or less understand the behavior. However, it's not doing anything remotely intensive with network or disk either. The problem is likely either how the setup pulls the necessary data, or how fast cvmfs can serve the data, or both.

But hey, this is the only program on my computer that's running python 2.7 which has reached EOL 4 years ago. This also means it's definitely not using basic optimizations like asyncio to parallelize IO requests. I doubt much care for performance is put into the setup phase, given the actual calculation is likely done by some C/C++ library.
ID: 49663 · Report as offensive     Reply Quote
maeax

Send message
Joined: 2 May 07
Posts: 2242
Credit: 173,902,375
RAC: 2,454
Message 49665 - Posted: 27 Feb 2024, 14:37:25 UTC - in response to Message 49663.  
Last modified: 27 Feb 2024, 14:43:19 UTC

CVMFS and Parrot is the alternate for CVMFS and Fuse.
Would be good, to install CVMFS on the own network.
Don't know under Win11pro or CentOS9?

This answer is from Bing KI:
Parrots and CernVM-FS:

While parrots themselves don’t directly interact with CernVM-FS, the term “Parrot” here refers to the Parrot connector used as an alternative to the Fuse module
ID: 49665 · Report as offensive     Reply Quote
Previous · 1 · 2

Message boards : ATLAS application : 2000 Events Threadripper 3995WX


©2024 CERN