Message boards : Theory Application : This gonna be long
Message board moderation

To post messages, you must log in.

AuthorMessage
Lem Novantotto

Send message
Joined: 24 May 23
Posts: 46
Credit: 2,628,447
RAC: 1,642
Message 51074 - Posted: 16 Nov 2024, 13:56:04 UTC
Last modified: 16 Nov 2024, 13:56:58 UTC

https://lhcathome.cern.ch/lhcathome/workunit.php?wuid=226595315
PbPb heavyion-mb 2760 - - pythia8 8.302 default 100000 38

Probably it'll take nineteen days, or so. Ten days are gone, and only 52800 events processed out of 100000.
--
Bye, Lem
ID: 51074 · Report as offensive     Reply Quote
Profile Guy
Avatar

Send message
Joined: 9 Feb 08
Posts: 53
Credit: 1,255,597
RAC: 893
Message 51102 - Posted: 20 Nov 2024, 4:39:59 UTC

Yep.

They're ironing out a few wrinkles at the moment.
The CMS task problem has apparently been fixed. But I've got to wait, hoping, for a "10 Day" Theory task to finish before I get to see any and find out!

Here's my list of failure -
https://lhcathome.cern.ch/lhcathome/results.php?userid=95350
LOL
ID: 51102 · Report as offensive     Reply Quote
Erich56

Send message
Joined: 18 Dec 15
Posts: 1827
Credit: 119,544,484
RAC: 43,177
Message 51103 - Posted: 20 Nov 2024, 5:55:47 UTC - in response to Message 51102.  

CMS task problem has apparently been fixed.
not entirely: the connection to Condor is up again, but the jobs queue has run dry; so one can download tasks, but they fail after about half an hour due to lack of jobs :-(
ID: 51103 · Report as offensive     Reply Quote
Lem Novantotto

Send message
Joined: 24 May 23
Posts: 46
Credit: 2,628,447
RAC: 1,642
Message 51106 - Posted: 20 Nov 2024, 23:58:38 UTC - in response to Message 51074.  

Probably it'll take nineteen days, or so. Ten days are gone, and only 52800 events processed out of 100000.

Probably much more: it has slowed down. In the last four days, less than 8000 events. At this pace, there are still more than 20 days left until the end of computation. Grand total, likely more than 35 days.
--
Bye, Lem
ID: 51106 · Report as offensive     Reply Quote
Lem Novantotto

Send message
Joined: 24 May 23
Posts: 46
Credit: 2,628,447
RAC: 1,642
Message 51109 - Posted: 22 Nov 2024, 17:40:12 UTC - in response to Message 51106.  

Power failure. :'-(
I'll buy an UPS, sooner or later...
--
Bye, Lem
ID: 51109 · Report as offensive     Reply Quote
Profile Guy
Avatar

Send message
Joined: 9 Feb 08
Posts: 53
Credit: 1,255,597
RAC: 893
Message 51110 - Posted: 22 Nov 2024, 18:39:46 UTC - in response to Message 51109.  

Sorry about the power failure.
Lem - please remind me - where do I find the "events" processed?
Thanks
ID: 51110 · Report as offensive     Reply Quote
Toggleton

Send message
Joined: 4 Mar 17
Posts: 26
Credit: 10,294,310
RAC: 2,958
Message 51111 - Posted: 22 Nov 2024, 20:15:02 UTC - in response to Message 51110.  

where do I find the "events" processed?

i use to monitor theory tasks
 tail -f /var/lib/boinc/slots/*/cernvm/shared/runRivet.log 

Herwig tasks did need a different command to filter out the spam.
ID: 51111 · Report as offensive     Reply Quote
Lem Novantotto

Send message
Joined: 24 May 23
Posts: 46
Credit: 2,628,447
RAC: 1,642
Message 51112 - Posted: 22 Nov 2024, 23:18:48 UTC - in response to Message 51111.  

where do I find the "events" processed?

i use to monitor theory tasks
 tail -f /var/lib/boinc/slots/*/cernvm/shared/runRivet.log 

Herwig tasks did need a different command to filter out the spam.


Right.
In my user directory I've created a file named: ~/.bash_aliases, which contains, among the other, the lines:
# My aliases
alias theorytasks='head -n 1 /var/lib/boinc/slots/?*/cernvm/shared/runRivet.log |grep -oPe "(?<= - )[^-][^[:blank:]]*" |sort |uniq -c'
alias theorystatus='for i in $( ls var/lib/boinc/slots/?*/cernvm/shared/runRivet.log ); do echo $i; head -n1 $i ; grep "Integrate " $i | tail -n1 ; grep " events processed" $i | tail -n1 ; echo; done'
alias atlasstatus='sudo bash -c "head -n1 /var/lib/boinc/slots/?*/PanDA_Pilot-*/eventLoopHeartBeat.txt"'
alias l@hstatus='theorystatus ; echo ; echo "---------------------------------" ; echo ; atlasstatus'


This file is recalled in ~/.bashrc, which contains also:
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.

if [ -f ~/.bash_aliases ]; then
    . ~/.bash_aliases
fi


So I can use the commands theorytasks, theorystatus, atlasstatus, l@hstatus to quickly get some info about the tasks.

Herwig theory tasks have two steps: the first creates the events (and it may lasts days) to be processed, the second processes the events.
The first step can be monitored reading the file:... uhmm, let's see if I can recall correctly... You've got to dive into .../boinc/slots/*?/cernvm/shared/tmp/tmp.*/run-main/pwgevents.lhe
I'll be more precise as soon as I'll crunch some herwig task, I promise. Or someone else will post it sooner. :-)
--
Bye, Lem
ID: 51112 · Report as offensive     Reply Quote
Profile Guy
Avatar

Send message
Joined: 9 Feb 08
Posts: 53
Credit: 1,255,597
RAC: 893
Message 51116 - Posted: 23 Nov 2024, 13:03:17 UTC - in response to Message 51112.  

Thanks for the responses.
I won't be able to implement this method -
I don't have
/var/lib/boinc/slots/*/cernvm
I do have
/var/lib/boinc/slots/*/shared
for the Theory task. But there's no runRivet.log or PanDA_Pilot anywhere. I searched for *event* and got nothing.
I do have a vague memory of being able to find the events processed in some xml file, without installing any extra software.
ID: 51116 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2549
Credit: 255,283,324
RAC: 57,798
Message 51117 - Posted: 23 Nov 2024, 14:54:34 UTC - in response to Message 51116.  

The suggested commands work only for native tasks.

You are running vbox tasks which write their logs to the filesystem inside the VM.
The VM then maps the logs (at least some of them) to it's internal apache workspace.
This in turn can be read using your local http browser (on the host) with an address that looks like:
http://localhost:12345/logs/

Each VM on the host has an individual port.
Get it from the stderr.txt, it looks like:
1066-10-14 16:39:37 (395588): Detected: Web Application Enabled (http://localhost:57455)
ID: 51117 · Report as offensive     Reply Quote
Profile Guy
Avatar

Send message
Joined: 9 Feb 08
Posts: 53
Credit: 1,255,597
RAC: 893
Message 51125 - Posted: 24 Nov 2024, 12:28:38 UTC - in response to Message 51117.  
Last modified: 24 Nov 2024, 12:35:27 UTC

Thank you. There it is!

61,600 of 100,000 events processed
5 days so far.
Started:.....19 Nov 2024, 14:21:01 UTC
Deadline:..30 Nov 2024, 14:21:01 UTC

(This is my only PC, so BOINC only runs for ~75% of the time.)

What happens to a Theory task? Do they just count to 100,000 [default] and stop?
ID: 51125 · Report as offensive     Reply Quote
Crystal Pellet
Volunteer moderator
Volunteer tester

Send message
Joined: 14 Jan 10
Posts: 1427
Credit: 9,510,310
RAC: 2,545
Message 51126 - Posted: 24 Nov 2024, 13:44:16 UTC - in response to Message 51125.  
Last modified: 24 Nov 2024, 13:45:35 UTC

What happens to a Theory task? Do they just count to 100,000 [default] and stop?
When all (mostly 100,000) Theory-events are processed some data is gathered and the result is sent back to LHC@home.
This very last part of the task lasts less than 1 minute.
ID: 51126 · Report as offensive     Reply Quote
Profile Guy
Avatar

Send message
Joined: 9 Feb 08
Posts: 53
Credit: 1,255,597
RAC: 893
Message 51128 - Posted: 24 Nov 2024, 14:20:51 UTC - in response to Message 51126.  

Perfect. Thanks. ;-)
ID: 51128 · Report as offensive     Reply Quote

Message boards : Theory Application : This gonna be long


©2025 CERN