Message boards :
Theory Application :
(Native) Theory - Sherpa looooooong runners
Message board moderation
Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 8 · Next
Author | Message |
---|---|
Send message Joined: 15 Jun 08 Posts: 2528 Credit: 253,722,187 RAC: 73,124 |
11 days to finish (estimated) but only 8 days left to hit the BOINC limit. Makes no sense to keep this alive: https://lhcathome.cern.ch/lhcathome/result.php?resultid=237122746 ===> [runRivet] Sat Jul 13 15:09:57 UTC 2019 [boinc pp jets 7000 150,-,2160 - sherpa 2.2.5 default 1000 78] . . . integration time: ( 22h 13m 43s elapsed / 10d 23h 3m 30s left ) [13:01:49] |
Send message Joined: 13 Apr 18 Posts: 443 Credit: 8,438,885 RAC: 0 |
4 days 16 hrs to finish this one on my old Athlon X2. runspec=boinc pp ttbar 7000 - - sherpa 2.1.1 default 4000 78 MCP record: evts: 9000 attempts: 38 success: 6 fail: 5 lost: 27 Had runRivet.log shown crazy integration time remaining or other warnings like "Y out of bounds", I would have cut my losses and aborted it. Glad I didn't. It's easier to have patience with long runners now that the loopers are filtered out. |
Send message Joined: 14 Jan 10 Posts: 1417 Credit: 9,439,910 RAC: 1,430 |
4 days 16 hrs to finish this one on my old Athlon X2. Really hard to keep sitting on your hands. Well done, bronco !! |
Send message Joined: 15 Jun 08 Posts: 2528 Credit: 253,722,187 RAC: 73,124 |
This one will most likely not finish regularly: https://lhcathome.cern.ch/lhcathome/result.php?resultid=237226429 ===> [runRivet] Wed Jul 17 01:47:10 UTC 2019 [boinc ee zhad 22 - - sherpa 2.2.5 default 2000 80] . . . integration time: ( 1d 8h 57m 8s elapsed / 1295d 19h 55m 36s left ) [18:52:58] |
Send message Joined: 14 Jan 10 Posts: 1417 Credit: 9,439,910 RAC: 1,430 |
This one will most likely not finish regularly:The success rate for that job is 9% |
Send message Joined: 13 Apr 18 Posts: 443 Credit: 8,438,885 RAC: 0 |
Really hard to keep sitting on your hands. Well done, bronco !! Not so hard with assistance from my watchdog script. I haven't yet found a way to make it query the McPlots database (credentials problem) so I screen scraped it and saved it as a text file which the watchdog searches for the job. From the McPlots report it calculates the job's viability. For that +4 day job the viability was 2 out of 10, not promising. The script also watches the number of processed events. That task ran for 2 days before processed events rose above 0. As the processed events increases, the script is able to predict completion time with some accuracy (in most cases accurate almost to the minute, so far). Since completion time was well before deadline and the script indicated no warning signs like 'Y out of bounds', it was allowed to continue. The questions are: 1. With so few tasks failing now that the bad Sherpa jobs are being filtered at the server, is it worth spending CPU cycles on a watchdog script? 2. What will happen when we start a new workflow? Will all jobs in the McPlots database initialize to "0 attempts, 0 success, 0 fail, 0 lost" and if so then how will the server filter out the loopers? |
Send message Joined: 19 Oct 19 Posts: 1 Credit: 6,848,260 RAC: 0 |
14:13:20 CEST +02:00 2019-10-23: cranky-0.0.29: [INFO] ===> [runRivet] Wed Oct 23 12:13:18 UTC 2019 [boinc pp jets 7000 80,-,1060 - sherpa 1.4.0 default 100000 144] Name TheoryN_2279-784482-144_0 Run time 7 days 9 hours 32 min 8 sec CPU time 7 days 8 hours 46 min 59 sec https://lhcathome.cern.ch/lhcathome/result.php?resultid=249684464 Sent to new host https://lhcathome.cern.ch/lhcathome/show_host_detail.php?hostid=10598254 Hope your ryzen take it computezrmle |
Send message Joined: 2 May 07 Posts: 2240 Credit: 173,894,884 RAC: 3,757 |
TheoryN_2279-752964-147 - [boinc ee zhad 91.2 - - sherpa 2.2.5 default 2000 147] 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED Computer ID 10589645 Laufzeit 2 Tage 19 Stunden 32 min. 15 sek. CPU Zeit 2 Tage 18 Stunden 31 min. 42 sek. https://lhcathome.cern.ch/lhcathome/workunit.php?wuid=125878783 |
Send message Joined: 7 Feb 14 Posts: 99 Credit: 5,180,005 RAC: 0 |
|
Send message Joined: 14 Jan 10 Posts: 1417 Credit: 9,439,910 RAC: 1,430 |
Is this task ok? Since it's making no progress after 75,000 events done, no much hope :( |
Send message Joined: 7 Feb 14 Posts: 99 Credit: 5,180,005 RAC: 0 |
Since it's making no progress after 75,000 events done, no much hope :(Aborted. :( https://lhcathome.cern.ch/lhcathome/result.php?resultid=253793046 [runRivet] Tue Dec 3 00:48:52 UTC 2019 [boinc pp jets 7000 40,-,760 - sherpa 1.4.5 default 100000 190] |
Send message Joined: 14 Jan 10 Posts: 1417 Credit: 9,439,910 RAC: 1,430 |
Following sherpa jobs were never successful: ee zhad 133 - - sherpa 1.2.2p default ee zhad 133 - - sherpa 1.2.3 default ee zhad 133 - - sherpa 1.3.0 default ee zhad 133 - - sherpa 1.3.1 default ee zhad 133 - - sherpa 1.4.0 default ee zhad 133 - - sherpa 1.4.1 default ee zhad 133 - - sherpa 1.4.2 default ee zhad 133 - - sherpa 1.4.3 default ee zhad 133 - - sherpa 1.4.5 default ee zhad 133 - - sherpa 2.1.0 default ee zhad 133 - - sherpa 2.1.1 default ee zhad 133 - - sherpa 2.2.0 default ee zhad 133 - - sherpa 2.2.1 default ee zhad 133 - - sherpa 2.2.2 default ee zhad 14 - - sherpa 1.2.2p default ee zhad 14 - - sherpa 1.2.3 default ee zhad 14 - - sherpa 1.3.0 default ee zhad 14 - - sherpa 1.3.1 default ee zhad 14 - - sherpa 1.4.0 default ee zhad 14 - - sherpa 1.4.1 default ee zhad 14 - - sherpa 1.4.2 default ee zhad 14 - - sherpa 1.4.3 default ee zhad 14 - - sherpa 1.4.5 default ee zhad 14 - - sherpa 2.1.0 default ee zhad 14 - - sherpa 2.1.1 default ee zhad 189 - - sherpa 1.2.2p default ee zhad 189 - - sherpa 1.2.3 default ee zhad 189 - - sherpa 1.3.0 default ee zhad 189 - - sherpa 1.3.1 default ee zhad 189 - - sherpa 1.4.0 default ee zhad 189 - - sherpa 1.4.1 default ee zhad 189 - - sherpa 1.4.2 default ee zhad 189 - - sherpa 1.4.3 default ee zhad 189 - - sherpa 1.4.5 default ee zhad 189 - - sherpa 2.1.0 default ee zhad 189 - - sherpa 2.1.1 default ee zhad 189 - - sherpa 2.2.0 default ee zhad 189 - - sherpa 2.2.1 default ee zhad 189 - - sherpa 2.2.2 default ee zhad 197 - - sherpa 1.2.2p default ee zhad 197 - - sherpa 1.2.3 default ee zhad 197 - - sherpa 1.3.0 default ee zhad 197 - - sherpa 1.3.1 default ee zhad 197 - - sherpa 1.4.0 default ee zhad 197 - - sherpa 1.4.1 default ee zhad 197 - - sherpa 1.4.2 default ee zhad 197 - - sherpa 1.4.3 default ee zhad 197 - - sherpa 1.4.5 default ee zhad 197 - - sherpa 2.1.0 default ee zhad 197 - - sherpa 2.1.1 default ee zhad 197 - - sherpa 2.2.0 default ee zhad 197 - - sherpa 2.2.1 default ee zhad 197 - - sherpa 2.2.2 default ee zhad 200 - - sherpa 1.2.2p default ee zhad 200 - - sherpa 1.2.3 default ee zhad 200 - - sherpa 1.3.0 default ee zhad 200 - - sherpa 1.3.1 default ee zhad 200 - - sherpa 1.4.0 default ee zhad 200 - - sherpa 1.4.1 default ee zhad 200 - - sherpa 1.4.2 default ee zhad 200 - - sherpa 1.4.3 default ee zhad 200 - - sherpa 1.4.5 default ee zhad 200 - - sherpa 2.1.0 default ee zhad 200 - - sherpa 2.1.1 default ee zhad 200 - - sherpa 2.2.0 default ee zhad 200 - - sherpa 2.2.1 default ee zhad 200 - - sherpa 2.2.2 default ee zhad 206 - - sherpa 1.2.2p default ee zhad 206 - - sherpa 1.2.3 default ee zhad 206 - - sherpa 1.3.0 default ee zhad 206 - - sherpa 1.3.1 default ee zhad 206 - - sherpa 1.4.0 default ee zhad 206 - - sherpa 1.4.1 default ee zhad 206 - - sherpa 1.4.2 default ee zhad 206 - - sherpa 1.4.3 default ee zhad 206 - - sherpa 1.4.5 default ee zhad 206 - - sherpa 2.1.0 default ee zhad 206 - - sherpa 2.1.1 default ee zhad 206 - - sherpa 2.2.0 default ee zhad 206 - - sherpa 2.2.1 default ee zhad 206 - - sherpa 2.2.2 default ee zhad 22 - - sherpa 1.2.2p default ee zhad 22 - - sherpa 1.2.3 default ee zhad 22 - - sherpa 1.3.0 default ee zhad 22 - - sherpa 1.3.1 default ee zhad 22 - - sherpa 1.4.0 default ee zhad 22 - - sherpa 1.4.1 default ee zhad 22 - - sherpa 1.4.2 default ee zhad 22 - - sherpa 1.4.3 default ee zhad 22 - - sherpa 1.4.5 default ee zhad 22 - - sherpa 2.1.0 default ee zhad 22 - - sherpa 2.1.1 default ee zhad 22 - - sherpa 2.2.0 default ee zhad 22 - - sherpa 2.2.1 default ee zhad 22 - - sherpa 2.2.2 default ee zhad 29 - - sherpa 1.2.2p default ee zhad 29 - - sherpa 1.2.3 default ee zhad 29 - - sherpa 1.3.0 default ee zhad 29 - - sherpa 1.3.1 default ee zhad 29 - - sherpa 1.4.0 default ee zhad 29 - - sherpa 1.4.1 default ee zhad 29 - - sherpa 1.4.2 default ee zhad 29 - - sherpa 1.4.3 default ee zhad 29 - - sherpa 1.4.5 default ee zhad 29 - - sherpa 2.1.0 default ee zhad 29 - - sherpa 2.1.1 default ee zhad 29 - - sherpa 2.2.0 default ee zhad 29 - - sherpa 2.2.1 default ee zhad 29 - - sherpa 2.2.2 default ee zhad 34.8 - - sherpa 1.2.2p default ee zhad 34.8 - - sherpa 1.2.3 default ee zhad 34.8 - - sherpa 1.3.0 default ee zhad 34.8 - - sherpa 1.3.1 default ee zhad 34.8 - - sherpa 1.4.0 default ee zhad 34.8 - - sherpa 1.4.1 default ee zhad 34.8 - - sherpa 1.4.2 default ee zhad 34.8 - - sherpa 1.4.3 default ee zhad 34.8 - - sherpa 1.4.5 default ee zhad 34.8 - - sherpa 2.1.0 default ee zhad 34.8 - - sherpa 2.1.1 default ee zhad 34.8 - - sherpa 2.2.0 default ee zhad 34.8 - - sherpa 2.2.1 default ee zhad 34.8 - - sherpa 2.2.2 default ee zhad 43.6 - - sherpa 1.2.2p default ee zhad 43.6 - - sherpa 1.2.3 default ee zhad 43.6 - - sherpa 1.3.0 default ee zhad 43.6 - - sherpa 1.3.1 default ee zhad 43.6 - - sherpa 1.4.0 default ee zhad 43.6 - - sherpa 1.4.1 default ee zhad 43.6 - - sherpa 1.4.2 default ee zhad 43.6 - - sherpa 1.4.3 default ee zhad 43.6 - - sherpa 1.4.5 default ee zhad 43.6 - - sherpa 2.1.0 default ee zhad 43.6 - - sherpa 2.1.1 default ee zhad 43.6 - - sherpa 2.2.0 default ee zhad 43.6 - - sherpa 2.2.1 default ee zhad 43.6 - - sherpa 2.2.2 default ee zhad 91.2 - - sherpa 1.2.2p default ee zhad 91.2 - - sherpa 1.2.3 default ee zhad 91.2 - - sherpa 1.3.0 default ee zhad 91.2 - - sherpa 1.3.1 default ee zhad 91.2 - - sherpa 1.4.0 default ee zhad 91.2 - - sherpa 1.4.1 default ee zhad 91.2 - - sherpa 1.4.2 default ee zhad 91.2 - - sherpa 1.4.3 default ee zhad 91.2 - - sherpa 1.4.5 default ee zhad 91.2 - - sherpa 2.1.0 default ee zhad 91.2 - - sherpa 2.1.1 default ee zhad 91.2 - - sherpa 2.2.0 default ee zhad 91.2 - - sherpa 2.2.1 default ee zhad 91.2 - - sherpa 2.2.2 default pp bbbar 7000 - - sherpa 1.2.2p default pp bbbar 7000 - - sherpa 1.2.3 default pp bbbar 7000 - - sherpa 1.3.0 default pp bbbar 7000 - - sherpa 1.3.1 default pp jets 13000 250,-,4760 - sherpa 2.2.0 default pp jets 13000 250,-,4760 - sherpa 2.2.1 default pp jets 13000 250,-,4760 - sherpa 2.2.2 default pp jets 13000 250,-,4760 - sherpa 2.2.4 default pp jets 13000 250,-,4760 - sherpa 2.2.5 default pp jets 7000 150,-,2360 - sherpa 2.2.0 default pp jets 7000 150,-,2360 - sherpa 2.2.1 default pp jets 7000 150,-,2360 - sherpa 2.2.2 default pp jets 7000 170,-,2960 - sherpa 1.2.2p default pp jets 7000 170,-,2960 - sherpa 1.2.3 default pp jets 7000 170,-,2960 - sherpa 1.3.0 default pp jets 7000 170,-,2960 - sherpa 1.3.1 default pp jets 7000 170,-,2960 - sherpa 1.4.0 default pp jets 7000 170,-,2960 - sherpa 1.4.1 default pp jets 7000 170,-,2960 - sherpa 1.4.2 default pp jets 7000 170,-,2960 - sherpa 1.4.3 default pp jets 7000 170,-,2960 - sherpa 1.4.5 default pp jets 7000 170,-,2960 - sherpa 2.1.0 default pp jets 7000 170,-,2960 - sherpa 2.1.1 default pp jets 7000 170,-,2960 - sherpa 2.2.0 default pp jets 7000 170,-,2960 - sherpa 2.2.1 default pp jets 7000 170,-,2960 - sherpa 2.2.2 default pp jets 7000 170,-,2960 - sherpa 2.2.4 default pp jets 7000 170,-,2960 - sherpa 2.2.5 default pp jets 8000 170,-,2960 - sherpa 2.2.0 default pp jets 8000 170,-,2960 - sherpa 2.2.1 default pp jets 8000 170,-,2960 - sherpa 2.2.2 default pp jets 8000 170,-,2960 - sherpa 2.2.4 default pp jets 8000 170,-,2960 - sherpa 2.2.5 default pp jets 8000 180,-,3560 - sherpa 1.2.2p default pp jets 8000 180,-,3560 - sherpa 1.2.3 default pp jets 8000 180,-,3560 - sherpa 1.3.0 default pp jets 8000 180,-,3560 - sherpa 1.3.1 default pp jets 8000 180,-,3560 - sherpa 1.4.0 default pp jets 8000 180,-,3560 - sherpa 1.4.1 default pp jets 8000 180,-,3560 - sherpa 1.4.2 default pp jets 8000 180,-,3560 - sherpa 1.4.3 default pp jets 8000 180,-,3560 - sherpa 1.4.5 default pp jets 8000 180,-,3560 - sherpa 2.1.0 default pp jets 8000 180,-,3560 - sherpa 2.1.1 default pp jets 8000 180,-,3560 - sherpa 2.2.0 default pp jets 8000 180,-,3560 - sherpa 2.2.1 default pp jets 8000 180,-,3560 - sherpa 2.2.2 default pp jets 8000 180,-,3560 - sherpa 2.2.4 default pp jets 8000 180,-,3560 - sherpa 2.2.5 default pp jets 8000 250,-,4160 - sherpa 1.2.2p default pp jets 8000 250,-,4160 - sherpa 1.2.3 default pp jets 8000 250,-,4160 - sherpa 1.3.0 default pp jets 8000 250,-,4160 - sherpa 1.3.1 default pp jets 8000 250,-,4160 - sherpa 1.4.0 default pp jets 8000 250,-,4160 - sherpa 1.4.1 default pp jets 8000 250,-,4160 - sherpa 1.4.2 default pp jets 8000 250,-,4160 - sherpa 1.4.3 default pp jets 8000 250,-,4160 - sherpa 1.4.5 default pp jets 8000 250,-,4160 - sherpa 2.1.0 default pp jets 8000 250,-,4160 - sherpa 2.1.1 default pp jets 8000 250,-,4160 - sherpa 2.2.0 default pp jets 8000 250,-,4160 - sherpa 2.2.1 default pp jets 8000 250,-,4160 - sherpa 2.2.2 default pp jets 8000 250,-,4160 - sherpa 2.2.4 default pp jets 8000 250,-,4160 - sherpa 2.2.5 default pp mb-inelastic 53 - - sherpa 1.2.3 default pp ttbar 7000 - - sherpa 2.1.0 default pp winclusive 7000 -,-,10 - sherpa 1.2.2p default pp winclusive 7000 -,-,10 - sherpa 1.2.3 default pp winclusive 7000 -,-,10 - sherpa 1.3.0 default pp winclusive 7000 -,-,10 - sherpa 1.3.1 default pp winclusive 7000 -,-,10 - sherpa 1.4.0 default pp winclusive 7000 -,-,10 - sherpa 1.4.1 default pp winclusive 7000 -,-,10 - sherpa 1.4.2 default pp winclusive 7000 -,-,10 - sherpa 1.4.3 default pp winclusive 7000 -,-,10 - sherpa 1.4.5 default pp winclusive 7000 -,-,10 - sherpa 2.1.0 default pp winclusive 7000 -,-,10 - sherpa 2.1.1 default pp winclusive 7000 -,-,10 - sherpa 2.2.0 default pp winclusive 7000 -,-,10 - sherpa 2.2.1 default pp winclusive 7000 -,-,10 - sherpa 2.2.2 default pp winclusive 7000 -,-,10 - sherpa 2.2.4 default pp winclusive 7000 -,-,10 - sherpa 2.2.5 default pp winclusive 7000 10 - sherpa 1.2.2p default pp winclusive 7000 10 - sherpa 1.2.3 default pp winclusive 7000 10 - sherpa 1.3.0 default pp winclusive 7000 10 - sherpa 1.3.1 default pp winclusive 7000 10 - sherpa 1.4.0 default pp winclusive 7000 10 - sherpa 1.4.1 default pp winclusive 7000 10 - sherpa 1.4.2 default pp winclusive 7000 10 - sherpa 1.4.3 default pp winclusive 7000 10 - sherpa 1.4.5 default pp winclusive 7000 10 - sherpa 2.1.0 default pp winclusive 7000 10 - sherpa 2.1.1 default pp winclusive 7000 10 - sherpa 2.2.0 default pp winclusive 7000 10 - sherpa 2.2.1 default pp winclusive 7000 10 - sherpa 2.2.2 default pp winclusive 7000 10 - sherpa 2.2.4 default pp winclusive 7000 10 - sherpa 2.2.5 default pp winclusive 7000 20 - sherpa 1.2.2p default pp winclusive 7000 20 - sherpa 1.2.3 default pp winclusive 7000 20 - sherpa 1.3.0 default pp winclusive 7000 20 - sherpa 1.3.1 default pp winclusive 7000 20 - sherpa 1.4.0 default pp winclusive 7000 20 - sherpa 1.4.1 default pp winclusive 7000 20 - sherpa 1.4.2 default pp winclusive 7000 20 - sherpa 1.4.3 default pp winclusive 7000 20 - sherpa 1.4.5 default pp winclusive 7000 20 - sherpa 2.1.0 default pp winclusive 7000 20 - sherpa 2.1.1 default pp winclusive 7000 20 - sherpa 2.2.0 default pp winclusive 7000 20 - sherpa 2.2.1 default pp winclusive 7000 20 - sherpa 2.2.2 default pp winclusive 7000 20 - sherpa 2.2.4 default pp winclusive 7000 20 - sherpa 2.2.5 default ppbar mb-inelastic 53 - - sherpa 1.2.3 default ppbar mb-inelastic 63 - - sherpa 1.2.3 default |
Send message Joined: 7 Feb 14 Posts: 99 Credit: 5,180,005 RAC: 0 |
Should we automatically abort them? Easy to do it by bash script. |
Send message Joined: 14 Jan 10 Posts: 1417 Credit: 9,439,910 RAC: 1,430 |
Should we automatically abort them? Easy to do it by bash script.It's your decision. |
Send message Joined: 7 May 08 Posts: 217 Credit: 1,575,053 RAC: 538 |
Should we automatically abort them? Easy to do it by bash script.It's your decision. I want to finish this one 67% after 67hs |
Send message Joined: 14 Jan 10 Posts: 1417 Credit: 9,439,910 RAC: 1,430 |
I want to finish this one % progress doesn't mean anything with Theory-tasks. You have to use 'Show VM Console' to see what's going on. |
Send message Joined: 13 Jul 05 Posts: 169 Credit: 15,000,737 RAC: 28 |
Following sherpa jobs were never successful:Would it be worth keeping the Theory-Native sub-project running, but dedicated to Sherpa tasks? That would provide an easy way for volunteers to opt-in/opt-out of the babysitting... (and the machinery's already there). |
Send message Joined: 7 May 08 Posts: 217 Credit: 1,575,053 RAC: 538 |
You have to use 'Show VM Console' to see what's going on. Tasks: 110 total, 2 running, 71 sleeping, 0 stopped, 0 zombie %CPU(s): 96.6 us, 2.8 sy, 0.0 ni, 0.0 id, 0.2 wa, 0.0 hi, 0.4 hi, 0.0 st KiB Mem: 605712 total, 64660 free, 312404 used, 228648 buff/cache 5504 boinc 20 0 473896 39124 5736 R 99.2 6.5 2213:28 Sherpa 5504 boinc 20 0 473896 40692 7304 R 98.8 6.7 2213:43 Sherpa Seems that is runnig well |
Send message Joined: 14 Jan 10 Posts: 1417 Credit: 9,439,910 RAC: 1,430 |
2 sherpa's using almost 100% cpu and both with the same pid. Looks strange to me.You have to use 'Show VM Console' to see what's going on. You may also have a look in the console with ALT-F1 for the job description and ALT-F2 for progress. Sherpa's without success are mentioned earlier in this thread. |
Send message Joined: 7 May 08 Posts: 217 Credit: 1,575,053 RAC: 538 |
You may also have a look in the console with ALT-F1 for the job description and ALT-F2 for progress. 2.73295e+18 pb +- ( 6.02271e+17 pb = 22.0374 %) 62802000 ( 628025526 → 99.9% ) Integration time : (1d 16h 57m 52s elapsed / 827d 12h 52m 33s left ) [15:42:29] Poincare::Poincare(): Inaccurate rotation { a = (-0.91078,-0.399788,0.101433) b = (0,0,1) a' = (0.317924,-0.918998,0.233165)→ rel.dev. (inf,-inf, -0.76635) m_ct =0.101433 ecc, ecc The "Poincare" part continues to repeat 827 days left.... |
©2024 CERN