21) Message boards : ATLAS application : Confused (Message 43309)
Posted 4 Sep 2020 by keputnam
Post:
Oh, i realize the purpose, but this has only ever happened on ATLAS as far as I can remember

And this is the third go round on the circus for me
22) Message boards : ATLAS application : Confused (Message 43308)
Posted 4 Sep 2020 by keputnam
Post:
Already have an app_config with max_concurrent set to 1

We took three power hits over about 19 hours, so that would account for three restarts

I think I did one for Windows maintenance, too




As for the aborted tasks, and ridiculous number of new tasks sent

I haven't changed relative resource share in over 6 months, nor added any new projects and the scheduler SHOULD be smart enough to not send me work I will never complete on time
23) Message boards : ATLAS application : Confused (Message 43305)
Posted 4 Sep 2020 by keputnam
Post:
Can anyone explain this to me


Run Time CPU Time Credit
120,886.49 140,595.50 590.26
107,254.38 36,754.30 2,149.71



Also I have another another complaint about the Scheduler. I had five WUs cancelled by the server because I would have returned them late Fair enough

But it sent me another 15 with an 8 day return date !

There is no way in hell I'll get through them all on time

What gives?
24) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43263)
Posted 24 Aug 2020 by keputnam
Post:
Well, running copper seems to have reduced latency considerably

Your Internet speed is
29Mbps

Latency
Unloaded
23 ms

Loaded
35 ms

Upload
Speed
4.6 Mbps



Finished one WU after installing the CAT6, and the next is now an hour and a half into execution, crunching along quite nicely



Thanks for all the assistance, guys
25) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43257)
Posted 23 Aug 2020 by keputnam
Post:
So when the task "locks up" and gets no more CPU time, as verified by Windows Resource Manager, what am I looking for?


Current WU is at 13:48:24 and crunching happily along
26) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43255)
Posted 22 Aug 2020 by keputnam
Post:
Thanks for the response

I'll get some CAT6 today or tomorrow

I only run 1 LHC task at time, but have BOINC set to use 10 of my 12 "processors" (Hex core/MT)


The last two ATLAS tasks ran to completion, waiting for another at this point

Curiously, one of them kind of lugged along getting 1-2 sec of CPU time per 20 seconds of Elapsed, then at about 8:30 took off and ran to completion!
27) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43244)
Posted 21 Aug 2020 by keputnam
Post:
copper to the house, WiFi throughout Contract is 24Mb Modem/Router is a Two Wire
Speed from desktop to the router from 56 to over 120 Mbps, currently 72, which is about average My to-do list for the day includes making a few phone calls to other ISPs

The supervisor I talked to suggested trying copper from router to the desktop to see if if made any difference was going to get some the next-time I was out and about If it helps, I've then got to figure out how to permanently run it frim the Kitchen (middle of the house) to my den

C:\WINDOWS\system32>ping 8.8.8.8

Pinging 8.8.8.8 with 32 bytes of data:
Reply from 8.8.8.8: bytes=32 time=25ms TTL=117
Reply from 8.8.8.8: bytes=32 time=31ms TTL=117
Reply from 8.8.8.8: bytes=32 time=25ms TTL=117
Reply from 8.8.8.8: bytes=32 time=24ms TTL=117







from fast.com
Your Internet speed is
16
Mbps


Latency
Unloaded
25 ms

Loaded
125 ms


Upload
Speed
4.2 Mbps
28) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43241)
Posted 20 Aug 2020 by keputnam
Post:
Well got the replacement modem, got it installed and worked with a Supervisor to get it back to a measures speed of the old one. When it was first installed, it was about half! (the first guy was an absolute idiot who didn't listen to a thing I told him - Yeah, Indian sub-continent))

First WU completed

The next two I had to abort
of note, BOTH of those two were aborted by other users, as well

I'm currently at max bandwidth, for my ISP this area (small neighborhood separated from the rest of the city by a river) so may have to shop for another carrier

(Yeah I was told "we are upgrading our service throughout the country and surveys are underway even now HaHaHa)


Guess I need to shop around and see if anyone else has better bandwidth, here



Looks like for the meantime, I either don't run Atlas, or do and accept a success rate around 1 in 5 or 1 in 8 though that's not really fair to the project or other crunchers



<sigh>
29) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43227)
Posted 17 Aug 2020 by keputnam
Post:
Double checked Yeti's check list - all good

Called my ISP and asked if there was anything they could do to reduce latency

They couldn't access the modem control panel from their end, and I couldn't access it from within my home network

They also said it was over 7 years old and offered to send me a new one, which should be here WED afternoon sometime

Let me get it hooked up and set "accept new tasks" here and lets see what happens



Thanks for all the responses so far

Really appreciated
30) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43225)
Posted 17 Aug 2020 by keputnam
Post:
Thanks, Guys


Guest Edition?

Not familiar with that term

Already at VBox 6.0.14 with Extension Pack 6.0.14


I'll review Yeti's checklist one more time
31) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43199)
Posted 8 Aug 2020 by keputnam
Post:
Sorry for the delayed response I was out of town most of the week



I'm not seeing what you describe, but here are the few lines of the VBox.log


00:00:10.586190 IEM: rdmsr(0x4e) -> #GP(0)
00:00:10.720435 APIC0: Switched mode to x2APIC
00:00:10.828486 PIT: mode=0 count=0x10000 (65536) - 18.20 Hz (ch=0)
00:00:10.863375 APIC1: Switched mode to x2APIC
00:00:10.863391 GIM: KVM: VCPU 1: Enabled system-time struct. at 0x000000014bf84040 - u32TscScale=0x9b26c76a i8TscShift=-1 uVersion=2 fFlags=0x1 uTsc=0x4d5156a93 uVirtNanoTS=0x176e06bcd
00:00:10.864397 IEM: rdmsr(0x4e) -> #GP(0)
00:00:12.276698 IEM: wrmsr(0xc90,0x0`000fffff) -> #GP(0)
00:00:13.344427 PIIX3 ATA: Ctl#0: RESET, DevSel=0 AIOIf=0 CmdIf0=0xc4 (-1 usec ago) CmdIf1=0x00 (-1 usec ago)
00:00:13.344508 PIIX3 ATA: Ctl#0: finished processing RESET
00:00:13.344924 PIIX3 ATA: Ctl#1: RESET, DevSel=0 AIOIf=0 CmdIf0=0xa1 (-1 usec ago) CmdIf1=0x00 (-1 usec ago)
00:00:13.344994 PIIX3 ATA: Ctl#1: finished processing RESET
00:00:15.339531 NAT: Link up
00:00:17.175622 VMMDev: Guest Additions information report: Version 5.2.32 r132073 '5.2.32'
00:00:17.175672 VMMDev: Guest Additions information report: Interface = 0x00010004 osType = 0x00053100 (Linux >= 2.6, 64-bit)
00:00:17.175813 VMMDev: Guest Additions capability report: (0x0 -> 0x0) seamless: no, hostWindowMapping: no, graphics: no
00:00:17.176096 VMMDev: Guest reported fixed hypervisor window at 00001800000 LB 0x2400000 (rc=VINF_SUCCESS)
00:00:17.176121 VMMDev: vmmDevReqHandler_HeartbeatConfigure: No change (fHeartbeatActive=false)
00:00:17.176141 VMMDev: Heartbeat flatline timer set to trigger after 4 000 000 000 ns
00:00:17.176199 VMMDev: Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
00:00:17.176806 VMMDev: Guest Log: vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
00:00:17.576133 Display::i_handleDisplayResize: uScreenId=0 pvVRAM=000000000ac60000 w=800 h=600 bpp=32 cbLine=0xC80 flags=0x1 origin=0,0
00:00:21.852605 NAT: IPv6 not supported
00:00:22.141405 NAT: DHCP offered IP address 10.0.2.15
00:00:22.141752 NAT: DHCP offered IP address 10.0.2.15
00:00:24.308484 VMMDev: Guest Log: Checking CVMFS...
00:00:35.698186 VMMDev: Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
00:00:35.698208 VMMDev: Guest Log: 00:00:00.000211 main Log opened 2020-08-08T12:40:50.916026000Z
00:00:35.698272 VMMDev: Guest Log: 00:00:00.000313 main OS Product: Linux
00:00:35.698310 VMMDev: Guest Log: 00:00:00.000354 main OS Release: 3.10.0-957.27.2.el7.x86_64
00:00:35.698344 VMMDev: Guest Log: 00:00:00.000389 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
00:00:35.698383 VMMDev: Guest Log: 00:00:00.000424 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
00:00:35.698391 VMMDev: Guest Log: 00:00:00.000426 main Process ID: 1490
00:00:35.698396 VMMDev: Guest Log: 00:00:00.000427 main Package type: LINUX_64BITS_GENERIC
00:00:35.703679 VMMDev: Guest Log: 00:00:00.005729 main 5.2.32 r132073 started. Verbose level = 0
00:00:35.704600 Guest Control: GUEST_MSG_REPORT_FEATURES: 0x1, 0x8000000000000000
00:00:45.706543 VMMDev: Guest Log: 00:00:10.008554 timesync vgsvcTimeSyncWorker: Radical guest time change: 25 211 221 087 000ns (GuestNow=1 596 915 662 144 209 000 ns GuestLast=1 596 890 450 923 122 000 ns fSetTimeLastLoop=true )
00:10:11.861076 Display::i_handleDisplayResize: uScreenId=0 pvVRAM=000000000ac60000 w=800 h=600 bpp=0 cbLine=0xC80 flags=0x5 origin=0,0
32) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43179)
Posted 3 Aug 2020 by keputnam
Post:
??

Is that file structure on LINUX, because it doesn't exist on my Win10 machine


I have a Boinc Data Folder

Under that I have Projects and Slots directories among others

Current Theory job is running at CPU 00:00:52 Elapsed 00:34:07 in slot 8

Neither the “cernvm\shared” folder or the runRivet.log file exists anywhere in the DATA directory
33) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43176)
Posted 3 Aug 2020 by keputnam
Post:
Gunde,


That's the point

The CPU time stops increasing and never starts up again
34) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43173)
Posted 3 Aug 2020 by keputnam
Post:
Aaaaaaand the next Theory WU is at 3 hours CPU time and counting


sigh
35) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43172)
Posted 3 Aug 2020 by keputnam
Post:
OK Tried Theory

Same thing

Well, the first two ran OK,

then with the rest processor time gets to a random point, then stops while elapsed time keeps going

I tried in both uni-thread and MT modes
36) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43168)
Posted 2 Aug 2020 by keputnam
Post:
OK

I've turn off Atlas and selected Theory

Take a day or two to clear the two Atlas WUs I've already got
37) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43137)
Posted 30 Jul 2020 by keputnam
Post:
I've run ATLAS as a standalone project and under the LHC umbrella since SEPT of 2004

Had a hiccup several years ago and my logs were showing no connection to server Did some network setting tweaks and bumped my bandwidth with my ISP and things settled down

up until about 8 weeks ago I was chugging through WUs with no problems whatsoever

I have one concurrent task, two CPUs max, and the correct RAM settings in app_config I have made no changes for over a year, until this started happening

I dont stop and start BOINC randomly


And as i said above
The last 6 Wus that I have aborted had one other aborted WU for the same task

Last night I had on with 35 seconds of CPU and 3 and a half hours Elapsed Just for grins I left it running Somewhere around 02:30 local (based on current CPU time), it took off and is still running
38) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43130)
Posted 30 Jul 2020 by keputnam
Post:
Just a note for consideration


The last 6 Wus that I have aborted had one other aborted WU for the same task

Apparently I'm not the only one, eh?
39) Message boards : ATLAS application : Processor Time Locks Up Elapsed Time Continues to Climb (Message 43125)
Posted 29 Jul 2020 by keputnam
Post:
If it is a network issue, it is ONLY on ATLAS I can upload/download all other projects I crunch for, I can access all other web sites

I did have problems downloading three xxx.pool.1 files, Ended up aborting them

But I really don't think my CPU time problem has anything to do with network
40) Message boards : Number crunching : Download Server Offline? (Message 43120)
Posted 28 Jul 2020 by keputnam
Post:
Still get a failure to connect error


Previous 20 · Next 20


©2024 CERN