1) Message boards : Number crunching : Double counting? (Message 49280)
Posted 26 Jan 2024 by BellyNitpicker
Post:
I have just checked my stats on BOINCSTATS and discovered that my score for the last three years on LHC@Home has been replicated into an LHC-DEV score. It shoots me up the charts a little, but perhaps it should be removed.

https://www.boincstats.com/stats/-1/user/detail/96181147537/projectList
2) Message boards : ATLAS application : ATLAS vbox and native 3.01 (Message 47986)
Posted 9 Apr 2023 by BellyNitpicker
Post:
This is part of the problem since all logs are gone which may have included useful hints.
So far the server shows successful ATLAS v2.03 logs but not a single one from v3.01.


Here is a log. I reduced the CPUs available to three, but left memory at 13GB. Two previously lost tasks downloaded, this time for 3CPUs. Both advertised their estimated duration as 4h20m. I ran one to conclusion, its actual duration was 35h15m. Remember that the 5CPU tasks also ran on for a very long time beyond their estimated time.

NB. Prior to the events of the last week, I have been running Ubuntu VMs alongside BOINC on Darwin (with LHC as its only project) for more than two years without conflict or problem (Except for the short-term VBox memory leak in an earlier version of MacOS/Darwin). The three VMs have a total memory allocation of 12GB, so there's 7GB (give or take) left over for system activity.

Thu 6 Apr 16:10:02 2023 | | cc_config.xml not found - using defaults
Thu 6 Apr 16:10:02 2023 | | Starting BOINC client version 7.20.4 for x86_64-apple-darwin
Thu 6 Apr 16:10:02 2023 | | log flags: file_xfer, sched_ops, task
Thu 6 Apr 16:10:02 2023 | | Libraries: libcurl/7.79.1 SecureTransport zlib/1.2.11 c-ares/1.17.2
Thu 6 Apr 16:10:02 2023 | | Data directory: /Library/Application Support/BOINC Data
Thu 6 Apr 16:10:02 2023 | | OpenCL: Intel GPU 0: Intel(R) UHD Graphics 630 (driver version 1.2(Jan 10 2023 21:29:09), device version OpenCL 1.2, 1536MB, 1536MB available, 230 GFLOPS peak)
Thu 6 Apr 16:10:02 2023 | | OpenCL CPU: Intel(R) Core(TM) i7-8700B CPU @ 3.20GHz (OpenCL driver vendor: Apple, driver version 1.1, device version OpenCL 1.2)
Thu 6 Apr 16:10:02 2023 | | Host name: NandLBTScience
Thu 6 Apr 16:10:02 2023 | | Processor: 12 GenuineIntel Intel(R) Core(TM) i7-8700B CPU @ 3.20GHz [x86 Family 6 Model 158 Stepping 10]
Thu 6 Apr 16:10:02 2023 | | Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clfsh ds acpi mmx fxsr sse sse2 ss htt tm pbe pni pclmulqdq dtes64 mon dscpl vmx smx est tm2 ssse3 fma cx16 tpr pdcm sse4_1 sse4_2 x2apic movbe popcnt aes pcid xsave osxsave seglim64 tsctmr avx rdrand f16c
Thu 6 Apr 16:10:02 2023 | | OS: Mac OS X 12.6.3 (Darwin 21.6.0)
Thu 6 Apr 16:10:02 2023 | | Memory: 32.00 GB physical, 209.57 GB virtual
Thu 6 Apr 16:10:02 2023 | | Disk: 465.63 GB total, 209.57 GB free
Thu 6 Apr 16:10:02 2023 | | Local time is UTC +1 hours
Thu 6 Apr 16:10:02 2023 | | VirtualBox version: 7.0.6r155176
Thu 6 Apr 16:10:02 2023 | | General prefs: from https://climateprediction.net/ (last modified 23-Dec-2021 14:43:38)
Thu 6 Apr 16:10:02 2023 | | Computer location: home
Thu 6 Apr 16:10:02 2023 | | General prefs: no separate prefs for home; using your defaults
Thu 6 Apr 16:10:02 2023 | | Reading preferences override file
Thu 6 Apr 16:10:02 2023 | | Preferences:
Thu 6 Apr 16:10:02 2023 | | max memory usage when active: 13107.20 MB
Thu 6 Apr 16:10:02 2023 | | max memory usage when idle: 13107.20 MB
Thu 6 Apr 16:10:02 2023 | | max disk usage: 40.00 GB
Thu 6 Apr 16:10:02 2023 | | max CPUs used: 5
Thu 6 Apr 16:10:02 2023 | | (to change preferences, visit a project web site or select Preferences in the Manager)
Thu 6 Apr 16:10:02 2023 | | Setting up project and slot directories
Thu 6 Apr 16:10:02 2023 | | Checking active tasks
Thu 6 Apr 16:10:02 2023 | LHC@home | URL https://lhcathome.cern.ch/lhcathome/; Computer ID 10667017; resource share 10
Thu 6 Apr 16:10:02 2023 | | Setting up GUI RPC socket
Thu 6 Apr 16:10:02 2023 | | Checking presence of 0 project files
Thu 6 Apr 16:10:22 2023 | | General prefs: from https://climateprediction.net/ (last modified 23-Dec-2021 14:43:38)
Thu 6 Apr 16:10:22 2023 | | Computer location: home
Thu 6 Apr 16:10:22 2023 | | General prefs: no separate prefs for home; using your defaults
Thu 6 Apr 16:10:22 2023 | | Reading preferences override file
Thu 6 Apr 16:10:22 2023 | | Preferences:
Thu 6 Apr 16:10:22 2023 | | max memory usage when active: 13107.20 MB
Thu 6 Apr 16:10:22 2023 | | max memory usage when idle: 13107.20 MB
Thu 6 Apr 16:10:22 2023 | | max disk usage: 40.00 GB
Thu 6 Apr 16:10:22 2023 | | Number of usable CPUs has changed from 5 to 3.
Thu 6 Apr 16:10:22 2023 | | max CPUs used: 3
Thu 6 Apr 16:10:22 2023 | | (to change preferences, visit a project web site or select Preferences in the Manager)
Thu 6 Apr 16:10:38 2023 | LHC@home | update requested by user
Thu 6 Apr 16:10:43 2023 | LHC@home | project resumed by user
Thu 6 Apr 16:10:44 2023 | LHC@home | Master file download succeeded
Thu 6 Apr 16:10:49 2023 | LHC@home | Sending scheduler request: Requested by user.
Thu 6 Apr 16:10:49 2023 | LHC@home | Not requesting tasks: "no new tasks" requested via Manager
Thu 6 Apr 16:10:50 2023 | LHC@home | Scheduler request completed
Thu 6 Apr 16:10:50 2023 | LHC@home | Project requested delay of 6 seconds
Thu 6 Apr 16:10:51 2023 | LHC@home | work fetch resumed by user
Thu 6 Apr 16:11:00 2023 | LHC@home | Sending scheduler request: To fetch work.
Thu 6 Apr 16:11:00 2023 | LHC@home | Requesting new tasks for CPU
Thu 6 Apr 16:11:01 2023 | LHC@home | Scheduler request completed: got 2 new tasks
Thu 6 Apr 16:11:01 2023 | LHC@home | Resent lost task FzWLDmF0o12nsSi4apGgGQJmABFKDmABFKDmjv4TDmAmnKDm8Wupsn_0
Thu 6 Apr 16:11:01 2023 | LHC@home | Resent lost task SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_0
Thu 6 Apr 16:11:01 2023 | LHC@home | Project requested delay of 6 seconds
Thu 6 Apr 16:11:03 2023 | LHC@home | Started download of vboxwrapper_26206_x86_64-apple-darwin
Thu 6 Apr 16:11:03 2023 | LHC@home | Started download of ATLAS_vbox_3.01_job.xml
Thu 6 Apr 16:11:04 2023 | LHC@home | Finished download of vboxwrapper_26206_x86_64-apple-darwin
Thu 6 Apr 16:11:04 2023 | LHC@home | Finished download of ATLAS_vbox_3.01_job.xml
Thu 6 Apr 16:11:04 2023 | LHC@home | Started download of ATLAS_vbox_3.01_image.vdi
Thu 6 Apr 16:11:04 2023 | LHC@home | Started download of FzWLDmF0o12nsSi4apGgGQJmABFKDmABFKDmjv4TDmAmnKDm8Wupsn_EVNT.32794571._000076.pool.root.1
Thu 6 Apr 16:11:11 2023 | LHC@home | Sending scheduler request: To fetch work.
Thu 6 Apr 16:11:11 2023 | LHC@home | Requesting new tasks for CPU
Thu 6 Apr 16:11:12 2023 | LHC@home | Scheduler request completed: got 0 new tasks
Thu 6 Apr 16:11:12 2023 | LHC@home | No tasks sent
Thu 6 Apr 16:11:12 2023 | LHC@home | No tasks are available for ATLAS Simulation
Thu 6 Apr 16:11:12 2023 | LHC@home | This computer has reached a limit on tasks in progress
Thu 6 Apr 16:11:12 2023 | LHC@home | Project requested delay of 6 seconds
Thu 6 Apr 16:13:13 2023 | LHC@home | work fetch suspended by user
Thu 6 Apr 16:14:30 2023 | LHC@home | Finished download of FzWLDmF0o12nsSi4apGgGQJmABFKDmABFKDmjv4TDmAmnKDm8Wupsn_EVNT.32794571._000076.pool.root.1
Thu 6 Apr 16:14:30 2023 | LHC@home | Started download of FzWLDmF0o12nsSi4apGgGQJmABFKDmABFKDmjv4TDmAmnKDm8Wupsn_input.tar.gz
Thu 6 Apr 16:14:31 2023 | LHC@home | Finished download of FzWLDmF0o12nsSi4apGgGQJmABFKDmABFKDmjv4TDmAmnKDm8Wupsn_input.tar.gz
Thu 6 Apr 16:14:31 2023 | LHC@home | Started download of boinc_job_script.SuPtZn
Thu 6 Apr 16:14:32 2023 | LHC@home | Finished download of boinc_job_script.SuPtZn
Thu 6 Apr 16:14:32 2023 | LHC@home | Started download of SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_EVNT.32794571._000076.pool.root.1
Thu 6 Apr 16:18:32 2023 | LHC@home | Finished download of SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_EVNT.32794571._000076.pool.root.1
Thu 6 Apr 16:18:32 2023 | LHC@home | Started download of SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_input.tar.gz
Thu 6 Apr 16:18:33 2023 | LHC@home | Finished download of SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_input.tar.gz
Thu 6 Apr 16:18:33 2023 | LHC@home | Started download of boinc_job_script.Ao4zBs
Thu 6 Apr 16:18:34 2023 | LHC@home | Finished download of boinc_job_script.Ao4zBs
Thu 6 Apr 16:19:00 2023 | LHC@home | Finished download of ATLAS_vbox_3.01_image.vdi
Thu 6 Apr 16:19:37 2023 | LHC@home | Starting task SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_0
Thu 6 Apr 21:11:17 2023 | LHC@home | Sending scheduler request: Requested by project.
Thu 6 Apr 21:11:17 2023 | LHC@home | Not requesting tasks: "no new tasks" requested via Manager
Thu 6 Apr 21:11:18 2023 | LHC@home | Scheduler request completed
Thu 6 Apr 21:11:18 2023 | LHC@home | Project requested delay of 6 seconds
Fri 7 Apr 02:11:19 2023 | LHC@home | Sending scheduler request: Requested by project.
Fri 7 Apr 02:11:19 2023 | LHC@home | Not requesting tasks: "no new tasks" requested via Manager
Fri 7 Apr 02:11:20 2023 | LHC@home | Scheduler request completed
Fri 7 Apr 02:11:20 2023 | LHC@home | Project requested delay of 6 seconds
Fri 7 Apr 07:11:20 2023 | LHC@home | Sending scheduler request: Requested by project.
Fri 7 Apr 07:11:20 2023 | LHC@home | Not requesting tasks: "no new tasks" requested via Manager
Fri 7 Apr 07:11:21 2023 | LHC@home | Scheduler request completed
Fri 7 Apr 07:11:21 2023 | LHC@home | Project requested delay of 6 seconds
Fri 7 Apr 12:11:24 2023 | LHC@home | Sending scheduler request: Requested by project.
Fri 7 Apr 12:11:24 2023 | LHC@home | Not requesting tasks: "no new tasks" requested via Manager
Fri 7 Apr 12:11:26 2023 | LHC@home | Scheduler request completed
Fri 7 Apr 12:11:26 2023 | LHC@home | Project requested delay of 6 seconds
Fri 7 Apr 15:24:20 2023 | LHC@home | task FzWLDmF0o12nsSi4apGgGQJmABFKDmABFKDmjv4TDmAmnKDm8Wupsn_0 suspended by user
Fri 7 Apr 17:11:30 2023 | LHC@home | Sending scheduler request: Requested by project.
Fri 7 Apr 17:11:30 2023 | LHC@home | Not requesting tasks: "no new tasks" requested via Manager
Fri 7 Apr 17:11:31 2023 | LHC@home | Scheduler request completed
Fri 7 Apr 17:11:31 2023 | LHC@home | Project requested delay of 6 seconds
Fri 7 Apr 22:11:33 2023 | LHC@home | Sending scheduler request: Requested by project.
Fri 7 Apr 22:11:33 2023 | LHC@home | Not requesting tasks: "no new tasks" requested via Manager
Fri 7 Apr 22:11:34 2023 | LHC@home | Scheduler request completed
Fri 7 Apr 22:11:34 2023 | LHC@home | Project requested delay of 6 seconds
Fri 7 Apr 22:25:22 2023 | LHC@home | Aborting task FzWLDmF0o12nsSi4apGgGQJmABFKDmABFKDmjv4TDmAmnKDm8Wupsn_0; not started and deadline has passed
Fri 7 Apr 22:25:54 2023 | LHC@home | Sending scheduler request: To report completed tasks.
Fri 7 Apr 22:25:54 2023 | LHC@home | Reporting 1 completed tasks
Fri 7 Apr 22:25:54 2023 | LHC@home | Not requesting tasks: "no new tasks" requested via Manager
Fri 7 Apr 22:25:55 2023 | LHC@home | Scheduler request completed
Fri 7 Apr 22:25:55 2023 | LHC@home | Project requested delay of 6 seconds
Sat 8 Apr 03:25:57 2023 | LHC@home | Sending scheduler request: Requested by project.
Sat 8 Apr 03:25:57 2023 | LHC@home | Not requesting tasks: "no new tasks" requested via Manager
Sat 8 Apr 03:25:58 2023 | LHC@home | Scheduler request completed
Sat 8 Apr 03:25:58 2023 | LHC@home | Result SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_0 is no longer usable
Sat 8 Apr 03:25:58 2023 | LHC@home | Project requested delay of 6 seconds
Sat 8 Apr 03:26:08 2023 | LHC@home | Sending scheduler request: To report completed tasks.
Sat 8 Apr 03:26:08 2023 | LHC@home | Reporting 1 completed tasks
Sat 8 Apr 03:26:08 2023 | LHC@home | Not requesting tasks: "no new tasks" requested via Manager
Sat 8 Apr 03:26:09 2023 | LHC@home | Scheduler request completed
Sat 8 Apr 03:26:09 2023 | LHC@home | Project requested delay of 6 seconds
Sat 8 Apr 03:26:09 2023 | LHC@home | [error] garbage_collect(); still have active task for acked result SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_0; state 5
Sat 8 Apr 03:26:10 2023 | LHC@home | [error] garbage_collect(); still have active task for acked result SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_0; state 6
Sat 8 Apr 03:26:10 2023 | LHC@home | Computation for task SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_0 finished
Sat 8 Apr 03:26:10 2023 | LHC@home | Output file SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_0_r1880572617_ATLAS_result for task SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_0 absent
Sat 8 Apr 03:26:20 2023 | LHC@home | Sending scheduler request: To report completed tasks.
Sat 8 Apr 03:26:20 2023 | LHC@home | Reporting 1 completed tasks
Sat 8 Apr 03:26:20 2023 | LHC@home | Not requesting tasks: "no new tasks" requested via Manager
Sat 8 Apr 03:26:21 2023 | LHC@home | Scheduler request completed
Sat 8 Apr 03:26:21 2023 | LHC@home | Project requested delay of 6 seconds
Sat 8 Apr 03:26:21 2023 | LHC@home | [error] Got ack for task SRvLDmC4o12nfZGDcpSWOuwoABFKDmABFKDm4gFKDmfrZKDmJuWicn_0, but can't find it
3) Message boards : ATLAS application : ATLAS vbox and native 3.01 (Message 47960)
Posted 1 Apr 2023 by BellyNitpicker
Post:
I don't think the ATLAS task like to be started and stopped.
I would pick a single project application to run and stick to only that for now.


I didn't switch the tasks. That was the BOINC manager.

After an earlier runaway, I: suspended the project; set no new tasks; aborted all existing tasks; tasks; unsuspended; reset the project; allowed new tasks.

All tasks downloaded (8) were ATLAS of the same type.

After >7mins of processing, the active task was made pending and a new one started. My task switching was set to "every 60 mins". I've set it to 9 hours. Have also set my preference only for ATLAS simulation FTB, and max of 2 jobs.

But only when I've run down the Ubuntu VM I started in place of Darwin BOINC, as the VM has a few days of work on it at the moment.
4) Message boards : ATLAS application : ATLAS vbox and native 3.01 (Message 47959)
Posted 1 Apr 2023 by BellyNitpicker
Post:
With Version 3.01 something went wrong. maybe more RAM needed.


Yes, I know my OS is Darwin. I've allocated 12.8GB RAM. That's all you can have, the rest is allocated to other usage. Do you need more??
5) Message boards : ATLAS application : ATLAS vbox and native 3.01 (Message 47954)
Posted 31 Mar 2023 by BellyNitpicker
Post:
Here's the same task, 16 hours later. It has been showing remaining time as --- and percent complete as 100.000% for more than ten hours. The elapsed time is clocking up, but there is no CPU activity associated with the task.

https://drive.google.com/file/d/199A_stcrLa-UzNMEwYPzLSPFfkhg8NFY/view?usp=share_link

As fas as I'm concerned, it's a runaway. I can't afford to keep 45% of my available CPUs clogged with a series of runaway tasks, so I've chopped it. I'll come back to LHC in a few weeks to see if the problems are sorted.
6) Message boards : ATLAS application : ATLAS vbox and native 3.01 (Message 47949)
Posted 30 Mar 2023 by BellyNitpicker
Post:
Where did you set this?


my BOINC settings give it 40% of 32GB

Task time is the estimate provided when the task arrives.

Very unusual.


Maybe so, but the next one is the same. Granted, it's 99.992% at the moment, but it's run for 3hrs 25mins out of its allotted 20 mins and 20 seconds, and looks as though it might accrue another couple of thousandths of a percent over the next twelve hours.

https://drive.google.com/file/d/1qDWN1Kdv82dz4bCAwN4EZ1SES4UWmzWq/view?usp=share_link
7) Message boards : ATLAS application : ATLAS vbox and native 3.01 (Message 47948)
Posted 30 Mar 2023 by BellyNitpicker
Post:
Where did you set this?


I didn't set it. That's the estimated process time when it arrives.

My settings give BOINC a 40% share of 32GB while running native under MacOS.

Very unusual.


Maybe, but the next task is doing the same. True the percentage is not exactly 100, but it's 99.992, and I would expect that tomorrow morning, with an additional 12 hours on the clock, it might have increased a couple of thousandths of a percent.

https://drive.google.com/file/d/1qDWN1Kdv82dz4bCAwN4EZ1SES4UWmzWq/view?usp=share_link
8) Message boards : ATLAS application : ATLAS vbox and native 3.01 (Message 47944)
Posted 30 Mar 2023 by BellyNitpicker
Post:
I'm running ATLAS on a Mac Mini (MacOS 12.6.3) under BOINC (7.20.4) and VirtualBox (7.0.6) with five CPUs, a max memory allocation of 12GB, and disc of 40GB.

Each ATLAST task is set for 5 CPUs, and an initial run time of 00:22:20. They reach 100% after the prescribed time, then run away. I've just chopped the last batch as one had run from 00:22:20 to more than 19 hours while showing progress as 100%.

All was fine until two days ago, when I upgraded VB from 7.0.4.

However, my Ubuntu VMs run without problem

Is there an LHC problem with VB 7.0.6?



©2024 CERN