21) Message boards : News : Theory application reaches 5 TRILLION events !! (Message 42686)
Posted 30 May 2020 by Sesson
Post:
The jet charge plots at http://mcplots.cern.ch/?query=plots,ppppbar,jets,jet_charge look so bad that all of these generators are off by huge differences.


However the referenced experimental article from CMS said predictions of PYTHIA8 and HERWIG++ matched almost perfectly with experiment results. Quite strange.

http://cms-results.web.cern.ch/cms-results/public-results/publications/SMP-15-003/
22) Message boards : News : CERN and COVID-19 (Message 42447)
Posted 13 May 2020 by Sesson
Post:
LHC@home sends tasks directly from HTCondor to your VirtualBox, BOINC server only sends you pseudo-task that just means there is something to do using VirtualBox. I can't believe Folding@home is more complex than LHC@home, and yet LHC@home is a BOINC project.
23) Message boards : News : Theory application reaches 5 TRILLION events !! (Message 42333)
Posted 29 Apr 2020 by Sesson
Post:
Yes, I run say 50 tasks. In assume in theory yes but seems like for LHC, more cores is better, clock speed doesn't see so important.


Believe it or not, I see identical credits/elapsed time ratio when I underclock my CPU to 800MHz from its stock frequency of 2500MHz. It seems LHC@home gives credits only based on your total time and BOINC benchmark. Your actual contribution to LHC@home can be seen at mcplots website.

So if you want more science results, boost all your cores and improve your network speed, or even better install linux inside your VirtualBox and run natives there. But if you just want more credits/W, underclock your CPU, make your network slower, and run as many tasks in parallel as possible without regard to cache performance.
24) Message boards : News : Theory application reaches 5 TRILLION events !! (Message 42329)
Posted 28 Apr 2020 by Sesson
Post:
Thank you for providing such a great educational resource at http://mcplots.cern.ch/ where anyone can see how our research in particle physics has progressed so far and what is the current state. Until now I was assuming scientists has modeled the LHC experiment to a precision on the order of 1e-10 or better, but the plots and predictions at mcplots is a bit of, disappointing. It is not uncommon to see theorical prediction go completely off the experimental uncertainty, sometimes by an order of magnitude! No wonder why scientists need such a strict standard of 5σ confidence in order to announce a discovery.
I have been diving in CERN publications in the hope that I can interpret these plots which I contributed to one day. But apart from authors of LHC@home team, I failed to see any "mcplots" being published. Then a big question arises: are these resources just "educational"? Has any scientist not from LHC@home team published one of these plots?
25) Message boards : Number crunching : Setting up a local squid cache for a home cluster - old comments (Message 42207)
Posted 17 Apr 2020 by Sesson
Post:
While one of the reasons for my participation in LHC@home is its less CPU utilization to keep power in control, I'm tired of waiting and watching these uncached tasks. I should better set up a linux in my VirtualBox and run native tasks there.
26) Message boards : Number crunching : Setting up a local squid cache for a home cluster - old comments (Message 42192)
Posted 16 Apr 2020 by Sesson
Post:
Another uncached task Theory_2378-1028449-3_0, elapsed time 48:56, CPU time 2:07, currently still downloading (https://lhcathome.cern.ch/lhcathome/result.php?resultid=271634163)
init_data.xml:
<app_init_data>
<major_version>7</major_version>
<minor_version>16</minor_version>
<release>5</release>
<app_version>30005</app_version>
<userid>583569</userid>
<teamid>0</teamid>
<hostid>10591872</hostid>
<app_name>Theory</app_name>
<project_preferences>

<apps_selected>
<app_id>1</app_id>
<app_id>13</app_id>
</apps_selected>
<max_jobs>4</max_jobs>
<max_cpus>2</max_cpus>
</project_preferences>
<user_name>Sesson</user_name>
<project_dir>C:\ProgramData\BOINC/projects/lhcathome.cern.ch_lhcathome</project_dir>
<boinc_dir>C:\ProgramData\BOINC</boinc_dir>
<authenticator>blahblah</authenticator>
<wu_name>Theory_2378-1028449-3</wu_name>
<result_name>Theory_2378-1028449-3_0</result_name>
<comm_obj_name>boinc_0</comm_obj_name>
<slot>1</slot>
<client_pid>4984</client_pid>
<wu_cpu_time>0.000000</wu_cpu_time>
<starting_elapsed_time>0.000000</starting_elapsed_time>
<using_sandbox>0</using_sandbox>
<vm_extensions_disabled>0</vm_extensions_disabled>
<user_total_credit>678733.580860</user_total_credit>
<user_expavg_credit>751.647658</user_expavg_credit>
<host_total_credit>311157.952305</host_total_credit>
<host_expavg_credit>750.732287</host_expavg_credit>
<resource_share_fraction>1.000000</resource_share_fraction>
<checkpoint_period>60.000000</checkpoint_period>
<fraction_done_start>0.000000</fraction_done_start>
<fraction_done_end>1.000000</fraction_done_end>
<gpu_type></gpu_type>
<gpu_device_num>-1</gpu_device_num>
<gpu_opencl_dev_index>-1</gpu_opencl_dev_index>
<gpu_usage>0.000000</gpu_usage>
<ncpus>1.000000</ncpus>
<rsc_fpops_est>3600000000000.000000</rsc_fpops_est>
<rsc_fpops_bound>6000000000000000000.000000</rsc_fpops_bound>
<rsc_memory_bound>700000000.000000</rsc_memory_bound>
<rsc_disk_bound>8000000000.000000</rsc_disk_bound>
<computation_deadline>1587799861.000000</computation_deadline>
<vbox_window>0</vbox_window>
<host_info>blahblah
</host_info>blahblah
<proxy_info>
    <use_http_proxy/>
    <socks_server_name>127.0.0.1</socks_server_name>
    <socks_server_port>9150</socks_server_port>
    <http_server_name>192.168.1.236</http_server_name>
    <http_server_port>3128</http_server_port>
    <socks5_user_name></socks5_user_name>
    <socks5_user_passwd></socks5_user_passwd>
    <socks5_remote_dns>0</socks5_remote_dns>
    <http_user_name></http_user_name>
    <http_user_passwd></http_user_passwd>
    <no_proxy></no_proxy>
    <no_autodetect>0</no_autodetect>
</proxy_info>
<global_preferences>
   <source_project>http://einstein.phys.uwm.edu/</source_project>
   <mod_time>1548296957.000000</mod_time>
   <battery_charge_min_pct>90.000000</battery_charge_min_pct>
   <battery_max_temperature>40.000000</battery_max_temperature>
   <run_on_batteries>0</run_on_batteries>
   <run_if_user_active>1</run_if_user_active>
   <run_gpu_if_user_active>1</run_gpu_if_user_active>
   <suspend_if_no_recent_input>0.000000</suspend_if_no_recent_input>
   <suspend_cpu_usage>0.000000</suspend_cpu_usage>
   <start_hour>0.000000</start_hour>
   <end_hour>0.000000</end_hour>
   <net_start_hour>0.000000</net_start_hour>
   <net_end_hour>0.000000</net_end_hour>
   <leave_apps_in_memory>1</leave_apps_in_memory>
   <confirm_before_connecting>1</confirm_before_connecting>
   <hangup_if_dialed>0</hangup_if_dialed>
   <dont_verify_images>0</dont_verify_images>
   <work_buf_min_days>1.000000</work_buf_min_days>
   <work_buf_additional_days>1.000000</work_buf_additional_days>
   <max_ncpus_pct>100.000000</max_ncpus_pct>
   <cpu_scheduling_period_minutes>60.000000</cpu_scheduling_period_minutes>
   <disk_interval>60.000000</disk_interval>
   <disk_max_used_gb>20.000000</disk_max_used_gb>
   <disk_max_used_pct>100.000000</disk_max_used_pct>
   <disk_min_free_gb>0.000000</disk_min_free_gb>
   <vm_max_used_pct>2.000000</vm_max_used_pct>
   <ram_max_used_busy_pct>70.000000</ram_max_used_busy_pct>
   <ram_max_used_idle_pct>95.000000</ram_max_used_idle_pct>
   <idle_time_to_run>3.000000</idle_time_to_run>
   <max_bytes_sec_up>0.000000</max_bytes_sec_up>
   <max_bytes_sec_down>0.000000</max_bytes_sec_down>
   <cpu_usage_limit>100.000000</cpu_usage_limit>
   <daily_xfer_limit_mb>0.000000</daily_xfer_limit_mb>
   <daily_xfer_period_days>0</daily_xfer_period_days>
   <override_file_present>1</override_file_present>
   <network_wifi_only>1</network_wifi_only>
</global_preferences>
<app_file>vboxwrapper_26198ab7_windows_x86_64.exe</app_file>
<app_file>Theory_2019_11_13a.xml</app_file>
<app_file>Theory_2020_01_15.vdi</app_file>
</app_init_data>


access_squid.log:
192.168.1.236 3128 - - [16/Apr/2020:15:31:06 +0800] "GET http://lhcathome-upload.cern.ch/lhcathome/download//18a/2378-1028449-3.run HTTP/1.1" 200 142055 "-" "BOINC client (windows_x86_64 7.16.5)" TCP_MISS:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:31:28 +0800] "CONNECT lhcathome.cern.ch:443 HTTP/1.1" 200 66859 "-" "BOINC client (windows_x86_64 7.16.5)" TCP_TUNNEL:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:32:30 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1444 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:32:32 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished HTTP/1.1" 200 1428 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:32:32 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1288 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MEM_HIT:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:32:32 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished HTTP/1.1" 200 1280 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MEM_HIT:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:32:33 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished HTTP/1.1" 200 1382 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:32:33 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished HTTP/1.1" 200 1227 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:32:52 +0800] "GET http://s1asgc-cvmfs.openhtc.io:8080/cvmfs/alice.cern.ch/api/v1.0/geo/192.168.1.236/s1asgc-cvmfs.openhtc.io,s1bnl-cvmfs.openhtc.io,s1cern-cvmfs.openhtc.io,s1fnal-cvmfs.openhtc.io,s1ihep-cvmfs.openhtc.io,s1ral-cvmfs.openhtc.io,s1unl-cvmfs.openhtc.io HTTP/1.1" 200 1107 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MISS:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:32:53 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished HTTP/1.1" 200 1397 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:32:58 +0800] "GET http://s1cern-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/api/v1.0/geo/192.168.1.236/s1asgc-cvmfs.openhtc.io,s1bnl-cvmfs.openhtc.io,s1cern-cvmfs.openhtc.io,s1fnal-cvmfs.openhtc.io,s1ihep-cvmfs.openhtc.io,s1ral-cvmfs.openhtc.io,s1unl-cvmfs.openhtc.io HTTP/1.1" 200 1089 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MISS:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:32:58 +0800] "GET http://s1bnl-cvmfs.openhtc.io/cvmfs/sft.cern.ch/api/v1.0/geo/192.168.1.236/s1asgc-cvmfs.openhtc.io,s1bnl-cvmfs.openhtc.io,s1cern-cvmfs.openhtc.io,s1fnal-cvmfs.openhtc.io,s1ihep-cvmfs.openhtc.io,s1ral-cvmfs.openhtc.io,s1unl-cvmfs.openhtc.io HTTP/1.1" 200 1162 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MISS:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:32:58 +0800] "GET http://s1cern-cvmfs.openhtc.io/cvmfs/grid.cern.ch/api/v1.0/geo/192.168.1.236/s1asgc-cvmfs.openhtc.io,s1bnl-cvmfs.openhtc.io,s1cern-cvmfs.openhtc.io,s1fnal-cvmfs.openhtc.io,s1ihep-cvmfs.openhtc.io,s1ral-cvmfs.openhtc.io,s1unl-cvmfs.openhtc.io HTTP/1.1" 200 1075 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MISS:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:33:17 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished HTTP/1.1" 200 1321 "-" "curl/7.29.0" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:36:32 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1444 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:36:32 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1288 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MEM_HIT:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:36:33 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished HTTP/1.1" 200 1428 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:36:33 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished HTTP/1.1" 200 1273 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:36:35 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished HTTP/1.1" 200 1382 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:36:35 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished HTTP/1.1" 200 1227 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:36:54 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished HTTP/1.1" 200 1392 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:40:32 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1444 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:40:32 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1289 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:40:34 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished HTTP/1.1" 200 1428 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:40:34 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished HTTP/1.1" 200 1273 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:40:36 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished HTTP/1.1" 200 1382 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:40:36 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished HTTP/1.1" 200 1227 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:40:54 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished HTTP/1.1" 200 1392 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:42:44 +0800] "CONNECT lhcathome.cern.ch:443 HTTP/1.1" 200 30633 "-" "BOINC client (windows_x86_64 7.16.5)" TCP_TUNNEL:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:15:44:38 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 0 254 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TAG_NONE_ABORTED:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:44:38 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 0 254 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TAG_NONE_ABORTED:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:44:39 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished HTTP/1.1" 200 1278 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:15:44:39 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished HTTP/1.1" 200 1433 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT

(the rest are all *.cvmfspublished)

squid -k parse
2020/04/16 16:13:17| Startup: Initializing Authentication Schemes ...
2020/04/16 16:13:17| Startup: Initialized Authentication Scheme 'basic'
2020/04/16 16:13:17| Startup: Initialized Authentication Scheme 'digest'
2020/04/16 16:13:17| Startup: Initialized Authentication Scheme 'negotiate'
2020/04/16 16:13:17| Startup: Initialized Authentication Scheme 'ntlm'
2020/04/16 16:13:17| Startup: Initialized Authentication.
2020/04/16 16:13:17| Processing Configuration File: /etc/squid/squid.conf (depth
 0)
2020/04/16 16:13:17| Processing: acl localnet src 10.0.0.0/8    # RFC1918 possib
le internal network
2020/04/16 16:13:17| Processing: acl localnet src 172.16.0.0/12 # RFC1918 possib
le internal network
2020/04/16 16:13:17| Processing: acl localnet src 192.168.0.0/16        # RFC191
8 possible internal network
2020/04/16 16:13:17| Processing: acl localnet src fc00::/7       # RFC 4193 loca
l private network range
2020/04/16 16:13:17| Processing: acl localnet src fe80::/10      # RFC 4291 link
-local (directly plugged) machines
2020/04/16 16:13:17| Processing: acl SSL_ports port 443
2020/04/16 16:13:17| Processing: acl Safe_ports port 80         # http
2020/04/16 16:13:17| Processing: acl Safe_ports port 21         # ftp
2020/04/16 16:13:17| Processing: acl Safe_ports port 443                # https
2020/04/16 16:13:17| Processing: acl Safe_ports port 70         # gopher
2020/04/16 16:13:17| Processing: acl Safe_ports port 210                # wais
2020/04/16 16:13:17| Processing: acl Safe_ports port 1025-65535 # unregistered p
orts
2020/04/16 16:13:17| Processing: acl Safe_ports port 280                # http-m
gmt
2020/04/16 16:13:17| Processing: acl Safe_ports port 488                # gss-ht
tp
2020/04/16 16:13:17| Processing: acl Safe_ports port 591                # filema
ker
2020/04/16 16:13:17| Processing: acl Safe_ports port 777                # multil
ing http
2020/04/16 16:13:17| Processing: acl CONNECT method CONNECT
2020/04/16 16:13:17| Processing: http_access allow localhost manager
2020/04/16 16:13:17| Processing: http_access deny manager
2020/04/16 16:13:17| Processing: http_access deny !Safe_ports
2020/04/16 16:13:17| Processing: http_access deny CONNECT !SSL_ports
2020/04/16 16:13:17| Processing: http_access deny to_localhost
2020/04/16 16:13:17| Processing: http_access allow localnet
2020/04/16 16:13:17| Processing: http_access allow localhost
2020/04/16 16:13:17| Processing: http_access deny all
2020/04/16 16:13:17| Processing: http_port 192.168.1.236:3128
2020/04/16 16:13:17| Processing: coredump_dir /var/cache/squid
2020/04/16 16:13:17| Processing: refresh_pattern ^ftp:          1440    20%10080

2020/04/16 16:13:17| Processing: refresh_pattern ^gopher:       1440    0%1440
2020/04/16 16:13:17| Processing: refresh_pattern -i (/cgi-bin/|\?) 0    0%0
2020/04/16 16:13:17| Processing: refresh_pattern .              0       20%4320
2020/04/16 16:13:17| Processing: dns_nameservers 8.8.8.8 208.67.222.222
2020/04/16 16:13:17| Processing: max_filedescriptors 3200
2020/04/16 16:13:17| Processing: acl wcg_nocache dstdomain .worldcommunitygrid.o
rg
2020/04/16 16:13:17| Processing: always_direct allow wcg_nocache
2020/04/16 16:13:17| Processing: cache deny wcg_nocache
2020/04/16 16:13:17| Processing: acl einstein_nocache dstdomain einstein2.aei.un
i-hannover.de
2020/04/16 16:13:17| Processing: always_direct allow einstein_nocache
2020/04/16 16:13:17| Processing: cache deny einstein_nocache
2020/04/16 16:13:17| Processing: acl cvmfs_geoapi urlpath_regex -i ^/+cvmfs/+[0-
9a-z._~-]+/+api/+[0-9a-z._~-]+/+geo/+[0-9a-z._~-]+/+[0-9a-z.,_~-]+
2020/04/16 16:13:17| Processing: always_direct allow cvmfs_geoapi
2020/04/16 16:13:17| Processing: cache deny cvmfs_geoapi
2020/04/16 16:13:17| Processing: acl boinc_nocache urlpath_regex -i /download[0-
9a-z._~-]*/+[0-9a-z._~-]+/+.+
2020/04/16 16:13:17| Processing: cache deny boinc_nocache
2020/04/16 16:13:17| Processing: acl PragmaNoCache req_header Pragma no-cache
2020/04/16 16:13:17| Processing: cache deny PragmaNoCache
2020/04/16 16:13:17| Processing: client_dst_passthru off
2020/04/16 16:13:17| Processing: cache_mem 192 MB
2020/04/16 16:13:17| Processing: maximum_object_size_in_memory 24 KB
2020/04/16 16:13:17| Processing: memory_replacement_policy heap GDSF
2020/04/16 16:13:17| Processing: cache_replacement_policy heap LFUDA
2020/04/16 16:13:17| Processing: maximum_object_size 6144 MB
2020/04/16 16:13:17| Processing: cache_dir aufs /var/cache/squid/0 32000 16 64 m
in-size=200
2020/04/16 16:13:17| Processing: logformat my_awstats %>A %lp %ui %un [%tl] "%rm
 %ru HTTP/%rv" %>Hs %st "%{Referer}>h" "%{User-Agent}>h" %Ss:%Sh
2020/04/16 16:13:17| Processing: access_log stdio:/var/log/squid/access_squid.lo
g logformat=my_awstats
2020/04/16 16:13:17| Processing: strip_query_terms off
2020/04/16 16:13:17| Processing: netdb_filename none
2020/04/16 16:13:17| ERROR: 'netdb_filename' requires --enable-icmp
2020/04/16 16:13:17| Processing: coredump_dir none
2020/04/16 16:13:17| Processing: ftp_user anonymous@
2020/04/16 16:13:17| Processing: max_stale 37 days
2020/04/16 16:13:17| Processing: refresh_pattern .      0       0%      0
2020/04/16 16:13:17| Processing: store_avg_object_size 1 MB
2020/04/16 16:13:17| Processing: collapsed_forwarding on
2020/04/16 16:13:17| Processing: client_persistent_connections on
2020/04/16 16:13:17| Processing: server_persistent_connections on
2020/04/16 16:13:17| Processing: digest_generation off
2020/04/16 16:13:17| ERROR: 'digest_generation' requires --enable-cache-digests
2020/04/16 16:13:17| Processing: log_icp_queries off
2020/04/16 16:13:17| Processing: error_default_language en
2020/04/16 16:13:17| Processing: dns_defnames on
2020/04/16 16:13:17| Processing: dns_v4_first on
2020/04/16 16:13:17| Processing: forwarded_for transparent
2020/04/16 16:13:17| Initializing https proxy context


user contribution http://mcplots-dev.cern.ch/production.php?view=user&system=3&userid=583569
27) Message boards : Number crunching : Setting up a local squid cache for a home cluster - old comments (Message 42190)
Posted 16 Apr 2020 by Sesson
Post:
I am using the following conf from the example squid.conf. I decreased the disk cache min size to keep more data in squid. The squid installation is not very big, but it is now 1.21GB including everything cached inside.
# You don't believe this is enough?
# For sure, it is!
cache_mem 192 MB
maximum_object_size_in_memory 24 KB
memory_replacement_policy heap GDSF


# Keep it large enough to store vdi files in the cache.
# See extra section 1 how to avoid onetimers eating up your storage.
# min-size=xxx keeps very small files away from your disk
cache_replacement_policy heap LFUDA
maximum_object_size 6144 MB
cache_dir aufs /var/cache/squid/0 32000 16 64 min-size=200

The squid was mostly working fine but some tasks still don't like it. Here is an example from access_squid.log when an uncached task started:
192.168.1.236 3128 - - [16/Apr/2020:13:21:32 +0800] "POST http://lhcathome-upload.cern.ch/lhcathome_cgi/file_upload_handler HTTP/1.1" 200 960 "-" "BOINC client (windows_x86_64 7.16.5)" TCP_MISS:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:21:36 +0800] "POST http://lhcathome-upload.cern.ch/lhcathome_cgi/file_upload_handler HTTP/1.1" 200 13158 "-" "BOINC client (windows_x86_64 7.16.5)" TCP_MISS:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:21:57 +0800] "GET http://lhcathome-upload.cern.ch/lhcathome/download//ca/2378-1019287-3.run HTTP/1.1" 200 142072 "-" "BOINC client (windows_x86_64 7.16.5)" TCP_MISS:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:22:17 +0800] "CONNECT lhcathome.cern.ch:443 HTTP/1.1" 200 67143 "-" "BOINC client (windows_x86_64 7.16.5)" TCP_TUNNEL:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:22:31 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1439 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:23:28 +0800] "GET http://s1asgc-cvmfs.openhtc.io:8080/cvmfs/cernvm-prod.cern.ch/api/v1.0/geo/192.168.1.236/s1asgc-cvmfs.openhtc.io,s1bnl-cvmfs.openhtc.io,s1cern-cvmfs.openhtc.io,s1fnal-cvmfs.openhtc.io,s1ihep-cvmfs.openhtc.io,s1ral-cvmfs.openhtc.io,s1unl-cvmfs.openhtc.io HTTP/1.1" 200 1122 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MISS:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:23:28 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1297 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MEM_HIT:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:13:23:31 +0800] "GET http://s1bnl-cvmfs.openhtc.io/cvmfs/alice.cern.ch/api/v1.0/geo/192.168.1.236/s1asgc-cvmfs.openhtc.io,s1bnl-cvmfs.openhtc.io,s1cern-cvmfs.openhtc.io,s1fnal-cvmfs.openhtc.io,s1ihep-cvmfs.openhtc.io,s1ral-cvmfs.openhtc.io,s1unl-cvmfs.openhtc.io HTTP/1.1" 200 1154 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MISS:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:23:32 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished HTTP/1.1" 200 1392 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:23:34 +0800] "GET http://s1ral-cvmfs.openhtc.io/cvmfs/grid.cern.ch/api/v1.0/geo/192.168.1.236/s1asgc-cvmfs.openhtc.io,s1bnl-cvmfs.openhtc.io,s1cern-cvmfs.openhtc.io,s1fnal-cvmfs.openhtc.io,s1ihep-cvmfs.openhtc.io,s1ral-cvmfs.openhtc.io,s1unl-cvmfs.openhtc.io HTTP/1.1" 0 421 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MISS_ABORTED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:23:34 +0800] "GET http://s1cern-cvmfs.openhtc.io/cvmfs/sft.cern.ch/api/v1.0/geo/192.168.1.236/s1asgc-cvmfs.openhtc.io,s1bnl-cvmfs.openhtc.io,s1cern-cvmfs.openhtc.io,s1fnal-cvmfs.openhtc.io,s1ihep-cvmfs.openhtc.io,s1ral-cvmfs.openhtc.io,s1unl-cvmfs.openhtc.io HTTP/1.1" 0 422 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MISS_ABORTED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:24:00 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1378 "-" "curl/7.29.0" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:24:04 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished HTTP/1.1" 200 1325 "-" "curl/7.29.0" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:24:51 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished HTTP/1.1" 200 1387 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:24:52 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished HTTP/1.1" 200 1236 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MEM_HIT:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:13:24:53 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1439 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:24:53 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished HTTP/1.1" 200 1428 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:24:58 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/sft.cern.ch/.cvmfspublished HTTP/1.1" 200 1231 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MEM_HIT:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:13:24:59 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished HTTP/1.1" 200 1236 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MEM_HIT:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:13:24:59 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/grid.cern.ch/.cvmfspublished HTTP/1.1" 200 1280 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MEM_HIT:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:13:25:03 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1292 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MEM_HIT:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:13:26:33 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1439 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT
192.168.1.236 3128 - - [16/Apr/2020:13:27:28 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch/.cvmfspublished HTTP/1.1" 200 1292 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_MEM_HIT:HIER_NONE
192.168.1.236 3128 - - [16/Apr/2020:13:27:33 +0800] "GET http://s1ihep-cvmfs.openhtc.io/cvmfs/alice.cern.ch/.cvmfspublished HTTP/1.1" 200 1387 "-" "cvmfs Fuse 2.5.2 11ac1fe9-e05a-44b5-b29e-ca3d2370db11" TCP_REFRESH_MODIFIED:HIER_DIRECT

After that access_squid.log doesn't log any activity until an Einstein@home GPU task finished, but the network is busy, netstat shows VBoxHeadless.exe is connected to Cloudflare, not squid.exe.
28) Message boards : Number crunching : Setting up a local squid cache for a home cluster - old comments (Message 42184)
Posted 15 Apr 2020 by Sesson
Post:
I set up squid on Windows on the same machine running BOINC just yesterday and it is working. Here are steps:

    1. Download Squid from https://squid.diladele.com/ and install it. I'm running Rosetta@home and Einstein@home as well as Test4Theory and the squid cache is about 1GB in size, please install it on a drive with sufficient disk space. Let's say it is installed at C:/Squid/ for the sake of simplicity.
    2. Right click on the squid tray to stop squid service and open squid.conf. Copy the example squid.conf into your squid.conf.
    3. Search for http_port setting and change it to
    http_port <LAN IP Address>:3128
    . Here you cannot use "localhost" nor "127.0.0.1", you must use a IP address that is accessible from within the VM. You may configurate your LAN router to assign your computer a fixed LAN IP such as 192.168.2.1 and use that. An IP that is in a VirtualBox LAN might work.
    4. In command prompt under C:/Squid/, run
    bin/squid -z
    to create subdirectories. I created
    C:\Squid\var\cache\squid\0
    directory manually before, but it might be not necessary.
    5. Now configurate BOINC to use a HTTP proxy at <LAN IP Address>:3128. You can now start downloading LHC@home tasks.


I still have to run more tasks in order to fill up my cache, and despite a Squid proxy is set up and serving CVMFS, the Test4Theory VM still connects directly to the Internet to download huge amount of data, so you can see the wallclock time/CPU time on my computer is incredibly low. I have a slow Internet connection, this is still much better than just running Sixtrack for LHC@home.

29) Message boards : Sixtrack Application : No more workspace1_HEL_Qp_2_MO_0_1t_3s_1e7turns_BOINC tasks for my small laptop (Message 40872)
Posted 9 Dec 2019 by Sesson
Post:
Please don't send me these tasks with deadline of just 7 days. I just completed my first 1e7turns task with more than 96 hours of processing by turnning on my computer when it should be powered off, and allowing it to use single core boosting which is not productive overall. I'm completing my second 1e7turns task now. No new tasks.
30) Message boards : Theory Application : Can I run Virtual Box tasks without Internet connection or with slow/unstable Internet connection? (Message 39809)
Posted 3 Sep 2019 by Sesson
Post:
Can I run Virtual Box tasks without Internet connection or with slow/unstable Internet connection? Can I run the tasks while using BitTorrent? Will the task be finished without the results being sent to CERN?


Previous 20


©2024 CERN