Posts by zooxit

1) Message boards : Number crunching : Setting up a local Squid to work with LHC@home - Comments and Questions (Message 48135) Posted 26 May 2023 by zooxit Post: Thank you for all the help. I believe it is working now. So how can I actually see if the traffic of boinc or IP address in squid? And how can I check what squid is doing "for my clients;from it's RAM-Cache" as Yeti mentioned?
2) Message boards : Number crunching : Setting up a local Squid to work with LHC@home - Comments and Questions (Message 48128) Posted 25 May 2023 by zooxit Post: After correcting squid.conf as mentioned systemctl status gives no errors. Does it mean that squid is running correctly? How can I check (no GUI)? If i now do: boinccmd --set_proxy_settings squid_hostname_or_IP 3128 '' '' '' '' '' '' '' (as metnioned at top of the thread) will all my projects be connecting through proxy correctly or do I need to add some more stuff to squid.conf?
3) Message boards : Number crunching : Setting up a local Squid to work with LHC@home - Comments and Questions (Message 48126) Posted 25 May 2023 by zooxit Post: So on the Can't create HTTP response output file notices... as expected - mea culpa. I ran boinc as service not daemon (got mixed up on which machine I am working :) ). Will start with squid from the begining slowly and taking into account all that you wrote. Hopefully I willl post back with success. Great thanks computezrmle
4) Message boards : Number crunching : Setting up a local Squid to work with LHC@home - Comments and Questions (Message 48124) Posted 25 May 2023 by zooxit Post: I commented the mentioned lines. I didn't mention it before - I installed squid on the same machine that is crunching - is this a problem? Would it be better if I make a VM on one of my other servers and use that one for squid? Since I installed and configured squid none of my project can connect (Can't create HTTP response output file notices/ wcg, rosetta, sidock, gpugrid) and the other two projects (lhc and einstein) are not even visible in the boinc-client/boinctui. Before that everything was running normal - cvmfs was installed per guide that makes it possible to run cms and other tasks natively. So, after commenting the lines you mentioned: squid -k parse: 2023/05/25 12:18:40\| Startup: Initializing Authentication Schemes ... 2023/05/25 12:18:40\| Startup: Initialized Authentication Scheme 'basic' 2023/05/25 12:18:40\| Startup: Initialized Authentication Scheme 'digest' 2023/05/25 12:18:40\| Startup: Initialized Authentication Scheme 'negotiate' 2023/05/25 12:18:40\| Startup: Initialized Authentication Scheme 'ntlm' 2023/05/25 12:18:40\| Startup: Initialized Authentication. 2023/05/25 12:18:40\| Processing Configuration File: /etc/squid/squid.conf (depth 0) 2023/05/25 12:18:40\| Processing: acl crunchers src 192.168.0.145 2023/05/25 12:18:40\| Processing: acl SSL_ports port 443 2023/05/25 12:18:40\| Processing: acl Safe_ports port 80 # http 2023/05/25 12:18:40\| Processing: acl Safe_ports port 21 # ftp 2023/05/25 12:18:40\| Processing: acl Safe_ports port 443 # https 2023/05/25 12:18:40\| Processing: acl Safe_ports port 70 # gopher 2023/05/25 12:18:40\| Processing: acl Safe_ports port 210 # wais 2023/05/25 12:18:40\| Processing: acl Safe_ports port 1025-65535 # unregistered ports 2023/05/25 12:18:40\| Processing: acl Safe_ports port 280 # http-mgmt 2023/05/25 12:18:40\| Processing: acl Safe_ports port 488 # gss-http 2023/05/25 12:18:40\| Processing: acl Safe_ports port 591 # filemaker 2023/05/25 12:18:40\| Processing: acl Safe_ports port 777 # multiling http 2023/05/25 12:18:40\| Processing: acl CONNECT method CONNECT 2023/05/25 12:18:40\| Processing: follow_x_forwarded_for allow localhost 2023/05/25 12:18:40\| Processing: follow_x_forwarded_for deny all 2023/05/25 12:18:40\| Processing: acl wcg_nocache dstdomain .worldcommunitygrid.org 2023/05/25 12:18:40\| Processing: cache deny wcg_nocache 2023/05/25 12:18:40\| Processing: acl cvmfs_geoapi urlpath_regex -i ^/+cvmfs/+[0-9a-z._~-]+/+api/+[0-9a-z._~-]+/+geo/+[0-9a-z._~-]+/+[0-9a-z.,_~-]+ 2023/05/25 12:18:40\| Processing: cache deny cvmfs_geoapi 2023/05/25 12:18:40\| Processing: acl boinc_nocache urlpath_regex -i /download[0-9a-z._~-]/+[0-9a-z._~-]+/+.+ 2023/05/25 12:18:40\| Processing: cache deny boinc_nocache 2023/05/25 12:18:40\| Processing: acl PragmaNoCache req_header Pragma no-cache 2023/05/25 12:18:40\| Processing: cache deny PragmaNoCache 2023/05/25 12:18:40\| Processing: acl Purge method PURGE 2023/05/25 12:18:40\| Processing: http_access deny !Safe_ports 2023/05/25 12:18:40\| Processing: http_access deny CONNECT !SSL_ports 2023/05/25 12:18:40\| Processing: http_access allow localhost manager 2023/05/25 12:18:40\| Processing: http_access deny manager 2023/05/25 12:18:40\| Processing: http_access deny to_localhost 2023/05/25 12:18:40\| Processing: include /etc/squid/conf.d/.conf 2023/05/25 12:18:40\| Processing Configuration File: /etc/squid/conf.d/debian.conf (depth 1) 2023/05/25 12:18:40\| Processing: logfile_rotate 0 2023/05/25 12:18:40\| Processing: http_access allow crunchers 2023/05/25 12:18:40\| Processing: http_access allow localhost 2023/05/25 12:18:40\| Processing: http_access deny all 2023/05/25 12:18:40\| Processing: http_port localhost:3128 2023/05/25 12:18:40\| Processing: http_port 3128 2023/05/25 12:18:40\| Processing: dns_nameservers 192.168.0.1 2023/05/25 12:18:40\| Processing: max_filedescriptors 4096 2023/05/25 12:18:40\| Processing: client_dst_passthru off 2023/05/25 12:18:40\| Processing: cache_mem 256 MB 2023/05/25 12:18:40\| Processing: maximum_object_size_in_memory 24 KB 2023/05/25 12:18:40\| Processing: memory_replacement_policy heap GDSF 2023/05/25 12:18:40\| Processing: cache_replacement_policy heap LFUDA 2023/05/25 12:18:40\| Processing: maximum_object_size 6144 MB 2023/05/25 12:18:40\| Processing: cache_dir aufs /var/cache/squid 20000 16 64 min-size=7937 2023/05/25 12:18:40\| Processing: logfile_rotate 10 2023/05/25 12:18:40\| Processing: logformat my_awstats %>A %lp %ui %un [%tl] "%rm %>ru HTTP/%rv" %>Hs %st "%{Referer}>h" "%{User-Agent}>h" %Ss:%Sh 2023/05/25 12:18:40\| Processing: access_log stdio:/var/log/squid/access.log logformat=my_awstats 2023/05/25 12:18:40\| Processing: strip_query_terms off 2023/05/25 12:18:40\| Processing: coredump_dir none 2023/05/25 12:18:40\| Processing: ftp_user anonymous@ 2023/05/25 12:18:40\| Processing: max_stale 37 days 2023/05/25 12:18:40\| Processing: refresh_pattern . 0 0% 0 2023/05/25 12:18:40\| Processing: store_avg_object_size 1800 KB 2023/05/25 12:18:40\| Processing: shutdown_lifetime 0 seconds 2023/05/25 12:18:40\| Processing: collapsed_forwarding on 2023/05/25 12:18:40\| Processing: client_persistent_connections on 2023/05/25 12:18:40\| Processing: server_persistent_connections on 2023/05/25 12:18:40\| Processing: log_icp_queries off 2023/05/25 12:18:40\| Processing: dns_defnames on 2023/05/25 12:18:40\| Processing: forwarded_for transparent 2023/05/25 12:18:40\| Initializing https:// proxy context ip -f inet addr show: 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 5: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 inet 192.168.0.145/24 metric 100 brd 192.168.0.255 scope global dynamic bond0 valid_lft 496sec preferred_lft 496sec ps -AF \|grep " $(lsof -ti:3128) " - is REALLy long - should I post the whole of it here? Thank you for helping.
5) Message boards : Number crunching : Setting up a local Squid to work with LHC@home - Comments and Questions (Message 48122) Posted 24 May 2023 by zooxit Post: I forgot to mention that squid -k reconfigure gave no errors.
6) Message boards : Number crunching : Setting up a local Squid to work with LHC@home - Comments and Questions (Message 48121) Posted 24 May 2023 by zooxit Post: Hi, After installing squid with apt (ubuntu server 22.04), running 'squid -z' and starting squid, 'sudo systemctl status squid.service' gives: ... Active: active (running) since Wed 2023-05-24 17:24:54 UTC; 9s ago ... ERROR: listen(..., 1024) system call failed: (98) Address already in use listening port: 3128 I guess this is wrong. What should I do? Kind regards, Nejc my /etc/squid/squid.conf is: acl crunchers src 192.168.0.145 acl localnet src 0.0.0.1-0.255.255.255 # RFC 1122 "this" network (LAN) acl localnet src 10.0.0.0/8 # RFC 1918 local private network (LAN) acl localnet src 100.64.0.0/10 # RFC 6598 shared address space (CGN) acl localnet src 169.254.0.0/16 # RFC 3927 link-local (directly plugged) machines acl localnet src 172.16.0.0/12 # RFC 1918 local private network (LAN) acl localnet src 192.168.0.0/16 # RFC 1918 local private network (LAN) acl localnet src fc00::/7 # RFC 4193 local private network range acl localnet src fe80::/10 # RFC 4291 link-local (directly plugged) machines acl SSL_ports port 443 acl Safe_ports port 80 # http acl Safe_ports port 21 # ftp acl Safe_ports port 443 # https acl Safe_ports port 70 # gopher acl Safe_ports port 210 # wais acl Safe_ports port 1025-65535 # unregistered ports acl Safe_ports port 280 # http-mgmt acl Safe_ports port 488 # gss-http acl Safe_ports port 591 # filemaker acl Safe_ports port 777 # multiling http acl CONNECT method CONNECT follow_x_forwarded_for allow localhost follow_x_forwarded_for deny all acl wcg_nocache dstdomain .worldcommunitygrid.org cache deny wcg_nocache acl cvmfs_geoapi urlpath_regex -i ^/+cvmfs/+[0-9a-z._~-]+/+api/+[0-9a-z._~-]+/+geo/+[0-9a-z._~-]+/+[0-9a-z.,_~-]+ cache deny cvmfs_geoapi acl boinc_nocache urlpath_regex -i /download[0-9a-z._~-]*/+[0-9a-z._~-]+/+.+ cache deny boinc_nocache acl PragmaNoCache req_header Pragma no-cache cache deny PragmaNoCache acl Purge method PURGE http_access deny !Safe_ports http_access deny CONNECT !SSL_ports http_access allow localhost manager http_access deny manager http_access deny to_localhost http_access allow crunchers http_access allow localhost http_access deny all http_port 3128 dns_nameservers 192.168.0.1 max_filedescriptors 4096 client_dst_passthru off cache_mem 256 MB maximum_object_size_in_memory 24 KB memory_replacement_policy heap GDSF cache_replacement_policy heap LFUDA maximum_object_size 6144 MB cache_dir aufs /var/cache/squid 20000 16 64 min-size=7937 logfile_rotate 10 logformat my_awstats %>A %lp %ui %un [%tl] "%rm %>ru HTTP/%rv" %>Hs %st "%{Referer}>h" "%{User-Agent}>h" %Ss:%Sh access_log stdio:/var/log/squid/access.log logformat=my_awstats strip_query_terms off coredump_dir none ftp_user anonymous@ max_stale 37 days refresh_pattern . 0 0% 0 store_avg_object_size 1800 KB shutdown_lifetime 0 seconds collapsed_forwarding on client_persistent_connections on server_persistent_connections on log_icp_queries off dns_defnames on forwarded_for transparent

LHC@home