Message boards : Number crunching : Frequency of Condor Connections
Message board moderation

To post messages, you must log in.

AuthorMessage
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2401
Credit: 225,470,192
RAC: 123,748
Message 34174 - Posted: 31 Jan 2018, 8:51:54 UTC

Every VM using Condor connects to vccondor01.cern.ch:9618 once per minute.
With thousands of concurrently running VMs out in the field this produces a high connection rate on the condor server.
As a missing condor ping at startup leads to a VM shutdown I wonder if the period between the regular contacts can be extended.
ID: 34174 · Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer

Send message
Joined: 20 Jun 14
Posts: 373
Credit: 238,712
RAC: 0
Message 34179 - Posted: 31 Jan 2018, 12:49:22 UTC - in response to Message 34174.  

It should scale but is something we could look at reducing. The test should now try three times before failing. Let's see if that helps.
ID: 34179 · Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer

Send message
Joined: 20 Jun 14
Posts: 373
Credit: 238,712
RAC: 0
Message 34181 - Posted: 31 Jan 2018, 13:00:55 UTC - in response to Message 34174.  

It should scale but is something we could look at reducing. The test should now try three times before failing. Let's see if that helps.
ID: 34181 · Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 15 Jun 08
Posts: 2401
Credit: 225,470,192
RAC: 123,748
Message 34183 - Posted: 31 Jan 2018, 13:16:46 UTC

Must have been a very important question to get 2 answers.
;-D


Much more important:
Congrats, Laurence.
Your first masterpiece?
ID: 34183 · Report as offensive     Reply Quote
marmot
Avatar

Send message
Joined: 5 Nov 15
Posts: 144
Credit: 6,301,268
RAC: 0
Message 34194 - Posted: 31 Jan 2018, 16:45:23 UTC - in response to Message 34181.  

It should scale but is something we could look at reducing. The test should now try three times before failing. Let's see if that helps.


If there is any way to reduce traffic, such as storing redundancies locally, streamlining the size of each packet, using more compression, etc it would be appreciated.

Currently I have a typical ~300kb bandwidth remaining of a 25,000kb ISP internet plan as the Theory WU's crunch.

The next step up data plan would more than double my monthly ISP service fees.
ID: 34194 · Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer

Send message
Joined: 20 Jun 14
Posts: 373
Credit: 238,712
RAC: 0
Message 34322 - Posted: 9 Feb 2018, 9:02:19 UTC - in response to Message 34194.  

If you have a small cluster at home, it should be possible to setup a local squid cache to reduce the external traffic. A few people have looked into this but we don't have any detailed instructions for anyone to follow. I will create a thread in Number Crunching about this.
ID: 34322 · Report as offensive     Reply Quote
marmot
Avatar

Send message
Joined: 5 Nov 15
Posts: 144
Credit: 6,301,268
RAC: 0
Message 34431 - Posted: 21 Feb 2018, 0:06:44 UTC - in response to Message 34322.  

If you have a small cluster at home, it should be possible to setup a local squid cache to reduce the external traffic. A few people have looked into this but we don't have any detailed instructions for anyone to follow. I will create a thread in Number Crunching about this.


Thankyou.

computezrmle reminded me of benefits of using a proxy server and some strategies of setting one up.
ID: 34431 · Report as offensive     Reply Quote

Message boards : Number crunching : Frequency of Condor Connections


©2024 CERN