we run three instances per Host
And configure them in the following way:
# NSH proxy settings for the Console instance
blasadmin -s "$HOST"_console set app maxnshproxycontexts 200
blasadmin -s "$HOST"_console set app maxnshproxythreads 50
# NSH proxy settings for the Job instances
blasadmin -s "$HOST"_job_1 set app maxnshproxycontexts 3000
blasadmin -s "$HOST"_job_1 set app maxnshproxythreads 600
blasadmin -s "$HOST"_job_2 set app maxnshproxycontexts 3000
blasadmin -s "$HOST"_job_2 set app maxnshproxythreads 600
Can't really remember how we figured out these numbers, but as they are much higher than yours, and we don't see similiar issues, you might need to set higher values for your servers as well.
Agreed, but how high can we go is what I'm wondering about. Also, what are you server specs in terms of memory and CPU?
The Hosts have 16GB each, while each instance has 4GB MaxHeap.I think we figured those values partly from the docs and also from some of Bills posts around that topic (the usual)
Oh forgot the cores. So in Prod we run 8 CPU's per Host
We are going to try this to see if it helps, and we've doubled the CPU count to 4.
(Our MaxWorkItemThreads is set to 50)
# Contexts = WIT * 15
# Threads = 20% of Contexts
blasadmin -a set appserver MaxNshProxyContexts 750
blasadmin -a set appserver MaxNshProxyThreads 150
# We have a lot of deploy jobs running and this is set to 0... unrelated to NSH but should help overall performance)
blasadmin -a set appserver MaxLightweightWorkItemThreads 200
the 3600/600 are a result of testing w/ the old os_config.nsh and a 100 wit appserver w/ nothing else going on in the env. that may be high for what you need, so i wouldn't start there.
the other thing you might want to think about is re-creating your JOB instances a JOB/NSH_PROXY so each job server has its own nsh proxy instance to hammer. instead of all of the job instance hitting the same proxy instance.
That's already how they are setup Bill, I made sure of that in my first month at this mandate. The settings I've posted above are working good so far and the performance is holding. So far so good !