tomcat - Response time too high during load testing even when CPU utilization falls after Auto Scaling -



tomcat - Response time too high during load testing even when CPU utilization falls after Auto Scaling -

here's scenario:

i'm running java/spring app on amazon ec2 linux instance in load balancing mode 3 servers initially, can scale or downwards required.

scale criteria: when cpu utilization goes above 30% more 10 mins, add together 2 more servers.

scale downwards criteria: when cpu utilization decreases below 15% more 10 minutes, remove 1 server.

loading (with blazemeter.com): increment no. of users steadily 0 50 in around 15 minutes, , remain constant there onwards.

response:

in first 15 minutes, load increased 50 hits/second, , remained steady 5 minutes. cpu utilization remains @ around 30%. response time below 20ms in phase. while load @ 50 hits/second, @ around 20 mins start, cpu utilization spiked around 33% more 10 mins thereby triggering step up. response time increases dramatically fluctuate between 5000ms 15000ms. with 2 additional servers (server count 5), cpu utilization goes 20%, response time shows no sign of receding. still remains between 5000ms 15000ms rest of testing period till load removed.

my question is, why think response time didn't come downwards normal (around 20ms) when cpu utilization normal (around 20% utilization)?

cpu utilization chart

response time chart

thanks time :)

tomcat amazon-ec2 load-balancing load-testing stress-testing

Comments

Popular posts from this blog

How do I check if an insert was successful with MySQLdb in Python? -

delphi - blogger via idHTTP : error 400 bad request -

postgresql - ERROR: operator is not unique: unknown + unknown -