How to stop the test after reaching a given number of errors during stress testing in JMeter

问题

When doing interface automation performance testing,Occasionally there are unstable factors that cause the request assertion to fail.JMeterThread groups have two common ways of handling errors：Continue or stop the test

For some reasons, very few errors do not affect the pressure measurement results and can be ignored,If choose to continue the test,It also keeps going down when a service crash does happen, which is not what we want,So how can we stop the test after reaching the specified cumulative number of errors during the stress test?？

解决方案

大致思路：使用beanshellThe script uses the variable after each requestcount记录错误数,Pass after reaching a predetermined number of errorsctx调用stopTest()结束测试.

1. setUp Thread Group中添加一个BeanShell Sampler

   

2. Add to test planBeanShell Listener

   

3. 执行测试

   

   以上使用httpbinProvided interface for testing,The request address does not exist/error,So in accumulating the number of errorscount=5The test stops when.

4. BeanShell Code

 // BeanShell Sampler
 props.put("__count", "0");
 
 // BeanShell Listener
 int __count = Integer.parseInt(props.get("__count"));
 int __limit = 5;
 int responseCode;
 
 try {
   responseCode = Integer.parseInt(prev.getResponseCode());
 }
 catch (exception ex) {
   responseCode = 0;
 }
 
 boolean errorResponse = ((responseCode < 200) || (responseCode >= 400) || (prev.getErrorCount() > 0) || (prev.getFirstAssertionFailureMessage() != null));
 
 if (errorResponse) {
   __count = __count + 1;
 }
 log.warn( "errors = " + __count );
 
 if (__count >= __limit) {
 log.warn("maximum number of errors reached, aborting test.");
   ctx.getEngine().stopTest();
 }
 
 props.put("__count", String.valueOf(__count));

讨论

in the overall solution,用到了JMeter的一些特性：

1. props设置countvariable is initialized only once,Accumulate later,这里用了setUp Group;
2. 为什么使用BeanShell Listener：在errorResponseThere is a response to the judgment condition ofcode、Number of errors and assertion information,These are only available after the assertion completes,按照JMeter组件执行顺序,ListenerComponents meet the conditions of use;