jmeter-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [jmeter] vlsi commented on pull request #603: Bug 64558 - Improve performances and throughput of Sample Results by lifting contention on writing SampleResults in CSV/XML
Date Sat, 11 Jul 2020 12:47:31 GMT

vlsi commented on pull request #603:
URL: https://github.com/apache/jmeter/pull/603#issuecomment-657057936


   I've tried the following:
   1. I've installed a local `nginx` that serves `Apache JMeter` website
   1. Then I created a test case that opens the home page, then it extracts "getting started"
URL and opens it, then it extracts "user manual" URL and opens it. All the actions are run
in a transaction controller.
   1. I launched the benchmark as follows
   
           ../bin/jmeter -n -t jmeter_home_page.jmx -Jjmeter.save.queue.size=524288 -Jthreads=2000
-Jduration=120 -Jrampup=1 -l results.csv
   
   The results are:
   
   Before patch:
   
   ```
   Starting standalone test @ Sat Jul 11 15:32:08 MSK 2020 (1594470728843)
   summary +  76492 in 00:00:21 = 3650.8/s Avg:   506 Min:     1 Max:  6071 Err:  1101 (1.44%)
Active: 2000 Started: 2000 Finished: 0
   summary + 147463 in 00:00:30 = 4926.1/s Avg:   405 Min:   301 Max:   727 Err:     0 (0.00%)
Active: 2000 Started: 2000 Finished: 0
   summary = 223955 in 00:00:51 = 4400.9/s Avg:   439 Min:     1 Max:  6071 Err:  1101 (0.49%)
   summary + 145472 in 00:00:30 = 4852.1/s Avg:   409 Min:     3 Max: 15673 Err:  1838 (1.26%)
Active: 2000 Started: 2000 Finished: 0
   summary = 369427 in 00:01:21 = 4568.2/s Avg:   427 Min:     1 Max: 15673 Err:  2939 (0.80%)
   summary + 135559 in 00:00:30 = 4518.6/s Avg:   445 Min:   310 Max: 11305 Err:     0 (0.00%)
Active: 2000 Started: 2000 Finished: 0
   summary = 504986 in 00:01:51 = 4554.8/s Avg:   432 Min:     1 Max: 15673 Err:  2939 (0.58%)
   summary +  58676 in 00:00:12 = 4981.4/s Avg:   366 Min:     0 Max:   733 Err:     0 (0.00%)
Active: 0 Started: 2000 Finished: 2000
   summary = 563662 in 00:02:03 = 4595.8/s Avg:   425 Min:     0 Max: 15673 Err:  2939 (0.52%)
   Tidying up ...    @ Sat Jul 11 15:34:11 MSK 2020 (1594470851780)
   ```
   
   After patch:
   
   ```
   Starting standalone test @ Sat Jul 11 15:40:24 MSK 2020 (1594471224569)
   summary +   9043 in 00:00:05 = 1761.7/s Avg:   679 Min:     1 Max:  3400 Err:   193 (2.13%)
Active: 2000 Started: 2000 Finished: 0
   summary + 146023 in 00:00:30 = 4865.3/s Avg:   416 Min:   127 Max:  4879 Err:     2 (0.00%)
Active: 2000 Started: 2000 Finished: 0
   summary = 155066 in 00:00:35 = 4412.1/s Avg:   431 Min:     1 Max:  4879 Err:   195 (0.13%)
   summary + 137837 in 00:00:30 = 4601.0/s Avg:   416 Min:    28 Max:  4500 Err:   758 (0.55%)
Active: 2000 Started: 2000 Finished: 0
   summary = 292903 in 00:01:05 = 4499.0/s Avg:   424 Min:     1 Max:  4879 Err:   953 (0.33%)
   summary + 130667 in 00:00:30 = 4355.9/s Avg:   478 Min:     2 Max: 24626 Err:  1996 (1.53%)
Active: 2000 Started: 2000 Finished: 0
   summary = 423570 in 00:01:35 = 4453.8/s Avg:   441 Min:     1 Max: 24626 Err:  2949 (0.70%)
   summary + 104537 in 00:00:28 = 3793.1/s Avg:   508 Min:     0 Max: 11232 Err:     0 (0.00%)
Active: 0 Started: 2000 Finished: 2000
   summary = 528107 in 00:02:03 = 4305.4/s Avg:   454 Min:     0 Max: 24626 Err:  2949 (0.56%)
   Tidying up ...    @ Sat Jul 11 15:42:27 MSK 2020 (1594471347561)
   ```
   
   It does not look like the patch improves the performance.
   
   [jmeter_home_page.jmx.txt](https://github.com/apache/jmeter/files/4906775/jmeter_home_page.jmx.txt)
   <img width="872" alt="test plan overview" src="https://user-images.githubusercontent.com/213894/87224400-c1f3b200-c38d-11ea-880a-66d0605008d8.png">
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



Mime
View raw message