Skip to content

Commit 0f46e39

Browse files
sjbermannginx-bot
sjberman
and
nginx-bot
authored
NFR Test Results for NGF version 1.4.0 (#2413) (#2414)
* NFR Test Results for NGF version 1.4.0 --------- Co-authored-by: nginx-bot <[email protected]>
1 parent 0e90229 commit 0f46e39

File tree

70 files changed

+7152
-0
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

70 files changed

+7152
-0
lines changed

‎tests/results/dp-perf/1.4.0/1.4.0-oss.md

+90
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,90 @@
1+
# Results
2+
3+
## Test environment
4+
5+
NGINX Plus: false
6+
7+
NGINX Gateway Fabric:
8+
9+
- Commit: 16a95222a968aef46277a77070f79bea9b87da12
10+
- Date: 2024-08-16T15:29:44Z
11+
- Dirty: false
12+
13+
GKE Cluster:
14+
15+
- Node count: 12
16+
- k8s version: v1.29.7-gke.1008000
17+
- vCPUs per node: 16
18+
- RAM per node: 65855012Ki
19+
- Max pods per node: 110
20+
- Zone: us-west1-b
21+
- Instance Type: n2d-standard-16
22+
23+
## Summary:
24+
25+
- Performance seems to have improved.
26+
27+
## Test1: Running latte path based routing
28+
29+
```text
30+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
31+
Duration [total, attack, wait] 30s, 29.999s, 791.901µs
32+
Latencies [min, mean, 50, 90, 95, 99, max] 512.393µs, 734.831µs, 721.822µs, 819.183µs, 855.351µs, 951.452µs, 13.787ms
33+
Bytes In [total, mean] 4830000, 161.00
34+
Bytes Out [total, mean] 0, 0.00
35+
Success [ratio] 100.00%
36+
Status Codes [code:count] 200:30000
37+
Error Set:
38+
```
39+
40+
## Test2: Running coffee header based routing
41+
42+
```text
43+
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
44+
Duration [total, attack, wait] 30s, 29.999s, 701.809µs
45+
Latencies [min, mean, 50, 90, 95, 99, max] 579.713µs, 757.73µs, 746.299µs, 837.969µs, 873.063µs, 990.77µs, 8.953ms
46+
Bytes In [total, mean] 4860000, 162.00
47+
Bytes Out [total, mean] 0, 0.00
48+
Success [ratio] 100.00%
49+
Status Codes [code:count] 200:30000
50+
Error Set:
51+
```
52+
53+
## Test3: Running coffee query based routing
54+
55+
```text
56+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
57+
Duration [total, attack, wait] 30s, 29.999s, 794.296µs
58+
Latencies [min, mean, 50, 90, 95, 99, max] 574.209µs, 766.349µs, 749.009µs, 851.856µs, 891.805µs, 1.011ms, 19.207ms
59+
Bytes In [total, mean] 5100000, 170.00
60+
Bytes Out [total, mean] 0, 0.00
61+
Success [ratio] 100.00%
62+
Status Codes [code:count] 200:30000
63+
Error Set:
64+
```
65+
66+
## Test4: Running tea GET method based routing
67+
68+
```text
69+
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
70+
Duration [total, attack, wait] 30s, 29.999s, 691.197µs
71+
Latencies [min, mean, 50, 90, 95, 99, max] 528.655µs, 742.271µs, 732.036µs, 826.113µs, 861.108µs, 954.498µs, 10.955ms
72+
Bytes In [total, mean] 4770000, 159.00
73+
Bytes Out [total, mean] 0, 0.00
74+
Success [ratio] 100.00%
75+
Status Codes [code:count] 200:30000
76+
Error Set:
77+
```
78+
79+
## Test5: Running tea POST method based routing
80+
81+
```text
82+
Requests [total, rate, throughput] 30000, 1000.00, 999.98
83+
Duration [total, attack, wait] 30.001s, 30s, 635.237µs
84+
Latencies [min, mean, 50, 90, 95, 99, max] 570.721µs, 765.885µs, 751.85µs, 855.286µs, 896.876µs, 1.012ms, 12.648ms
85+
Bytes In [total, mean] 4770000, 159.00
86+
Bytes Out [total, mean] 0, 0.00
87+
Success [ratio] 100.00%
88+
Status Codes [code:count] 200:30000
89+
Error Set:
90+
```

‎tests/results/dp-perf/1.4.0/1.4.0-plus.md

+90
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,90 @@
1+
# Results
2+
3+
## Test environment
4+
5+
NGINX Plus: true
6+
7+
NGINX Gateway Fabric:
8+
9+
- Commit: 16a95222a968aef46277a77070f79bea9b87da12
10+
- Date: 2024-08-16T15:29:44Z
11+
- Dirty: false
12+
13+
GKE Cluster:
14+
15+
- Node count: 12
16+
- k8s version: v1.29.7-gke.1008000
17+
- vCPUs per node: 16
18+
- RAM per node: 65855012Ki
19+
- Max pods per node: 110
20+
- Zone: us-west1-b
21+
- Instance Type: n2d-standard-16
22+
23+
## Summary:
24+
25+
- Performance seems to have improved.
26+
27+
## Test1: Running latte path based routing
28+
29+
```text
30+
Requests [total, rate, throughput] 30000, 1000.01, 999.99
31+
Duration [total, attack, wait] 30s, 30s, 563.254µs
32+
Latencies [min, mean, 50, 90, 95, 99, max] 485.302µs, 666.323µs, 637.029µs, 721.283µs, 754.013µs, 863.087µs, 15.211ms
33+
Bytes In [total, mean] 4800000, 160.00
34+
Bytes Out [total, mean] 0, 0.00
35+
Success [ratio] 100.00%
36+
Status Codes [code:count] 200:30000
37+
Error Set:
38+
```
39+
40+
## Test2: Running coffee header based routing
41+
42+
```text
43+
Requests [total, rate, throughput] 30000, 1000.01, 999.98
44+
Duration [total, attack, wait] 30s, 30s, 721.605µs
45+
Latencies [min, mean, 50, 90, 95, 99, max] 515.404µs, 694.237µs, 678.089µs, 767.846µs, 801.31µs, 903.184µs, 12.586ms
46+
Bytes In [total, mean] 4830000, 161.00
47+
Bytes Out [total, mean] 0, 0.00
48+
Success [ratio] 100.00%
49+
Status Codes [code:count] 200:30000
50+
Error Set:
51+
```
52+
53+
## Test3: Running coffee query based routing
54+
55+
```text
56+
Requests [total, rate, throughput] 30000, 1000.01, 999.99
57+
Duration [total, attack, wait] 30s, 30s, 631.83µs
58+
Latencies [min, mean, 50, 90, 95, 99, max] 516.613µs, 672.121µs, 656.131µs, 745.518µs, 781.046µs, 879.265µs, 19.659ms
59+
Bytes In [total, mean] 5070000, 169.00
60+
Bytes Out [total, mean] 0, 0.00
61+
Success [ratio] 100.00%
62+
Status Codes [code:count] 200:30000
63+
Error Set:
64+
```
65+
66+
## Test4: Running tea GET method based routing
67+
68+
```text
69+
Requests [total, rate, throughput] 30000, 1000.01, 999.99
70+
Duration [total, attack, wait] 30s, 30s, 681.029µs
71+
Latencies [min, mean, 50, 90, 95, 99, max] 514.133µs, 659.359µs, 647.028µs, 734.385µs, 769.668µs, 860.748µs, 6.583ms
72+
Bytes In [total, mean] 4740000, 158.00
73+
Bytes Out [total, mean] 0, 0.00
74+
Success [ratio] 100.00%
75+
Status Codes [code:count] 200:30000
76+
Error Set:
77+
```
78+
79+
## Test5: Running tea POST method based routing
80+
81+
```text
82+
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
83+
Duration [total, attack, wait] 30s, 29.999s, 595.53µs
84+
Latencies [min, mean, 50, 90, 95, 99, max] 516.825µs, 666.438µs, 651.132µs, 733.055µs, 763.861µs, 851.963µs, 14.266ms
85+
Bytes In [total, mean] 4740000, 158.00
86+
Bytes Out [total, mean] 0, 0.00
87+
Success [ratio] 100.00%
88+
Status Codes [code:count] 200:30000
89+
Error Set:
90+
```

‎tests/results/ngf-upgrade/1.4.0/1.4.0-oss.md

+55
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,55 @@
1+
# Results
2+
3+
## Test environment
4+
5+
NGINX Plus: false
6+
7+
NGINX Gateway Fabric:
8+
9+
- Commit: 16a95222a968aef46277a77070f79bea9b87da12
10+
- Date: 2024-08-16T15:29:44Z
11+
- Dirty: false
12+
13+
GKE Cluster:
14+
15+
- Node count: 12
16+
- k8s version: v1.29.7-gke.1008000
17+
- vCPUs per node: 16
18+
- RAM per node: 65855012Ki
19+
- Max pods per node: 110
20+
- Zone: us-west1-b
21+
- Instance Type: n2d-standard-16
22+
23+
## Summary:
24+
25+
- Performance seems to have improved.
26+
27+
## Test: Send https /tea traffic
28+
29+
```text
30+
Requests [total, rate, throughput] 6000, 100.02, 100.01
31+
Duration [total, attack, wait] 59.991s, 59.99s, 883.687µs
32+
Latencies [min, mean, 50, 90, 95, 99, max] 717.401µs, 1.039ms, 1.012ms, 1.192ms, 1.256ms, 1.426ms, 12.471ms
33+
Bytes In [total, mean] 924000, 154.00
34+
Bytes Out [total, mean] 0, 0.00
35+
Success [ratio] 100.00%
36+
Status Codes [code:count] 200:6000
37+
Error Set:
38+
```
39+
40+
![https-oss.png](https-oss.png)
41+
42+
## Test: Send http /coffee traffic
43+
44+
```text
45+
Requests [total, rate, throughput] 6000, 100.02, 100.01
46+
Duration [total, attack, wait] 59.991s, 59.99s, 886.936µs
47+
Latencies [min, mean, 50, 90, 95, 99, max] 686.413µs, 949.204µs, 930.943µs, 1.071ms, 1.125ms, 1.246ms, 14.436ms
48+
Bytes In [total, mean] 967939, 161.32
49+
Bytes Out [total, mean] 0, 0.00
50+
Success [ratio] 100.00%
51+
Status Codes [code:count] 200:6000
52+
Error Set:
53+
```
54+
55+
![http-oss.png](http-oss.png)

‎tests/results/ngf-upgrade/1.4.0/1.4.0-plus.md

+55
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,55 @@
1+
# Results
2+
3+
## Test environment
4+
5+
NGINX Plus: true
6+
7+
NGINX Gateway Fabric:
8+
9+
- Commit: 16a95222a968aef46277a77070f79bea9b87da12
10+
- Date: 2024-08-16T15:29:44Z
11+
- Dirty: false
12+
13+
GKE Cluster:
14+
15+
- Node count: 12
16+
- k8s version: v1.29.7-gke.1008000
17+
- vCPUs per node: 16
18+
- RAM per node: 65855012Ki
19+
- Max pods per node: 110
20+
- Zone: us-west1-b
21+
- Instance Type: n2d-standard-16
22+
23+
## Summary:
24+
25+
- Performance seems to have improved.
26+
27+
## Test: Send http /coffee traffic
28+
29+
```text
30+
Requests [total, rate, throughput] 6000, 100.02, 100.01
31+
Duration [total, attack, wait] 59.991s, 59.99s, 746.557µs
32+
Latencies [min, mean, 50, 90, 95, 99, max] 492.426µs, 916.951µs, 894.929µs, 997.453µs, 1.04ms, 1.225ms, 12.566ms
33+
Bytes In [total, mean] 960000, 160.00
34+
Bytes Out [total, mean] 0, 0.00
35+
Success [ratio] 100.00%
36+
Status Codes [code:count] 200:6000
37+
Error Set:
38+
```
39+
40+
![http-plus.png](http-plus.png)
41+
42+
## Test: Send https /tea traffic
43+
44+
```text
45+
Requests [total, rate, throughput] 6000, 100.02, 100.01
46+
Duration [total, attack, wait] 59.991s, 59.99s, 844.339µs
47+
Latencies [min, mean, 50, 90, 95, 99, max] 714.591µs, 948.908µs, 919.169µs, 1.03ms, 1.081ms, 1.24ms, 12.421ms
48+
Bytes In [total, mean] 919974, 153.33
49+
Bytes Out [total, mean] 0, 0.00
50+
Success [ratio] 100.00%
51+
Status Codes [code:count] 200:6000
52+
Error Set:
53+
```
54+
55+
![https-plus.png](https-plus.png)

‎tests/results/ngf-upgrade/1.4.0/http-oss.png

9.92 KB
Loading

‎tests/results/ngf-upgrade/1.4.0/http-plus.png

9.39 KB
Loading

‎tests/results/ngf-upgrade/1.4.0/https-oss.png

9.92 KB
Loading

‎tests/results/ngf-upgrade/1.4.0/https-plus.png

9.39 KB
Loading

0 commit comments

Comments
 (0)