Skip to content

Commit 7697510

Browse files
nginx-botnginx-bot
authored
NFR Test Results for NGF version edge (#2393)
1 parent 6625a41 commit 7697510

File tree

70 files changed

+6482
-175
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

70 files changed

+6482
-175
lines changed

‎tests/results/dp-perf/edge/edge-oss.md

Lines changed: 26 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -4,10 +4,16 @@
44

55
NGINX Plus: false
66

7+
NGINX Gateway Fabric:
8+
9+
- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
10+
- Date: 2024-08-13T21:12:05Z
11+
- Dirty: false
12+
713
GKE Cluster:
814

915
- Node count: 12
10-
- k8s version: v1.29.6-gke.1038001
16+
- k8s version: v1.29.6-gke.1326000
1117
- vCPUs per node: 16
1218
- RAM per node: 65855012Ki
1319
- Max pods per node: 110
@@ -17,22 +23,23 @@ GKE Cluster:
1723
## Test1: Running latte path based routing
1824

1925
```text
20-
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
21-
Duration [total, attack, wait] 30s, 29.999s, 624.318µs
22-
Latencies [min, mean, 50, 90, 95, 99, max] 496.907µs, 666.131µs, 651.971µs, 742.531µs, 778.713µs, 872.635µs, 11.772ms
23-
Bytes In [total, mean] 4770000, 159.00
26+
Requests [total, rate, throughput] 30000, 1000.01, 999.79
27+
Duration [total, attack, wait] 30s, 30s, 701.442µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 341.042µs, 737.394µs, 718.76µs, 827.697µs, 866.432µs, 962.831µs, 16.145ms
29+
Bytes In [total, mean] 4769946, 159.00
2430
Bytes Out [total, mean] 0, 0.00
25-
Success [ratio] 100.00%
26-
Status Codes [code:count] 200:30000
31+
Success [ratio] 99.98%
32+
Status Codes [code:count] 200:29994 502:6
2733
Error Set:
34+
502 Bad Gateway
2835
```
2936

3037
## Test2: Running coffee header based routing
3138

3239
```text
33-
Requests [total, rate, throughput] 30000, 1000.03, 1000.00
34-
Duration [total, attack, wait] 30s, 29.999s, 697.125µs
35-
Latencies [min, mean, 50, 90, 95, 99, max] 520.741µs, 681.361µs, 670.45µs, 761.428µs, 795.946µs, 884.223µs, 9.626ms
40+
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
41+
Duration [total, attack, wait] 30s, 29.999s, 687.856µs
42+
Latencies [min, mean, 50, 90, 95, 99, max] 554.445µs, 759.558µs, 740.252µs, 848.701µs, 889.401µs, 997.689µs, 22.657ms
3643
Bytes In [total, mean] 4800000, 160.00
3744
Bytes Out [total, mean] 0, 0.00
3845
Success [ratio] 100.00%
@@ -43,9 +50,9 @@ Error Set:
4350
## Test3: Running coffee query based routing
4451

4552
```text
46-
Requests [total, rate, throughput] 30000, 1000.02, 999.99
47-
Duration [total, attack, wait] 30s, 29.999s, 753.834µs
48-
Latencies [min, mean, 50, 90, 95, 99, max] 523.903µs, 693.564µs, 681.217µs, 776.952µs, 817.06µs, 913.016µs, 6.02ms
53+
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
54+
Duration [total, attack, wait] 29.999s, 29.999s, 726.197µs
55+
Latencies [min, mean, 50, 90, 95, 99, max] 550.722µs, 769.327µs, 747.389µs, 857.742µs, 898.394µs, 1.015ms, 13.026ms
4956
Bytes In [total, mean] 5040000, 168.00
5057
Bytes Out [total, mean] 0, 0.00
5158
Success [ratio] 100.00%
@@ -56,9 +63,9 @@ Error Set:
5663
## Test4: Running tea GET method based routing
5764

5865
```text
59-
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
60-
Duration [total, attack, wait] 30s, 29.999s, 680.402µs
61-
Latencies [min, mean, 50, 90, 95, 99, max] 511.054µs, 680.638µs, 669.25µs, 763.254µs, 800.238µs, 900.815µs, 5.474ms
66+
Requests [total, rate, throughput] 30000, 1000.00, 999.98
67+
Duration [total, attack, wait] 30.001s, 30s, 705.904µs
68+
Latencies [min, mean, 50, 90, 95, 99, max] 539.272µs, 750.546µs, 734.78µs, 841.798µs, 880.351µs, 979.455µs, 16.567ms
6269
Bytes In [total, mean] 4710000, 157.00
6370
Bytes Out [total, mean] 0, 0.00
6471
Success [ratio] 100.00%
@@ -69,9 +76,9 @@ Error Set:
6976
## Test5: Running tea POST method based routing
7077

7178
```text
72-
Requests [total, rate, throughput] 30000, 1000.01, 999.98
73-
Duration [total, attack, wait] 30.001s, 30s, 726.41µs
74-
Latencies [min, mean, 50, 90, 95, 99, max] 511.128µs, 684.525µs, 671.866µs, 765.429µs, 801.43µs, 904.838µs, 10.938ms
79+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
80+
Duration [total, attack, wait] 30s, 29.999s, 772.597µs
81+
Latencies [min, mean, 50, 90, 95, 99, max] 541.485µs, 752.07µs, 740.31µs, 847.409µs, 886.955µs, 981.786µs, 12.398ms
7582
Bytes In [total, mean] 4710000, 157.00
7683
Bytes Out [total, mean] 0, 0.00
7784
Success [ratio] 100.00%

‎tests/results/dp-perf/edge/edge-plus.md

Lines changed: 26 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -4,10 +4,16 @@
44

55
NGINX Plus: true
66

7+
NGINX Gateway Fabric:
8+
9+
- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
10+
- Date: 2024-08-13T21:12:05Z
11+
- Dirty: false
12+
713
GKE Cluster:
814

915
- Node count: 12
10-
- k8s version: v1.29.6-gke.1038001
16+
- k8s version: v1.29.6-gke.1326000
1117
- vCPUs per node: 16
1218
- RAM per node: 65855012Ki
1319
- Max pods per node: 110
@@ -17,10 +23,10 @@ GKE Cluster:
1723
## Test1: Running latte path based routing
1824

1925
```text
20-
Requests [total, rate, throughput] 30000, 1000.01, 999.98
21-
Duration [total, attack, wait] 30.001s, 30s, 766.8µs
22-
Latencies [min, mean, 50, 90, 95, 99, max] 535.083µs, 732.524µs, 709.951µs, 801.487µs, 837.721µs, 978.661µs, 19.138ms
23-
Bytes In [total, mean] 4770000, 159.00
26+
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
27+
Duration [total, attack, wait] 30s, 29.999s, 682.261µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 515.366µs, 729.019µs, 712.033µs, 843.484µs, 895.476µs, 1.019ms, 9.154ms
29+
Bytes In [total, mean] 4800000, 160.00
2430
Bytes Out [total, mean] 0, 0.00
2531
Success [ratio] 100.00%
2632
Status Codes [code:count] 200:30000
@@ -30,10 +36,10 @@ Error Set:
3036
## Test2: Running coffee header based routing
3137

3238
```text
33-
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
34-
Duration [total, attack, wait] 30s, 29.999s, 750.962µs
35-
Latencies [min, mean, 50, 90, 95, 99, max] 569.894µs, 751.471µs, 737.453µs, 830.219µs, 865.522µs, 975.891µs, 13.021ms
36-
Bytes In [total, mean] 4800000, 160.00
39+
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
40+
Duration [total, attack, wait] 30s, 29.999s, 599.51µs
41+
Latencies [min, mean, 50, 90, 95, 99, max] 540.423µs, 740.62µs, 724.16µs, 857.72µs, 911.755µs, 1.042ms, 7.517ms
42+
Bytes In [total, mean] 4830000, 161.00
3743
Bytes Out [total, mean] 0, 0.00
3844
Success [ratio] 100.00%
3945
Status Codes [code:count] 200:30000
@@ -43,10 +49,10 @@ Error Set:
4349
## Test3: Running coffee query based routing
4450

4551
```text
46-
Requests [total, rate, throughput] 30000, 1000.00, 999.98
47-
Duration [total, attack, wait] 30.001s, 30s, 795.267µs
48-
Latencies [min, mean, 50, 90, 95, 99, max] 566.893µs, 746.284µs, 731.685µs, 821.144µs, 856.146µs, 949.534µs, 18.228ms
49-
Bytes In [total, mean] 5040000, 168.00
52+
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
53+
Duration [total, attack, wait] 29.999s, 29.999s, 683.488µs
54+
Latencies [min, mean, 50, 90, 95, 99, max] 523.729µs, 756.497µs, 740.664µs, 870.743µs, 921.816µs, 1.062ms, 12.337ms
55+
Bytes In [total, mean] 5070000, 169.00
5056
Bytes Out [total, mean] 0, 0.00
5157
Success [ratio] 100.00%
5258
Status Codes [code:count] 200:30000
@@ -57,9 +63,9 @@ Error Set:
5763

5864
```text
5965
Requests [total, rate, throughput] 30000, 1000.01, 999.98
60-
Duration [total, attack, wait] 30.001s, 30s, 733.608µs
61-
Latencies [min, mean, 50, 90, 95, 99, max] 545.997µs, 736.79µs, 725.161µs, 816.5µs, 852.368µs, 950.282µs, 9.048ms
62-
Bytes In [total, mean] 4710000, 157.00
66+
Duration [total, attack, wait] 30.001s, 30s, 762.485µs
67+
Latencies [min, mean, 50, 90, 95, 99, max] 499.61µs, 744.201µs, 726.564µs, 862.287µs, 914.928µs, 1.054ms, 7.531ms
68+
Bytes In [total, mean] 4740000, 158.00
6369
Bytes Out [total, mean] 0, 0.00
6470
Success [ratio] 100.00%
6571
Status Codes [code:count] 200:30000
@@ -69,10 +75,10 @@ Error Set:
6975
## Test5: Running tea POST method based routing
7076

7177
```text
72-
Requests [total, rate, throughput] 30000, 1000.01, 999.98
73-
Duration [total, attack, wait] 30.001s, 30s, 743.446µs
74-
Latencies [min, mean, 50, 90, 95, 99, max] 553.99µs, 726.832µs, 715.508µs, 802.061µs, 835.171µs, 926.755µs, 8.575ms
75-
Bytes In [total, mean] 4710000, 157.00
78+
Requests [total, rate, throughput] 30000, 1000.01, 999.99
79+
Duration [total, attack, wait] 30s, 30s, 651.893µs
80+
Latencies [min, mean, 50, 90, 95, 99, max] 532.673µs, 751.908µs, 734.466µs, 872.179µs, 927.874µs, 1.068ms, 6.327ms
81+
Bytes In [total, mean] 4740000, 158.00
7682
Bytes Out [total, mean] 0, 0.00
7783
Success [ratio] 100.00%
7884
Status Codes [code:count] 200:30000

‎tests/results/ngf-upgrade/edge/edge-oss.md

Lines changed: 15 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -4,10 +4,16 @@
44

55
NGINX Plus: false
66

7+
NGINX Gateway Fabric:
8+
9+
- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
10+
- Date: 2024-08-13T21:12:05Z
11+
- Dirty: false
12+
713
GKE Cluster:
814

915
- Node count: 12
10-
- k8s version: v1.29.6-gke.1038001
16+
- k8s version: v1.29.6-gke.1326000
1117
- vCPUs per node: 16
1218
- RAM per node: 65855012Ki
1319
- Max pods per node: 110
@@ -17,29 +23,29 @@ GKE Cluster:
1723
## Test: Send https /tea traffic
1824

1925
```text
20-
Requests [total, rate, throughput] 6000, 100.02, 100.01
21-
Duration [total, attack, wait] 59.991s, 59.99s, 799.917µs
22-
Latencies [min, mean, 50, 90, 95, 99, max] 450.094µs, 821.717µs, 823.258µs, 951.13µs, 997.824µs, 1.126ms, 11.934ms
23-
Bytes In [total, mean] 920025, 153.34
26+
Requests [total, rate, throughput] 6000, 100.02, 100.02
27+
Duration [total, attack, wait] 59.991s, 59.99s, 763.57µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 631.935µs, 834.342µs, 818.106µs, 916.549µs, 953.194µs, 1.06ms, 12.108ms
29+
Bytes In [total, mean] 918000, 153.00
2430
Bytes Out [total, mean] 0, 0.00
2531
Success [ratio] 100.00%
2632
Status Codes [code:count] 200:6000
2733
Error Set:
2834
```
2935

30-
![https.png](https.png)
36+
![https-oss.png](https-oss.png)
3137

3238
## Test: Send http /coffee traffic
3339

3440
```text
3541
Requests [total, rate, throughput] 6000, 100.02, 100.02
36-
Duration [total, attack, wait] 59.991s, 59.99s, 794.113µs
37-
Latencies [min, mean, 50, 90, 95, 99, max] 618.014µs, 872.17µs, 856.784µs, 991.181µs, 1.038ms, 1.148ms, 12.075ms
42+
Duration [total, attack, wait] 59.991s, 59.99s, 761.784µs
43+
Latencies [min, mean, 50, 90, 95, 99, max] 605.288µs, 828.183µs, 816.906µs, 927.903µs, 968.164µs, 1.089ms, 3.097ms
3844
Bytes In [total, mean] 960000, 160.00
3945
Bytes Out [total, mean] 0, 0.00
4046
Success [ratio] 100.00%
4147
Status Codes [code:count] 200:6000
4248
Error Set:
4349
```
4450

45-
![http.png](http.png)
51+
![http-oss.png](http-oss.png)

‎tests/results/ngf-upgrade/edge/edge-plus.md

Lines changed: 15 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -4,10 +4,16 @@
44

55
NGINX Plus: true
66

7+
NGINX Gateway Fabric:
8+
9+
- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
10+
- Date: 2024-08-13T21:12:05Z
11+
- Dirty: false
12+
713
GKE Cluster:
814

915
- Node count: 12
10-
- k8s version: v1.29.6-gke.1038001
16+
- k8s version: v1.29.6-gke.1326000
1117
- vCPUs per node: 16
1218
- RAM per node: 65855012Ki
1319
- Max pods per node: 110
@@ -17,10 +23,10 @@ GKE Cluster:
1723
## Test: Send https /tea traffic
1824

1925
```text
20-
Requests [total, rate, throughput] 6000, 100.02, 100.02
21-
Duration [total, attack, wait] 59.991s, 59.99s, 867.428µs
22-
Latencies [min, mean, 50, 90, 95, 99, max] 653.414µs, 901.844µs, 879.015µs, 1.006ms, 1.051ms, 1.18ms, 12.8ms
23-
Bytes In [total, mean] 919993, 153.33
26+
Requests [total, rate, throughput] 6000, 100.02, 100.01
27+
Duration [total, attack, wait] 59.991s, 59.99s, 921.041µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 616.005µs, 851.643µs, 821.167µs, 986.363µs, 1.055ms, 1.241ms, 12.227ms
29+
Bytes In [total, mean] 921995, 153.67
2430
Bytes Out [total, mean] 0, 0.00
2531
Success [ratio] 100.00%
2632
Status Codes [code:count] 200:6000
@@ -32,10 +38,10 @@ Error Set:
3238
## Test: Send http /coffee traffic
3339

3440
```text
35-
Requests [total, rate, throughput] 6000, 100.02, 100.02
36-
Duration [total, attack, wait] 59.991s, 59.99s, 839.172µs
37-
Latencies [min, mean, 50, 90, 95, 99, max] 421.992µs, 816.859µs, 820.308µs, 942.646µs, 983.206µs, 1.111ms, 11.939ms
38-
Bytes In [total, mean] 960000, 160.00
41+
Requests [total, rate, throughput] 6000, 100.02, 100.01
42+
Duration [total, attack, wait] 59.991s, 59.99s, 902.051µs
43+
Latencies [min, mean, 50, 90, 95, 99, max] 483.51µs, 832.015µs, 814.172µs, 976.685µs, 1.031ms, 1.193ms, 12.788ms
44+
Bytes In [total, mean] 966000, 161.00
3945
Bytes Out [total, mean] 0, 0.00
4046
Success [ratio] 100.00%
4147
Status Codes [code:count] 200:6000

‎tests/results/ngf-upgrade/edge/http-oss.png

5.2 KB
Loading

‎tests/results/ngf-upgrade/edge/http-plus.png

5.51 KB
Loading

‎tests/results/ngf-upgrade/edge/https-oss.png

5.2 KB
Loading

‎tests/results/ngf-upgrade/edge/https-plus.png

5.51 KB
Loading

0 commit comments

Comments
 (0)