Skip to content

Commit fe90ff1

Browse files
nginx-botnginx-bot
authored
NFR Test Results for NGF version edge (#2554)
1 parent 2b4eee3 commit fe90ff1

File tree

71 files changed

+393
-5720
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

71 files changed

+393
-5720
lines changed

‎tests/results/dp-perf/edge/edge-oss.md

Lines changed: 26 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -6,41 +6,40 @@ NGINX Plus: false
66

77
NGINX Gateway Fabric:
88

9-
- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
10-
- Date: 2024-08-15T00:04:25Z
9+
- Commit: bf8ea47203eb4695af0d359243c73de2d1badbbf
10+
- Date: 2024-09-13T20:33:11Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.29.6-gke.1326000
16+
- k8s version: v1.30.3-gke.1639000
1717
- vCPUs per node: 16
18-
- RAM per node: 65855012Ki
18+
- RAM per node: 65853968Ki
1919
- Max pods per node: 110
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

2323
## Test1: Running latte path based routing
2424

2525
```text
26-
Requests [total, rate, throughput] 30000, 1000.03, 999.91
27-
Duration [total, attack, wait] 30s, 29.999s, 586.041µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 459.105µs, 652.462µs, 640.858µs, 731.955µs, 766.916µs, 868.446µs, 5.683ms
29-
Bytes In [total, mean] 4829967, 161.00
26+
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
27+
Duration [total, attack, wait] 30s, 29.999s, 674.086µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 504.902µs, 690.958µs, 671.389µs, 776.467µs, 814.84µs, 920.64µs, 11.923ms
29+
Bytes In [total, mean] 4800000, 160.00
3030
Bytes Out [total, mean] 0, 0.00
31-
Success [ratio] 99.99%
32-
Status Codes [code:count] 200:29997 502:3
31+
Success [ratio] 100.00%
32+
Status Codes [code:count] 200:30000
3333
Error Set:
34-
502 Bad Gateway
3534
```
3635

3736
## Test2: Running coffee header based routing
3837

3938
```text
40-
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
41-
Duration [total, attack, wait] 30s, 29.999s, 637.326µs
42-
Latencies [min, mean, 50, 90, 95, 99, max] 474.92µs, 694.704µs, 678.367µs, 786.23µs, 826.769µs, 934.323µs, 12.252ms
43-
Bytes In [total, mean] 4860000, 162.00
39+
Requests [total, rate, throughput] 30000, 1000.01, 999.99
40+
Duration [total, attack, wait] 30s, 30s, 727.772µs
41+
Latencies [min, mean, 50, 90, 95, 99, max] 544.595µs, 724.644µs, 711.056µs, 815.628µs, 855.662µs, 971.898µs, 12.671ms
42+
Bytes In [total, mean] 4830000, 161.00
4443
Bytes Out [total, mean] 0, 0.00
4544
Success [ratio] 100.00%
4645
Status Codes [code:count] 200:30000
@@ -50,10 +49,10 @@ Error Set:
5049
## Test3: Running coffee query based routing
5150

5251
```text
53-
Requests [total, rate, throughput] 30000, 1000.02, 999.99
54-
Duration [total, attack, wait] 30s, 30s, 676.679µs
55-
Latencies [min, mean, 50, 90, 95, 99, max] 525.067µs, 708.22µs, 693.208µs, 804.086µs, 849.031µs, 958.899µs, 10.449ms
56-
Bytes In [total, mean] 5100000, 170.00
52+
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
53+
Duration [total, attack, wait] 30s, 29.999s, 680.019µs
54+
Latencies [min, mean, 50, 90, 95, 99, max] 549.132µs, 745.892µs, 717.999µs, 829.205µs, 873.444µs, 1.024ms, 16.671ms
55+
Bytes In [total, mean] 5070000, 169.00
5756
Bytes Out [total, mean] 0, 0.00
5857
Success [ratio] 100.00%
5958
Status Codes [code:count] 200:30000
@@ -63,10 +62,10 @@ Error Set:
6362
## Test4: Running tea GET method based routing
6463

6564
```text
66-
Requests [total, rate, throughput] 30000, 1000.01, 999.99
67-
Duration [total, attack, wait] 30s, 30s, 637.156µs
68-
Latencies [min, mean, 50, 90, 95, 99, max] 512.28µs, 691.498µs, 675.513µs, 780.523µs, 817.834µs, 910.375µs, 9.619ms
69-
Bytes In [total, mean] 4770000, 159.00
65+
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
66+
Duration [total, attack, wait] 30s, 29.999s, 641.483µs
67+
Latencies [min, mean, 50, 90, 95, 99, max] 537.369µs, 718.158µs, 698.151µs, 811.422µs, 855.477µs, 967.85µs, 19.633ms
68+
Bytes In [total, mean] 4740000, 158.00
7069
Bytes Out [total, mean] 0, 0.00
7170
Success [ratio] 100.00%
7271
Status Codes [code:count] 200:30000
@@ -76,10 +75,10 @@ Error Set:
7675
## Test5: Running tea POST method based routing
7776

7877
```text
79-
Requests [total, rate, throughput] 30000, 1000.00, 999.98
80-
Duration [total, attack, wait] 30.001s, 30s, 773.157µs
81-
Latencies [min, mean, 50, 90, 95, 99, max] 503.29µs, 669.335µs, 655.455µs, 754.428µs, 792.559µs, 892.505µs, 10.652ms
82-
Bytes In [total, mean] 4770000, 159.00
78+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
79+
Duration [total, attack, wait] 30s, 29.999s, 798.923µs
80+
Latencies [min, mean, 50, 90, 95, 99, max] 536.667µs, 719.1µs, 707.001µs, 811.278µs, 849.968µs, 956.036µs, 11.637ms
81+
Bytes In [total, mean] 4740000, 158.00
8382
Bytes Out [total, mean] 0, 0.00
8483
Success [ratio] 100.00%
8584
Status Codes [code:count] 200:30000

‎tests/results/dp-perf/edge/edge-plus.md

Lines changed: 24 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -6,27 +6,27 @@ NGINX Plus: true
66

77
NGINX Gateway Fabric:
88

9-
- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
10-
- Date: 2024-08-15T00:04:25Z
9+
- Commit: bf8ea47203eb4695af0d359243c73de2d1badbbf
10+
- Date: 2024-09-13T20:33:11Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.29.6-gke.1326000
16+
- k8s version: v1.30.3-gke.1639000
1717
- vCPUs per node: 16
18-
- RAM per node: 65855012Ki
18+
- RAM per node: 65853960Ki
1919
- Max pods per node: 110
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

2323
## Test1: Running latte path based routing
2424

2525
```text
26-
Requests [total, rate, throughput] 30000, 1000.01, 999.99
27-
Duration [total, attack, wait] 30s, 30s, 673.045µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 487.307µs, 681.853µs, 664.969µs, 758.583µs, 798.223µs, 915.644µs, 11.35ms
29-
Bytes In [total, mean] 4740000, 158.00
26+
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
27+
Duration [total, attack, wait] 30s, 29.999s, 659.753µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 516.947µs, 682.043µs, 667.613µs, 764.261µs, 807.989µs, 925.905µs, 10.402ms
29+
Bytes In [total, mean] 4860000, 162.00
3030
Bytes Out [total, mean] 0, 0.00
3131
Success [ratio] 100.00%
3232
Status Codes [code:count] 200:30000
@@ -36,10 +36,10 @@ Error Set:
3636
## Test2: Running coffee header based routing
3737

3838
```text
39-
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
40-
Duration [total, attack, wait] 30s, 29.999s, 687.489µs
41-
Latencies [min, mean, 50, 90, 95, 99, max] 508.353µs, 694.959µs, 683.138µs, 780.78µs, 818.701µs, 943.447µs, 7.212ms
42-
Bytes In [total, mean] 4770000, 159.00
39+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
40+
Duration [total, attack, wait] 30s, 29.999s, 672.01µs
41+
Latencies [min, mean, 50, 90, 95, 99, max] 544.056µs, 708.524µs, 693.659µs, 798.224µs, 842.354µs, 962.69µs, 10.503ms
42+
Bytes In [total, mean] 4890000, 163.00
4343
Bytes Out [total, mean] 0, 0.00
4444
Success [ratio] 100.00%
4545
Status Codes [code:count] 200:30000
@@ -49,10 +49,10 @@ Error Set:
4949
## Test3: Running coffee query based routing
5050

5151
```text
52-
Requests [total, rate, throughput] 30000, 1000.01, 999.99
53-
Duration [total, attack, wait] 30s, 30s, 607.004µs
54-
Latencies [min, mean, 50, 90, 95, 99, max] 525.289µs, 702.559µs, 688.194µs, 791.113µs, 832.688µs, 952.855µs, 8.97ms
55-
Bytes In [total, mean] 5010000, 167.00
52+
Requests [total, rate, throughput] 30000, 1000.00, 999.98
53+
Duration [total, attack, wait] 30.001s, 30s, 688.255µs
54+
Latencies [min, mean, 50, 90, 95, 99, max] 548.294µs, 725.822µs, 704.967µs, 812.886µs, 862.452µs, 1.002ms, 16.667ms
55+
Bytes In [total, mean] 5130000, 171.00
5656
Bytes Out [total, mean] 0, 0.00
5757
Success [ratio] 100.00%
5858
Status Codes [code:count] 200:30000
@@ -62,10 +62,10 @@ Error Set:
6262
## Test4: Running tea GET method based routing
6363

6464
```text
65-
Requests [total, rate, throughput] 30000, 1000.02, 999.99
66-
Duration [total, attack, wait] 30s, 30s, 682.661µs
67-
Latencies [min, mean, 50, 90, 95, 99, max] 520.536µs, 700.459µs, 686.666µs, 790.333µs, 830.005µs, 947.376µs, 13.797ms
68-
Bytes In [total, mean] 4680000, 156.00
65+
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
66+
Duration [total, attack, wait] 30s, 29.999s, 618.502µs
67+
Latencies [min, mean, 50, 90, 95, 99, max] 540.088µs, 700.199µs, 685.361µs, 780.736µs, 823.779µs, 952µs, 10.406ms
68+
Bytes In [total, mean] 4800000, 160.00
6969
Bytes Out [total, mean] 0, 0.00
7070
Success [ratio] 100.00%
7171
Status Codes [code:count] 200:30000
@@ -75,10 +75,10 @@ Error Set:
7575
## Test5: Running tea POST method based routing
7676

7777
```text
78-
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
79-
Duration [total, attack, wait] 30s, 29.999s, 734.519µs
80-
Latencies [min, mean, 50, 90, 95, 99, max] 517.019µs, 687.341µs, 674.327µs, 775.376µs, 819.395µs, 936.514µs, 8.43ms
81-
Bytes In [total, mean] 4680000, 156.00
78+
Requests [total, rate, throughput] 30000, 1000.00, 999.98
79+
Duration [total, attack, wait] 30.001s, 30s, 696.35µs
80+
Latencies [min, mean, 50, 90, 95, 99, max] 533.042µs, 705.177µs, 691.789µs, 786.608µs, 828.257µs, 945.722µs, 11.154ms
81+
Bytes In [total, mean] 4800000, 160.00
8282
Bytes Out [total, mean] 0, 0.00
8383
Success [ratio] 100.00%
8484
Status Codes [code:count] 200:30000

‎tests/results/ngf-upgrade/edge/edge-oss.md

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -6,16 +6,16 @@ NGINX Plus: false
66

77
NGINX Gateway Fabric:
88

9-
- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
10-
- Date: 2024-08-15T00:04:25Z
9+
- Commit: bf8ea47203eb4695af0d359243c73de2d1badbbf
10+
- Date: 2024-09-13T20:33:11Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.29.6-gke.1326000
16+
- k8s version: v1.30.3-gke.1639000
1717
- vCPUs per node: 16
18-
- RAM per node: 65855012Ki
18+
- RAM per node: 65853968Ki
1919
- Max pods per node: 110
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
@@ -24,9 +24,9 @@ GKE Cluster:
2424

2525
```text
2626
Requests [total, rate, throughput] 6000, 100.02, 100.01
27-
Duration [total, attack, wait] 59.991s, 59.99s, 879.288µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 624.858µs, 833.765µs, 811.136µs, 926.889µs, 971.561µs, 1.103ms, 12.54ms
29-
Bytes In [total, mean] 962028, 160.34
27+
Duration [total, attack, wait] 59.992s, 59.991s, 884.168µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 634.08µs, 868.36µs, 853.024µs, 982.366µs, 1.035ms, 1.149ms, 4.411ms
29+
Bytes In [total, mean] 968003, 161.33
3030
Bytes Out [total, mean] 0, 0.00
3131
Success [ratio] 100.00%
3232
Status Codes [code:count] 200:6000
@@ -39,9 +39,9 @@ Error Set:
3939

4040
```text
4141
Requests [total, rate, throughput] 6000, 100.02, 100.01
42-
Duration [total, attack, wait] 59.991s, 59.99s, 877.076µs
43-
Latencies [min, mean, 50, 90, 95, 99, max] 630.112µs, 888.373µs, 853.502µs, 995.531µs, 1.046ms, 1.215ms, 12.537ms
44-
Bytes In [total, mean] 918000, 153.00
42+
Duration [total, attack, wait] 59.991s, 59.991s, 741.801µs
43+
Latencies [min, mean, 50, 90, 95, 99, max] 649.146µs, 849.636µs, 833.298µs, 943.565µs, 991.03µs, 1.118ms, 9.986ms
44+
Bytes In [total, mean] 930000, 155.00
4545
Bytes Out [total, mean] 0, 0.00
4646
Success [ratio] 100.00%
4747
Status Codes [code:count] 200:6000

‎tests/results/ngf-upgrade/edge/edge-plus.md

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -6,46 +6,46 @@ NGINX Plus: true
66

77
NGINX Gateway Fabric:
88

9-
- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
10-
- Date: 2024-08-15T00:04:25Z
9+
- Commit: bf8ea47203eb4695af0d359243c73de2d1badbbf
10+
- Date: 2024-09-13T20:33:11Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.29.6-gke.1326000
16+
- k8s version: v1.30.3-gke.1639000
1717
- vCPUs per node: 16
18-
- RAM per node: 65855012Ki
18+
- RAM per node: 65853960Ki
1919
- Max pods per node: 110
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23-
## Test: Send http /coffee traffic
23+
## Test: Send https /tea traffic
2424

2525
```text
2626
Requests [total, rate, throughput] 6000, 100.02, 100.01
27-
Duration [total, attack, wait] 59.992s, 59.991s, 994.033µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 618.031µs, 867.451µs, 853.111µs, 978.461µs, 1.029ms, 1.281ms, 3.592ms
29-
Bytes In [total, mean] 960000, 160.00
27+
Duration [total, attack, wait] 59.991s, 59.99s, 1.041ms
28+
Latencies [min, mean, 50, 90, 95, 99, max] 625.872µs, 826.301µs, 807.398µs, 918.006µs, 960.877µs, 1.112ms, 6.257ms
29+
Bytes In [total, mean] 936000, 156.00
3030
Bytes Out [total, mean] 0, 0.00
3131
Success [ratio] 100.00%
3232
Status Codes [code:count] 200:6000
3333
Error Set:
3434
```
3535

36-
![http-plus.png](http-plus.png)
36+
![https-plus.png](https-plus.png)
3737

38-
## Test: Send https /tea traffic
38+
## Test: Send http /coffee traffic
3939

4040
```text
4141
Requests [total, rate, throughput] 6000, 100.02, 100.01
42-
Duration [total, attack, wait] 59.992s, 59.991s, 1.001ms
43-
Latencies [min, mean, 50, 90, 95, 99, max] 699.522µs, 977.274µs, 952.901µs, 1.125ms, 1.185ms, 1.338ms, 7.794ms
44-
Bytes In [total, mean] 918000, 153.00
42+
Duration [total, attack, wait] 59.991s, 59.99s, 1.116ms
43+
Latencies [min, mean, 50, 90, 95, 99, max] 437.199µs, 801.276µs, 794.836µs, 903.922µs, 948.055µs, 1.064ms, 6.149ms
44+
Bytes In [total, mean] 972000, 162.00
4545
Bytes Out [total, mean] 0, 0.00
4646
Success [ratio] 100.00%
4747
Status Codes [code:count] 200:6000
4848
Error Set:
4949
```
5050

51-
![https-plus.png](https-plus.png)
51+
![http-plus.png](http-plus.png)

‎tests/results/ngf-upgrade/edge/http-oss.png

240 Bytes
Loading

‎tests/results/ngf-upgrade/edge/http-plus.png

-27 Bytes
Loading

‎tests/results/ngf-upgrade/edge/https-oss.png

240 Bytes
Loading

‎tests/results/ngf-upgrade/edge/https-plus.png

-27 Bytes
Loading

0 commit comments

Comments
 (0)