Skip to content

Commit f765b79

Browse files
authored
NFR Test Results for NGF version edge (#2408)
1 parent 4dc56ba commit f765b79

File tree

70 files changed

+5741
-5741
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

70 files changed

+5741
-5741
lines changed

tests/results/dp-perf/edge/edge-oss.md

Lines changed: 24 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -6,8 +6,8 @@ NGINX Plus: false
66

77
NGINX Gateway Fabric:
88

9-
- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
10-
- Date: 2024-08-13T21:12:05Z
9+
- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
10+
- Date: 2024-08-15T00:04:25Z
1111
- Dirty: false
1212

1313
GKE Cluster:
@@ -23,24 +23,24 @@ GKE Cluster:
2323
## Test1: Running latte path based routing
2424

2525
```text
26-
Requests [total, rate, throughput] 30000, 1000.01, 999.79
27-
Duration [total, attack, wait] 30s, 30s, 701.442µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 341.042µs, 737.394µs, 718.76µs, 827.697µs, 866.432µs, 962.831µs, 16.145ms
29-
Bytes In [total, mean] 4769946, 159.00
26+
Requests [total, rate, throughput] 30000, 1000.03, 999.91
27+
Duration [total, attack, wait] 30s, 29.999s, 586.041µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 459.105µs, 652.462µs, 640.858µs, 731.955µs, 766.916µs, 868.446µs, 5.683ms
29+
Bytes In [total, mean] 4829967, 161.00
3030
Bytes Out [total, mean] 0, 0.00
31-
Success [ratio] 99.98%
32-
Status Codes [code:count] 200:29994 502:6
31+
Success [ratio] 99.99%
32+
Status Codes [code:count] 200:29997 502:3
3333
Error Set:
3434
502 Bad Gateway
3535
```
3636

3737
## Test2: Running coffee header based routing
3838

3939
```text
40-
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
41-
Duration [total, attack, wait] 30s, 29.999s, 687.856µs
42-
Latencies [min, mean, 50, 90, 95, 99, max] 554.445µs, 759.558µs, 740.252µs, 848.701µs, 889.401µs, 997.689µs, 22.657ms
43-
Bytes In [total, mean] 4800000, 160.00
40+
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
41+
Duration [total, attack, wait] 30s, 29.999s, 637.326µs
42+
Latencies [min, mean, 50, 90, 95, 99, max] 474.92µs, 694.704µs, 678.367µs, 786.23µs, 826.769µs, 934.323µs, 12.252ms
43+
Bytes In [total, mean] 4860000, 162.00
4444
Bytes Out [total, mean] 0, 0.00
4545
Success [ratio] 100.00%
4646
Status Codes [code:count] 200:30000
@@ -50,10 +50,10 @@ Error Set:
5050
## Test3: Running coffee query based routing
5151

5252
```text
53-
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
54-
Duration [total, attack, wait] 29.999s, 29.999s, 726.197µs
55-
Latencies [min, mean, 50, 90, 95, 99, max] 550.722µs, 769.327µs, 747.389µs, 857.742µs, 898.394µs, 1.015ms, 13.026ms
56-
Bytes In [total, mean] 5040000, 168.00
53+
Requests [total, rate, throughput] 30000, 1000.02, 999.99
54+
Duration [total, attack, wait] 30s, 30s, 676.679µs
55+
Latencies [min, mean, 50, 90, 95, 99, max] 525.067µs, 708.22µs, 693.208µs, 804.086µs, 849.031µs, 958.899µs, 10.449ms
56+
Bytes In [total, mean] 5100000, 170.00
5757
Bytes Out [total, mean] 0, 0.00
5858
Success [ratio] 100.00%
5959
Status Codes [code:count] 200:30000
@@ -63,10 +63,10 @@ Error Set:
6363
## Test4: Running tea GET method based routing
6464

6565
```text
66-
Requests [total, rate, throughput] 30000, 1000.00, 999.98
67-
Duration [total, attack, wait] 30.001s, 30s, 705.904µs
68-
Latencies [min, mean, 50, 90, 95, 99, max] 539.272µs, 750.546µs, 734.78µs, 841.798µs, 880.351µs, 979.455µs, 16.567ms
69-
Bytes In [total, mean] 4710000, 157.00
66+
Requests [total, rate, throughput] 30000, 1000.01, 999.99
67+
Duration [total, attack, wait] 30s, 30s, 637.156µs
68+
Latencies [min, mean, 50, 90, 95, 99, max] 512.28µs, 691.498µs, 675.513µs, 780.523µs, 817.834µs, 910.375µs, 9.619ms
69+
Bytes In [total, mean] 4770000, 159.00
7070
Bytes Out [total, mean] 0, 0.00
7171
Success [ratio] 100.00%
7272
Status Codes [code:count] 200:30000
@@ -76,10 +76,10 @@ Error Set:
7676
## Test5: Running tea POST method based routing
7777

7878
```text
79-
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
80-
Duration [total, attack, wait] 30s, 29.999s, 772.597µs
81-
Latencies [min, mean, 50, 90, 95, 99, max] 541.485µs, 752.07µs, 740.31µs, 847.409µs, 886.955µs, 981.786µs, 12.398ms
82-
Bytes In [total, mean] 4710000, 157.00
79+
Requests [total, rate, throughput] 30000, 1000.00, 999.98
80+
Duration [total, attack, wait] 30.001s, 30s, 773.157µs
81+
Latencies [min, mean, 50, 90, 95, 99, max] 503.29µs, 669.335µs, 655.455µs, 754.428µs, 792.559µs, 892.505µs, 10.652ms
82+
Bytes In [total, mean] 4770000, 159.00
8383
Bytes Out [total, mean] 0, 0.00
8484
Success [ratio] 100.00%
8585
Status Codes [code:count] 200:30000

tests/results/dp-perf/edge/edge-plus.md

Lines changed: 21 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -6,8 +6,8 @@ NGINX Plus: true
66

77
NGINX Gateway Fabric:
88

9-
- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
10-
- Date: 2024-08-13T21:12:05Z
9+
- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
10+
- Date: 2024-08-15T00:04:25Z
1111
- Dirty: false
1212

1313
GKE Cluster:
@@ -23,10 +23,10 @@ GKE Cluster:
2323
## Test1: Running latte path based routing
2424

2525
```text
26-
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
27-
Duration [total, attack, wait] 30s, 29.999s, 682.261µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 515.366µs, 729.019µs, 712.033µs, 843.484µs, 895.476µs, 1.019ms, 9.154ms
29-
Bytes In [total, mean] 4800000, 160.00
26+
Requests [total, rate, throughput] 30000, 1000.01, 999.99
27+
Duration [total, attack, wait] 30s, 30s, 673.045µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 487.307µs, 681.853µs, 664.969µs, 758.583µs, 798.223µs, 915.644µs, 11.35ms
29+
Bytes In [total, mean] 4740000, 158.00
3030
Bytes Out [total, mean] 0, 0.00
3131
Success [ratio] 100.00%
3232
Status Codes [code:count] 200:30000
@@ -37,9 +37,9 @@ Error Set:
3737

3838
```text
3939
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
40-
Duration [total, attack, wait] 30s, 29.999s, 599.51µs
41-
Latencies [min, mean, 50, 90, 95, 99, max] 540.423µs, 740.62µs, 724.16µs, 857.72µs, 911.755µs, 1.042ms, 7.517ms
42-
Bytes In [total, mean] 4830000, 161.00
40+
Duration [total, attack, wait] 30s, 29.999s, 687.489µs
41+
Latencies [min, mean, 50, 90, 95, 99, max] 508.353µs, 694.959µs, 683.138µs, 780.78µs, 818.701µs, 943.447µs, 7.212ms
42+
Bytes In [total, mean] 4770000, 159.00
4343
Bytes Out [total, mean] 0, 0.00
4444
Success [ratio] 100.00%
4545
Status Codes [code:count] 200:30000
@@ -49,10 +49,10 @@ Error Set:
4949
## Test3: Running coffee query based routing
5050

5151
```text
52-
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
53-
Duration [total, attack, wait] 29.999s, 29.999s, 683.488µs
54-
Latencies [min, mean, 50, 90, 95, 99, max] 523.729µs, 756.497µs, 740.664µs, 870.743µs, 921.816µs, 1.062ms, 12.337ms
55-
Bytes In [total, mean] 5070000, 169.00
52+
Requests [total, rate, throughput] 30000, 1000.01, 999.99
53+
Duration [total, attack, wait] 30s, 30s, 607.004µs
54+
Latencies [min, mean, 50, 90, 95, 99, max] 525.289µs, 702.559µs, 688.194µs, 791.113µs, 832.688µs, 952.855µs, 8.97ms
55+
Bytes In [total, mean] 5010000, 167.00
5656
Bytes Out [total, mean] 0, 0.00
5757
Success [ratio] 100.00%
5858
Status Codes [code:count] 200:30000
@@ -62,10 +62,10 @@ Error Set:
6262
## Test4: Running tea GET method based routing
6363

6464
```text
65-
Requests [total, rate, throughput] 30000, 1000.01, 999.98
66-
Duration [total, attack, wait] 30.001s, 30s, 762.485µs
67-
Latencies [min, mean, 50, 90, 95, 99, max] 499.61µs, 744.201µs, 726.564µs, 862.287µs, 914.928µs, 1.054ms, 7.531ms
68-
Bytes In [total, mean] 4740000, 158.00
65+
Requests [total, rate, throughput] 30000, 1000.02, 999.99
66+
Duration [total, attack, wait] 30s, 30s, 682.661µs
67+
Latencies [min, mean, 50, 90, 95, 99, max] 520.536µs, 700.459µs, 686.666µs, 790.333µs, 830.005µs, 947.376µs, 13.797ms
68+
Bytes In [total, mean] 4680000, 156.00
6969
Bytes Out [total, mean] 0, 0.00
7070
Success [ratio] 100.00%
7171
Status Codes [code:count] 200:30000
@@ -75,10 +75,10 @@ Error Set:
7575
## Test5: Running tea POST method based routing
7676

7777
```text
78-
Requests [total, rate, throughput] 30000, 1000.01, 999.99
79-
Duration [total, attack, wait] 30s, 30s, 651.893µs
80-
Latencies [min, mean, 50, 90, 95, 99, max] 532.673µs, 751.908µs, 734.466µs, 872.179µs, 927.874µs, 1.068ms, 6.327ms
81-
Bytes In [total, mean] 4740000, 158.00
78+
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
79+
Duration [total, attack, wait] 30s, 29.999s, 734.519µs
80+
Latencies [min, mean, 50, 90, 95, 99, max] 517.019µs, 687.341µs, 674.327µs, 775.376µs, 819.395µs, 936.514µs, 8.43ms
81+
Bytes In [total, mean] 4680000, 156.00
8282
Bytes Out [total, mean] 0, 0.00
8383
Success [ratio] 100.00%
8484
Status Codes [code:count] 200:30000

tests/results/ngf-upgrade/edge/edge-oss.md

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -6,8 +6,8 @@ NGINX Plus: false
66

77
NGINX Gateway Fabric:
88

9-
- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
10-
- Date: 2024-08-13T21:12:05Z
9+
- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
10+
- Date: 2024-08-15T00:04:25Z
1111
- Dirty: false
1212

1313
GKE Cluster:
@@ -20,32 +20,32 @@ GKE Cluster:
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23-
## Test: Send https /tea traffic
23+
## Test: Send http /coffee traffic
2424

2525
```text
26-
Requests [total, rate, throughput] 6000, 100.02, 100.02
27-
Duration [total, attack, wait] 59.991s, 59.99s, 763.57µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 631.935µs, 834.342µs, 818.106µs, 916.549µs, 953.194µs, 1.06ms, 12.108ms
29-
Bytes In [total, mean] 918000, 153.00
26+
Requests [total, rate, throughput] 6000, 100.02, 100.01
27+
Duration [total, attack, wait] 59.991s, 59.99s, 879.288µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 624.858µs, 833.765µs, 811.136µs, 926.889µs, 971.561µs, 1.103ms, 12.54ms
29+
Bytes In [total, mean] 962028, 160.34
3030
Bytes Out [total, mean] 0, 0.00
3131
Success [ratio] 100.00%
3232
Status Codes [code:count] 200:6000
3333
Error Set:
3434
```
3535

36-
![https-oss.png](https-oss.png)
36+
![http-oss.png](http-oss.png)
3737

38-
## Test: Send http /coffee traffic
38+
## Test: Send https /tea traffic
3939

4040
```text
41-
Requests [total, rate, throughput] 6000, 100.02, 100.02
42-
Duration [total, attack, wait] 59.991s, 59.99s, 761.784µs
43-
Latencies [min, mean, 50, 90, 95, 99, max] 605.288µs, 828.183µs, 816.906µs, 927.903µs, 968.164µs, 1.089ms, 3.097ms
44-
Bytes In [total, mean] 960000, 160.00
41+
Requests [total, rate, throughput] 6000, 100.02, 100.01
42+
Duration [total, attack, wait] 59.991s, 59.99s, 877.076µs
43+
Latencies [min, mean, 50, 90, 95, 99, max] 630.112µs, 888.373µs, 853.502µs, 995.531µs, 1.046ms, 1.215ms, 12.537ms
44+
Bytes In [total, mean] 918000, 153.00
4545
Bytes Out [total, mean] 0, 0.00
4646
Success [ratio] 100.00%
4747
Status Codes [code:count] 200:6000
4848
Error Set:
4949
```
5050

51-
![http-oss.png](http-oss.png)
51+
![https-oss.png](https-oss.png)

tests/results/ngf-upgrade/edge/edge-plus.md

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -6,8 +6,8 @@ NGINX Plus: true
66

77
NGINX Gateway Fabric:
88

9-
- Commit: 9a85dbcc0797e31557a3731688795aa166ee0f96
10-
- Date: 2024-08-13T21:12:05Z
9+
- Commit: 3c029b1417c1f89f2a29aeef07f47078640e28b2
10+
- Date: 2024-08-15T00:04:25Z
1111
- Dirty: false
1212

1313
GKE Cluster:
@@ -20,32 +20,32 @@ GKE Cluster:
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23-
## Test: Send https /tea traffic
23+
## Test: Send http /coffee traffic
2424

2525
```text
2626
Requests [total, rate, throughput] 6000, 100.02, 100.01
27-
Duration [total, attack, wait] 59.991s, 59.99s, 921.041µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 616.005µs, 851.643µs, 821.167µs, 986.363µs, 1.055ms, 1.241ms, 12.227ms
29-
Bytes In [total, mean] 921995, 153.67
27+
Duration [total, attack, wait] 59.992s, 59.991s, 994.033µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 618.031µs, 867.451µs, 853.111µs, 978.461µs, 1.029ms, 1.281ms, 3.592ms
29+
Bytes In [total, mean] 960000, 160.00
3030
Bytes Out [total, mean] 0, 0.00
3131
Success [ratio] 100.00%
3232
Status Codes [code:count] 200:6000
3333
Error Set:
3434
```
3535

36-
![https-plus.png](https-plus.png)
36+
![http-plus.png](http-plus.png)
3737

38-
## Test: Send http /coffee traffic
38+
## Test: Send https /tea traffic
3939

4040
```text
4141
Requests [total, rate, throughput] 6000, 100.02, 100.01
42-
Duration [total, attack, wait] 59.991s, 59.99s, 902.051µs
43-
Latencies [min, mean, 50, 90, 95, 99, max] 483.51µs, 832.015µs, 814.172µs, 976.685µs, 1.031ms, 1.193ms, 12.788ms
44-
Bytes In [total, mean] 966000, 161.00
42+
Duration [total, attack, wait] 59.992s, 59.991s, 1.001ms
43+
Latencies [min, mean, 50, 90, 95, 99, max] 699.522µs, 977.274µs, 952.901µs, 1.125ms, 1.185ms, 1.338ms, 7.794ms
44+
Bytes In [total, mean] 918000, 153.00
4545
Bytes Out [total, mean] 0, 0.00
4646
Success [ratio] 100.00%
4747
Status Codes [code:count] 200:6000
4848
Error Set:
4949
```
5050

51-
![http-plus.png](http-plus.png)
51+
![https-plus.png](https-plus.png)
-110 Bytes
Loading
-374 Bytes
Loading
-110 Bytes
Loading
-374 Bytes
Loading

0 commit comments

Comments
 (0)