From a47b8ecbec02ed4726ce912647cbe6ca7816cf02 Mon Sep 17 00:00:00 2001 From: sjberman <8921145+sjberman@users.noreply.github.com> Date: Tue, 19 Mar 2024 17:22:23 +0000 Subject: [PATCH 1/3] NFR Test Results for NGF version 1.2.0 --- tests/results/dp-perf/1.2.0/1.2.0.md | 80 ++++++++++++++++++++++ tests/results/ngf-upgrade/1.2.0/1.2.0.md | 45 ++++++++++++ tests/results/ngf-upgrade/1.2.0/http.png | Bin 0 -> 4310 bytes tests/results/ngf-upgrade/1.2.0/https.png | Bin 0 -> 4310 bytes 4 files changed, 125 insertions(+) create mode 100755 tests/results/dp-perf/1.2.0/1.2.0.md create mode 100755 tests/results/ngf-upgrade/1.2.0/1.2.0.md create mode 100644 tests/results/ngf-upgrade/1.2.0/http.png create mode 100644 tests/results/ngf-upgrade/1.2.0/https.png diff --git a/tests/results/dp-perf/1.2.0/1.2.0.md b/tests/results/dp-perf/1.2.0/1.2.0.md new file mode 100755 index 0000000000..16bbcc8103 --- /dev/null +++ b/tests/results/dp-perf/1.2.0/1.2.0.md @@ -0,0 +1,80 @@ +# Results + +## Test environment + +NGINX Plus: false + +GKE Cluster: + +- Node count: 3 +- k8s version: v1.27.8-gke.1067004 +- vCPUs per node: 2 +- RAM per node: 4022900Ki +- Max pods per node: 110 +- Zone: us-east1-b +- Instance Type: e2-medium + +## Test1: Running latte path based routing + +```text +Requests [total, rate, throughput] 30000, 1000.03, 1000.00 +Duration [total, attack, wait] 30s, 29.999s, 920.347µs +Latencies [min, mean, 50, 90, 95, 99, max] 455.097µs, 1.762ms, 1.034ms, 1.837ms, 3.382ms, 18.819ms, 97.198ms +Bytes In [total, mean] 4800000, 160.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test2: Running coffee header based routing + +```text +Requests [total, rate, throughput] 30000, 1000.04, 1000.00 +Duration [total, attack, wait] 30s, 29.999s, 1.154ms +Latencies [min, mean, 50, 90, 95, 99, max] 527.567µs, 1.834ms, 1.084ms, 2.159ms, 4.694ms, 20.164ms, 72.738ms +Bytes In [total, mean] 4830000, 161.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test3: Running coffee query based routing + +```text +Requests [total, rate, throughput] 30000, 1000.00, 999.96 +Duration [total, attack, wait] 30.001s, 30s, 1.233ms +Latencies [min, mean, 50, 90, 95, 99, max] 535.012µs, 1.9ms, 1.057ms, 2.057ms, 4.498ms, 20.73ms, 116.243ms +Bytes In [total, mean] 5070000, 169.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test4: Running tea GET method based routing + +```text +Requests [total, rate, throughput] 30000, 1000.03, 1000.00 +Duration [total, attack, wait] 30s, 29.999s, 1.028ms +Latencies [min, mean, 50, 90, 95, 99, max] 521.799µs, 3.613ms, 962.891µs, 4.15ms, 14.717ms, 62.353ms, 211.694ms +Bytes In [total, mean] 4740000, 158.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test5: Running tea POST method based routing + +```text +Requests [total, rate, throughput] 30000, 1000.03, 999.98 +Duration [total, attack, wait] 30s, 29.999s, 1.273ms +Latencies [min, mean, 50, 90, 95, 99, max] 533.536µs, 2.134ms, 1.104ms, 2.042ms, 4.096ms, 28.08ms, 155.969ms +Bytes In [total, mean] 4740000, 158.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` diff --git a/tests/results/ngf-upgrade/1.2.0/1.2.0.md b/tests/results/ngf-upgrade/1.2.0/1.2.0.md new file mode 100755 index 0000000000..f8a3c82461 --- /dev/null +++ b/tests/results/ngf-upgrade/1.2.0/1.2.0.md @@ -0,0 +1,45 @@ +# Results + +## Test environment + +NGINX Plus: false + +GKE Cluster: + +- Node count: 3 +- k8s version: v1.27.8-gke.1067004 +- vCPUs per node: 2 +- RAM per node: 4022900Ki +- Max pods per node: 110 +- Zone: us-east1-b +- Instance Type: e2-medium + +## Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 6000, 100.02, 100.01 +Duration [total, attack, wait] 59.993s, 59.991s, 1.986ms +Latencies [min, mean, 50, 90, 95, 99, max] 644.027µs, 1.779ms, 1.655ms, 2.251ms, 2.557ms, 5.29ms, 32.836ms +Bytes In [total, mean] 961952, 160.33 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:6000 +Error Set: +``` + +![http.png](http.png) + +## Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 6000, 100.02, 100.01 +Duration [total, attack, wait] 59.992s, 59.991s, 1.491ms +Latencies [min, mean, 50, 90, 95, 99, max] 766.73µs, 1.875ms, 1.735ms, 2.332ms, 2.68ms, 5.794ms, 34.444ms +Bytes In [total, mean] 921996, 153.67 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:6000 +Error Set: +``` + +![https.png](https.png) diff --git a/tests/results/ngf-upgrade/1.2.0/http.png b/tests/results/ngf-upgrade/1.2.0/http.png new file mode 100644 index 0000000000000000000000000000000000000000..69111a8bc8aad22ae5372971c26a75f6632b3ee8 GIT binary patch literal 4310 zcmd^CYgAL$wvJG5s7mN*@kS65Z11UB522!c?f}oawJOB z;6On@2^Aq!2nLV@2#`n`d5KhcD}ew4g^&;g5+HP6Kz%Wx- zSh&%NK_EIH1_2MO%ito#?l zI!jB-0|yS^aJY*XFVbkV+}zyi>T0oA{NlxniHQk=3AMd_rYe&=Fsb%d%K<2AcR<~;LRsc%tT)+?ZVsZGo71s|MyCgf=|KQ} zgFhB1G_)X~FcJ`p0fRq)xKmJ|2GoW8&S${0PBD)PU<(18rlzKmkr4uc0Efdd7z~@u z7KudnEq%%jK7Sl}@=Oc}1o?U6+;n#zWG4t@_TQ(zIqH>gUn$!fUDaxoPRym$va2D8 zD!|q%b>2gB2(_WwG=KeqiF+ly>AxVDZx+YmATJ5*GqgNCs2iCNh-|D^- zTa*7lpZI3I?Gc;S5Ob*W-S-HiI=>(*qx>6lM_0j9DFm~w9a0yYajtZFKH2i5gHtW! zky9hq61FZBE+*B?vS|=$c$`KNQdUo>x<9-U+JQH&3)lcyWRsS5MkO?gp5R@VHV|Ty z_vn5+XLDiOyS0zSk-t#-M$^~ZijeT(y`)_zayf^sQIFrJN`v<3%?z!sC-Cb0bhogjpThwJHW4}8I6 zGH|>l2CYO-58l=37d^|@yV*0Bdq%!@q&OiT!M}{S%@MuY2{zT4=ve{!!7||sHPqW%bZv&Uf+J1Ovzwr84!*LGnGkb`o zDr)_&Kflx3$n?*#lNSNBGNfj~z`(xFF#%%dX7h>3M@F0eEqOumxqb5Zq$nGO*`c8& z*QwRboMpQgOPe^$TSW3IK)iQ-YfQ3uZ&R~f?JOoT185F_M`k>U99fJn=)og2!T9;E zvjbfS&6{c3GrYX3V2s`Pb?P!}vB|@I-rcSMcJ|v3CR4Hh`%Wc$Mgf2kA5m!H@-{8_ zyQXMEZ2?Xp@4#@X%Cszf6?Yv1;?ldc7__vUheBJ2SalYzrBG=2^nP zM`|JA%s7)rwwjjUtc%g=8`Gm-3^k@H&RI#^%9CF?#yX)k=Z!vCS&@%Uj~+)pO=ARSj_YnE zd$@lPNj9E3D-6E95r1-Gf{^W~HuC*X8vZ|^Wd1b1$E)Pg zgpI;wcn2Qzb!EAm!N*=&5A`T3xC#|7y#1WTg!ENWw}ep}1D+GwQKANv5SKw*H5*3B zTc@da6+llunI)C3a&D^>2~UZu@xaNTnV(Xv>Vq@ury*MD;wAm!-1-%9@$UclPBV9O zCbae8eJgIkx(s7lt7*XIJ=|_W>+ClAsUGTgh(I!p1N4IYl_?o!>$2)82A`yL*Zs(9 z8GaG-X)qqwEXXkiF zt$SvX7T9?Wx~WZ`BaXl70Ka(|=F`J<5nxR72x(sU@t;Pc|9^FqFbP4F)n97Q!I@#^ za-C}pdHBUdSqX!!{n?tjr#-w`&n#gaN*IGw%*-pc{(hUUQmm6sq^gCe1DTI?^>c(v zjX{YC#;I8KOpafgj0Pyz#@U3Wu8=u2&YMN(N<~H(9>W)o$)Q(2L2B{1jE8#(j;J*x zt=!~~-?`BCna=o`-B4XMXF1qzHW-?uTolQ7t3SNR?_t+m6G!%N5;!FNXu5Fy*8q{+ z9JpGCmYWksp#d8BVJVGRVRl&RySzC^4|bm?+*264&u`zdEIYf?ZN?W_BKSKz={ zsVx~7ehtb$93~-6G$Cd}6<2X5CX`XJ8T+(jW2JRcpU`|s%Dr`71gi|nvEHxehqsSk zx%>7+jr6?uCQ&B(Nra&2Nm(8vP=70jMunip$JC99d-5*yY9z6v$g$j^(O~91&y?v9 zD%C^71YJ2kyukT&@ zPALCi*jrMIzLu2qx105qs3tT2YG}?0lx^l{TNzTB@nov1-a^Hvc=_LW@?8Xk%2(Yc|E8Kpida3R<*8vc?eD6=~m* zh-;I}=n`uVCRtck#uRd`dQ}~&rODniw%Zih%UjM%45AH6CtY!>Bf>r{`WfNwq`%sw=ZJ3$n_P1=9s0~8z|v!dbD={3;%P+96dAL+|0uVD{812{{qZs-4kH01XAzg>?$i5 zT>ZWHa04r%SKV5hLPtQwQhUtPcvy-KRHQD$mL7W`|lZIUV zwCuhXEP{%<*@Kle&E1)uOXPP n#78Ba@Q7jl&#y#753s3h|EY-UYn9m>JHaUz_irkW1^w_3AKo+> literal 0 HcmV?d00001 diff --git a/tests/results/ngf-upgrade/1.2.0/https.png b/tests/results/ngf-upgrade/1.2.0/https.png new file mode 100644 index 0000000000000000000000000000000000000000..69111a8bc8aad22ae5372971c26a75f6632b3ee8 GIT binary patch literal 4310 zcmd^CYgAL$wvJG5s7mN*@kS65Z11UB522!c?f}oawJOB z;6On@2^Aq!2nLV@2#`n`d5KhcD}ew4g^&;g5+HP6Kz%Wx- zSh&%NK_EIH1_2MO%ito#?l zI!jB-0|yS^aJY*XFVbkV+}zyi>T0oA{NlxniHQk=3AMd_rYe&=Fsb%d%K<2AcR<~;LRsc%tT)+?ZVsZGo71s|MyCgf=|KQ} zgFhB1G_)X~FcJ`p0fRq)xKmJ|2GoW8&S${0PBD)PU<(18rlzKmkr4uc0Efdd7z~@u z7KudnEq%%jK7Sl}@=Oc}1o?U6+;n#zWG4t@_TQ(zIqH>gUn$!fUDaxoPRym$va2D8 zD!|q%b>2gB2(_WwG=KeqiF+ly>AxVDZx+YmATJ5*GqgNCs2iCNh-|D^- zTa*7lpZI3I?Gc;S5Ob*W-S-HiI=>(*qx>6lM_0j9DFm~w9a0yYajtZFKH2i5gHtW! zky9hq61FZBE+*B?vS|=$c$`KNQdUo>x<9-U+JQH&3)lcyWRsS5MkO?gp5R@VHV|Ty z_vn5+XLDiOyS0zSk-t#-M$^~ZijeT(y`)_zayf^sQIFrJN`v<3%?z!sC-Cb0bhogjpThwJHW4}8I6 zGH|>l2CYO-58l=37d^|@yV*0Bdq%!@q&OiT!M}{S%@MuY2{zT4=ve{!!7||sHPqW%bZv&Uf+J1Ovzwr84!*LGnGkb`o zDr)_&Kflx3$n?*#lNSNBGNfj~z`(xFF#%%dX7h>3M@F0eEqOumxqb5Zq$nGO*`c8& z*QwRboMpQgOPe^$TSW3IK)iQ-YfQ3uZ&R~f?JOoT185F_M`k>U99fJn=)og2!T9;E zvjbfS&6{c3GrYX3V2s`Pb?P!}vB|@I-rcSMcJ|v3CR4Hh`%Wc$Mgf2kA5m!H@-{8_ zyQXMEZ2?Xp@4#@X%Cszf6?Yv1;?ldc7__vUheBJ2SalYzrBG=2^nP zM`|JA%s7)rwwjjUtc%g=8`Gm-3^k@H&RI#^%9CF?#yX)k=Z!vCS&@%Uj~+)pO=ARSj_YnE zd$@lPNj9E3D-6E95r1-Gf{^W~HuC*X8vZ|^Wd1b1$E)Pg zgpI;wcn2Qzb!EAm!N*=&5A`T3xC#|7y#1WTg!ENWw}ep}1D+GwQKANv5SKw*H5*3B zTc@da6+llunI)C3a&D^>2~UZu@xaNTnV(Xv>Vq@ury*MD;wAm!-1-%9@$UclPBV9O zCbae8eJgIkx(s7lt7*XIJ=|_W>+ClAsUGTgh(I!p1N4IYl_?o!>$2)82A`yL*Zs(9 z8GaG-X)qqwEXXkiF zt$SvX7T9?Wx~WZ`BaXl70Ka(|=F`J<5nxR72x(sU@t;Pc|9^FqFbP4F)n97Q!I@#^ za-C}pdHBUdSqX!!{n?tjr#-w`&n#gaN*IGw%*-pc{(hUUQmm6sq^gCe1DTI?^>c(v zjX{YC#;I8KOpafgj0Pyz#@U3Wu8=u2&YMN(N<~H(9>W)o$)Q(2L2B{1jE8#(j;J*x zt=!~~-?`BCna=o`-B4XMXF1qzHW-?uTolQ7t3SNR?_t+m6G!%N5;!FNXu5Fy*8q{+ z9JpGCmYWksp#d8BVJVGRVRl&RySzC^4|bm?+*264&u`zdEIYf?ZN?W_BKSKz={ zsVx~7ehtb$93~-6G$Cd}6<2X5CX`XJ8T+(jW2JRcpU`|s%Dr`71gi|nvEHxehqsSk zx%>7+jr6?uCQ&B(Nra&2Nm(8vP=70jMunip$JC99d-5*yY9z6v$g$j^(O~91&y?v9 zD%C^71YJ2kyukT&@ zPALCi*jrMIzLu2qx105qs3tT2YG}?0lx^l{TNzTB@nov1-a^Hvc=_LW@?8Xk%2(Yc|E8Kpida3R<*8vc?eD6=~m* zh-;I}=n`uVCRtck#uRd`dQ}~&rODniw%Zih%UjM%45AH6CtY!>Bf>r{`WfNwq`%sw=ZJ3$n_P1=9s0~8z|v!dbD={3;%P+96dAL+|0uVD{812{{qZs-4kH01XAzg>?$i5 zT>ZWHa04r%SKV5hLPtQwQhUtPcvy-KRHQD$mL7W`|lZIUV zwCuhXEP{%<*@Kle&E1)uOXPP n#78Ba@Q7jl&#y#753s3h|EY-UYn9m>JHaUz_irkW1^w_3AKo+> literal 0 HcmV?d00001 From 2cb8cc1949224bcdb7ef093efc3120d75b96482c Mon Sep 17 00:00:00 2001 From: Saylor Berman Date: Tue, 19 Mar 2024 11:24:44 -0600 Subject: [PATCH 2/3] Update dp-perf with summary --- tests/results/dp-perf/1.2.0/1.2.0.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/tests/results/dp-perf/1.2.0/1.2.0.md b/tests/results/dp-perf/1.2.0/1.2.0.md index 16bbcc8103..755dfc7015 100755 --- a/tests/results/dp-perf/1.2.0/1.2.0.md +++ b/tests/results/dp-perf/1.2.0/1.2.0.md @@ -14,6 +14,11 @@ GKE Cluster: - Zone: us-east1-b - Instance Type: e2-medium +## Summary + +- Results will look different due to the new automation tools used. +- Overall latency seems to have reduced. + ## Test1: Running latte path based routing ```text From 4770bf343b6d6da691e321f3f041956336c37b54 Mon Sep 17 00:00:00 2001 From: Saylor Berman Date: Tue, 19 Mar 2024 11:25:46 -0600 Subject: [PATCH 3/3] Update ngf-upgrade summary --- tests/results/ngf-upgrade/1.2.0/1.2.0.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/tests/results/ngf-upgrade/1.2.0/1.2.0.md b/tests/results/ngf-upgrade/1.2.0/1.2.0.md index f8a3c82461..df22fa2610 100755 --- a/tests/results/ngf-upgrade/1.2.0/1.2.0.md +++ b/tests/results/ngf-upgrade/1.2.0/1.2.0.md @@ -14,6 +14,11 @@ GKE Cluster: - Zone: us-east1-b - Instance Type: e2-medium +## Summary + +- Results will look different due to the new automation tools used. +- Overall latency seems to have reduced. + ## Test: Send http /coffee traffic ```text