diff --git a/tests/scale/results/1.1.0/1.1.0.md b/tests/scale/results/1.1.0/1.1.0.md new file mode 100644 index 0000000000..ebcbbade53 --- /dev/null +++ b/tests/scale/results/1.1.0/1.1.0.md @@ -0,0 +1,224 @@ +# Results for v1.1.0 + + +- [Results for v1.1.0](#results-for-v110) + - [Summary](#summary) + - [Versions](#versions) + - [Tests](#tests) + - [Scale Listeners](#scale-listeners) + - [Scale HTTPS Listeners](#scale-https-listeners) + - [Scale HTTPRoutes](#scale-httproutes) + - [Scale Upstream Servers](#scale-upstream-servers) + - [Scale HTTP Matches](#scale-http-matches) + - [Future Improvements](#future-improvements) + + +## Summary + +- Memory usage has increased since 1.0 +- Number of events being processed has increased a bit, therefore so has the average time. +- CPU and TTR seem to have stayed about the same. +- One of the CPU charts for the final test was not being calculated properly. + +## Versions + +NGF version: + +```text +commit: 7a37efac52546f2fe24dbc2772e913a49329ed6c +date: 2023-12-06T02:17:06Z +version: edge +``` + +with NGINX: + +```text +nginx/1.25.3 +built by gcc 12.2.1 20220924 (Alpine 12.2.1_git20220924-r10) +OS: Linux 5.15.109+ +``` + +Kubernetes: + +```json + "serverVersion": { + "major": "1", + "minor": "27", + "gitVersion": "v1.27.3-gke.100", + "gitCommit": "6466b51b762a5c49ae3fb6c2c7233ffe1c96e48c", + "gitTreeState": "clean", + "buildDate": "2023-06-23T09:27:28Z", + "goVersion": "go1.20.5 X:boringcrypto", + "compiler": "gc", + "platform": "linux/amd64" + } +``` + +## Tests + +### Scale Listeners + +Reloads: + +| Total | Total Errors | Ave Time (ms) | <= 500ms | +|-------|--------------|--------------------|----------| +| 128 | 0 | 136.38250641586066 | 100% | + + +Event Batch Processing: + +| Total | Ave Time (ms) | <= 500ms | <= 1000ms | +|-------|--------------------|----------|-----------| +| 467 | 228.32680399999995 | 89.07% | 97.43% | + +**NGINX Errors**: None. + +**NGF Errors**: None. + +**Pod Restarts**: None. + +**CPU**: ![CPU.png](/tests/scale/results/1.1.0/TestScale_Listeners/CPU.png). + +**Memory**: ![Memory.png](/tests/scale/results/1.1.0/TestScale_Listeners/Memory.png). + +**Time To Ready**: ![TTR.png](/tests/scale/results/1.1.0/TestScale_Listeners/TTR.png). + +### Scale HTTPS Listeners + +Reloads: + +| Total | Total Errors | Ave Time (ms) | <= 500ms | +|-------|--------------|--------------------|----------| +| 106 | 0 | 153.87735849056605 | 100% | + + +Event Batch Processing: + +| Total | Ave Time (ms) | <= 500ms | <= 1000ms | <= 5000ms | +|-------|--------------------|----------|-----------|-----------| +| 520 | 266.9285714285714 | 92.5% | 100% | 100% | + + +**NGINX Errors**: None. + +**NGF Errors**: None. + +**Pod Restarts**: None. + +**CPU**: ![CPU.png](/tests/scale/results/1.1.0/TestScale_HTTPSListeners/CPU.png). + +**Memory**: ![Memory.png](/tests/scale/results/1.1.0/TestScale_HTTPSListeners/Memory.png). + +**Time To Ready**: ![TTR.png](/tests/scale/results/1.1.0/TestScale_HTTPSListeners/TTR.png). + +### Scale HTTPRoutes + +Reloads: + +| Delay | Total | Total Errors | Ave Time (ms) | <= 500ms | <= 1000ms | +|-----------|-------|--------------|-------------------|----------|-----------| +| 2 seconds | 1001 | 0 | 364.405076142132 | 75.92% | 100% | +| No delay | 1001 | 0 | 358.1523316062176 | 75.92% | 100% | + + +Event Batch Processing: + +| Delay | Total | Ave Time | <= 500ms | <= 1000ms | +|-----------|-------|--------------------|----------|-----------| +| 2 seconds | 2056 | 200.38335809806838 | 83.37% | 100% | +| No delay | 2044 | 197.871000507872 | 83.22% | 100% | + + +**NGINX Errors**: None. + +**NGF Errors**: None. + +**Pod Restarts**: None. + +**CPU**: + +2-sec delay: +![CPU.png](/tests/scale/results/1.1.0/TestScale_HTTPRoutes/CPU.png). + +No delay: +![CPU.png](/tests/scale/results/1.1.0/TestScale_HTTPRoutes/CPU-no-delay.png). + +**Memory**: + +2-sec delay: +![Memory.png](/tests/scale/results/1.1.0/TestScale_HTTPRoutes/Memory.png). + +No delay: +![Memory.png](/tests/scale/results/1.1.0/TestScale_HTTPRoutes/Memory-no-delay.png). + +**TTR**: + +Combined: +![TTR.png](/tests/scale/results/1.1.0/TestScale_HTTPRoutes/TTR.png) + +### Scale Upstream Servers + +| Start Time (UNIX) | End Time (UNIX) | Duration (s) | +|-------------------|-----------------|--------------| +| 1701893886 | 1701893955 | 69 | + +Reloads: + +| Total | Total Errors | Ave Time (ms) | <= 500ms | +|-------|--------------|---------------------|----------| +| 157 | 0 | 1126.36305732484075 | 100% | + +Event Batch Processing: + +| Total | Ave Time (ms) | <=500ms | <= 1000ms | <= 5000ms | +|-------|--------------------|---------|-----------|-----------| +| 159 | 210.08176100628933 | 99.37% | 100% | 100% | + +**NGINX Errors**: None. + +**NGF Errors**: None. + +**Pod Restarts**: None. + +**CPU**: ![CPU.png](/tests/scale/results/1.1.0/TestScale_UpstreamServers/CPU.png). + +**Memory**: ![Memory.png](/tests/scale/results/1.1.0/TestScale_UpstreamServers/Memory.png). + +### Scale HTTP Matches + +**Results for the first match**: + +```text +Running 30s test @ http://cafe.example.com + 2 threads and 10 connections + Thread Stats Avg Stdev Max +/- Stdev + Latency 25.09ms 57.91ms 693.45ms 97.96% + Req/Sec 284.70 24.62 330.00 84.30% + 16710 requests in 30.01s, 5.91MB read +Requests/sec: 556.84 +Transfer/sec: 201.74KB +``` + +**Results for the last match**: + +```text +Running 30s test @ http://cafe.example.com + 2 threads and 10 connections + Thread Stats Avg Stdev Max +/- Stdev + Latency 17.63ms 1.93ms 56.53ms 86.77% + Req/Sec 284.44 18.22 323.00 74.29% + 17025 requests in 30.10s, 6.02MB read +Requests/sec: 565.66 +Transfer/sec: 204.94KB +``` + +**Findings**: + +- There's not a noticeable difference between the response times for the first match and last match. In +fact, the latency of the last match is slightly lower than the latency of the first match. + +## Future Improvements + +- Check that the statuses of the Gateway API resources are updated after each scaling event. +- Measure the time it takes for NGF to update the status of the Gateway API resources after creating or updating the resources. +- Record the reload time distributions per bucket after each test. diff --git a/tests/scale/results/1.1.0/TestScale_HTTPRoutes/CPU-no-delay.png b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/CPU-no-delay.png new file mode 100644 index 0000000000..ed65e73fed Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/CPU-no-delay.png differ diff --git a/tests/scale/results/1.1.0/TestScale_HTTPRoutes/CPU.png b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/CPU.png new file mode 100644 index 0000000000..4894b7a12c Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/CPU.png differ diff --git a/tests/scale/results/1.1.0/TestScale_HTTPRoutes/Memory-no-delay.png b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/Memory-no-delay.png new file mode 100644 index 0000000000..d2841e4461 Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/Memory-no-delay.png differ diff --git a/tests/scale/results/1.1.0/TestScale_HTTPRoutes/Memory.png b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/Memory.png new file mode 100644 index 0000000000..7e3168bc04 Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/Memory.png differ diff --git a/tests/scale/results/1.1.0/TestScale_HTTPRoutes/TTR.png b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/TTR.png new file mode 100644 index 0000000000..3a90cf178f Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/TTR.png differ diff --git a/tests/scale/results/1.1.0/TestScale_HTTPRoutes/results-no-delay.csv b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/results-no-delay.csv new file mode 100644 index 0000000000..2fea963aaf --- /dev/null +++ b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/results-no-delay.csv @@ -0,0 +1,1003 @@ +# HTTPRoutes,Time to Ready (s),Error +1,0.103154125 +2,0.189255333 +3,0.195507375 +4,0.191802875 +5,0.194460458 +6,0.19457125 +7,0.189630375 +8,0.195447917 +9,0.196909875 +10,0.193186458 +11,0.193078208 +12,0.126666292 +13,0.194017166 +14,0.191090833 +15,0.190367875 +16,0.18987475 +17,0.19653575 +18,0.206651459 +19,0.191892084 +20,0.18681925 +21,0.118981583 +22,0.201258834 +23,0.194032708 +24,0.116170958 +25,0.193182291 +26,0.214064458 +27,0.218131 +28,0.187379583 +29,0.193281791 +30,0.205557333 +31,0.192705209 +32,0.194091125 +33,0.193496292 +34,0.194047625 +35,0.188978583 +36,0.1979745 +37,0.186635625 +38,0.191732791 +39,0.1978405 +40,0.1989115 +41,0.188409833 +42,0.188746417 +43,0.190522417 +44,0.199044291 +45,0.188969167 +46,0.191121125 +47,0.21073 +48,0.187472208 +49,0.199064333 +50,0.214941958 +51,0.193538459 +52,0.192481625 +53,0.219738292 +54,0.192665667 +55,0.192670084 +56,0.197754292 +57,0.19541075 +58,0.191504625 +59,0.215374083 +60,0.190625958 +61,0.197558875 +62,0.18667525 +63,0.191775958 +64,0.211436334 +65,0.19326375 +66,0.196678917 +67,0.189764958 +68,0.204070667 +69,0.207488375 +70,0.190400541 +71,0.1949615 +72,0.222126 +73,0.194788541 +74,0.191402625 +75,0.190613125 +76,0.195623166 +77,0.194326375 +78,0.195355041 +79,0.217683292 +80,0.193072667 +81,0.198207833 +82,0.191294042 +83,0.198187125 +84,0.190687083 +85,0.193436416 +86,0.186355375 +87,0.194690709 +88,0.211468875 +89,0.194790375 +90,0.187356208 +91,0.188529667 +92,0.194770542 +93,0.192456125 +94,0.190748209 +95,0.207590334 +96,0.190286917 +97,0.197247041 +98,0.200008875 +99,0.193061042 +100,0.18736125 +101,0.224608666 +102,0.189932291 +103,0.191655709 +104,0.19345275 +105,0.189714708 +106,0.189158167 +107,0.206422833 +108,0.190390625 +109,0.206501625 +110,0.192044167 +111,0.189402042 +112,0.191879459 +113,0.189643417 +114,0.195753 +115,0.192657125 +116,0.19014575 +117,0.200002791 +118,0.190867958 +119,0.188561333 +120,0.189927708 +121,0.186989417 +122,0.194464042 +123,0.216216125 +124,0.207585625 +125,0.189805375 +126,0.192503333 +127,0.194005917 +128,0.202325542 +129,0.196240708 +130,0.215649583 +131,0.1896205 +132,0.190197625 +133,0.196055708 +134,0.19071725 +135,0.18863675 +136,0.189686917 +137,0.198042458 +138,0.189040583 +139,0.192276709 +140,0.188761 +141,0.190300417 +142,0.191613583 +143,0.201489042 +144,0.192292916 +145,0.192017042 +146,0.194920375 +147,0.194971458 +148,0.1958735 +149,0.217935167 +150,0.193122041 +151,0.192484958 +152,0.1987195 +153,0.197508291 +154,0.192465416 +155,0.190308833 +156,0.20113825 +157,0.201843958 +158,0.193549 +159,0.194627291 +160,0.193463042 +161,0.191258583 +162,0.485922583 +163,0.193452459 +164,0.192114333 +165,0.2086585 +166,0.206161125 +167,0.187967667 +168,0.1979925 +169,0.1909055 +170,0.19381475 +171,0.197485083 +172,0.196570792 +173,0.2185345 +174,0.200662958 +175,0.20471875 +176,0.1893315 +177,0.205527458 +178,0.205997375 +179,0.208695208 +180,0.207012459 +181,0.203050375 +182,0.20214325 +183,0.504364292 +184,0.500891333 +185,0.20492325 +186,0.193300875 +187,0.486672041 +188,0.486381458 +189,0.491331792 +190,0.2023795 +191,0.2114035 +192,0.485447125 +193,0.209076125 +194,0.487065209 +195,0.493945334 +196,0.484709 +197,0.487442584 +198,0.493220375 +199,0.492895542 +200,0.210039042 +201,0.485324334 +202,0.493447916 +203,0.586203875 +204,0.484344625 +205,0.503745292 +206,0.491588416 +207,0.487737333 +208,0.507023792 +209,0.503311666 +210,0.502276708 +211,0.505203 +212,0.486521292 +213,0.510267416 +214,0.501097458 +215,0.500865125 +216,0.495168708 +217,0.494591333 +218,0.502304625 +219,0.48560625 +220,0.486116292 +221,0.490960584 +222,0.495597541 +223,0.493113334 +224,0.493408416 +225,0.48854225 +226,0.485815 +227,0.492999167 +228,0.4872285 +229,0.491327417 +230,0.487420959 +231,0.507123333 +232,0.491887542 +233,0.486575958 +234,0.490928875 +235,0.491798291 +236,0.485429292 +237,0.480778875 +238,0.491904208 +239,0.486609917 +240,0.487709625 +241,0.49046275 +242,0.487707291 +243,0.484806041 +244,0.498895958 +245,0.502908625 +246,0.494572208 +247,0.497442584 +248,0.50476175 +249,0.249975167 +250,0.491337625 +251,0.497455417 +252,0.490725833 +253,0.492824792 +254,0.50167925 +255,0.496408667 +256,0.494588416 +257,0.490560083 +258,0.4960885 +259,0.50425175 +260,0.495331792 +261,0.4890735 +262,0.495357583 +263,0.485602667 +264,0.491572708 +265,0.493447083 +266,0.487859125 +267,0.483909584 +268,0.481436416 +269,0.486436833 +270,0.490978958 +271,0.505104 +272,0.4866865 +273,0.4872315 +274,0.495064708 +275,0.488956708 +276,0.484820333 +277,0.488179084 +278,0.487382458 +279,0.491421333 +280,0.495721791 +281,0.503601417 +282,0.486319917 +283,0.4988315 +284,0.491481542 +285,0.496720792 +286,0.497183083 +287,0.493888208 +288,0.496859333 +289,0.503362084 +290,0.510436083 +291,0.525122042 +292,0.496125583 +293,0.500684042 +294,0.497391041 +295,0.519271334 +296,0.518529708 +297,0.517553042 +298,0.494299584 +299,0.520808792 +300,0.524291833 +301,0.540050583 +302,0.504327959 +303,0.494809208 +304,0.505747458 +305,0.519829042 +306,0.498188084 +307,0.503322166 +308,0.515965125 +309,0.501437875 +310,0.540384667 +311,0.498238792 +312,0.497471917 +313,0.503212708 +314,0.508208458 +315,0.504522375 +316,0.498082292 +317,0.49950975 +318,0.483825333 +319,0.4938355 +320,0.489284542 +321,0.487601791 +322,0.4960065 +323,0.488549541 +324,0.493043584 +325,0.489692833 +326,0.487116792 +327,0.487809458 +328,0.489419708 +329,0.498641792 +330,0.522507583 +331,0.497545792 +332,0.498369667 +333,0.49033575 +334,0.484036625 +335,0.482104625 +336,0.482177375 +337,0.492295333 +338,0.489886083 +339,0.48838875 +340,0.48470175 +341,0.485031417 +342,0.487668 +343,0.483792542 +344,0.486672666 +345,0.489914667 +346,0.489187166 +347,0.48824425 +348,0.488323792 +349,0.489379375 +350,0.497936209 +351,0.502756916 +352,0.492700375 +353,0.5251465 +354,0.49721175 +355,0.489891625 +356,0.520922292 +357,0.51501875 +358,0.5102105 +359,0.508519792 +360,0.497277792 +361,0.511795625 +362,0.487654875 +363,0.49074575 +364,0.504367083 +365,0.49807725 +366,0.499998625 +367,0.487053166 +368,0.494781875 +369,0.49699925 +370,0.501491167 +371,0.4913855 +372,0.486968125 +373,0.495007042 +374,0.49246775 +375,0.494139958 +376,0.50048325 +377,0.505426166 +378,0.487592167 +379,0.500420375 +380,0.529182208 +381,0.509044166 +382,0.487409292 +383,0.495203333 +384,0.493383417 +385,0.484752917 +386,0.488460583 +387,0.512988125 +388,0.49126425 +389,0.490254291 +390,0.502010875 +391,0.4910205 +392,0.493594583 +393,0.489134708 +394,0.497416709 +395,0.494523084 +396,0.495798333 +397,0.492983375 +398,0.490813209 +399,0.487782292 +400,0.517848583 +401,0.487089875 +402,0.491744083 +403,0.484046291 +404,0.491276958 +405,0.487433084 +406,0.486823167 +407,0.500378625 +408,0.491670541 +409,0.495078209 +410,0.51404525 +411,0.492176458 +412,0.491776709 +413,0.491412041 +414,0.486085333 +415,0.491318458 +416,0.485270417 +417,0.497549875 +418,0.506375125 +419,0.502832958 +420,0.504576792 +421,0.495231708 +422,0.510412916 +423,0.511370375 +424,0.497772417 +425,0.494246375 +426,0.50630475 +427,0.522472666 +428,0.4990585 +429,0.51064075 +430,0.493981875 +431,0.511576459 +432,0.52247125 +433,0.502061625 +434,0.519648 +435,0.499708791 +436,0.497833083 +437,0.523183833 +438,0.507314292 +439,0.495897875 +440,0.496878833 +441,0.49732075 +442,0.492289583 +443,0.487890542 +444,0.49134675 +445,0.485266542 +446,0.484220542 +447,0.504757875 +448,0.49513925 +449,0.487657209 +450,0.496377708 +451,0.496124333 +452,0.514234417 +453,0.487512291 +454,0.501179209 +455,0.514072083 +456,0.4957065 +457,0.504019167 +458,0.493558625 +459,0.500143625 +460,0.487669625 +461,0.482505667 +462,0.484459208 +463,0.48925 +464,0.491090791 +465,0.489485917 +466,0.489492458 +467,0.493753208 +468,0.487328792 +469,0.496079167 +470,0.494423541 +471,0.481286 +472,0.489772917 +473,0.486830125 +474,0.493252792 +475,0.488827542 +476,0.494745417 +477,0.491421458 +478,0.489098458 +479,0.525827875 +480,0.492643416 +481,0.488456666 +482,0.493808542 +483,0.487916459 +484,0.491241166 +485,0.48635 +486,0.499101625 +487,0.4901175 +488,0.491755416 +489,0.522518542 +490,0.502571792 +491,0.507072917 +492,0.486543 +493,0.495335292 +494,0.493652792 +495,0.488051042 +496,0.491798292 +497,0.500615709 +498,0.485463 +499,0.486150292 +500,0.491600834 +501,0.489956334 +502,0.488387666 +503,0.494391792 +504,0.518770458 +505,0.505603958 +506,0.487393667 +507,0.485611 +508,0.522182333 +509,0.495098333 +510,0.49185875 +511,0.4904935 +512,0.48763725 +513,0.501168833 +514,0.4918855 +515,0.491872625 +516,0.511926167 +517,0.50874325 +518,0.539585917 +519,0.496497917 +520,0.504561417 +521,0.48811175 +522,0.508310875 +523,0.520627916 +524,0.516576292 +525,0.514567667 +526,0.502603958 +527,0.500674709 +528,0.549319292 +529,0.500369083 +530,0.487819667 +531,0.488856125 +532,0.49166175 +533,0.524792625 +534,0.487660333 +535,0.485286708 +536,0.493899208 +537,0.497117208 +538,0.50468375 +539,0.504118083 +540,0.510768167 +541,0.504669292 +542,0.492130541 +543,0.514166958 +544,0.508758459 +545,0.505003916 +546,0.503288209 +547,0.494433083 +548,0.517773167 +549,0.4919095 +550,0.49093775 +551,0.499935 +552,0.490354292 +553,0.492154291 +554,0.483279541 +555,0.487763375 +556,0.49621675 +557,0.491903916 +558,0.513340625 +559,0.490845959 +560,0.489131 +561,0.491138 +562,0.489997417 +563,0.499321167 +564,0.489104 +565,0.492982667 +566,0.493686875 +567,0.489615125 +568,0.512413083 +569,0.492458833 +570,0.491269375 +571,0.490593333 +572,0.48771625 +573,0.488942542 +574,0.486399833 +575,0.4835995 +576,0.489453 +577,0.487104416 +578,0.505346375 +579,0.577831625 +580,0.492023042 +581,0.488392375 +582,0.491028292 +583,0.492111209 +584,0.484116583 +585,0.488622917 +586,0.49049425 +587,0.487837875 +588,0.481849417 +589,0.503376625 +590,0.496521667 +591,0.501051166 +592,0.485699042 +593,0.496112334 +594,0.50042675 +595,0.509127833 +596,0.494593041 +597,0.517596125 +598,0.4840505 +599,0.500355834 +600,0.513680041 +601,0.508399625 +602,0.493017417 +603,0.493862417 +604,0.505572709 +605,0.489488375 +606,0.489536 +607,0.50198875 +608,0.493237334 +609,0.484403208 +610,0.489780791 +611,0.492545125 +612,0.494686542 +613,0.495734209 +614,0.495621583 +615,0.493753708 +616,0.491130834 +617,0.540463292 +618,0.490544625 +619,0.518440417 +620,0.48849375 +621,0.505207042 +622,0.4915415 +623,0.504742375 +624,0.499446792 +625,0.490160542 +626,0.488249166 +627,0.514893791 +628,0.502448083 +629,0.494470625 +630,0.4948805 +631,0.495383417 +632,0.492095166 +633,0.489242209 +634,0.490961792 +635,0.491963625 +636,0.488548084 +637,0.508493083 +638,0.48847575 +639,0.49299675 +640,0.488395125 +641,0.515405708 +642,0.488496792 +643,0.493719417 +644,0.491297875 +645,0.491545417 +646,0.4859385 +647,0.506109666 +648,0.491437916 +649,0.493618667 +650,0.491066459 +651,0.489204417 +652,0.486996542 +653,0.493299416 +654,0.489946333 +655,0.499782584 +656,0.488047417 +657,0.493582083 +658,0.482700792 +659,0.492113042 +660,0.493960792 +661,0.492875708 +662,0.494533584 +663,0.487404125 +664,0.494699416 +665,0.490965583 +666,0.484484875 +667,0.488028208 +668,0.490040708 +669,0.483467375 +670,0.523520542 +671,0.504598542 +672,0.492908458 +673,0.490045333 +674,0.498133166 +675,0.535727292 +676,0.5168825 +677,0.503898916 +678,0.501686708 +679,0.503204167 +680,0.546462209 +681,0.510060667 +682,0.500928541 +683,0.502921875 +684,0.4909455 +685,0.530493875 +686,0.522518667 +687,0.497309875 +688,0.503285 +689,0.518652541 +690,0.497552833 +691,0.508922625 +692,0.509704833 +693,0.511998875 +694,0.502575042 +695,0.521240625 +696,0.494287 +697,0.494880708 +698,0.505252709 +699,0.508000542 +700,0.510921292 +701,0.494897708 +702,0.499424375 +703,0.496051333 +704,0.499750167 +705,0.4868205 +706,0.486335792 +707,0.499533375 +708,0.494295625 +709,0.483530875 +710,0.495350542 +711,0.493309042 +712,0.489398666 +713,0.494936125 +714,0.500659458 +715,0.521998958 +716,0.489123541 +717,0.501892 +718,0.490692583 +719,0.512273333 +720,0.491388875 +721,0.4900695 +722,0.491243917 +723,0.491015 +724,0.505818125 +725,0.491166667 +726,0.486070667 +727,0.48600475 +728,0.489900333 +729,0.488176833 +730,0.491016792 +731,0.488184541 +732,0.491381417 +733,0.492049333 +734,0.486590583 +735,0.51967325 +736,0.487551666 +737,0.493020584 +738,0.488953166 +739,0.49965375 +740,0.488433208 +741,0.495406375 +742,0.493903083 +743,0.489176292 +744,0.497510958 +745,0.55514425 +746,0.495613834 +747,0.493228584 +748,0.494327792 +749,0.49432275 +750,0.497183292 +751,0.490144917 +752,0.49494125 +753,0.486482417 +754,0.526192375 +755,0.493488084 +756,0.492501167 +757,0.502075375 +758,0.507504 +759,0.505188208 +760,0.504856292 +761,0.507710667 +762,0.499289791 +763,0.5053275 +764,0.491474416 +765,0.529735042 +766,0.495350208 +767,0.506315583 +768,0.500821625 +769,0.50340375 +770,0.520948083 +771,0.502928667 +772,0.502953666 +773,0.49832825 +774,0.523816209 +775,0.514775833 +776,0.508419334 +777,0.689397292 +778,0.683365666 +779,0.503548791 +780,0.543654333 +781,0.513199625 +782,0.512275333 +783,0.516306167 +784,0.507175292 +785,0.517874584 +786,0.516437542 +787,0.504706417 +788,0.690049166 +789,0.690557208 +790,0.687424125 +791,0.695734958 +792,0.508841167 +793,0.51304975 +794,0.515526875 +795,0.702448334 +796,0.517080792 +797,0.518814042 +798,0.513945083 +799,0.694599333 +800,0.520854958 +801,0.691238333 +802,0.532279041 +803,0.694764333 +804,0.694179416 +805,0.705568084 +806,0.684723708 +807,0.698375375 +808,0.527174416 +809,0.694797292 +810,0.70024775 +811,0.68875825 +812,0.695619625 +813,0.688557959 +814,0.688073916 +815,0.70248475 +816,0.691054458 +817,0.688623083 +818,0.698823917 +819,0.694956791 +820,0.691967083 +821,0.529221375 +822,0.718626209 +823,0.686945167 +824,0.693591292 +825,0.68790725 +826,0.68694275 +827,0.697240584 +828,0.692224625 +829,0.698344292 +830,0.697996792 +831,0.687884041 +832,0.692113833 +833,0.711940459 +834,0.687182875 +835,0.693464083 +836,0.716005 +837,0.686314917 +838,0.681148917 +839,0.699503709 +840,0.690309833 +841,0.689732667 +842,0.706169208 +843,0.692721167 +844,0.688316625 +845,0.687642708 +846,0.6872095 +847,0.688486458 +848,0.690289375 +849,0.691885125 +850,0.687245125 +851,0.715043875 +852,0.695981083 +853,0.693080166 +854,0.688470542 +855,0.693095625 +856,0.688432208 +857,0.69719075 +858,0.688401917 +859,0.691441792 +860,0.696055375 +861,0.718095959 +862,0.694378959 +863,0.69833575 +864,0.692551333 +865,0.687750625 +866,0.688826292 +867,0.692981875 +868,0.692640584 +869,0.707207917 +870,0.687392958 +871,0.690879042 +872,0.698957166 +873,0.692163 +874,0.691089208 +875,0.709945542 +876,0.687490916 +877,0.689033083 +878,0.691484875 +879,0.709235333 +880,0.697928416 +881,0.715269708 +882,0.686931 +883,0.700130583 +884,0.689704125 +885,0.692335459 +886,0.7224775 +887,0.686911209 +888,0.688505958 +889,0.703739583 +890,0.682474459 +891,0.703404625 +892,0.704240833 +893,0.688936459 +894,0.68714525 +895,0.687590291 +896,0.6919135 +897,0.707846125 +898,0.708951292 +899,0.687958208 +900,0.700973167 +901,0.690037791 +902,0.709697625 +903,0.696960042 +904,0.689583708 +905,0.690566 +906,0.699606583 +907,0.690069792 +908,0.693855416 +909,0.709792167 +910,0.693290458 +911,0.725999583 +912,0.688161708 +913,0.695117084 +914,0.703603875 +915,0.708292917 +916,0.696737958 +917,0.702044417 +918,0.6906945 +919,0.689148667 +920,0.700252875 +921,0.695187208 +922,0.692481125 +923,0.706841666 +924,0.689242333 +925,0.686375 +926,0.696433792 +927,0.681863334 +928,0.689267042 +929,0.69009925 +930,0.691586958 +931,0.692280458 +932,0.696377333 +933,0.692237583 +934,0.689091167 +935,0.698009291 +936,0.725696666 +937,0.690779667 +938,0.705735958 +939,0.69217025 +940,0.688352208 +941,0.689809833 +942,0.688933541 +943,0.685318875 +944,0.720696916 +945,0.690471875 +946,0.679457042 +947,0.695246916 +948,0.696231667 +949,0.702032708 +950,0.690546125 +951,0.6892105 +952,0.69500575 +953,0.685708667 +954,0.6865075 +955,0.694416417 +956,0.704578292 +957,0.696329 +958,0.69550275 +959,0.686181041 +960,0.691668375 +961,0.7293745 +962,0.689336333 +963,0.686441875 +964,0.703473834 +965,0.690268667 +966,0.699031416 +967,0.697034958 +968,0.685184542 +969,0.691379958 +970,0.696740084 +971,0.676915542 +972,0.692524583 +973,0.686909208 +974,0.707905792 +975,0.684319916 +976,0.685403833 +977,0.705584833 +978,0.688631875 +979,0.713576167 +980,0.686456667 +981,0.700610625 +982,0.691412167 +983,0.689889375 +984,0.685985584 +985,0.687244875 +986,0.693468084 +987,0.709245 +988,0.692307208 +989,0.684322208 +990,0.690064583 +991,0.686631333 +992,0.685043417 +993,0.702767958 +994,0.68837025 +995,0.686474625 +996,0.722289583 +997,0.685600958 +998,0.689732042 +999,0.701542791 +1000,0.690787375 +Test Start,Test End,Test End + 10s,Duration +1701886593,1701887637,1701887647,17m23.952198583s diff --git a/tests/scale/results/1.1.0/TestScale_HTTPRoutes/results.csv b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/results.csv new file mode 100644 index 0000000000..07668f1476 --- /dev/null +++ b/tests/scale/results/1.1.0/TestScale_HTTPRoutes/results.csv @@ -0,0 +1,1003 @@ +# HTTPRoutes,Time to Ready (s),Error +1,0.195855708 +2,0.196368334 +3,0.192519167 +4,0.1158 +5,0.2212645 +6,0.116894542 +7,0.130501708 +8,0.193241541 +9,0.189836917 +10,0.188604916 +11,0.191707791 +12,0.192331041 +13,0.190955916 +14,0.191060917 +15,0.193289041 +16,0.197727416 +17,0.189516708 +18,0.191866291 +19,0.186989 +20,0.188304666 +21,0.202632167 +22,0.194981875 +23,0.212822125 +24,0.189378208 +25,0.189759291 +26,0.197741917 +27,0.193206167 +28,0.193051959 +29,0.194801666 +30,0.146341167 +31,0.190412583 +32,0.217170583 +33,0.192269708 +34,0.200058667 +35,0.194837625 +36,0.191804666 +37,0.189550125 +38,0.192992458 +39,0.192696333 +40,0.19266625 +41,0.191424584 +42,0.185562583 +43,0.188784459 +44,0.192107583 +45,0.194785875 +46,0.193029917 +47,0.1907975 +48,0.198327375 +49,0.20718725 +50,0.195812709 +51,0.196591917 +52,0.188378667 +53,0.195061958 +54,0.191503875 +55,0.212498292 +56,0.192368416 +57,0.198094958 +58,0.190369416 +59,0.190210667 +60,0.192260125 +61,0.186270833 +62,0.190125958 +63,0.190803167 +64,0.206834875 +65,0.196286584 +66,0.197245541 +67,0.1879645 +68,0.191795333 +69,0.23804875 +70,0.194415209 +71,0.192135834 +72,0.187265333 +73,0.188556458 +74,0.213240458 +75,0.194373709 +76,0.189849667 +77,0.199629583 +78,0.188531416 +79,0.193351833 +80,0.191002167 +81,0.190980166 +82,0.190352792 +83,0.226482667 +84,0.196825416 +85,0.192230625 +86,0.198356958 +87,0.215492375 +88,0.189837 +89,0.193800416 +90,0.192399875 +91,0.194233584 +92,0.206832292 +93,0.189264834 +94,0.20584725 +95,0.195990417 +96,0.19861275 +97,0.195452459 +98,0.192450916 +99,0.199739791 +100,0.186541208 +101,0.192314667 +102,0.251062292 +103,0.192606625 +104,0.192987291 +105,0.208036333 +106,0.192217458 +107,0.21495125 +108,0.196269792 +109,0.201551875 +110,0.191038292 +111,0.19354975 +112,0.193861125 +113,0.195634333 +114,0.194466709 +115,0.188902666 +116,0.200519541 +117,0.191955708 +118,0.200376708 +119,0.188549084 +120,0.240944042 +121,0.254918709 +122,0.194028 +123,0.194843708 +124,0.204993375 +125,0.189615458 +126,0.191944792 +127,0.202530917 +128,0.191478667 +129,0.211604292 +130,0.193885083 +131,0.188771958 +132,0.199387042 +133,0.203595333 +134,0.189743208 +135,0.189425292 +136,0.195183875 +137,0.187993083 +138,0.20097325 +139,0.197263625 +140,0.196250416 +141,0.196629291 +142,0.198693292 +143,0.192936041 +144,0.190629666 +145,0.213758666 +146,0.189473083 +147,0.20285725 +148,0.190652542 +149,0.221123042 +150,0.193376709 +151,0.188732459 +152,0.190676417 +153,0.187947334 +154,0.193598583 +155,0.191088291 +156,0.201806666 +157,0.193143334 +158,0.210158667 +159,0.197577167 +160,0.197099708 +161,0.194284083 +162,0.195952708 +163,0.236013958 +164,0.194585959 +165,0.196401791 +166,0.199738042 +167,0.197992584 +168,0.194306292 +169,0.193152916 +170,0.197581375 +171,0.201594875 +172,0.195507791 +173,0.199003625 +174,0.226684792 +175,0.201615416 +176,0.197401625 +177,0.205117125 +178,0.194381916 +179,0.199420584 +180,0.20637025 +181,0.203544042 +182,0.20757475 +183,0.486872209 +184,0.202421209 +185,0.201671917 +186,0.497242333 +187,0.207909584 +188,0.224780542 +189,0.211780208 +190,0.200636625 +191,0.489936875 +192,0.20291175 +193,0.204533959 +194,0.484429875 +195,0.213565542 +196,0.497428334 +197,0.4924055 +198,0.207895333 +199,0.491380375 +200,0.4868715 +201,0.491944958 +202,0.490173375 +203,0.508962 +204,0.494983166 +205,0.491023125 +206,0.496493666 +207,0.484646833 +208,0.505231208 +209,0.492715666 +210,0.242424666 +211,0.484636208 +212,0.495750667 +213,0.491509583 +214,0.500671375 +215,0.507116166 +216,0.503882083 +217,0.4931675 +218,0.491718458 +219,0.492210583 +220,0.489131083 +221,0.496873125 +222,0.49629325 +223,0.488043792 +224,0.485248458 +225,0.505813666 +226,0.503304625 +227,0.485155834 +228,0.504307375 +229,0.498035833 +230,0.48266675 +231,0.483801792 +232,0.510054666 +233,0.502798959 +234,0.5110545 +235,0.497575083 +236,0.492138875 +237,0.496070958 +238,0.506018708 +239,0.512505417 +240,0.491620042 +241,0.492886708 +242,0.511603292 +243,0.485314417 +244,0.491722333 +245,0.492481 +246,0.495025458 +247,0.490626375 +248,0.492952166 +249,0.50713575 +250,0.49012025 +251,0.518237875 +252,0.493933958 +253,0.49298825 +254,0.494255917 +255,0.494868042 +256,0.486555958 +257,0.494907583 +258,0.512364666 +259,0.500717667 +260,0.513908916 +261,0.485915375 +262,0.486933334 +263,0.486243667 +264,0.490199916 +265,0.492311708 +266,0.509255666 +267,0.493997458 +268,0.493737625 +269,0.498239792 +270,0.489008459 +271,0.484792083 +272,0.488577041 +273,0.496849916 +274,0.527083834 +275,0.501672541 +276,0.495885875 +277,0.490823833 +278,0.49877025 +279,0.50577775 +280,0.525459708 +281,0.492881625 +282,0.488759708 +283,0.504341625 +284,0.493359125 +285,0.49086475 +286,0.50802875 +287,0.505291875 +288,0.492799667 +289,0.491630208 +290,0.492808167 +291,0.493021125 +292,0.501620667 +293,0.500681542 +294,0.482903209 +295,0.482743041 +296,0.488387416 +297,0.504911333 +298,0.488642208 +299,0.483524791 +300,0.489796416 +301,0.484850917 +302,0.490128375 +303,0.491181709 +304,0.489406 +305,0.495175833 +306,0.499614666 +307,0.489242708 +308,0.4884015 +309,0.491619375 +310,0.4891195 +311,0.493734875 +312,0.491149333 +313,0.484135917 +314,0.494963875 +315,0.495074958 +316,0.487813458 +317,0.502651541 +318,0.500742625 +319,0.493347583 +320,0.490881083 +321,0.495304875 +322,0.496333 +323,0.502468916 +324,0.508975042 +325,0.483379167 +326,0.485594417 +327,0.486036709 +328,0.511220292 +329,0.489048833 +330,0.508400125 +331,0.486740083 +332,0.490224042 +333,0.492581417 +334,0.502801292 +335,0.493726584 +336,0.495923916 +337,0.5043035 +338,0.508517084 +339,0.487268542 +340,0.497066167 +341,0.48684075 +342,0.4930295 +343,0.489474083 +344,0.491051875 +345,0.489434958 +346,0.492741292 +347,0.506823291 +348,0.487929125 +349,0.4936415 +350,0.486325208 +351,0.492853042 +352,0.493490459 +353,0.485859792 +354,0.536483 +355,0.48698425 +356,0.503214125 +357,0.488528167 +358,0.511431208 +359,0.494740791 +360,0.482733209 +361,0.517886792 +362,0.491137459 +363,0.494552792 +364,0.49134475 +365,0.493989167 +366,0.48965975 +367,0.48741075 +368,0.493619833 +369,0.489563583 +370,0.494660709 +371,0.490816542 +372,0.498246417 +373,0.493763084 +374,0.492211334 +375,0.485087333 +376,0.488699084 +377,0.491599708 +378,0.5025515 +379,0.495067542 +380,0.491226333 +381,0.50837275 +382,0.4943815 +383,0.487305375 +384,0.486768917 +385,0.495938542 +386,0.494532084 +387,0.498230042 +388,0.488807875 +389,0.489690834 +390,0.487558917 +391,0.495590458 +392,0.491048166 +393,0.493054709 +394,0.485245 +395,0.490696708 +396,0.491682167 +397,0.494467042 +398,0.485147416 +399,0.485729542 +400,0.507354667 +401,0.48358025 +402,0.511673917 +403,0.492312542 +404,0.484532875 +405,0.490873333 +406,0.492981667 +407,0.495225041 +408,0.499809 +409,0.490941042 +410,0.480662666 +411,0.496857083 +412,0.486451916 +413,0.491412375 +414,0.492173959 +415,0.487915708 +416,0.49006275 +417,0.488912 +418,0.494911875 +419,0.502184291 +420,0.493638291 +421,0.49949575 +422,0.481969125 +423,0.494229208 +424,0.486877959 +425,0.493869375 +426,0.539373542 +427,0.511286541 +428,0.48795525 +429,0.487248542 +430,0.487518458 +431,0.489996375 +432,0.494900667 +433,0.529302209 +434,0.488413042 +435,0.500616125 +436,0.485306541 +437,0.498913625 +438,0.487948959 +439,0.487788 +440,0.524386916 +441,0.4890815 +442,0.491680916 +443,0.48999775 +444,0.491210083 +445,0.481968292 +446,0.49323275 +447,0.501004959 +448,0.493297875 +449,0.4882005 +450,0.498572666 +451,0.487785584 +452,0.510297458 +453,0.486282958 +454,0.502272291 +455,0.488898542 +456,0.49671 +457,0.486616542 +458,0.489034917 +459,0.496379042 +460,0.484981583 +461,0.491776375 +462,0.483359375 +463,0.546019708 +464,0.492117584 +465,0.488071541 +466,0.505726041 +467,0.490110917 +468,0.488135375 +469,0.484393292 +470,0.501402834 +471,0.4892655 +472,0.495139166 +473,0.489789125 +474,0.497080083 +475,0.4854195 +476,0.511743791 +477,0.511084583 +478,0.500336459 +479,0.488737958 +480,0.492087542 +481,0.485648625 +482,0.505949584 +483,0.483551834 +484,0.519838959 +485,0.487255208 +486,0.487604167 +487,0.485832625 +488,0.49444575 +489,0.496519542 +490,0.51090175 +491,0.492960833 +492,0.491737625 +493,0.50845125 +494,0.485826791 +495,0.484034875 +496,0.488008125 +497,0.495216375 +498,0.506038084 +499,0.487643958 +500,0.497376541 +501,0.490850333 +502,0.49053425 +503,0.488832625 +504,0.489946125 +505,0.521727 +506,0.488478833 +507,0.500899583 +508,0.484981459 +509,0.48539725 +510,0.496990875 +511,0.509504541 +512,0.500070625 +513,0.48876725 +514,0.512872 +515,0.5028295 +516,0.487361833 +517,0.492436417 +518,0.4941525 +519,0.488293875 +520,0.491749167 +521,0.491395583 +522,0.499204875 +523,0.488523833 +524,0.493896333 +525,0.498102875 +526,0.487324042 +527,0.504115792 +528,0.491117042 +529,0.502211875 +530,0.489047333 +531,0.52675375 +532,0.490067708 +533,0.492799917 +534,0.497345583 +535,0.486839083 +536,0.49161975 +537,0.491459833 +538,0.495516709 +539,0.497963 +540,0.504458541 +541,0.496715791 +542,0.492671833 +543,0.487851125 +544,0.542454792 +545,0.48840425 +546,0.54883125 +547,0.494530541 +548,0.486358417 +549,0.493619459 +550,0.492645917 +551,0.521917375 +552,0.508022041 +553,0.494065 +554,0.492049834 +555,0.487912125 +556,0.489055375 +557,0.495787375 +558,0.495122125 +559,0.496290583 +560,0.486543458 +561,0.492047125 +562,0.491468917 +563,1.500325125 +564,0.503868542 +565,0.489153416 +566,0.488794584 +567,0.501710375 +568,0.490893875 +569,0.488688083 +570,0.509791542 +571,0.481464959 +572,0.490763125 +573,0.506817458 +574,0.499053875 +575,0.495636375 +576,0.493628334 +577,0.498709 +578,0.487015125 +579,0.48776525 +580,0.485017334 +581,0.495729375 +582,0.492041292 +583,0.486466208 +584,0.492174417 +585,0.48756825 +586,0.4872155 +587,0.498325875 +588,0.489958167 +589,0.492340833 +590,0.491416916 +591,0.490541625 +592,0.491945958 +593,0.498849666 +594,0.507824583 +595,0.493882541 +596,0.494484083 +597,0.482027583 +598,0.49071525 +599,0.490355667 +600,0.495233166 +601,0.497279125 +602,0.498908541 +603,0.487172959 +604,0.486942209 +605,0.490919167 +606,0.483160875 +607,0.5180785 +608,0.492136125 +609,0.499053417 +610,0.496520417 +611,0.495820833 +612,0.491769292 +613,0.491570459 +614,0.490872667 +615,0.489243041 +616,0.505536084 +617,0.507666292 +618,0.494830166 +619,0.488854708 +620,0.501826666 +621,0.4953555 +622,0.491781125 +623,0.486723458 +624,0.539065542 +625,0.491492791 +626,0.490666792 +627,0.485067791 +628,0.491303708 +629,0.489431375 +630,0.494495375 +631,0.518360958 +632,0.4916115 +633,0.483696708 +634,0.489418375 +635,0.495936459 +636,0.495626917 +637,0.49689775 +638,0.504663542 +639,0.485013792 +640,0.493640042 +641,0.508674709 +642,0.484667375 +643,0.500541625 +644,0.490678167 +645,0.499075375 +646,0.50082975 +647,0.498120667 +648,0.493204708 +649,0.495385 +650,0.49437575 +651,0.490319167 +652,0.547588084 +653,0.499702583 +654,0.49157625 +655,0.49650225 +656,0.499704417 +657,0.493336459 +658,0.540977875 +659,0.512300167 +660,0.492967541 +661,0.496932708 +662,0.570126 +663,0.492627584 +664,0.490570416 +665,0.492592584 +666,0.52185225 +667,0.496262458 +668,0.498496208 +669,0.490969375 +670,0.488101708 +671,0.496333625 +672,0.493292583 +673,0.507126459 +674,0.49746275 +675,0.522336959 +676,0.512868875 +677,0.487216375 +678,0.493157917 +679,0.488520416 +680,0.522865458 +681,0.483905875 +682,0.487900667 +683,0.4928515 +684,0.494833167 +685,0.494630542 +686,0.489997625 +687,0.490084792 +688,0.514631458 +689,0.492124792 +690,0.508641667 +691,0.491037958 +692,0.4957095 +693,0.497576834 +694,0.510208167 +695,0.494379 +696,0.510909708 +697,0.487752959 +698,0.491096375 +699,0.517860625 +700,0.49936625 +701,0.497982959 +702,0.507611541 +703,0.487737792 +704,0.491649333 +705,0.493706708 +706,0.488226375 +707,0.496068833 +708,0.491187209 +709,0.510903625 +710,0.493133666 +711,0.492747042 +712,0.494816375 +713,0.494646041 +714,0.513110541 +715,0.518207083 +716,0.517656 +717,0.491065125 +718,0.498220541 +719,0.49128825 +720,0.490445208 +721,0.513139333 +722,0.516033417 +723,0.491216292 +724,0.511211541 +725,0.536181666 +726,0.495016125 +727,0.491791791 +728,0.491180833 +729,0.502386958 +730,0.499392833 +731,0.491089083 +732,0.512786667 +733,0.510228375 +734,0.483638125 +735,0.497520584 +736,0.500392333 +737,0.495830042 +738,0.503506292 +739,0.488042541 +740,0.488575083 +741,0.486158375 +742,0.492596667 +743,0.506149667 +744,0.495781541 +745,0.486525125 +746,0.489888833 +747,0.502448125 +748,0.492033291 +749,0.503661042 +750,0.517234541 +751,0.509731166 +752,0.496210958 +753,0.494061709 +754,0.488444584 +755,0.4877935 +756,0.498089417 +757,0.524542167 +758,0.494800584 +759,0.51302175 +760,0.505005417 +761,0.501411208 +762,0.50311975 +763,0.494655541 +764,0.505971917 +765,0.51006575 +766,0.537733833 +767,0.507916209 +768,0.505091833 +769,0.500311959 +770,0.509708416 +771,0.717592416 +772,0.4852735 +773,0.500914708 +774,0.522726667 +775,0.517161542 +776,0.688811708 +777,0.504364375 +778,0.508986958 +779,0.496632875 +780,0.686783916 +781,0.695880542 +782,0.508764333 +783,0.512769833 +784,0.517555625 +785,0.512548125 +786,0.500978042 +787,0.505213334 +788,0.694716208 +789,0.49666375 +790,0.506699667 +791,0.503357959 +792,0.499978167 +793,0.686862458 +794,0.513941 +795,0.515781958 +796,0.695588916 +797,0.682586833 +798,0.51463425 +799,0.513729917 +800,0.6885605 +801,0.516380333 +802,0.715527833 +803,0.688158667 +804,0.691371541 +805,0.687589125 +806,0.690688417 +807,0.511654958 +808,0.70068275 +809,0.700217458 +810,0.68747775 +811,0.696099417 +812,0.715847458 +813,0.697743125 +814,0.696479583 +815,0.687148375 +816,0.696588792 +817,0.69417975 +818,0.693161041 +819,0.691250541 +820,0.52933125 +821,0.686245125 +822,0.696351709 +823,0.700862 +824,0.703213625 +825,0.6971375 +826,0.706690583 +827,0.524078084 +828,0.701843 +829,0.699388375 +830,0.690899416 +831,0.703492416 +832,0.689919875 +833,0.711604375 +834,0.690937584 +835,0.692850292 +836,0.70139275 +837,0.693394167 +838,0.706346542 +839,0.689980083 +840,0.704879333 +841,0.689381209 +842,0.687815625 +843,0.691166958 +844,0.690775958 +845,0.693746291 +846,0.691127166 +847,0.691608667 +848,0.695182167 +849,0.71608 +850,0.705483083 +851,0.705691792 +852,0.698849833 +853,0.700802042 +854,0.699550875 +855,0.714319667 +856,0.696284333 +857,0.693318292 +858,0.695724917 +859,0.691801 +860,0.695472458 +861,0.685706416 +862,0.693974875 +863,0.685157583 +864,0.692763084 +865,0.547378875 +866,0.6848965 +867,0.691143 +868,0.696080834 +869,0.69073 +870,0.699124125 +871,0.695591083 +872,0.689927833 +873,0.694728208 +874,0.693801084 +875,0.6911395 +876,0.692726458 +877,0.690064333 +878,0.72220225 +879,0.691904083 +880,0.696308834 +881,0.727226208 +882,0.690018375 +883,0.704396125 +884,0.691441625 +885,0.688379541 +886,0.693927458 +887,0.68756 +888,0.693273917 +889,0.689318583 +890,0.692254209 +891,0.685348459 +892,0.681972916 +893,0.688999417 +894,0.558689709 +895,0.691430083 +896,0.683573792 +897,0.689469958 +898,0.6820305 +899,0.690238667 +900,0.694212458 +901,0.698748 +902,0.691123125 +903,0.716174708 +904,0.701074041 +905,0.7132715 +906,0.690724667 +907,0.704887209 +908,0.716601834 +909,0.698374167 +910,0.688420209 +911,0.692634167 +912,0.692517958 +913,0.723949417 +914,0.688619417 +915,0.691972875 +916,0.696481291 +917,0.687932042 +918,0.695733208 +919,0.696552375 +920,0.708850917 +921,0.696176875 +922,0.690025792 +923,0.6908415 +924,0.692736958 +925,0.683927709 +926,0.704580208 +927,0.686296709 +928,0.715062833 +929,0.704029584 +930,0.7013065 +931,0.702792459 +932,0.688029042 +933,0.736331959 +934,0.694729209 +935,0.689184958 +936,0.705503041 +937,0.699105791 +938,0.707342291 +939,0.704181166 +940,0.706126167 +941,0.690091208 +942,0.694363792 +943,0.726856792 +944,0.698073042 +945,0.696612792 +946,0.701846917 +947,0.698349584 +948,0.693824041 +949,0.69175 +950,0.692905625 +951,0.684302834 +952,0.689225583 +953,0.690029541 +954,0.689218958 +955,0.689658542 +956,0.705435083 +957,0.692564542 +958,0.696098917 +959,0.70102375 +960,0.700892458 +961,0.701300375 +962,0.709338208 +963,0.697062125 +964,0.686628542 +965,0.69410625 +966,0.698736125 +967,0.703172375 +968,0.693582833 +969,0.6849595 +970,0.691296875 +971,0.695839375 +972,0.689032208 +973,0.693019834 +974,0.682212791 +975,0.696672791 +976,0.694206916 +977,0.69541975 +978,0.703072666 +979,0.699539958 +980,0.701825375 +981,0.702205292 +982,0.697797583 +983,0.69237875 +984,0.689765208 +985,0.696897375 +986,0.703582625 +987,0.6867635 +988,0.70468925 +989,0.68552475 +990,0.6901035 +991,0.720639916 +992,0.6939485 +993,0.6900575 +994,0.69804925 +995,0.687031708 +996,0.711348625 +997,0.698028542 +998,0.696750666 +999,0.692748458 +1000,0.694813333 +Test Start,Test End,Test End + 10s,Duration +1701889088,1701892137,1701892147,50m49.1159155s diff --git a/tests/scale/results/1.1.0/TestScale_HTTPSListeners/CPU.png b/tests/scale/results/1.1.0/TestScale_HTTPSListeners/CPU.png new file mode 100644 index 0000000000..ecf2b12098 Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_HTTPSListeners/CPU.png differ diff --git a/tests/scale/results/1.1.0/TestScale_HTTPSListeners/Memory.png b/tests/scale/results/1.1.0/TestScale_HTTPSListeners/Memory.png new file mode 100644 index 0000000000..a3a3857e91 Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_HTTPSListeners/Memory.png differ diff --git a/tests/scale/results/1.1.0/TestScale_HTTPSListeners/TTR.png b/tests/scale/results/1.1.0/TestScale_HTTPSListeners/TTR.png new file mode 100644 index 0000000000..aab65db720 Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_HTTPSListeners/TTR.png differ diff --git a/tests/scale/results/1.1.0/TestScale_HTTPSListeners/results.csv b/tests/scale/results/1.1.0/TestScale_HTTPSListeners/results.csv new file mode 100644 index 0000000000..62ab6d24cd --- /dev/null +++ b/tests/scale/results/1.1.0/TestScale_HTTPSListeners/results.csv @@ -0,0 +1,67 @@ +# HTTPS Listeners,Time to Ready (s),Error +1,0.298623292 +2,0.290336833 +3,0.306998416 +4,0.321833583 +5,0.285856459 +6,0.286231417 +7,0.292070875 +8,0.290567292 +9,0.650310959 +10,0.304725541 +11,0.3069135 +12,0.302009791 +13,0.648091833 +14,0.294033625 +15,0.296551583 +16,0.646265417 +17,0.65992275 +18,0.300309625 +19,0.29289875 +20,0.64213275 +21,0.650311333 +22,0.646811375 +23,0.299184917 +24,0.642298041 +25,0.671666917 +26,0.69368975 +27,0.646926875 +28,0.643671833 +29,0.643396 +30,0.644220583 +31,0.644612125 +32,0.643424875 +33,0.64300325 +34,0.649530875 +35,0.652973417 +36,0.662407125 +37,0.644821041 +38,0.641600792 +39,0.640892584 +40,0.6504125 +41,0.65593525 +42,0.6443835 +43,0.644433459 +44,0.635714292 +45,0.655499542 +46,0.649910792 +47,0.651249583 +48,0.676125125 +49,0.663608084 +50,0.675555542 +51,0.859976208 +52,0.64676775 +53,0.863790542 +54,0.639687417 +55,0.847149833 +56,0.641498833 +57,0.863656417 +58,0.842914875 +59,0.837865 +60,1.071833125 +61,0.836140667 +62,0.84014325 +63,1.244114458 +64,1.102959541 +Test Start,Test End,Test End + 10s,Duration +1701885669,1701885816,1701885826,2m26.985204958s diff --git a/tests/scale/results/1.1.0/TestScale_Listeners/CPU.png b/tests/scale/results/1.1.0/TestScale_Listeners/CPU.png new file mode 100644 index 0000000000..1d2de28840 Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_Listeners/CPU.png differ diff --git a/tests/scale/results/1.1.0/TestScale_Listeners/Memory.png b/tests/scale/results/1.1.0/TestScale_Listeners/Memory.png new file mode 100644 index 0000000000..543e0d04b7 Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_Listeners/Memory.png differ diff --git a/tests/scale/results/1.1.0/TestScale_Listeners/TTR.png b/tests/scale/results/1.1.0/TestScale_Listeners/TTR.png new file mode 100644 index 0000000000..9994a3a226 Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_Listeners/TTR.png differ diff --git a/tests/scale/results/1.1.0/TestScale_Listeners/results.csv b/tests/scale/results/1.1.0/TestScale_Listeners/results.csv new file mode 100644 index 0000000000..5c76620791 --- /dev/null +++ b/tests/scale/results/1.1.0/TestScale_Listeners/results.csv @@ -0,0 +1,67 @@ +# Listeners,Time to Ready (s),Error +1,0.210250292 +2,0.192975292 +3,0.188067917 +4,0.191371875 +5,0.191525792 +6,0.193815083 +7,0.215587666 +8,0.191928708 +9,0.193707042 +10,0.494461958 +11,0.498684708 +12,0.207748208 +13,0.19541975 +14,0.18638525 +15,0.491794084 +16,0.5214365 +17,0.192586167 +18,0.214503042 +19,0.490024917 +20,0.491494291 +21,0.51203375 +22,0.686117667 +23,0.493136625 +24,0.529205833 +25,0.491464417 +26,0.894854583 +27,0.487970833 +28,0.487137958 +29,0.499481375 +30,0.504625333 +31,0.902609459 +32,0.487152709 +33,0.525170417 +34,0.50292825 +35,1.090166875 +36,0.493419167 +37,0.489361458 +38,0.1961595 +39,1.301617375 +40,0.490068334 +41,0.487308541 +42,0.513367708 +43,0.515950375 +44,0.501541625 +45,0.696882167 +46,0.490644666 +47,0.514852625 +48,0.507536333 +49,0.487025209 +50,0.886309541 +51,0.488347708 +52,0.689164708 +53,0.891632541 +54,1.311187042 +55,1.086047834 +56,0.89004 +57,0.69001625 +58,0.696373958 +59,0.73816675 +60,1.091213458 +61,1.6926421249999999 +62,0.690621292 +63,0.893777708 +64,0.926865209 +Test Start,Test End,Test End + 10s,Duration +1701879986,1701880143,1701880153,2m36.901530417s diff --git a/tests/scale/results/1.1.0/TestScale_UpstreamServers/CPU.png b/tests/scale/results/1.1.0/TestScale_UpstreamServers/CPU.png new file mode 100644 index 0000000000..a0eaf5a6e1 Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_UpstreamServers/CPU.png differ diff --git a/tests/scale/results/1.1.0/TestScale_UpstreamServers/Memory.png b/tests/scale/results/1.1.0/TestScale_UpstreamServers/Memory.png new file mode 100644 index 0000000000..4eba18dfed Binary files /dev/null and b/tests/scale/results/1.1.0/TestScale_UpstreamServers/Memory.png differ diff --git a/tests/scale/scale.md b/tests/scale/scale.md index b3b342eb59..47c0ed51dc 100644 --- a/tests/scale/scale.md +++ b/tests/scale/scale.md @@ -361,13 +361,13 @@ Follow these steps to run the test: - Test the first match: ```console - ./wrk -t2 -c10 -d30 http://cafe.example.com -H "header-1: header-1-val" + wrk -t2 -c10 -d30 http://cafe.example.com -H "header-1: header-1-val" ``` - Test the last match: ```console - ./wrk -t2 -c10 -d30 http://cafe.example.com -H "header-50: header-50-val" + wrk -t2 -c10 -d30 http://cafe.example.com -H "header-50: header-50-val" ``` - Copy and paste the results into the results file. @@ -472,3 +472,4 @@ Follow these steps to run the test: ### Results - [1.0.0](/tests/scale/results/1.0.0/1.0.0.md) +- [1.1.0](/tests/scale/results/1.1.0/1.1.0.md) diff --git a/tests/scale/scale_test.go b/tests/scale/scale_test.go index c3174de8f3..d0a26d79a9 100644 --- a/tests/scale/scale_test.go +++ b/tests/scale/scale_test.go @@ -25,7 +25,7 @@ import ( var ( numIterations = flag.Int("i", 1, "number of times to scale the resource") delay = flag.Duration("delay", 0, "delay between each scaling iteration") - version = flag.String("version", "1.0.0", "version of NGF under test") + version = flag.String("version", "1.1.0", "version of NGF under test") ) func TestScale_Listeners(t *testing.T) {