Skip to content

docs(results): round 2026-10-11 with 63 generators #37

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
matbrgz wants to merge 4 commits into
base: master
Choose a base branch
from
Open

docs(results): round 2026-10-11 with 63 generators #37

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
506da7d
fix(merge_results): union the spec 009 quality section and write qual…
matbrgz Oct 11, 2026
2c3f6e0
docs(results): rounds 2026-10-11 for suites P and M with 63 generators
matbrgz Oct 11, 2026
2bc9f7f
docs(results): round 2026-10-11 suite GG with 63 generators
matbrgz Oct 11, 2026
4091c07
docs(results): round 2026-10-11 suite G with 63 generators
matbrgz Oct 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3,942 changes: 3,942 additions & 0 deletions docs/results/2026-10-11/G/nf10000-cs5/results.json
View file
Open in desktop

Large diffs are not rendered by default.

64 changes: 64 additions & 0 deletions docs/results/2026-10-11/G/nf10000-cs5/summary.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
framework,language,numberOfFiles,contentSize,minRuns,mean,stddev,median,min,max,status,suite,suiteVersion,profile,features,fingerprint,cv,noisy,attempts,user,system,cpuUtilization,peakRssMB,inputMB,outputFiles,outputMB,postsPerSecond,inputMBPerSecond,imageBuildSeconds,failureReason
zola,rust,10000,5,3,2.5869723356,0.019862689427794292,2.5962748396,2.5641655335999998,2.6004766335999996,ok,G,1,core,,3f2f1aaf006c,0.007677967465851355,false,1,3.75280692,3.1215662199999996,2.657,752.42,53.46,10004,89.24,3851.6723451129965,20.592484734103493,26.837,
zine,zig,10000,5,3,4.709590445213333,0.04997678834832398,4.6833100518799995,4.678236989879999,4.76722429388,ok,G,1,core,,3f2f1aaf006c,0.01061170582234357,false,1,5.328872366666666,6.17092512,2.442,2291.1,51.2,10004,78.56,2135.241931288693,10.93243868819811,23.069,
hugo,go,10000,5,3,7.4275248709933335,0.1687438439969701,7.40700623566,7.26997857466,7.60558980266,ok,G,1,core,,ebe58c534103,0.022718718136638543,false,1,24.96581052666667,2.062532673333333,3.639,4004.71,53.34,10003,123.09,1350.0731175108767,7.201796286222083,26.619,
jekyll,ruby,10000,5,3,8.219984967793334,0.0642365970064345,8.19020108046,8.17604638846,8.29370743446,ok,G,1,core,,3f2f1aaf006c,0.007814685459659533,false,1,6.347125613333333,1.8411667199999997,0.996,321.03,53.47,10001,111.74,1220.9712437778578,6.5289911046966225,51.657,
metalsmith-nunjucks,javascript,10000,5,3,9.531926600093334,0.011073617528151827,9.527575926759999,9.52368902476,9.54451484876,ok,G,1,core,,8e17af3b158e,0.0011617396978322722,false,1,9.687282106666666,3.2825879133333333,1.361,642.2,53.34,10002,88.89,1049.5849182280572,5.598879548172793,44.774,
ink,go,10000,5,3,11.478660450919998,0.020803514690415026,11.47283785792,11.46138860392,11.50175489092,ok,G,1,core,,3f2f1aaf006c,0.0018123643241618542,false,1,10.94310778,3.4563434333333327,1.254,1380.14,53.34,10022,489.12,871.6239280847797,4.649568891377247,61.745,
metalsmith-handlebars,javascript,10000,5,3,13.991761491900002,0.0809387971483027,13.961503185900002,13.930311175900002,14.0834701139,ok,G,1,core,,3f2f1aaf006c,0.00578474677367529,false,1,15.305475300000003,3.631388973333333,1.353,664.34,53.34,10002,88.89,716.2552532380037,3.8207741164914757,34.322,
eleventy,javascript,10000,5,3,15.141654069980001,0.05051654446477003,15.156875431980001,15.08527706998,15.18280970798,ok,G,1,core,,8e17af3b158e,0.0033362632795134748,false,1,16.82541970666667,1.8825972466666665,1.236,1312.48,53.34,10001,83.02,659.7665887588324,3.5194423969103967,46.377,
astro,javascript,10000,5,3,17.11669626908,0.11044247485938936,17.065542266079998,17.04110513708,17.24344140408,ok,G,1,core,,c5ccc7094d75,0.006452324275853118,false,1,21.005486693333328,2.6449994800000005,1.382,1367.66,53.34,10001,104.24,585.9761057740492,3.125816289238444,40.482,
bridgetown,ruby,10000,5,3,18.429440243913334,0.19290828731677023,18.526536573580003,18.20727516058,18.55450899758,ok,G,1,core,,3f2f1aaf006c,0.010467398074148334,false,1,16.092244293333334,2.304353013333333,0.998,642.56,53.47,10004,111.28,539.7662947029519,2.8863327901371973,238.244,
jigsaw,php,10000,5,3,21.660149737666668,0.1372427969455027,21.644880497000003,21.531180101,21.804388615,ok,G,1,core,,d9fc9f362ed7,0.006336188743277226,false,1,19.75221074,1.5734104933333333,0.985,402.53,53.57,10003,92.95,462.00301273947935,2.475123390375168,74.59,
tanstack-start,javascript,10000,5,3,23.65370307725333,0.09066592092563498,23.645735418919998,23.56728393892,23.748089873919998,ok,G,1,core,,ebe58c534103,0.0038330539886088366,false,1,25.875913466666663,5.276881593333333,1.317,2154.32,53.34,10006,209.14,422.9092402006054,2.2559564781951043,46.008,
hexo,javascript,10000,5,3,25.228987772946667,0.05630179818300754,25.25025299228,25.16515050828,25.27155981828,ok,G,1,core,,583b6f736cfe,0.002231631276280557,false,1,33.029371473333335,5.261197279999999,1.518,4551.99,53.34,10001,125.37,396.03563588283237,2.1126025951624836,44.575,
lume,javascript,10000,5,3,27.858206482333333,0.2102037188781819,27.745950222,27.727962666000003,28.100706559000002,ok,G,1,core,,3f2f1aaf006c,0.0075454864264677445,false,1,29.68643077333333,2.96611976,1.172,1005.39,53.34,10004,94.77,360.41295828718506,1.922577874363203,32.171,
docfx,c#,10000,5,3,33.04926961434,0.7325995601130711,32.96903859134,32.360087962339996,33.818682289339996,ok,G,1,core,,ebe58c534103,0.02216689108903024,false,1,66.78258201999999,4.8800239733333335,2.168,1114.24,53.34,10006,102.83,303.31488048385813,1.617995315581081,54.093,
publish,swift,10000,5,3,33.3790174596,0.11943193512132341,33.422922305600004,33.243847279600004,33.470282793600006,ok,G,1,core,,6fc37d2dc496,0.003578054245181926,false,1,33.87343409333334,2.2040718066666662,1.081,250.56,53.34,10004,94.65,299.19586051051266,1.596022918410766,121.057,
quarkdown,kotlin,10000,5,3,46.13311950556001,0.6526525720237214,45.93893541656,45.59959694156,46.86082615856,ok,G,1,core,,c5ccc7094d75,0.014147158896225585,false,1,68.98300958,1.7563665999999998,1.533,1947.66,51.2,10033,130.71,217.68027293891566,1.1145229974472481,34.365,
soupault,ocaml,10000,5,3,48.038970933586675,0.15395850154395707,48.06850009192,47.87238658692,48.17602612192,ok,G,1,core,,8e17af3b158e,0.0032048667686242266,false,1,43.154672119999994,4.52866228,0.993,3765.95,51.2,10003,124.99,208.036447587865,1.065146611649869,43.112,
nextjs-export,javascript,10000,5,3,49.659823083860005,2.0237676941416454,49.37621639786,47.79281804486,51.81043480886,ok,G,1,core,,2bb7b205c77e,0.04075261586663591,false,1,94.41771771333333,19.187821866666667,2.288,1396.14,53.34,50021,650.87,202.52665614195192,1.0803531313572248,53.628,
sculpin,php,10000,5,3,50.112595580000004,0.2922044489067903,50.08082313,49.837575766,50.419387844,ok,G,1,core,,3f2f1aaf006c,0.00583095817578065,false,1,46.6306725,3.4483249533333336,0.999,1076.74,53.47,10003,91.26,199.67722922688313,1.067749023637104,75.793,
laika,scala,10000,5,3,51.97171178200667,1.0798861124563714,51.61890369134,51.112355790340004,53.18387586434,ok,G,1,core,,ebe58c534103,0.020778344130474514,false,1,102.58759101333332,1.83426952,2.009,3971.98,53.34,10003,114.2,193.7274774333822,1.0334150124336983,41.223,
vike,javascript,10000,5,3,52.950881024800005,0.43629661340184717,52.8126348698,52.6004558508,53.4395523538,ok,G,1,core,,3f2f1aaf006c,0.008239647857747709,false,1,68.24753771333332,11.815165693333332,1.512,3798.49,53.34,20009,336.04,189.34862887741147,1.0100565921679419,39.148,
starlight,javascript,10000,5,3,53.02326536867333,0.45421735061547597,53.02453823134,52.56841292434,53.47684495034,ok,G,1,core,,ae30efe0efb4,0.008566378314448965,false,1,67.85749136666666,3.596283226666667,1.348,2381.92,53.34,10014,386.73,188.5919299546022,1.0060200763515812,45.116,
lustre-ssg,gleam,10000,5,3,53.35523402920666,1.2519872954000344,52.68095238854,52.58490909854,54.79984060054,ok,G,1,core,,3f2f1aaf006c,0.023465126115175438,false,1,65.07622341999999,11.693851933333333,1.439,754.35,53.34,10004,94.97,189.82192892502374,1.0125813521094236,21.851,
mkdocs,python,10000,5,3,66.86610887561334,0.7053905277834035,66.54048656628,66.38234955428,67.67549050628,ok,G,1,core,,90616b2b906d,0.010549298286454735,false,1,65.41261699333333,1.2920025666666666,0.998,296.83,51.2,10001,90.37,150.28444359268622,0.7694563511945534,41.564,
franklin,julia,10000,5,3,67.1305996831,0.5743270193364336,67.3156660501,66.4865555251,67.5895774741,ok,G,1,core,,ba134637a49c,0.008555368521175588,false,1,57.96860684666666,5.6095583599999985,0.947,1495.84,51.2,10005,117.88,148.55382984040375,0.7605956087828672,227.207,
cryogen,clojure,10000,5,3,69.14357576012,0.44962028444035307,69.13256097012,68.69956407212,69.59860223812001,ok,G,1,core,,ba134637a49c,0.006502705124771417,false,1,220.13393526666667,4.206639806666666,3.245,2506.17,53.34,10024,100.75,144.64963918119759,0.7716154190072009,44.701,
middleman,ruby,10000,5,3,76.19967308838001,0.3836532482230934,76.36329115638,75.76133683138,76.47439127738001,ok,G,1,core,,ba134637a49c,0.005034841130855169,false,1,232.66108181999996,5.075142546666666,3.12,315.26,53.34,10002,100.18,130.95297293462082,0.698552264998118,100.664,
nesta,ruby,10000,5,3,76.67198299732667,0.9875240119396195,76.96162194466,75.57202707566,77.48229997166,ok,G,1,core,,3f2f1aaf006c,0.01287985484833556,false,1,73.42540668666666,3.2374990799999996,1.0,308.02,53.34,10006,97.93,129.93489153841634,0.6931214370502397,47.401,
lektor,python,10000,5,3,78.75992439134001,0.6148876000492843,78.63459622334,78.21735595934,79.42782099134,ok,G,1,core,,ba134637a49c,0.007807112624868059,false,1,66.01773401333332,6.320832753333332,0.918,164.68,51.2,10004,83.1,127.17048831277448,0.6511129001614054,54.295,
pelican,python,10000,5,3,82.47586786151334,1.010851014176898,82.24511259218,81.60034500818,83.58214598418,ok,G,1,core,,3f2f1aaf006c,0.012256324672742281,false,1,80.61446309333333,1.9353513599999996,1.001,141.83,53.34,10001,74.4,121.58777202465421,0.6485947713940148,48.581,
nanoc,ruby,10000,5,3,95.35211970071998,1.0898169843285428,94.99662916972,94.48443638372,96.57529354872,ok,G,1,core,,ba134637a49c,0.011429394414609053,false,1,93.16090476666666,2.030310866666666,0.998,639.1,53.54,10001,100.83,105.26689301926812,0.5636384203100437,42.599,
cobalt,rust,10000,5,3,95.49712138666,1.2909010133291423,95.68007485666,94.12450396966,96.68678533366,ok,G,1,core,,ebe58c534103,0.013517695555475334,false,1,94.01060595999998,1.4629100466666667,1.0,463.6,51.2,10003,81.88,104.51496839839618,0.5351166381997884,24.58,
hakyll,haskell,10000,5,3,112.30559916848,1.0291580518914778,112.85591926648,111.11828390347999,112.94259433548,ok,G,1,core,,3f2f1aaf006c,0.009163906871175164,false,1,364.39765998,15.238601340000002,3.38,865.83,53.34,10003,107.45,88.60855562558125,0.47267126391520997,2497.646,
antora,javascript,10000,5,3,144.46564395793334,1.9282133023285783,143.38724510859998,143.3178939226,146.6917928426,ok,G,1,core,,d9fc9f362ed7,0.013347210101316898,false,1,154.23251329999997,2.82041888,1.087,1232.7,51.2,10003,198.17,69.74121019220438,0.3570749961840864,44.107,
cecil,php,10000,5,3,152.26603105199334,2.691058015487082,151.77978125266,149.85124999166,155.16706191166,ok,G,1,core,,3f2f1aaf006c,0.01767339699402937,false,1,148.27311422666665,3.96085042,1.0,471.1,53.34,10004,89.24,65.88492826560024,0.35145491421681124,52.36,
gatsby,javascript,10000,5,3,176.37643133736003,13.925014394506508,169.27985703636003,167.42931930336002,192.42011767236002,ok,G,1,core,,3f2f1aaf006c,0.0789505394168666,false,1,234.53457261333332,20.561939753333334,1.446,1657.88,53.34,20030,197.02,59.07377389769461,0.31512166263551467,260.709,
nikola-mako,python,10000,5,3,185.45801627158664,0.5914010716265737,185.15956809392,185.07530827692,186.13917244392,ok,G,1,core,,c5ccc7094d75,0.0031888676667419964,false,1,176.46527712,4.921200353333332,0.978,439.32,53.52,10025,86.28,54.007470977290346,0.28906823747207444,56.431,
quartz,javascript,10000,5,3,271.9236342941133,1.5386687556566805,272.59224976078,270.16376822878,273.01488489278,ok,G,1,core,,3f2f1aaf006c,0.0056584590730809825,false,1,944.5241109733333,17.560662893333333,3.538,6411.63,53.34,10012,240.88,36.6848287461428,0.19569063334270548,275.379,
mdbook,rust,10000,5,3,283.91233382276664,2.572157757221039,285.3004100991,280.9443280691,285.4922633001,ok,G,1,core,,3f2f1aaf006c,0.009059690090204811,false,1,116.01811945333331,165.85733570000002,0.993,1628.67,51.2,10019,124.65,35.050773311284296,0.17945995935377562,27.742,
zensical,python,10000,5,3,362.42095689945336,3.529272758408089,362.74105471412,358.74253915912004,365.77927682512,ok,G,1,core,,3f2f1aaf006c,0.009738048231540918,false,1,426.23030082666656,8.124820013333332,1.198,1564.66,51.2,10014,204.03,27.567874851886017,0.14114751924165642,57.798,
tableau,elixir,10000,5,3,412.7883586142,25.800396817937997,426.3217227352,383.0369747362,429.0063783712,ok,G,1,core,,8e17af3b158e,0.0625027239250503,false,1,928.1255919533332,13.346963346666664,2.281,2150.39,53.34,10004,101.42,23.456463667490084,0.12512557337626742,80.273,
analog,javascript,10000,5,3,491.57487416414665,7.783541508558531,488.35255078548,485.91995076948,500.45212093748,ok,G,1,core,,3f2f1aaf006c,0.015833888015113342,false,1,531.2025627533333,15.349661926666665,1.112,7061.06,53.34,20008,213.11,20.47700986493409,0.10923204949825778,59.099,
emanote,haskell,10000,5,3,498.55826491032667,1.4522229204213348,497.75653433566,497.68364108566,500.23461930966,ok,G,1,core,,3f2f1aaf006c,0.0029128449423710574,false,1,601.2291027,20.549258006666665,1.247,5837.0,53.34,10043,618.2,20.09014309243913,0.10716835705872998,3121.975,
sveltekit,javascript,10000,5,3,514.2999228267266,2.1854614933419767,515.38370664106,511.78437912106,515.73168271806,ok,G,1,core,,3f2f1aaf006c,0.004249391058295537,false,1,690.6964786600001,18.773871966666665,1.379,5963.61,53.34,20020,198.28,19.4030192866856,0.10350298100741348,37.877,
nuxt-content,javascript,10000,5,3,638.0068508964666,2.0770571305775616,637.5750484538,636.1796353048,640.2658689308,ok,G,1,core,,ba134637a49c,0.003255540481515329,false,1,405.52814342666665,289.28732399333336,1.089,5736.18,53.34,20053,463.9,15.684428090859676,0.08366662109717958,60.911,
jbake,java,10000,5,3,639.0043642368267,11.003757083309614,633.29425180216,632.0294340891601,651.68940681916,ok,G,1,core,,ba134637a49c,0.017220159515579488,false,1,713.1088813066666,7.48567066,1.128,1297.02,53.34,10003,95.39,15.790448076140096,0.08423217145615983,40.754,
sphinx,python,10000,5,3,640.9130033435999,0.5052026693266379,641.0262430976,640.3607905836,641.3519763496,ok,G,1,core,,8e17af3b158e,0.0007882546721489962,false,1,630.6283353,10.184152566666667,1.0,6896.6,53.34,10005,134.39,15.59998534799057,0.08321617184068719,42.882,
docmd,javascript,10000,5,3,995.8974459652667,8.138573970013605,994.5716016076001,988.5031981186,1004.6175381696,ok,G,1,core,,3f2f1aaf006c,0.008172100453702187,false,1,1079.85320664,6.572904573333332,1.091,4394.38,53.34,10020,387.25,10.05458026735959,0.053634901613696315,47.469,
plenti,go,10000,5,3,2565.049321817413,3.0953913531799,2563.9331439170796,2562.66682276508,2568.5479987700796,ok,G,1,core,,8e17af3b158e,0.0012067570501867481,false,1,2626.292962973333,101.84639480666665,1.064,2439.75,53.34,10077,135.0,3.9002577051296976,0.020805437195801232,107.802,
docusaurus,javascript,10000,5,,,,,,,failed,G,1,core,,32b3f23116a6,,,,,,,,,,,,,105.58,SSGBERK_VERIFY_FAIL build exited 134
dumi,javascript,10000,5,,,,,,,failed,G,1,core,,3f2f1aaf006c,,,,,,,,,,,,,89.535,SSGBERK_VERIFY_FAIL build exited 134
iles,javascript,10000,5,,,,,,,oom,G,1,core,,2bb7b205c77e,,,,,,,,,,,,,49.126,oom
marmite,rust,10000,5,,,,,,,oom,G,1,core,,3f2f1aaf006c,,,,,,,,,,,,,50.904,oom
nextra,javascript,10000,5,,,,,,,oom,G,1,core,,3f2f1aaf006c,,,,,,,,,,,,,78.994,oom
nimib,nim,10000,5,,,,,,,timeout,G,1,core,,dc6727d97293,,,,,,,,,,,,,67.214,timeout
observable-framework,javascript,10000,5,,,,,,,timeout,G,1,core,,ebe58c534103,,,,,,,,,,,,,51.262,timeout
quarto,typescript,10000,5,,,,,,,oom,G,1,core,,5ea81f79ec03,,,,,,,,,,,,,37.578,oom
rspress,javascript,10000,5,,,,,,,oom,G,1,core,,ba134637a49c,,,,,,,,,,,,,44.406,oom
statiq,c#,10000,5,,,,,,,failed,G,1,core,,8e17af3b158e,,,,,,,,,,,,,69.616,SSGBERK_VERIFY_FAIL build exited 134
vite-ssg,javascript,10000,5,,,,,,,oom,G,1,core,,3f2f1aaf006c,,,,,,,,,,,,,37.78,oom
vitepress,javascript,10000,5,,,,,,,failed,G,1,core,,ebe58c534103,,,,,,,,,,,,,42.529,SSGBERK_VERIFY_FAIL build exited 134
vuepress,javascript,10000,5,,,,,,,oom,G,1,core,,e2d6f2db677c,,,,,,,,,,,,,40.959,oom
Loading
Loading