CMS Benchmarking

Nice! I think these benchmarks and exercises are really valuable!

What is the baseline? Are we setting the CMS up locally, or using some managed solution or trial experience? Or are we benchmarking all of these three as three separate benchmarks?

If setting up locally:

Will the exercise run on Windows, Mac - or both? Linux?
Will you start with having an existing development environment? Or is setting that up part of the benchmark?

Where this this benchmarking being tracked?

Came here to ask if any performance comparisons are being done - e.g. if people are setting up local ddev installs (or default hosted installs for SASS) then it would be possible to run lighthouse or similar against the install and compare vs. the default install of Drupal CMS. It could use some standard steps (e.g. testing logged out vs. as an admin etc.).

As Gabor noted in Slack, this is product benchmarking (of UX and features) rather than performance.

Right but presumably UX and features would include things like responsive image and resizing support, CSS and JavaScript aggregation or the lack of it?

And then I was hoping this could be expanded to page weight / loading times.

It's being pretty loosely gathered by contributors here: https://airtable.com/appmVfRW1N0voF7vM/shrEI3Evagd1sCmn5/tbls3Xv0A1WxkTUq0

Based on the contribution model I don't think it's feasible to include performance metrics.

Four related issues (including this one):

1. https://www.drupal.org/project/drupal_cms/issues/3500771 🐛 Front-end Performance Suggestions (Via Google Lighthouse) Active
2. https://www.drupal.org/project/drupal_cms/issues/3479394 ✨ Add Google Lighthouse testing Active
3. https://www.drupal.org/project/drupal_cms/issues/3500770 📌 Aim For 100 in Google Lighthouse Scores Active
4. https://www.drupal.org/project/drupal_cms/issues/3481524 📌 CMS Benchmarking Active

This isn't about performance benchmarking, it was research on CMS features and journeys. It was crowdsourced and probably can be closed once credit is added.

Who needs to add credit here?

@thejimbirch - here is the list of those who contributed based on the airtable data:
yana-karpliuk
vinmayiswamy
emma horrell
skyejohnson
gábor hojtsy
artinruins

thejimbirch → credited artinruins → .

thejimbirch → credited emma horrell → .

thejimbirch → credited gábor hojtsy → .

thejimbirch → credited skyejohnson → .

thejimbirch → credited vinmayiswamy → .

thejimbirch → credited yana-karpliuk → .

Thanks. Adding credit and closing as fixed.

Automatically closed - issue fixed for 2 weeks with no activity.