Skip to content

Introduce performance regression CI check #2294

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

Conversation

grgur
Copy link
Contributor

@grgur grgur commented Sep 12, 2019

Using Gimbal and GitHub Actions to ensure Performance Budgeting on the VueJS.org homepage.

This CI action will

  • ensure lighthouse tests don’t fall below thresholds
  • ensure a11y rules are observed
  • ensure heap memory doesn’t go over the threshold
  • automatically create a PR comment with items that are failing

The thresholds are loose to reflect the current state of the built site. Some of the tests are skipped as they are taken care of on the server side post-deployment.

Gimbal is not made a dependency to keep the dependency tree light (apart from the light axe plugin). However, it can be executed locally via a CLI command as such:

npx @modus/gimbal

Using [Gimbal](https://github.com/ModusCreateOrg/gimbal) and GitHub Actions to ensure Performance Budgeting on VueJS.org homepage.

This CI action will
* [x] ensure lighthouse tests don’t fall below thresholds
* [x] ensure a11y rules are observed
* [x] ensure heap memory doesn’t go over the threshold
* [x] automatically create a PR comment with items that are failing

The thresholds are loose to reflect the current state of the built site. Some of the tests are skipped as they are taken care of on the server side post-deployment.
@sdras
Copy link
Member

sdras commented Oct 3, 2019

@bencodezen since you are leading the charge for vuepresss migration, I think your input on this is important

@bencodezen
Copy link
Member

@sdras Thanks for pinging me. Sorry for missing the notification on this one and not seeing it till now.

I'll definitely need to play around with Gimbal to see how it interacts with VuePress. Will keep you posted. 👍

@grgur
Copy link
Contributor Author

grgur commented Oct 8, 2019

Thanks @bencodezen and @sdras. Please let me know if I can help with anything there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants