Skip to content

Alerts for performance regressions #158

Closed
@alexcrichton

Description

@alexcrichton

Recently crates.io suffered a huge performance regression:

https://i.imgur.com/ibBy9g2.png

The reason behind this regression was that I deployed a version of crates.io linked against bustream 1.0, which accidentally didn't actually buffer anything. This meant that all DB reads/writes took an enormous amount of time (e.g. 500ms per req), resulting in the huge regression. While an easy fix, we really should have reporting which alerts us to this sort of thing.

Something like just sending an alert whenever the response time is way outside the normal response time for a period of time.

Metadata

Metadata

Assignees

No one assigned

    Labels

    A-infrastructure 📡C-enhancement ✨Category: Adding new behavior or a change to the way an existing feature works

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions