Changelog

2026-10-16

flakytest now tells you why your tests are slow

The pytest plugin can now profile your suite (pytest --flakytest-profile) and break every test down into setup, call and teardown, fixtures, categories like database, network and password hashing, and the hot lines in your code, with a ranked "fix next" list. It works locally without an account.

Uploaded profiles are grouped by environment: every CI job and every developer machine, so you can compare CI with local runs.
A new dashboard with the slowest tests and why, suite time trends per environment, fix next and CI vs local.
A test page with its duration per environment, the call tree of its latest run, hot lines, fixtures and repeated queries.
Failures are classified as flaky, caught regressions or changed tests, split by CI and local.
An MCP server at /mcp so coding agents can ask about your test suite.
A new design, with dark mode.

2024-05-14

The pricing page now clearly sates that the project is free for non profits and open source projects ❤️

Project pages can now be made public. Check out the page for flakytest.dev itself here.

2024-04-01

Simplifed onboarding experince.

Indicator on the setup project page to show that the page will refresh when the first test run is received.

2024-03-27

Improvements to the landing page in preparation for the product hunt launch.

2024-02-20

Improvements to clickable areas and tables.

2024-02-18

Mute test improvements

You can now set a limit for how long a test should be muted for. This is useful because it will automatically unmute the test after the specified time, making sure that muted tests don't get forgotten.

2024-01-10

Multiple improvements

We have made test ingestion more reliable and faster, making sure your CI is not slowed down. 🏎️

Mute a test, Terms of Service and Privacy Policy pages were added.

FlakyTest is live on GitHub Marketplace! 🎉

2023-12-07

New tests page

The new tests page shows all the project's tests along with their failure counts and run times. It also makes it easy to mute tests directly from the list view.

Added sidebar

The sidebar makes it easier to switch between the different views and improves the navigation experience.

Before

After

2023-12-01

Added test overview page

Improved single test view now shows the test pass percentage, p50, and p95 durations. It is now also possible filter previous runs by test status.