Profiles / #5
Passed Run of Oct 18, 23:20
short_tests 4 tests finished faster than one sample (1ms), so they have timings but no breakdown. That's expected for tests this fast.
Wall time
31.71 s
1 worker
Test time
26.10 s
sum of test durations
Tests
235
235 passed
Profiler
tachyon
1000 Hz ·
21,656 samples · Python 3.15.0 · flakytest 2026.0b1
Peak memory
173 MB
test process
Where the time goes
Test time by category- Database11.50 s
- Libraries5.79 s
- Migrations3.21 s
- Password hashing1.96 s
- DB schema1.60 s
- Templates523 ms
- Serialization436 ms
- App code303 ms
- Imports287 ms
- Unsampled157 ms
- pytest152 ms
- Deep copies113 ms
- Factories20 ms
- Waiting18 ms
- Test code15 ms
- Logging9 ms
- Mocking5 ms
- Cache1 ms
Session timeline
Tests
24.94 s
Startup
5.23 s
Collection
274 ms
Between tests
635 ms
Session teardown
469 ms
Test phases
Setup 5.91 s
Call 20.04 s
Teardown 149 ms
Fix next
Ranked by the time each fix saves per run
1
Run tests in parallel on all 2 CPUs
Tests run one at a time: 26.1s of test time on a 2-CPU machine. With pytest-xdist this could take about 13.1s.
High
Parallelism
13.05 s
per run
Fix: pip install pytest-xdist, then run pytest -n auto (add it to addopts, or only in CI). pytest-django creates a separate test database per worker automatically.
Details
Tests must not share state: files in fixed paths, ports, a shared database without per-worker names, or module globals. Run with -p randomly first to shake out order dependencies.
2
Use plain static file storage in tests
Static file storage/manifest handling costs 11.1s.
High
App code
11.14 s
per run
Fix: In test settings use STORAGES["staticfiles"] = {"BACKEND": "django.contrib.staticfiles.storage.StaticFilesStorage"} so templates don't need a manifest.
Details
Where:
- apps/mcp/tests.py:66 McpTest.post · 577 ms
- apps/api/tests.py:487 ProfileUploadTest.upload · 552 ms
- ft/tests.py:203 TestAccountSettings.test_change_password · 413 ms
- apps/orgs/tests.py:28 SignupTest.test_signing_up_creates_an_organization · 289 ms
- ft/tests.py:159 TestAccountPages.test_signup · 250 ms
- apps/projects/urls.py:498 project_profile · 212 ms
- ft/tests.py:198 TestAccountSettings.test_change_password · 205 ms
- ft/tests.py:96 TestTrubleshootingPage.test_troubleshooting · 200 ms
- apps/api/urls.py:72 api_request.<locals>.decorator.<locals>.wrapped_view · 186 ms
- apps/api/tests.py:352 IngestEnvironmentTest.ingest_start · 181 ms
Most affected tests:
- ft/tests.py::TestAccountSettings::test_change_password
- apps/orgs/tests.py::SignupTest::test_signing_up_creates_an_organization
- apps/projects/tests.py::ProjectPagesTest::test_dashboard_filters
- ft/tests.py::TestAccountPages::test_signup
- apps/api/tests.py::ProfileUploadTest::test_missing_parts_mark_the_profile_incomplete
- ft/tests.py::TestTrubleshootingPage::test_troubleshooting
- apps/projects/tests.py::IndexPageTest::test_index_page
- apps/api/tests.py::ProfileUploadTest::test_upload_links_ingest_session
3
Disable django-debug-toolbar in tests
django-debug-toolbar is installed in the test settings and costs 6.4s.
High
App code
6.42 s
per run
Fix: Only add debug_toolbar to INSTALLED_APPS and MIDDLEWARE when not testing (e.g. `if DEBUG and not TESTING:`).
Details
Where:
- ft/tests.py:203 TestAccountSettings.test_change_password · 413 ms
- apps/orgs/tests.py:28 SignupTest.test_signing_up_creates_an_organization · 275 ms
- ft/tests.py:159 TestAccountPages.test_signup · 250 ms
- apps/projects/urls.py:498 project_profile · 212 ms
- ft/tests.py:198 TestAccountSettings.test_change_password · 205 ms
- apps/api/urls.py:72 api_request.<locals>.decorator.<locals>.wrapped_view · 186 ms
- apps/projects/tests.py:88 IndexPageTest.test_index_page · 146 ms
- apps/orgs/views.py:33 org_shell · 137 ms
- apps/orgs/models.py:65 Organization.is_owner · 119 ms
- apps/projects/urls.py:40 can_manage_project · 119 ms
Most affected tests:
- ft/tests.py::TestAccountSettings::test_change_password
- apps/orgs/tests.py::SignupTest::test_signing_up_creates_an_organization
- apps/projects/tests.py::ProjectPagesTest::test_dashboard_filters
- ft/tests.py::TestAccountPages::test_signup
- apps/api/tests.py::ProfileUploadTest::test_missing_parts_mark_the_profile_incomplete
- apps/projects/tests.py::IndexPageTest::test_index_page
- apps/projects/tests.py::ProfilePagePaginationTest::test_slowest_tests_first_then_the_next_page
- apps/projects/tests.py::ProjectPagesTest::test_projects_page
4
Repeated queries (N+1) in the code under test
27 tests run the same query 10+ times, e.g. 180x in test_seed_demo. N+1 queries slow the tests and production alike.
High
Database
3.34 s
per run
Fix: Django: fetch related rows in one query with select_related() for foreign keys and prefetch_related() for reverse/many-to-many relations, then lock the count in with assertNumQueries (or pytest-django's django_assert_num_queries).
Details
This changes application code, so it speeds up production too; the tests stay as they are.
- 180x in test_seed_demo: SELECT "projects_test"."id", "projects_test"."name", "projects_test"."project_id", "projects_test"."slug", "projects_test"."date_last_run", "projects_test"."date_first_seen", "projects_test"."first_commit_id", "projects_test"."muted" FROM "projects_test" WHERE ("projects_test"."name" = %s AND "proj…
- 22x in test_dashboard_filters: SELECT "projects_environment"."id", "projects_environment"."project_id", "projects_environment"."name", "projects_environment"."kind", "projects_environment"."provider", "projects_environment"."details", "projects_environment"."date_first_seen", "projects_environment"."date_last_seen" FROM "project…
- 21x in test_configure_page: SELECT "projects_profile"."id", "projects_profile"."project_id", "projects_profile"."number", "projects_profile"."environment_id", "projects_profile"."session_id", "projects_profile"."run_id", "projects_profile"."commit_id", "projects_profile"."ingest_id", "projects_profile"."external_id", "project…
- 20x in test_index: SELECT "django_content_type"."model" AS "model" FROM "django_content_type" WHERE "django_content_type"."app_label" = %s
- 20x in test_daily_stats_count_a_profile_once_every_part_is_in: SELECT "projects_profilepart"."id", "projects_profilepart"."profile_id", "projects_profilepart"."index", "projects_profilepart"."count", "projects_profilepart"."checksum", "projects_profilepart"."status", "projects_profilepart"."error", "projects_profilepart"."tests_count", "projects_profilepart"."…
Most affected tests:
- apps/projects/tests.py::SeedDemoCommandTest::test_seed_demo
- apps/projects/tests.py::ProjectPagesTest::test_dashboard_filters
- apps/projects/tests.py::ProjectPagesTest::test_configure_page
- apps/api/tests.py::TestApiIndex::test_index
- apps/api/tests.py::ProfileUploadTest::test_daily_stats_count_a_profile_once_every_part_is_in
- apps/api/tests.py::IngestStartEndpointTest::test_all_test_status_types
- apps/api/tests.py::IngestStartEndpointTest::test_details_are_kept_for_failures_only
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_end_after_progress
5
Make the test database server skip durability work
Tests spend 16.3s (62%) in the database. Test databases don't need to survive a crash, so the server can skip flushing to disk.
High
Database
3.26 s
per run
Fix: For a PostgreSQL test server (Docker/CI service) start it with -c fsync=off -c synchronous_commit=off -c full_page_writes=off, and put its data directory on tmpfs; for MySQL use --innodb-flush-log-at-trx-commit=0 --skip-log-bin. Never on a server with data you need.
Details
Only affects crash safety of the throwaway test server; query behaviour is identical.
Where:
- apps/projects/models.py:466 Profile.save · 342 ms
- apps/projects/profiles.py:313 write_snapshots · 231 ms
- apps/projects/tests.py:953 ProjectPagesTest.setUp · 208 ms
- apps/api/tests.py:76 IngestStartEndpointTest.join_workers · 198 ms
- apps/projects/environments.py:63 get_or_create_environment · 190 ms
- apps/api/urls.py:72 api_request.<locals>.decorator.<locals>.wrapped_view · 184 ms
- apps/projects/profiles.py:458 write_perfs · 162 ms
- apps/projects/rollups.py:88 add_perfs · 160 ms
- apps/projects/management/commands/seed_demo.py:248 Command.ingest_session · 153 ms
- apps/projects/profiles.py:383 claim_part · 142 ms
Most affected tests:
- apps/api/tests.py::TestApiIndex::test_index
- apps/projects/tests.py::SeedDemoCommandTest::test_seed_demo
- apps/api/tests.py::IngestStartEndpointTest::test_all_test_status_types
- apps/projects/tests.py::ProjectPagesTest::test_configure_page
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_end_after_progress
- apps/api/tests.py::IngestStartEndpointTest::test_results_are_counted_and_the_payload_dropped
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_progress_before_start
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_start_progress_end
6
Stop re-running migrations on every test run
Migrations take 3.2s per run, before the first test can start.
High
Migrations
2.89 s
per run
Fix: Run with --reuse-db (add it to addopts in pytest.ini/pyproject) so the test database survives between runs; pass --create-db when migrations change. If no test depends on data migrations, --nomigrations builds the schema straight from the models, which is faster still.
Details
CI should still build the database from scratch (no --reuse-db) so broken migrations are caught.
Where:
- apps/projects/migrations/0012_backfill_session_environments.py:30 backfill · 4 ms
- apps/projects/migrations/0025_backfill_slugs_and_numbers.py:28 forwards · 3 ms
- apps/projects/migrations/0004_project_created_by_project_date_created_and_more.py:12 add_created_by_to_project · 1 ms
- apps/projects/migrations/0009_auto_20240218_1217.py:12 create_mute_objects · 1 ms
- apps/projects/migrations/0014_backfill_session_counts.py:13 backfill.<locals>.count · 1 ms
- apps/projects/migrations/0014_backfill_session_counts.py:23 backfill · 1 ms
- apps/projects/migrations/0016_profile_parts.py:9 move_documents · 1 ms
- apps/projects/migrations/0016_profile_parts.py:24 external_storage · 1 ms
- apps/projects/migrations/0018_profile_stats_applied.py:9 mark_applied · 1 ms
- apps/projects/migrations/0022_backfill_organizations.py:48 forwards · 1 ms
Most affected tests:
- apps/api/tests.py::TestApiIndex::test_index
7
pytest takes a long time before the first test runs
Startup takes 5.2s and collection 274ms on every run, even when you only run one test.
Medium
Imports
2.20 s
per run
Fix: Set testpaths and norecursedirs (node_modules, .venv, build, docs) so pytest doesn't walk unrelated directories; move heavy imports out of module level in test files and conftest.py into fixtures; check `python -X importtime -m pytest --collect-only -q` for the slowest imports.
8
Use a fast password hasher in tests
2.0s (8% of test time) is spent hashing passwords. Slow hashing protects real passwords; in tests it only burns CPU.
Medium
Password hashing
1.87 s
per run
Fix: In your test settings set PASSWORD_HASHERS = ["django.contrib.auth.hashers.MD5PasswordHasher"] (currently PBKDF2PasswordHasher).
Details
Only change the hasher in test settings. Tests that assert on a specific hash format need updating.
Where:
- ft/tests.py:203 TestAccountSettings.test_change_password · 407 ms
- ft/tests.py:230 TestAccountSettings.test_projects_only_lists_your_own_even_for_superusers · 240 ms
- ft/tests.py:159 TestAccountPages.test_signup · 236 ms
- apps/orgs/tests.py:194 SuperuserTest.test_superusers_can_open_any_project_but_dont_list_them · 227 ms
- apps/orgs/tests.py:28 SignupTest.test_signing_up_creates_an_organization · 225 ms
- ft/tests.py:175 TestAccountSettings.setUpTestData · 221 ms
- ft/tests.py:213 TestAccountSettings.test_change_password · 204 ms
- ft/tests.py:198 TestAccountSettings.test_change_password · 201 ms
- ft/tests.py:101 TestTrubleshootingPage.test_troubleshooting_with_project · 2 ms
- apps/orgs/tests.py:52 OrganizationTestCase.setUpTestData · 1 ms
Most affected tests:
- ft/tests.py::TestAccountSettings::test_change_password
- ft/tests.py::TestAccountSettings::test_projects_only_lists_your_own_even_for_superusers
- ft/tests.py::TestAccountPages::test_signup
- apps/orgs/tests.py::SuperuserTest::test_superusers_can_open_any_project_but_dont_list_them
- apps/orgs/tests.py::SignupTest::test_signing_up_creates_an_organization
- ft/tests.py::TestTrubleshootingPage::test_troubleshooting_with_project
9
Use TestCase instead of TransactionTestCase
1.3s goes to flushing every table after tests in 11 TransactionTestCase / transaction=True / live_server tests.
Medium
DB schema
1.20 s
per run
Fix: Use django.test.TestCase (or @pytest.mark.django_db without transaction=True): it wraps each test in a transaction and rolls back instead of truncating every table. Keep TransactionTestCase only for tests that need real commits (on_commit hooks can use TestCase.captureOnCommitCallbacks).
Details
Tests that rely on commit behaviour, multiple connections or a live server still need a transactional test case.
Most affected tests:
- apps/api/tests.py::IngestStartEndpointTest::test_all_test_status_types
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_valid
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_start_with_git
- apps/api/tests.py::IngestStartEndpointTest::test_details_are_kept_for_failures_only
- apps/api/tests.py::IngestStartEndpointTest::test_results_are_counted_and_the_payload_dropped
- apps/api/tests.py::ProfileUploadLockTest::test_upload_while_a_part_is_being_processed
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_multiple_sessions
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_end_after_progress
10
Tests open new database connections over and over
Connecting to the database takes 953ms.
Low
Database
763 ms
per run
Fix: Reuse connections: create the engine once per session (not per test) and keep the default pool (NullPool reconnects on every checkout); in Django avoid closing connections in tests (connection.close()/close_old_connections).
Details
Where:
- apps/api/tests.py:76 IngestStartEndpointTest.join_workers · 174 ms
- apps/api/tests.py:73 IngestStartEndpointTest.setUp · 88 ms
- apps/api/tasks.py:266 warm_reports · 64 ms
- apps/api/urls.py:72 api_request.<locals>.decorator.<locals>.wrapped_view · 51 ms
- apps/api/tasks.py:237 process_profile · 13 ms
- apps/api/tests.py:306 IngestStartEndpointTest.test_details_are_kept_for_failures_only · 13 ms
- apps/api/tests.py:988 ProfileUploadQueueTest.test_upload_is_processed_by_the_worker · 10 ms
- apps/api/tests.py:975 ProfileUploadQueueTest.setUp · 10 ms
- apps/api/tests.py:331 IngestStartEndpointTest.test_results_are_counted_and_the_payload_dropped · 10 ms
- apps/api/tests.py:257 IngestStartEndpointTest.test_ingest_end_after_progress · 10 ms
Most affected tests:
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_start_progress_end
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_progress_before_start
- apps/api/tests.py::IngestStartEndpointTest::test_all_test_status_types
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_end_after_progress
- apps/api/tests.py::IngestStartEndpointTest::test_results_are_counted_and_the_payload_dropped
- apps/api/tests.py::ProfileUploadQueueTest::test_upload_is_processed_by_the_worker
- apps/api/tests.py::IngestStartEndpointTest::test_details_are_kept_for_failures_only
- apps/projects/tests.py::ProjectRunsPage::test_not_logged_in
11
Create shared test data in setUpTestData instead of setUp
setUp() runs before every test and takes 900ms in total (db 836ms, library 52ms, copying 6ms) in 13 classes: SettingsTest (3 tests), ProjectsPageTest (5 tests), ProjectEditPage (6 tests), ProjectDeletePage (4 tests).
Low
Database
630 ms
per run
Fix: Move object creation that tests only read from setUp() into `@classmethod def setUpTestData(cls)`: it runs once per class and each test still sees the original rows (TestCase rolls back to a savepoint).
Details
Since Django 3.2 attributes assigned in setUpTestData are deep-copied per test, so in-memory changes don't leak between tests. Keep objects a test modifies in the database (or re-fetches) as before.
Where:
- apps/projects/tests.py:953 ProjectPagesTest.setUp · 225 ms
- apps/api/tests.py:73 IngestStartEndpointTest.setUp · 140 ms
- apps/projects/tests.py:142 ProjectEditPage.setUp · 63 ms
- apps/projects/tests.py:100 ProjectsPageTest.setUp · 61 ms
- apps/projects/tests.py:1375 MemoryTest.setUp · 55 ms
- ft/tests.py:179 TestAccountSettings.setUp · 54 ms
- apps/projects/tests.py:268 ProjectRunsPage.setUp · 44 ms
- apps/projects/tests.py:337 ProjectTestsPage.setUp · 43 ms
- apps/projects/tests.py:187 ProjectDeletePage.setUp · 43 ms
- apps/projects/tests.py:412 TestProjectTestPage.setUp · 42 ms
Most affected tests:
- apps/api/tests.py::IngestStartEndpointTest::test_details_are_kept_for_failures_only
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_start_with_git
- apps/api/tests.py::ProfileUploadQueueTest::test_upload_is_processed_by_the_worker
- apps/projects/tests.py::ProjectsPageTest::test_multiple_projects
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_end_after_progress
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_progress_before_start
- apps/api/tests.py::IngestStartEndpointTest::test_ingest_start_progress_end
- apps/api/tests.py::ProfileUploadLockTest::test_upload_while_a_part_is_being_processed
Tests
1–200 of 235, slowest first · click a column to sort this page
Page 1 of 2
Next
Memory
The test process peaked at 199 MBSlowest fixtures
Exact setup time across the session| Fixture | Scope | Calls | Total |
|---|---|---|---|
| _django_setup_unittest | class | 50 | 3.52 s |
| django_db_setup | session | 1 | 3.50 s |
| _unittest_setUpClass_fixture_RealProfileDocumentTest | class | 1 | 285 ms |
| _unittest_setUpClass_fixture_ProjectPagesTest | class | 1 | 280 ms |
| _unittest_setUpClass_fixture_TestAccountSettings | class | 1 | 234 ms |
| _unittest_setUpClass_fixture_ProfilePagePaginationTest | class | 1 | 219 ms |
| _unittest_setUpClass_fixture_AnalyticsTest | class | 1 | 205 ms |
| _unittest_setUpClass_fixture_McpTest | class | 1 | 182 ms |
| _unittest_setUpClass_fixture_MemoryTest | class | 1 | 90 ms |
| _unittest_setUpClass_fixture_StorageTest | class | 1 | 82 ms |
| _unittest_setUpClass_fixture_FlakyReportTest | class | 1 | 69 ms |
| _unittest_setUpClass_fixture_LegacyUrlTest | class | 1 | 63 ms |
| _unittest_setUpClass_fixture_FlakyReportCacheTest | class | 1 | 48 ms |
| _unittest_setUpClass_fixture_ProjectRunsPage | class | 1 | 21 ms |
| _unittest_setUpClass_fixture_ProjectRunPage | class | 1 | 21 ms |