Remove robots.txt entries now that canonical links fixed the problem of overindexing
Commit 1f84a pushed by Anže Pečar

12 tests 12 passed Duration
accounts/tests.py::TestSelectedInstance::test_invalid_selected_instance 1.0435s
accounts/tests.py::TestSelectedInstance::test_no_selected_instance 0.3428s
accounts/tests.py::TestSelectedInstance::test_selected_instance 0.3463s
accounts/tests.py::TestSelectedInstance::test_selected_instance_https_truncate 0.3430s
accounts/tests.py::TestSelectedInstance::test_selected_instance_http_truncate 0.3919s
accounts/tests.py::TestSelectedInstance::test_selected_instance_slash_truncate 0.3426s
accounts/tests.py::TestSelectedInstance::test_selected_instance_through_session 0.5942s
accounts/tests.py::TestSelectedInstance::test_unselected_instance 0.5954s
stats/tests.py::TestStats::test_all_daily_lang_stats 0.0008s
stats/tests.py::TestStats::test_posts_from_yesterday_are_updated 0.0692s
stats/tests.py::TestStats::test_store_daily_stats 0.0600s
stats/tests.py::TestStats::test_store_daily_stats_with_accounts 0.0613s