test flake #782

joseph-sentry · 2024-08-29T18:19:27Z

No description provided.

codecov-staging · 2024-08-29T18:29:15Z

❌ 1 Tests Failed:

Tests completed	Failed	Passed	Skipped
2267	1	2266	6

View the top 1 failed tests by shortest run time

billing.tests.test_views.StripeWebhookHandlerTests test_customer_subscription_deleted_deactivates_all_repos

Stack Traces | 0.017s run time

self = &lt;billing.tests.test_views.StripeWebhookHandlerTests testMethod=test_customer_subscription_deleted_deactivates_all_repos&gt;

    def test_customer_subscription_deleted_deactivates_all_repos(self):
        # RepositoryFactory(author=self.owner, activated=True, active=True)
        RepositoryFactory(author=self.owner, activated=True, active=True)
        RepositoryFactory(author=self.owner, activated=True, active=True)
    
&gt;       assert (
            self.owner.repository_set.filter(activated=True, active=True).count() == 3
        )
E       assert 2 == 3
E        +  where 2 = &lt;bound method QuerySet.count of &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt;&gt;()
E        +    where &lt;bound method QuerySet.count of &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt;&gt; = &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt;.count
E        +      where &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt; = &lt;bound method QuerySet.filter of &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt;&gt;(activated=True, active=True)
E        +        where &lt;bound method QuerySet.filter of &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt;&gt; = &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt;.filter
E        +          where &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt; = &lt;Owner: Owner&lt;github/eduardohartman&gt;&gt;.repository_set
E        +            where &lt;Owner: Owner&lt;github/eduardohartman&gt;&gt; = &lt;billing.tests.test_views.StripeWebhookHandlerTests testMethod=test_customer_subscription_deleted_deactivates_all_repos&gt;.owner

billing/tests/test_views.py:151: AssertionError

To view individual test run time comparison to the main branch, go to the Test Analytics Dashboard

codecov-qa · 2024-08-29T18:29:20Z

❌ 1 Tests Failed:

Tests completed	Failed	Passed	Skipped
2267	1	2266	6

View the top 1 failed tests by shortest run time

billing.tests.test_views.StripeWebhookHandlerTests test_customer_subscription_deleted_deactivates_all_repos

Stack Traces | 0.017s run time

self = &lt;billing.tests.test_views.StripeWebhookHandlerTests testMethod=test_customer_subscription_deleted_deactivates_all_repos&gt;

    def test_customer_subscription_deleted_deactivates_all_repos(self):
        # RepositoryFactory(author=self.owner, activated=True, active=True)
        RepositoryFactory(author=self.owner, activated=True, active=True)
        RepositoryFactory(author=self.owner, activated=True, active=True)
    
&gt;       assert (
            self.owner.repository_set.filter(activated=True, active=True).count() == 3
        )
E       assert 2 == 3
E        +  where 2 = &lt;bound method QuerySet.count of &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt;&gt;()
E        +    where &lt;bound method QuerySet.count of &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt;&gt; = &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt;.count
E        +      where &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt; = &lt;bound method QuerySet.filter of &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt;&gt;(activated=True, active=True)
E        +        where &lt;bound method QuerySet.filter of &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt;&gt; = &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt;.filter
E        +          where &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt; = &lt;Owner: Owner&lt;github/eduardohartman&gt;&gt;.repository_set
E        +            where &lt;Owner: Owner&lt;github/eduardohartman&gt;&gt; = &lt;billing.tests.test_views.StripeWebhookHandlerTests testMethod=test_customer_subscription_deleted_deactivates_all_repos&gt;.owner

billing/tests/test_views.py:151: AssertionError

To view individual test run time comparison to the main branch, go to the Test Analytics Dashboard

codecov-public-qa · 2024-08-29T18:29:25Z

Test Failures Detected: Due to failing tests, we cannot provide coverage reports at this time.

❌ Failed Test Results:

Completed 2273 tests with 1 failed, 2266 passed and 6 skipped.

View the full list of failed tests

pytest

Class name: billing.tests.test_views.StripeWebhookHandlerTests
Test name: test_customer_subscription_deleted_deactivates_all_repos

self = <billing.tests.test_views.StripeWebhookHandlerTests testMethod=test_customer_subscription_deleted_deactivates_all_repos>

    def test_customer_subscription_deleted_deactivates_all_repos(self):
        # RepositoryFactory(author=self.owner, activated=True, active=True)
        RepositoryFactory(author=self.owner, activated=True, active=True)
        RepositoryFactory(author=self.owner, activated=True, active=True)
    
>       assert (
            self.owner.repository_set.filter(activated=True, active=True).count() == 3
        )
E       assert 2 == 3
E        +  where 2 = <bound method QuerySet.count of <RepositoryQuerySet [<Repository: Repo<Owner<github/eduardohartman>/little>>, <Repository: Repo<Owner<github/eduardohartman>/which>>]>>()
E        +    where <bound method QuerySet.count of <RepositoryQuerySet [<Repository: Repo<Owner<github/eduardohartman>/little>>, <Repository: Repo<Owner<github/eduardohartman>/which>>]>> = <RepositoryQuerySet [<Repository: Repo<Owner<github/eduardohartman>/little>>, <Repository: Repo<Owner<github/eduardohartman>/which>>]>.count
E        +      where <RepositoryQuerySet [<Repository: Repo<Owner<github/eduardohartman>/little>>, <Repository: Repo<Owner<github/eduardohartman>/which>>]> = <bound method QuerySet.filter of <django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.<locals>.RelatedManager object at 0x7f1b2ac68f80>>(activated=True, active=True)
E        +        where <bound method QuerySet.filter of <django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.<locals>.RelatedManager object at 0x7f1b2ac68f80>> = <django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.<locals>.RelatedManager object at 0x7f1b2ac68f80>.filter
E        +          where <django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.<locals>.RelatedManager object at 0x7f1b2ac68f80> = <Owner: Owner<github/eduardohartman>>.repository_set
E        +            where <Owner: Owner<github/eduardohartman>> = <billing.tests.test_views.StripeWebhookHandlerTests testMethod=test_customer_subscription_deleted_deactivates_all_repos>.owner

billing/tests/test_views.py:151: AssertionError

codecov · 2024-08-29T18:30:29Z

❌ 1 Tests Failed:

Tests completed	Failed	Passed	Skipped
2267	1	2266	6

View the full list of 1 ❄️ flaky tests

billing.tests.test_views.StripeWebhookHandlerTests test_customer_subscription_deleted_deactivates_all_repos

Flake rate in main: 16.666666666666664% (Passed 20 times, Failed 4 times)

Stack Traces | 0.017s run time

self = &lt;billing.tests.test_views.StripeWebhookHandlerTests testMethod=test_customer_subscription_deleted_deactivates_all_repos&gt;

    def test_customer_subscription_deleted_deactivates_all_repos(self):
        # RepositoryFactory(author=self.owner, activated=True, active=True)
        RepositoryFactory(author=self.owner, activated=True, active=True)
        RepositoryFactory(author=self.owner, activated=True, active=True)
    
&gt;       assert (
            self.owner.repository_set.filter(activated=True, active=True).count() == 3
        )
E       assert 2 == 3
E        +  where 2 = &lt;bound method QuerySet.count of &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt;&gt;()
E        +    where &lt;bound method QuerySet.count of &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt;&gt; = &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt;.count
E        +      where &lt;RepositoryQuerySet [&lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/little&gt;&gt;, &lt;Repository: Repo&lt;Owner&lt;github/eduardohartman&gt;/which&gt;&gt;]&gt; = &lt;bound method QuerySet.filter of &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt;&gt;(activated=True, active=True)
E        +        where &lt;bound method QuerySet.filter of &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt;&gt; = &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt;.filter
E        +          where &lt;django.db.models.fields.related_descriptors.create_reverse_many_to_one_manager.&lt;locals&gt;.RelatedManager object at 0x7f1b2ac68f80&gt; = &lt;Owner: Owner&lt;github/eduardohartman&gt;&gt;.repository_set
E        +            where &lt;Owner: Owner&lt;github/eduardohartman&gt;&gt; = &lt;billing.tests.test_views.StripeWebhookHandlerTests testMethod=test_customer_subscription_deleted_deactivates_all_repos&gt;.owner

billing/tests/test_views.py:151: AssertionError

To view individual test run time comparison to the main branch, go to the Test Analytics Dashboard

test flake

4f74b56

thomasrockhu-codecov mentioned this pull request Sep 10, 2024

Let's talk about the CI situation nodejs/TSC#1614

Open

joseph-sentry closed this Sep 18, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

test flake #782

test flake #782

joseph-sentry commented Aug 29, 2024

codecov-staging bot commented Aug 29, 2024 •

edited

Loading

codecov-qa bot commented Aug 29, 2024 •

edited

Loading

codecov-public-qa bot commented Aug 29, 2024 •

edited

Loading

pytest

codecov bot commented Aug 29, 2024 •

edited

Loading

test flake #782

test flake #782

Conversation

joseph-sentry commented Aug 29, 2024

codecov-staging bot commented Aug 29, 2024 • edited Loading

❌ 1 Tests Failed:

codecov-qa bot commented Aug 29, 2024 • edited Loading

❌ 1 Tests Failed:

codecov-public-qa bot commented Aug 29, 2024 • edited Loading

❌ Failed Test Results:

pytest

codecov bot commented Aug 29, 2024 • edited Loading

❌ 1 Tests Failed:

codecov-staging bot commented Aug 29, 2024 •

edited

Loading

codecov-qa bot commented Aug 29, 2024 •

edited

Loading

codecov-public-qa bot commented Aug 29, 2024 •

edited

Loading

codecov bot commented Aug 29, 2024 •

edited

Loading