Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix longevity test runs #2065

Merged
merged 1 commit into from
May 30, 2024
Merged

Conversation

pleshakov
Copy link
Contributor

@pleshakov pleshakov commented May 30, 2024

Proposed changes

Problem:
Running longevity test mistakenly runs all other NFRs make start-longevity-test and make stop-longevity-test mistakenly executes all NFRs. Only longevity test must run.

Solution:
Problem was introduced in 18671fb
Ensure the env variables are exported so that they are passed to nfr-test target.

Testing:

  • Ran make start-longevity-test and make stop-longevity-test successfully.

CLOSES - #2064

Checklist

Before creating a PR, run through this checklist and mark each as complete.

  • I have read the CONTRIBUTING doc
  • [] I have added tests that prove my fix is effective or that my feature works
  • [] I have checked that all unit tests pass after adding my changes
  • [] I have updated necessary documentation
  • I have rebased my branch onto main
  • I will ensure my PR is targeting the main branch and pulling from my branch from my own fork

Release notes

If this PR introduces a change that affects users and needs to be mentioned in the release notes,
please add a brief note that summarizes the change.

NONE

@pleshakov pleshakov requested a review from a team as a code owner May 30, 2024 20:56
@github-actions github-actions bot added the tests Pull requests that update tests label May 30, 2024
@sjberman
Copy link
Contributor

Can we also fix line 130 since it likely suffers from the same issue?

tests/Makefile Outdated Show resolved Hide resolved
@lucacome
Copy link
Member

@sjberman line 130 works because it's just make and not calling a bash script

Problem:
Running longevity test mistakenly runs all other NFRs
make start-longevity-test and make stop-longevity-test mistakenly
executes all NFRs. Only longevity test must run.

Solution:
Problem was introduced in 8671fb7
Ensure the env variables are exported so that they are passed to nfr-test target.

Testing:
- Ran make start-longevity-test and make stop-longevity-test successfully.

CLOSES - nginxinc#2064
Copy link

codecov bot commented May 30, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.00%. Comparing base (d943b50) to head (1786098).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2065      +/-   ##
==========================================
+ Coverage   87.61%   95.00%   +7.38%     
==========================================
  Files          96        1      -95     
  Lines        6694      220    -6474     
  Branches       50       50              
==========================================
- Hits         5865      209    -5656     
+ Misses        773       11     -762     
+ Partials       56        0      -56     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@pleshakov pleshakov enabled auto-merge (squash) May 30, 2024 21:17
@pleshakov pleshakov disabled auto-merge May 30, 2024 21:19
@pleshakov pleshakov enabled auto-merge (squash) May 30, 2024 21:19
@pleshakov pleshakov merged commit ad9e003 into nginxinc:main May 30, 2024
40 checks passed
lucacome pushed a commit to lucacome/nginx-kubernetes-gateway that referenced this pull request May 31, 2024
Problem:
Running longevity test mistakenly runs all other NFRs
make start-longevity-test and make stop-longevity-test mistakenly
executes all NFRs. Only longevity test must run.

Solution:
Problem was introduced in 18671fb
Ensure the env variables are exported so that they are passed to nfr-test target.

Testing:
- Ran make start-longevity-test and make stop-longevity-test successfully.

CLOSES - nginxinc#2064
lucacome added a commit to lucacome/nginx-kubernetes-gateway that referenced this pull request May 31, 2024
* Fix longevity test runs (nginxinc#2065)

Problem:
Running longevity test mistakenly runs all other NFRs
make start-longevity-test and make stop-longevity-test mistakenly
executes all NFRs. Only longevity test must run.

Solution:
Problem was introduced in 18671fb
Ensure the env variables are exported so that they are passed to nfr-test target.

Testing:
- Ran make start-longevity-test and make stop-longevity-test successfully.

CLOSES - nginxinc#2064

* test notes

---------

Co-authored-by: Michael Pleshakov <pleshakov@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tests Pull requests that update tests
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

None yet

3 participants