Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix feature server docker image tag generation in pr integration tests #2077

Merged

Conversation

tsotnet
Copy link
Collaborator

@tsotnet tsotnet commented Nov 19, 2021

Signed-off-by: Tsotne Tabidze tsotne@tecton.ai

What this PR does / why we need it: Sometimes is can happen that build-docker-image and integration-test-python workflows run on different git commit hashes. This is because the HEAD commit hash is a merge commit of master and current PR HEAD. If the master gets updated between these 2 workflows, the HEAD commit hash changes, causing integration tests to try to use a wrong feature server docker image tag.

Instead, we'll be setting the commit hash as a workflow output in build-docker-image, then pass it to integration-test-python as an environment variable and use that in integration tests. This will guarantee that the same tag is being used.

Which issue(s) this PR fixes:

Fixes #

Does this PR introduce a user-facing change?:

NONE

Signed-off-by: Tsotne Tabidze <tsotne@tecton.ai>
@codecov-commenter
Copy link

codecov-commenter commented Nov 19, 2021

Codecov Report

Merging #2077 (75bf9f8) into master (3917d5a) will decrease coverage by 25.12%.
The diff coverage is 25.00%.

Impacted file tree graph

@@             Coverage Diff             @@
##           master    #2077       +/-   ##
===========================================
- Coverage   83.31%   58.18%   -25.13%     
===========================================
  Files         100      100               
  Lines        8084     8084               
===========================================
- Hits         6735     4704     -2031     
- Misses       1349     3380     +2031     
Flag Coverage Δ
integrationtests ?
unittests 58.18% <25.00%> (-0.02%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
sdk/python/feast/infra/aws.py 24.15% <0.00%> (-48.45%) ⬇️
sdk/python/feast/constants.py 100.00% <100.00%> (ø)
.../integration/online_store/test_online_retrieval.py 17.39% <0.00%> (-82.61%) ⬇️
.../integration/online_store/test_universal_online.py 15.34% <0.00%> (-82.33%) ⬇️
...fline_store/test_universal_historical_retrieval.py 19.29% <0.00%> (-80.12%) ⬇️
sdk/python/tests/utils/online_read_write_test.py 20.68% <0.00%> (-79.32%) ⬇️
...gration/registration/test_feature_service_apply.py 31.25% <0.00%> (-68.75%) ⬇️
sdk/python/feast/infra/online_stores/redis.py 26.97% <0.00%> (-67.11%) ⬇️
sdk/python/tests/data/data_creator.py 34.78% <0.00%> (-65.22%) ⬇️
sdk/python/tests/integration/e2e/test_usage_e2e.py 35.00% <0.00%> (-65.00%) ⬇️
... and 51 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3917d5a...75bf9f8. Read the comment docs.

Signed-off-by: Tsotne Tabidze <tsotne@tecton.ai>
Copy link
Collaborator

@adchia adchia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: adchia, tsotnet

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@@ -37,3 +37,6 @@

# Default FTS port
DEFAULT_FEATURE_TRANSFORMATION_SERVER_PORT = 6569

# Environment variable for feature server docker image tag
DOCKER_IMAGE_TAG_ENV_NAME: str = "FEAST_SERVER_DOCKER_IMAGE_TAG"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't DOCKER_IMAGE_TAG_ENV_NAME be something "feature server" specific?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why would we use different tags for different servers? Also, we could always rename this if the necessity arises. It won't break anything.

@achals achals merged commit 27bf63c into feast-dev:master Nov 20, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants