Skip to content
This repository has been archived by the owner on Dec 1, 2022. It is now read-only.

Make SparkOfflineStore compatible with interface change in feast>=0.17 #15

Merged
merged 18 commits into from
Feb 25, 2022

Conversation

jbvaningen
Copy link
Contributor

@jbvaningen jbvaningen commented Feb 24, 2022

Summary

  • Extended SparkOfflineStore functionality to work with feast>=0.17
  • Migrated to setuptools_scm for versioning
  • Updated tests to make them runnable in parallel
  • Reformatted code a bit (mostly imports and using kwargs in more places)
  • PR also includes changes from upstream main that were not included in upstream develop

Tested scenarios

Ran all tests

Fixed issue

#14

thijsbrits and others added 11 commits December 22, 2021 10:54
Update readme to reflect Adyen template and add code owners
* Add github actions workflow based on python-package.yaml example

* Black format repository

* Install dev requirements with workflow

* Update setup.py to only include dev as extra requires

* Install package with dev requirements in github action workflow

* Remove support for python 3.7

* Add workflow to publish to Python on release

Co-authored-by: thijsbrits <thijsbrits@users.noreply.github.com>
First release with bumped version
# interface of offline_utils.get_feature_view_query_context changed in feast==0.17
arg_spec = inspect.getfullargspec(func=offline_utils.get_feature_view_query_context)
if "entity_df_timestamp_range" in arg_spec.args:
# for feast>=0.17
Copy link
Contributor

@ohommos ohommos Feb 24, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see we're trying to support across few versions; we should update requirements in setup.py to reflect that.
I't also be fine dropping support for older versions altogether. Users of this plugin can update it when updating feast in one-go.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

setup.py mentions feast>=0.15.0 which is correct. If we'd choose to not support backwards compatibility we would have to update the requirements.

I vote to keep it like this for now, this also allows us to decouple upgrading feast from upgrading feast-spark-offline-store

setup.py Outdated Show resolved Hide resolved
@jbvaningen jbvaningen changed the title #14 Make SparkOfflineStore compatible with interface change in feast>=0.17 Make SparkOfflineStore compatible with interface change in feast>=0.17 Feb 25, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants