Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Updating the batch field so that you can query create and event date. #3411

Merged

Conversation

franciscojavierarceo
Copy link
Member

@franciscojavierarceo franciscojavierarceo commented Dec 23, 2022

What this PR does / why we need it:

This PR allows users to call get_online_features or get_historical_features with the created or event_timestamp fields in the features function call and return the proper data.

Which issue(s) this PR fixes:

Fixes # #3412

@franciscojavierarceo franciscojavierarceo changed the title updating the batch field so that if you want return the created date … fox" updating the batch field so that if you want return the created date … Dec 23, 2022
@franciscojavierarceo franciscojavierarceo changed the title fox" updating the batch field so that if you want return the created date … fix: updating the batch field so that if you want return the created date … Dec 23, 2022
@franciscojavierarceo franciscojavierarceo changed the title fix: updating the batch field so that if you want return the created date … fix: Updating the batch field so that you can query create date. Dec 23, 2022
@franciscojavierarceo franciscojavierarceo marked this pull request as ready for review December 24, 2022 01:46
@franciscojavierarceo franciscojavierarceo changed the title fix: Updating the batch field so that you can query create date. fix: Updating the batch field so that you can query create and event date. Jan 3, 2023
@@ -599,6 +599,11 @@ def _normalize_timestamp(
created_timestamp_column_type = df_to_join_types[created_timestamp_column]

if not hasattr(timestamp_field_type, "tz") or timestamp_field_type.tz != pytz.UTC:
# if you are querying for the event timestamp field, we have to deduplicate
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not fully sure i understand what these duplicate columns are coming from? Can you leave more comments on why?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah i'll update the PR but basically querying for created in get_online_features duplicates the created_timestamp_column. So I could go deeper and try to fix the duplication but I needed a quick fix on my side and it works correctly for us.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@adchia updated the comment 👍

Copy link
Collaborator

@adchia adchia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: adchia, franciscojavierarceo

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

kysersozelee and others added 4 commits January 3, 2023 19:08
* fix: Add assertion condition when value is 0

Signed-off-by: zlatan.el <zlatan.el@kakaomobility.com>

* chore: Add comment about zero value validation

Signed-off-by: zlatan.el <zlatan.el@kakaomobility.com>

* chore: Modifiy the comment

Signed-off-by: zlatan.el <zlatan.el@kakaomobility.com>

* chore: Add the comment

Signed-off-by: zlatan.el <zlatan.el@kakaomobility.com>

Signed-off-by: zlatan.el <zlatan.el@kakaomobility.com>
Co-authored-by: zlatan.el <zlatan.el@kakaomobility.com>
Signed-off-by: franciscojavierarceo <francisco.arceo@affirm.com>
…of a model you can just add it in the get_online_features feature argument

Signed-off-by: franciscojavierarceo <francisco.arceo@affirm.com>
Signed-off-by: franciscojavierarceo <francisco.arceo@affirm.com>
Signed-off-by: franciscojavierarceo <francisco.arceo@affirm.com>
@franciscojavierarceo
Copy link
Member Author

sorry @adchia looks like I had to redo the sign off will need another stamp

@adchia
Copy link
Collaborator

adchia commented Jan 5, 2023

/lgtm

@feast-ci-bot feast-ci-bot merged commit 01ab462 into feast-dev:master Jan 5, 2023
kevjumba pushed a commit that referenced this pull request Jan 31, 2023
# [0.29.0](v0.28.0...v0.29.0) (2023-01-31)

### Bug Fixes

* Add check for bool type in addition to sample ([#3452](#3452)) ([1c7c491](1c7c491))
* Buggy SQL for postgres source ([#3424](#3424)) ([1ea100e](1ea100e))
* Ensure no duplicates in `fv.schema` ([#3460](#3460)) ([08ffa8d](08ffa8d))
* Fix delete sfv twice issue ([#3466](#3466)) ([dfd5eae](dfd5eae))
* Stream feature view UI shows transformation issue ([#3464](#3464)) ([1ef5137](1ef5137))
* Update registry.refresh to have a default arg ([#3450](#3450)) ([2f7c4ed](2f7c4ed))
* Updating the batch field so that you can query create and event date. ([#3411](#3411)) ([01ab462](01ab462)), closes [#3401](#3401)

### Features

* Add data source search ([#3449](#3449)) ([fbbb293](fbbb293))
* Adding list_validation_references for default and sql registry ([#3436](#3436)) ([21dd253](21dd253))
* Make UI accessible behind proxy ([#3428](#3428)) ([753d8db](753d8db))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants