Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Fix for historical field mappings #2252

Merged

Conversation

michelle-rascati-sp
Copy link
Contributor

What this PR does / why we need it:
Uses field mapping to convert feature names into column names, and back to feature names for Redshift and DyanmoDB data sources when calling get_historical_features()

Which issue(s) this PR fixes:

Fixes #2248

Does this PR introduce a user-facing change?:

get_historical_features() should now work with field_mappings

Signed-off-by: Michelle Rascati <michelle.rascati@sailpoint.com>
Copy link
Collaborator

@felixwang9817 felixwang9817 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: felixwang9817, michelle-rascati-sp

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@felixwang9817
Copy link
Collaborator

@michelle-rascati-sp thanks for noticing the issue and the quick fix!

@feast-ci-bot feast-ci-bot merged commit 592af75 into feast-dev:master Jan 28, 2022
feast-ci-bot pushed a commit that referenced this pull request Jan 31, 2022
* Add backticks to left_table_query_string (#2250)

Signed-off-by: david <davidmiller252@gmail.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Delete entity key from Redis only when all attached feature views are gone (#2240)

* Delete entity from redis when the last attached feature view is deleted

Signed-off-by: pyalex <moskalenko.alexey@gmail.com>

* Delete entity key from Redis only when all attached feature views are gone

Signed-off-by: pyalex <moskalenko.alexey@gmail.com>

* make lint happy

Signed-off-by: pyalex <moskalenko.alexey@gmail.com>

* make lint happy

Signed-off-by: pyalex <moskalenko.alexey@gmail.com>

* one more try with mypy

Signed-off-by: pyalex <moskalenko.alexey@gmail.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* historical_field_mappings2 merge for one sign off commit (#2252)

Signed-off-by: Michelle Rascati <michelle.rascati@sailpoint.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Correct inconsistent dependency (#2255)

Signed-off-by: Judah Rand <17158624+judahrand@users.noreply.github.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Add snowflake environment variables to allow testing on snowflake infra (#2258)

* add snowflake environment vars to test framework

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* add snowflake environment vars to test framework

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Return `UNIX_TIMESTAMP` as Python `datetime` (#2244)

* Refactor `UNIX_TIMESTAMP` conversion

Signed-off-by: Judah Rand <17158624+judahrand@users.noreply.github.com>

* Return `UNIX_TIMESTAMP` types as `datetime` to user

Signed-off-by: Judah Rand <17158624+judahrand@users.noreply.github.com>

* Fix linting errors

Signed-off-by: Judah Rand <17158624+judahrand@users.noreply.github.com>

* Rename variable to something more sensible

Signed-off-by: Judah Rand <17158624+judahrand@users.noreply.github.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Feast plan clean up (#2256)

* Run validation and inference on views and entities during plan

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Do not log objects that are unchanged

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Rename Fco to FeastObject

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Remove useless method

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Lint

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Always initialize registry during feature store initialization

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Fix usage test

Signed-off-by: Felix Wang <wangfelix98@gmail.com>

* Remove print statements

Signed-off-by: Felix Wang <wangfelix98@gmail.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Squash commits

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Add error type and refactor query execution to have retries

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Handle more snowflake errors

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Fix lint errors

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Fix lint errors

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Fix lint errors

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* Fix wrong import

Signed-off-by: Danny Chiao <danny@tecton.ai>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* modify registry.db s3 object initialization to work in S3 subdirectory with Java Feast Server (#2259)

Signed-off-by: NalinGHub <nalinm01@gmail.com>
Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* clean up docs

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* lint-python

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* fixed historical test

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

* fixed historical test

Signed-off-by: sfc-gh-madkins <miles.adkins@snowflake.com>

Co-authored-by: David Miller <david@patagona.ca>
Co-authored-by: Oleksii Moskalenko <moskalenko.alexey@gmail.com>
Co-authored-by: Michelle Rascati <44408275+michelle-rascati-sp@users.noreply.github.com>
Co-authored-by: Judah Rand <17158624+judahrand@users.noreply.github.com>
Co-authored-by: Felix Wang <wangfelix98@gmail.com>
Co-authored-by: Danny Chiao <danny@tecton.ai>
Co-authored-by: Nalin Mehra <37969183+NalinGHub@users.noreply.github.com>
# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Python SDK get_historical_features does not use field mappings.
4 participants