Skip to content

Commit

Permalink
Update roadmap to include Snowflake + Trino. Also fix docs + update F…
Browse files Browse the repository at this point in the history
…AQ (#2175)

* Update roadmap to include Snowflake + Trino. Also fix some Gitbook artifacts / bugs on feature server documentation and add FAQ question on mixing clouds in Feast

Signed-off-by: Danny Chiao <danny@tecton.ai>

* Fix readme by running compile-templates

Signed-off-by: Danny Chiao <danny@tecton.ai>
  • Loading branch information
adchia authored Dec 31, 2021
1 parent 680a7af commit 3b211ba
Show file tree
Hide file tree
Showing 7 changed files with 36 additions and 35 deletions.
17 changes: 8 additions & 9 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@ The list below contains the functionality that contributors are planning to deve
* [x] [Hive (community plugin)](https://github.com/baineng/feast-hive)
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
* [x] Kafka source (with [push support into the online store](reference/alpha-stream-ingestion.md))
* [ ] Snowflake source (Planned for Q4 2021)
* [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
* [ ] HTTP source
* **Offline Stores**
* [x] [Redshift](https://docs.feast.dev/reference/offline-stores/redshift)
Expand All @@ -152,8 +152,8 @@ The list below contains the functionality that contributors are planning to deve
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
* [x] [In-memory / Pandas](https://docs.feast.dev/reference/offline-stores/file)
* [x] [Custom offline store support](https://docs.feast.dev/how-to-guides/adding-a-new-offline-store)
* [ ] Snowflake (Planned for Q4 2021)
* [ ] Trino (Planned for Q4 2021)
* [x] [Snowflake (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
* [x] [Trino (communiuty plugin)](https://github.com/Shopify/feast-trino)
* **Online Stores**
* [x] [DynamoDB](https://docs.feast.dev/reference/online-stores/dynamodb)
* [x] [Redis](https://docs.feast.dev/reference/online-stores/redis)
Expand All @@ -171,12 +171,12 @@ The list below contains the functionality that contributors are planning to deve
* [ ] Streaming ingestion on GCP
* **Feature Engineering**
* [x] On-demand Transformations (Alpha release. See [RFC](https://docs.google.com/document/d/1lgfIw0Drc65LpaxbUu49RCeJgMew547meSJttnUqz7c/edit#))
* [ ] Batch transformation (SQL)
* [ ] Batch transformation (SQL. In progress. See [RFC](https://docs.google.com/document/d/1964OkzuBljifDvkV-0fakp2uaijnVzdwWNGdz7Vz50A/edit))
* [ ] Streaming transformation
* **Deployments**
* [x] AWS Lambda (Alpha release. See [RFC](https://docs.google.com/document/d/1eZWKWzfBif66LDN32IajpaG-j82LSHCCOzY6R7Ax7MI/edit))
* [x] Kubernetes (See [guide](https://docs.feast.dev/how-to-guides/running-feast-in-production#4.3.-java-based-feature-server-deployed-on-kubernetes))
* [ ] Cloud Run
* [ ] Kubernetes
* [ ] KNative
* **Feature Serving**
* [x] Python Client
Expand All @@ -187,18 +187,17 @@ The list below contains the functionality that contributors are planning to deve
* [ ] Go Client
* [ ] Delete API
* [ ] Feature Logging (for training)
* **Data Quality Management**
* [ ] Data profiling and validation (Great Expectations) (Planned for Q4 2021)
* **Data Quality Management (See [RFC](https://docs.google.com/document/d/110F72d4NTv80p35wDSONxhhPBqWRwbZXG4f9mNEMd98/edit))**
* [ ] Data profiling and validation (Great Expectations) (Planned for Q1 2022)
* [ ] Metric production
* [ ] Training-serving skew detection
* [ ] Drift detection
* [ ] Alerting
* **Feature Discovery and Governance**
* [x] Python SDK for browsing feature registry
* [x] CLI for browsing feature registry
* [x] Model-centric feature tracking (feature services)
* [ ] REST API for browsing feature registry
* [ ] Feast Web UI (Planned for Q4 2021)
* [ ] Feast Web UI
* [ ] Feature versioning
* [ ] Amundsen integration

Expand Down
20 changes: 12 additions & 8 deletions docs/getting-started/faq.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,11 @@
# FAQ

{% hint style="info" %}
**Don't see your question?**

We encourage you to ask questions on [Slack](https://slack.feast.dev) or [Github](https://github.com/feast-dev/feast). Even better, once you get an answer, add the answer to this FAQ via a [pull request](../project/development-guide.md)!
{% endhint %}

## Getting started

### Do you have any examples of how Feast should be used?
Expand Down Expand Up @@ -44,7 +50,7 @@ Please see a detailed comparison of Feast vs. Tecton [here](https://www.tecton.a

### What are the performance/latency characteristics of Feast?

Feast is designed to work at scale and support low latency online serving. Benchmarks to be released soon, and active work is underway to support very latency sensitive use cases.
Feast is designed to work at scale and support low latency online serving. Benchmarks ([RFC](https://docs.google.com/document/d/12UuvTQnTTCJhdRgy6h10zSbInNGSyEJkIxpOcgOen1I/edit)) will be released soon, and active work is underway to support very latency sensitive use cases.

### Does Feast support embeddings and list features?

Expand All @@ -61,6 +67,10 @@ Yes. Specifically:

The list of supported offline and online stores can be found [here](../reference/offline-stores/) and [here](../reference/online-stores/), respectively. The [roadmap](../roadmap.md) indicates the stores for which we are planning to add support. Finally, our Provider abstraction is built to be extensible, so you can plug in your own implementations of offline and online stores. Please see more details about custom providers [here](../how-to-guides/creating-a-custom-provider.md).

### Does Feast support using different clouds for offline vs online stores?

Yes. Using a GCP or AWS provider in `feature_store.yaml` primarily sets default offline / online stores and configures where the remote registry file can live (Using the AWS provider also allows for deployment to AWS Lambda). You can override the offline and online stores to be in different clouds if you wish.

### How can I add a custom online store?

Please follow the instructions [here](../how-to-guides/adding-support-for-a-new-online-store.md).
Expand Down Expand Up @@ -100,10 +110,4 @@ For more details on contributing to the Feast community, see [here](../community

### What are the plans for Feast Core, Feast Serving, and Feast Spark?

Feast Core and Feast Serving were both part of Feast Java. We plan to support Feast Serving. We will not support Feast Core; instead we will support our object store based registry. We will not support Feast Spark. For more details on what we plan on supporting, please see the [roadmap](../roadmap.md).

{% hint style="info" %}
**Don't see your question?**

We encourage you to ask questions on [Slack](https://slack.feast.dev) or [Github](https://github.com/feast-dev/feast). Even better, once you get an answer, add the answer to this FAQ via a [pull request](../project/development-guide.md)!
{% endhint %}
Feast Core and Feast Serving were both part of Feast Java. We plan to support Feast Serving. We will not support Feast Core; instead we will support our object store based registry. We will not support Feast Spark. For more details on what we plan on supporting, please see the [roadmap](../roadmap.md).
2 changes: 1 addition & 1 deletion docs/getting-started/quickstart.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ In this tutorial we will

You can run this tutorial in Google Colab or run it on your localhost, following the guided steps below.

![](../.gitbook/assets/colab\_logo\_32px.png)[**Run in Google Colab**](https://colab.research.google.com/github/feast-dev/feast/blob/master/examples/quickstart/quickstart.ipynb)****
![](../.gitbook/assets/colab\_logo\_32px.png)[**Run in Google Colab**](https://colab.research.google.com/github/feast-dev/feast/blob/master/examples/quickstart/quickstart.ipynb)

## Overview

Expand Down
11 changes: 5 additions & 6 deletions docs/getting-started/third-party-integrations.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
We integrate with a wide set of tools and technologies so you can make Feast work in your existing stack. Many of these integrations are maintained as plugins to the main Feast repo.

{% hint style="info" %}
Don't see your offline store or online store of choice here? Check our our guides to make a custom one!
Don't see your offline store or online store of choice here? Check out our guides to make a custom one!

* [Adding a new offline store](../how-to-guides/adding-a-new-offline-store.md)
* [Adding a new online store](../how-to-guides/adding-support-for-a-new-online-store.md)
Expand All @@ -20,7 +20,7 @@ Don't see your offline store or online store of choice here? Check our our guide
* [x] [Hive (community plugin)](https://github.com/baineng/feast-hive)
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
* [x] Kafka source (with [push support into the online store](https://docs.feast.dev/reference/alpha-stream-ingestion))
* [ ] Snowflake source (Planned for Q4 2021)
* [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
* [ ] HTTP source

### Offline Stores
Expand All @@ -32,8 +32,8 @@ Don't see your offline store or online store of choice here? Check our our guide
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
* [x] [In-memory / Pandas](https://docs.feast.dev/reference/offline-stores/file)
* [x] [Custom offline store support](https://docs.feast.dev/how-to-guides/adding-a-new-offline-store)
* [ ] Snowflake (Planned for Q4 2021)
* [ ] Trino (Planned for Q4 2021)
* [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
* [x] [Trino (communiuty plugin)](https://github.com/Shopify/feast-trino)

### Online Stores

Expand All @@ -50,12 +50,11 @@ Don't see your offline store or online store of choice here? Check our our guide
### **Deployments**

* [x] AWS Lambda (Alpha release. See [guide](../reference/alpha-aws-lambda-feature-server.md) and [RFC](https://docs.google.com/document/d/1eZWKWzfBif66LDN32IajpaG-j82LSHCCOzY6R7Ax7MI/edit))
* [x] Kubernetes (See [guide](https://docs.feast.dev/how-to-guides/running-feast-in-production#4.3.-java-based-feature-server-deployed-on-kubernetes))
* [ ] Cloud Run
* [ ] Kubernetes
* [ ] KNative



## Standards

In order for a plugin integration to be highlighted on this page, it must meet the following requirements:
Expand Down
2 changes: 1 addition & 1 deletion docs/reference/alpha-aws-lambda-feature-server.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
**Warning**: This is an _experimental_ feature. It's intended for early testing and feedback, and could change without warnings in future releases.

{% hint style="info" %}
To enable this feature, run**`feast alpha enable aws_lambda_feature_server`**
To enable this feature, run **`feast alpha enable aws_lambda_feature_server`**
{% endhint %}

## Overview
Expand Down
2 changes: 1 addition & 1 deletion docs/reference/feature-server.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
**Warning**: This is an _experimental_ feature. It's intended for early testing and feedback, and could change without warnings in future releases.

{% hint style="info" %}
To enable this feature, run**`feast alpha enable python_feature_server`**
To enable this feature, run **`feast alpha enable python_feature_server`**
{% endhint %}

## Overview
Expand Down
17 changes: 8 additions & 9 deletions docs/roadmap.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ The list below contains the functionality that contributors are planning to deve
* [x] [Hive (community plugin)](https://github.com/baineng/feast-hive)
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
* [x] Kafka source (with [push support into the online store](reference/alpha-stream-ingestion.md))
* [ ] Snowflake source (Planned for Q4 2021)
* [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
* [ ] HTTP source
* **Offline Stores**
* [x] [Redshift](https://docs.feast.dev/reference/offline-stores/redshift)
Expand All @@ -24,8 +24,8 @@ The list below contains the functionality that contributors are planning to deve
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
* [x] [In-memory / Pandas](https://docs.feast.dev/reference/offline-stores/file)
* [x] [Custom offline store support](https://docs.feast.dev/how-to-guides/adding-a-new-offline-store)
* [ ] Snowflake (Planned for Q4 2021)
* [ ] Trino (Planned for Q4 2021)
* [x] [Snowflake (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
* [x] [Trino (communiuty plugin)](https://github.com/Shopify/feast-trino)
* **Online Stores**
* [x] [DynamoDB](https://docs.feast.dev/reference/online-stores/dynamodb)
* [x] [Redis](https://docs.feast.dev/reference/online-stores/redis)
Expand All @@ -43,12 +43,12 @@ The list below contains the functionality that contributors are planning to deve
* [ ] Streaming ingestion on GCP
* **Feature Engineering**
* [x] On-demand Transformations (Alpha release. See [RFC](https://docs.google.com/document/d/1lgfIw0Drc65LpaxbUu49RCeJgMew547meSJttnUqz7c/edit#))
* [ ] Batch transformation (SQL)
* [ ] Batch transformation (SQL. In progress. See [RFC](https://docs.google.com/document/d/1964OkzuBljifDvkV-0fakp2uaijnVzdwWNGdz7Vz50A/edit))
* [ ] Streaming transformation
* **Deployments**
* [x] AWS Lambda (Alpha release. See [RFC](https://docs.google.com/document/d/1eZWKWzfBif66LDN32IajpaG-j82LSHCCOzY6R7Ax7MI/edit))
* [x] Kubernetes (See [guide](https://docs.feast.dev/how-to-guides/running-feast-in-production#4.3.-java-based-feature-server-deployed-on-kubernetes))
* [ ] Cloud Run
* [ ] Kubernetes
* [ ] KNative
* **Feature Serving**
* [x] Python Client
Expand All @@ -59,17 +59,16 @@ The list below contains the functionality that contributors are planning to deve
* [ ] Go Client
* [ ] Delete API
* [ ] Feature Logging (for training)
* **Data Quality Management**
* [ ] Data profiling and validation (Great Expectations) (Planned for Q4 2021)
* **Data Quality Management (See [RFC](https://docs.google.com/document/d/110F72d4NTv80p35wDSONxhhPBqWRwbZXG4f9mNEMd98/edit))**
* [ ] Data profiling and validation (Great Expectations) (Planned for Q1 2022)
* [ ] Metric production
* [ ] Training-serving skew detection
* [ ] Drift detection
* [ ] Alerting
* **Feature Discovery and Governance**
* [x] Python SDK for browsing feature registry
* [x] CLI for browsing feature registry
* [x] Model-centric feature tracking (feature services)
* [ ] REST API for browsing feature registry
* [ ] Feast Web UI (Planned for Q4 2021)
* [ ] Feast Web UI
* [ ] Feature versioning
* [ ] Amundsen integration

0 comments on commit 3b211ba

Please sign in to comment.