Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add Firestore vector embedding support #421

Merged
merged 26 commits into from
Jul 25, 2024
Merged

Conversation

ferdeleong
Copy link
Collaborator

@ferdeleong ferdeleong commented Jun 20, 2024

Enable amenities and policies search with the new added Firebase vector k-nearest neighbor in version 2.16.0.

To support search functionality, it is required to cast amenities and policies field embedding to Vector type and create single-field vector indexing for both collections.

Finally k-nearest neighbor query with DOT_PRODUCT is applied to find the closest semantic similarity.

@ferdeleong ferdeleong self-assigned this Jun 20, 2024
@ferdeleong ferdeleong requested a review from a team as a code owner June 20, 2024 19:12
Copy link

🤖 I detect that the PR title and the commit message differ and there's only one commit. To use the PR title for the commit history, you can use Github's automerge feature with squashing, or use automerge label. Good luck human!

-- conventional-commit-lint bot
https://conventionalcommits.org/

@ferdeleong ferdeleong marked this pull request as draft June 20, 2024 19:12
@ferdeleong ferdeleong marked this pull request as ready for review July 15, 2024 19:57
@duwenxin99 duwenxin99 changed the title feat: Add vector indexing for amenities and policies collections feat: Add Firestore vector embedding support Jul 18, 2024
retrieval_service/requirements.txt Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/requirements.txt Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
@ferdeleong ferdeleong requested a review from kurtisvg July 23, 2024 04:57
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
retrieval_service/datastore/providers/firestore.py Outdated Show resolved Hide resolved
@ferdeleong ferdeleong merged commit 93ca72d into main Jul 25, 2024
13 checks passed
@ferdeleong ferdeleong deleted the Firestore-Vector-01 branch July 25, 2024 07:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants