Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(datastore): add Qdrant data store #2

Closed
joshua-mo-143 opened this issue Sep 2, 2024 · 1 comment · Fixed by #81
Closed

feat(datastore): add Qdrant data store #2

joshua-mo-143 opened this issue Sep 2, 2024 · 1 comment · Fixed by #81
Labels
vector store Integration of new vector stores

Comments

@joshua-mo-143
Copy link

joshua-mo-143 commented Sep 2, 2024

Hey there!

I think adding Qdrant as a possible data store would be quite beneficial for the library as they're fairly well known within the RAG community, so adding it would increase the amount of potential use cases by quite a lot.

I'm happy to implement this for you as it looks like the scope of this is quite clear (just adding a new crate and implementing relevant traits, then adding it to the list whenever you need to release), but wanted to reach out first and make sure it's OK to add.

@cvauclair
Copy link
Contributor

Hey @joshua-mo-143, excellent idea, we're always looking to add support for more vector data stores! Qdrant was not in our immediate implementation roadmap but if you want to integrate it, go for it! If you have any questions, we're more than happy to help out as well!

The integration should follow the same strategy as the MongoDB integration that is already part of the repo. As you mentioned, integration is pretty straightforward with you just having to implement the traits for whatever Qdrant client you want to use. If you could also include an example or two that would be perfect! In case you were wondering, the reason we're packaging the vector store integrations in separate crates is to keep the rig-core crate as lightweight as possible.

Note that we are still tweaking the Rig API and the traits mentioned above will most likely change over time. Additionally, if you find that the existing traits could be improved (e.g.: if they are not expressive enough to capture all of Qdrant's functionality) please let us know, Rig is still very early in its development and we're always looking for feedback!

Happy coding!

@mateobelanger mateobelanger changed the title feature suggestion: add Qdrant data store feat(datastore): add Qdrant data store Sep 4, 2024
@mateobelanger mateobelanger added the vector store Integration of new vector stores label Sep 4, 2024
@Anush008 Anush008 mentioned this issue Oct 29, 2024
8 tasks
cvauclair added a commit that referenced this issue Nov 29, 2024
cvauclair added a commit that referenced this issue Dec 17, 2024
* feat(chain): Initial prototype for agentic chain feature

* feat: Add chain error handling

* feat: Add parallel ops and rename `chain` to `pipeline`

* docs: Update example

* feat: Add extraction pipeline op

* docs: Add extraction pipeline example

* feat: Add `try_parallel!` pipeline op macro

* misc: Remove unused module

* style: cargo fmt

* test: fix typo in test

* test: fix typo in test #2

* test: Fix broken lookup op test

* feat: Add `Op::batch_call` and `TryOp::try_batch_call`

* test: Fix tests

* docs: Add more docstrings to agent pipeline ops

* docs: Add pipeline module level docs

* docs: improve pipeline docs

* style: clippy+fmt

* fix(pipelines): Type errors

* fix: Missing trait import in macros

* feat(pipeline): Add id and score to `lookup` op result

* docs(pipelines): Add more docstrings

* docs(pipelines): Update example

* test(mongodb): Fix flaky test again

* style: fmt

* test(mongodb): fix
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
vector store Integration of new vector stores
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants