Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transformerjs embeddings #4

Merged
merged 7 commits into from
Aug 28, 2023
Merged

Conversation

praveen-palanisamy
Copy link
Owner

This PR adds the ability to use HuggingFace transformers.js models to generate embeddings in the MemReFinder app. It allows the user to use the App in Hybrid mode depending on their preference and device capabilities.

The main changes are:

  • Added a dependency on HF transformers.js and a new embedding provider class that uses HF transformers.js models to generate embeddings.
  • Added an embeddings factory class that selects the appropriate embedding model based on the app mode.
  • Added a hybrid app mode that processes data locally to generate embeddings using HF transformers.js models and sends them to the backend service for retrieval.
  • Updated the welcome screen image with the latest app screenshot that shows the app mode selection option.
  • Removed old and unused launch configurations and added new ones for debugging the frontend and backend separately.

@vercel
Copy link

vercel bot commented Aug 28, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Updated (UTC)
memrefinder ✅ Ready (Inspect) Visit Preview Aug 28, 2023 6:22am

@praveen-palanisamy praveen-palanisamy merged commit 255c6d9 into main Aug 28, 2023
2 checks passed
@praveen-palanisamy praveen-palanisamy deleted the transformerjs-embeddings branch August 28, 2023 06:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant