Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

adds support for nomic-embed-vision-v1.5 image embeddings model #129

Merged
merged 2 commits into from
Nov 27, 2024

Conversation

rozgo
Copy link
Contributor

@rozgo rozgo commented Nov 26, 2024

nomic-embed-vision-v1.5 image embeddings that shares the same embedding space as nomic-embed-text-v1.5

Includes a test that outputs the similarity matrix between image and text. First column is blue cat, second is red cat:

green cat: [0.07165963, 0.067335285]
blue cat: [0.09806663, 0.055019084]
red cat: [0.06977239, 0.10732647]
yellow cat: [0.07075872, 0.071573]
dog: [0.035324473, 0.020524085]

@Anush008
Copy link
Owner

Thanks @rozgo

@Anush008 Anush008 merged commit 76751ec into Anush008:main Nov 27, 2024
1 check passed
github-actions bot pushed a commit that referenced this pull request Nov 27, 2024
# [4.3.0](v4.2.1...v4.3.0) (2024-11-27)

### Features

* Support for nomic-embed-vision-v1.5 image embeddings model ([#129](#129)) ([76751ec](76751ec))

## [4.3.0](v4.2.1...v4.3.0) (2024-11-27)

### 🍕 Features

* Support for nomic-embed-vision-v1.5 image embeddings model ([#129](#129)) ([76751ec](76751ec))
Copy link

🎉 This PR is included in version 4.3.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

greenhat616 added a commit to gety-ai/fastembed-rs that referenced this pull request Dec 2, 2024
* chore: bump ort recv

* docs: Support notice in README.md (Anush008#123)

Signed-off-by: Anush008 <anushshetty90@gmail.com>

* chore: Bump ort to 2.0.0.-rc8 with "ort/half" enabled (Anush008#124)

* chore(release): 4.1.1 [skip ci]

## [4.1.1](Anush008/fastembed-rs@v4.1.0...v4.1.1) (2024-11-21)

## [4.1.1](Anush008/fastembed-rs@v4.1.0...v4.1.1) (2024-11-21)

### 📝 Documentation

* Support notice in README.md ([Anush008#123](Anush008#123)) ([a3794de](Anush008@a3794de))

### 🧹 Chores

* Bump ort to 2.0.0.-rc8 with "ort/half" enabled ([Anush008#124](Anush008#124)) ([f4844a8](Anush008@f4844a8))

* chore: Bump ort to v2.0.0-rc.9 (Anush008#125)

* chore: Bump ort to v2.0.0-rc.9

Signed-off-by: Anush008 <anushshetty90@gmail.com>

* refactor: Dedup imports

Signed-off-by: Anush008 <anushshetty90@gmail.com>

* ci: Custom link v1.20.1 ONNX build

Signed-off-by: Anush008 <anushshetty90@gmail.com>

* chore: no 'half'

---------

Signed-off-by: Anush008 <anushshetty90@gmail.com>

* chore(release): 4.1.2 [skip ci]

## [4.1.2](Anush008/fastembed-rs@v4.1.1...v4.1.2) (2024-11-22)

## [4.1.2](Anush008/fastembed-rs@v4.1.1...v4.1.2) (2024-11-22)

### 🧹 Chores

* Bump ort to v2.0.0-rc.9 ([Anush008#125](Anush008#125)) ([87f4ced](Anush008@87f4ced))

* ci: Use ONNX version as cache key for the ONNX cache (Anush008#127)


Signed-off-by: Anush008 <anushshetty90@gmail.com>

* feat: Added ClipVitB32 model to support text-to-image search. (Anush008#126)

* chore(release): 4.2.0 [skip ci]

# [4.2.0](Anush008/fastembed-rs@v4.1.2...v4.2.0) (2024-11-23)

### Features

* Added ClipVitB32 model to support text-to-image search. ([Anush008#126](Anush008#126)) ([a890a61](Anush008@a890a61))

## [4.2.0](Anush008/fastembed-rs@v4.1.2...v4.2.0) (2024-11-23)

### 🍕 Features

* Added ClipVitB32 model to support text-to-image search. ([Anush008#126](Anush008#126)) ([a890a61](Anush008@a890a61))

### 🔁 Continuous Integration

* Use ONNX version as cache key for the ONNX cache ([Anush008#127](Anush008#127)) ([f19a540](Anush008@f19a540))

* refactor: Turn most panics into recoverable errors (Anush008#128)

* for image embeddings, turn some panics into returned errors

* turn more panics into recoverable errors

* Simplify collection of image embeddings

Co-authored-by: Anush  <anushshetty90@gmail.com>

* Pass errors in sparse text embedding and reranking batches onto the user instead of panicking

* fix warnings: only import anyhow::Context if online feature enabled

* cargo fmt

---------

Co-authored-by: Anush <anushshetty90@gmail.com>

* chore(release): 4.2.1 [skip ci]

## [4.2.1](Anush008/fastembed-rs@v4.2.0...v4.2.1) (2024-11-26)

## [4.2.1](Anush008/fastembed-rs@v4.2.0...v4.2.1) (2024-11-26)

### 🧑‍💻 Code Refactoring

* Turn most panics into recoverable errors ([Anush008#128](Anush008#128)) ([86594fc](Anush008@86594fc))

* feat: Support for nomic-embed-vision-v1.5 image embeddings model (Anush008#129)

* adds support for nomic-embed-vision-v1.5 image embeddings model

* ignore optional test

* chore(release): 4.3.0 [skip ci]

# [4.3.0](Anush008/fastembed-rs@v4.2.1...v4.3.0) (2024-11-27)

### Features

* Support for nomic-embed-vision-v1.5 image embeddings model ([Anush008#129](Anush008#129)) ([76751ec](Anush008@76751ec))

## [4.3.0](Anush008/fastembed-rs@v4.2.1...v4.3.0) (2024-11-27)

### 🍕 Features

* Support for nomic-embed-vision-v1.5 image embeddings model ([Anush008#129](Anush008#129)) ([76751ec](Anush008@76751ec))

* chore: bump onnx version to 1.20.1

---------

Signed-off-by: Anush008 <anushshetty90@gmail.com>
Co-authored-by: Anush008 <anushshetty90@gmail.com>
Co-authored-by: Daniel Boros <56868953+dancixx@users.noreply.github.com>
Co-authored-by: Bernard van Gastel <bvgastel@bitpowder.com>
Co-authored-by: llenck <lialenck@protonmail.com>
Co-authored-by: Alex Rozgo <alex.rozgo@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants