Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

models(gallery): add phi-3.5-vision #3421

Merged
merged 1 commit into from
Aug 28, 2024
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 18 additions & 0 deletions gallery/index.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4636,6 +4636,24 @@
- filename: calme-2.1-phi3.5-4b.i1-Q4_K_M.gguf
sha256: 989eccacd52b6d9ebf2c06c35c363da19aadb125659a10df299b7130bc293e77
uri: huggingface://mradermacher/calme-2.1-phi3.5-4b-i1-GGUF/calme-2.1-phi3.5-4b.i1-Q4_K_M.gguf
- !!merge <<: *phi-3
name: "phi-3.5-vision-instruct"
urls:
- https://huggingface.co/microsoft/Phi-3.5-vision-instruct
- https://huggingface.co/abetlen/Phi-3.5-vision-instruct-gguf
description: |
Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which include - synthetic data and filtered publicly available websites - with a focus on very high-quality, reasoning dense data both on text and vision. The model belongs to the Phi-3 model family, and the multimodal version comes with 128K context length (in tokens) it can support. The model underwent a rigorous enhancement process, incorporating both supervised fine-tuning and direct preference optimization to ensure precise instruction adherence and robust safety measures.
overrides:
mmproj: Phi-3.5-3.8B-vision-instruct-mmproj-F16.gguf
parameters:
model: Phi-3.5-3.8B-vision-instruct-Q8_0.gguf
files:
- filename: Phi-3.5-3.8B-vision-instruct-Q8_0.gguf
sha256: ad0a1ee23ea9d88e932b493a4c077dea95c0f52a0f57a604509504c6ebc3df12
uri: huggingface://abetlen/Phi-3.5-vision-instruct-gguf/Phi-3.5-3.8B-vision-instruct-Q8_0.gguf
- filename: Phi-3.5-3.8B-vision-instruct-mmproj-F16.gguf
sha256: ab8449cc7527c21d7082a6ca8266f67a71b459019f67e814ae1683700e61f3f9
uri: huggingface://abetlen/Phi-3.5-vision-instruct-gguf/Phi-3.5-3.8B-vision-instruct-mmproj-F16.gguf
- &hermes-2-pro-mistral
### START Hermes
url: "github:mudler/LocalAI/gallery/hermes-2-pro-mistral.yaml@master"
Expand Down
Loading