Pinned to Show and tell

• 7 You must be logged in to vote

  🙌

  Hugging Face Inference Endpoints now supports GGUF out of the box!

  ngxson started Sep 27, 2024 in Show and tell

  

  

  1

Discussions

• 36 You must be logged in to vote

  🙌

  Performance of llama.cpp on Apple Silicon M-series

  performance Speed related topics need feedback Testing and feedback with results are needed

  ggerganov started Nov 22, 2023 in Show and tell

  

  

  

  

  146
• 53 You must be logged in to vote

  🙌

  Tutorial: How to convert HuggingFace model to GGUF format

  samos123 started Sep 1, 2023 in Show and tell

  

  

  

  

  101
• 7 You must be logged in to vote

  🙌

  How to use the gguf-split / Model sharding demo

  split GGUF split model sharding

  phymbert started Mar 31, 2024 in Show and tell

  

  

  

  

  24
• 2 You must be logged in to vote

  🙌

  Nutshell 🐿️ - an AI meeting assistant powered by llama.cpp

  NutshellAI started Nov 8, 2024 in Show and tell

  

  

  0
• 7 You must be logged in to vote

  🙌

  tutorial : compute embeddings using llama.cpp

  ggerganov started Jun 3, 2024 in Show and tell

  

  

  

  

  7
• 14 You must be logged in to vote

  🙌

  Performance of llama.cpp on Apple Silicon A-series

  ggerganov started Dec 17, 2023 in Show and tell

  

  

  

  

  35
• 7 You must be logged in to vote

  🙌

  Introducing GGUF-my-LoRA

  ngxson started Nov 1, 2024 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  🙌

  Fedora 41 build script for ROCM (AMD)

  M4TH1EU started Oct 21, 2024 in Show and tell

  

  

  1
• 3 You must be logged in to vote

  🙌

  Python GGML model creation library

  iamlemec started Oct 14, 2024 in Show and tell

  

  

  2
• 1 You must be logged in to vote

  🙌

  Repository to help users get started with a Conda install of LLaMA C++

  davidrpugh started Oct 3, 2024 in Show and tell

  

  

  0
• 8 You must be logged in to vote

  🙌

  Running llama.cpp directly on iOS devices

  philippzagar started Dec 12, 2023 in Show and tell

  

  

  

  

  2
• 7 You must be logged in to vote

  🙌

  Huggingface GGUF Editor

  CISC started Sep 1, 2024 in Show and tell

  

  

  2
• 1 You must be logged in to vote

  🙌

  Reverse turing test

  steampunque started Sep 13, 2024 in Show and tell

  

  

  0
• 2 You must be logged in to vote

  🙌

  Samantha Interface Assistant: An Open Science Project

  controlecidadao started Sep 12, 2024 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  🙌

  Hey guys, I just made a simple little python program that lets you search the internet using LLMs running llama.cpp, feel free to check it out!

  TheBlewish started Sep 10, 2024 in Show and tell

  

  

  0
• 3 You must be logged in to vote

  🙌

  Distributed inference on Hugging Face Spaces

  rgerganov started Aug 23, 2024 in Show and tell

  

  

  0
• 27 You must be logged in to vote

  🙌

  Blind testing different quants: initial results + I need your help!

  Artefact2 started Mar 9, 2024 in Show and tell

  

  

  

  

  36
• 4 You must be logged in to vote

  🙌

  tutorial : parallel inference using Hugging Face dedicated endpoints

  ggerganov started Aug 15, 2024 in Show and tell

  

  

  1
• 4 You must be logged in to vote

  🙌

  Containers for Apple Silicon Macs work with GPU-accelerated Vulkan

  AndreasKunar started Jun 20, 2024 in Show and tell

  

  

  5
• 2 You must be logged in to vote

  🙌

  Effectively use LLamaCPP with Langchain - ChatModel, JSON Mode & Function Calling Support

  samuelint started Jul 8, 2024 in Show and tell

  

  

  0
• 4 You must be logged in to vote

  🙌

  FYI: Quantizations of LLaMA-2-7B-32K and Llama-2-7B-32K-Instruct (both trained w/ context lengths of 32K!) available in GGUF format

  rozek started Sep 1, 2023 in Show and tell

  

  

  

  

  12
• 2 You must be logged in to vote

  🙌

  Build and deploy llama-server on fly.io

  hazelnutcloud started Jun 20, 2024 in Show and tell

  

  

  0
• 37 You must be logged in to vote

  🙌

  Using llama.cpp with AWS instances

  ggerganov started Nov 26, 2023 in Show and tell

  

  

  

  

  22
• 4 You must be logged in to vote

  🙌

  Made a RAG-centric, Open-Source UI based on llama.cpp - With Advanced Source Citations & Referencing: Pinpointing Page-Numbers, Incorporating Extracted Images, Text-highlighting & Document-Readers alongside Local LLM-generated Responses

  abgulati started Jun 13, 2024 in Show and tell

  

  

  7