Skip to content

Commit

Permalink
Change test model
Browse files Browse the repository at this point in the history
  • Loading branch information
mudler committed Feb 8, 2024
1 parent e7f62c2 commit 2cee605
Show file tree
Hide file tree
Showing 2 changed files with 9 additions and 2 deletions.
2 changes: 1 addition & 1 deletion Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -317,7 +317,7 @@ run: prepare ## run local-ai
test-models/testmodel:
mkdir test-models
mkdir test-dir
wget -q https://huggingface.co/TheBloke/stable-code-3b-GGUF/resolve/main/stable-code-3b.Q2_K.gguf -O test-models/testmodel
wget -q https://huggingface.co/TheBloke/orca_mini_3B-GGML/resolve/main/orca-mini-3b.ggmlv3.q4_0.bin -O test-models/testmodel
wget -q https://huggingface.co/ggerganov/whisper.cpp/resolve/main/ggml-base.en.bin -O test-models/whisper-en
wget -q https://huggingface.co/mudler/all-MiniLM-L6-v2/resolve/main/ggml-model-q4_0.bin -O test-models/bert
wget -q https://cdn.openai.com/whisper/draft-20220913a/micro-machines.wav -O test-dir/audio.wav
Expand Down
9 changes: 8 additions & 1 deletion api/api_test.go
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,14 @@ import (
"github.com/sashabaranov/go-openai/jsonschema"
)

const testPrompt = "import torch\nimport torch.nn as nn"
const testPrompt = `### System:
You are an AI assistant that follows instruction extremely well. Help as much as you can.
### User:
Can you help rephrasing sentences?
### Response:`

type modelApplyRequest struct {
ID string `json:"id"`
Expand Down

0 comments on commit 2cee605

Please sign in to comment.