Releases: bentoml/OpenLLM
v0.1.2
Installation
pip install openllm==0.1.2
To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.1.2
Usage
All available models: python -m openllm.models
To start a LLM: python -m openllm start dolly-v2
What's Changed
Full Changelog: v0.1.1...v0.1.2
v0.1.1
🎉 Hello world, OpenLLM
OpenLLM version 0.1.1 brings initial support for SOTA LLMs (more to come!!):
Model | CPU | GPU | Installation | Model Ids |
---|---|---|---|---|
flan-t5 | ✅ | ✅ |
pip install "openllm[flan-t5]" |
google/flan-t5-small google/flan-t5-base google/flan-t5-large google/flan-t5-xl google/flan-t5-xxl |
dolly-v2 | ✅ | ✅ |
pip install openllm |
databricks/dolly-v2-3b databricks/dolly-v2-7b databricks/dolly-v2-12b |
chatglm | ❌ | ✅ |
pip install "openllm[chatglm]" |
thudm/chatglm-6b thudm/chatglm-6b-int8 thudm/chatglm-6b-int4 |
starcoder | ❌ | ✅ |
pip install "openllm[starcoder]" |
bigcode/starcoder bigcode/starcoderbase |
falcon | ❌ | ✅ |
pip install "openllm[falcon]" |
tiiuae/falcon-7b tiiuae/falcon-40b tiiuae/falcon-7b-instruct tiiuae/falcon-40b-instruct |
stablelm | ✅ | ✅ |
pip install openllm |
stabilityai/stablelm-tuned-alpha-3b stabilityai/stablelm-tuned-alpha-7b stabilityai/stablelm-base-alpha-3b stabilityai/stablelm-base-alpha-7b |
Quickly startup falcon locally, with openllm start falcon
:
openllm start falcon
Easily bundle this LLM into Bento, a portable format that can be easily deployed everywhere:
openllm build falcon
Refers to the README.md for more details
Installation
pip install openllm==0.1.1
To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.1.1
Usage
All available models: python -m openllm.models
To start a LLM: python -m openllm start dolly-v2
Full Changelog: v0.1.0...v0.1.1
v0.1.0
Installation
pip install openllm==0.1.0
To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.1.0
Usage
All available models: python -m openllm.models
To start a LLM: python -m openllm start dolly-v2
What's Changed
Full Changelog: v0.0.34...v0.1.0
v0.0.34
Installation
pip install openllm==0.0.34
To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.0.34
Usage
All available models: python -m openllm.models
To start a LLM: python -m openllm start dolly-v2
Full Changelog: v0.0.33...v0.0.34
v0.0.33
Installation
pip install openllm==0.0.33
To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.0.33
Usage
All available models: python -m openllm.models
To start a LLM: python -m openllm start dolly-v2
Full Changelog: v0.0.32...v0.0.33
v0.0.32
Installation
pip install openllm==0.0.32
To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.0.32
Usage
All available models: python -m openllm.models
To start a LLM: python -m openllm start dolly-v2
Full Changelog: v0.0.31...v0.0.32
v0.0.31
Installation
pip install openllm==0.0.31
To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.0.31
Usage
All available models: python -m openllm.models
To start a LLM: python -m openllm start dolly-v2
Full Changelog: v0.0.30...v0.0.31
v0.0.30
Installation
pip install openllm==0.0.30
To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.0.30
Usage
All available models: python -m openllm.models
To start a LLM: python -m openllm start dolly-v2
Full Changelog: v0.0.29...v0.0.30
v0.0.27
Installation
pip install openllm==0.0.27
To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.0.27
Usage
All available models: python -m openllm.models
To start a LLM: python -m openllm start dolly-v2
Full Changelog: v0.0.26...v0.0.27
v0.0.26
Installation
pip install openllm==0.0.26
To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.0.26
Usage
All available models: python -m openllm.models
To start a LLM: python -m openllm start dolly-v2
Full Changelog: v0.0.25...v0.0.26