Skip to content

Releases: bentoml/OpenLLM

v0.1.2

13 Jun 11:19
Compare
Choose a tag to compare

Installation

pip install openllm==0.1.2

To upgrade from a previous version, use the following command:

pip install --upgrade openllm==0.1.2

Usage

All available models: python -m openllm.models

To start a LLM: python -m openllm start dolly-v2

What's Changed

Full Changelog: v0.1.1...v0.1.2

v0.1.1

12 Jun 20:24
Compare
Choose a tag to compare

🎉 Hello world, OpenLLM

OpenLLM version 0.1.1 brings initial support for SOTA LLMs (more to come!!):

Model CPU GPU Installation Model Ids
flan-t5
pip install "openllm[flan-t5]"
  • google/flan-t5-small
  • google/flan-t5-base
  • google/flan-t5-large
  • google/flan-t5-xl
  • google/flan-t5-xxl
  • dolly-v2
    pip install openllm
  • databricks/dolly-v2-3b
  • databricks/dolly-v2-7b
  • databricks/dolly-v2-12b
  • chatglm
    pip install "openllm[chatglm]"
  • thudm/chatglm-6b
  • thudm/chatglm-6b-int8
  • thudm/chatglm-6b-int4
  • starcoder
    pip install "openllm[starcoder]"
  • bigcode/starcoder
  • bigcode/starcoderbase
  • falcon
    pip install "openllm[falcon]"
  • tiiuae/falcon-7b
  • tiiuae/falcon-40b
  • tiiuae/falcon-7b-instruct
  • tiiuae/falcon-40b-instruct
  • stablelm
    pip install openllm
  • stabilityai/stablelm-tuned-alpha-3b
  • stabilityai/stablelm-tuned-alpha-7b
  • stabilityai/stablelm-base-alpha-3b
  • stabilityai/stablelm-base-alpha-7b
  • Quickly startup falcon locally, with openllm start falcon:

    openllm start falcon

    Easily bundle this LLM into Bento, a portable format that can be easily deployed everywhere:

    openllm build falcon

    Refers to the README.md for more details

    Installation

    pip install openllm==0.1.1

    To upgrade from a previous version, use the following command:

    pip install --upgrade openllm==0.1.1

    Usage

    All available models: python -m openllm.models

    To start a LLM: python -m openllm start dolly-v2

    Full Changelog: v0.1.0...v0.1.1

    v0.1.0

    12 Jun 18:39
    Compare
    Choose a tag to compare

    Installation

    pip install openllm==0.1.0

    To upgrade from a previous version, use the following command:

    pip install --upgrade openllm==0.1.0

    Usage

    All available models: python -m openllm.models

    To start a LLM: python -m openllm start dolly-v2

    What's Changed

    Full Changelog: v0.0.34...v0.1.0

    v0.0.34

    11 Jun 04:40
    Compare
    Choose a tag to compare

    Installation

    pip install openllm==0.0.34

    To upgrade from a previous version, use the following command:

    pip install --upgrade openllm==0.0.34

    Usage

    All available models: python -m openllm.models

    To start a LLM: python -m openllm start dolly-v2

    Full Changelog: v0.0.33...v0.0.34

    v0.0.33

    10 Jun 10:14
    Compare
    Choose a tag to compare

    Installation

    pip install openllm==0.0.33

    To upgrade from a previous version, use the following command:

    pip install --upgrade openllm==0.0.33

    Usage

    All available models: python -m openllm.models

    To start a LLM: python -m openllm start dolly-v2

    Full Changelog: v0.0.32...v0.0.33

    v0.0.32

    09 Jun 19:12
    Compare
    Choose a tag to compare

    Installation

    pip install openllm==0.0.32

    To upgrade from a previous version, use the following command:

    pip install --upgrade openllm==0.0.32

    Usage

    All available models: python -m openllm.models

    To start a LLM: python -m openllm start dolly-v2

    Full Changelog: v0.0.31...v0.0.32

    v0.0.31

    08 Jun 22:10
    Compare
    Choose a tag to compare

    Installation

    pip install openllm==0.0.31

    To upgrade from a previous version, use the following command:

    pip install --upgrade openllm==0.0.31

    Usage

    All available models: python -m openllm.models

    To start a LLM: python -m openllm start dolly-v2

    Full Changelog: v0.0.30...v0.0.31

    v0.0.30

    08 Jun 21:03
    Compare
    Choose a tag to compare

    Installation

    pip install openllm==0.0.30

    To upgrade from a previous version, use the following command:

    pip install --upgrade openllm==0.0.30

    Usage

    All available models: python -m openllm.models

    To start a LLM: python -m openllm start dolly-v2

    Full Changelog: v0.0.29...v0.0.30

    v0.0.27

    08 Jun 09:20
    Compare
    Choose a tag to compare

    Installation

    pip install openllm==0.0.27

    To upgrade from a previous version, use the following command:

    pip install --upgrade openllm==0.0.27

    Usage

    All available models: python -m openllm.models

    To start a LLM: python -m openllm start dolly-v2

    Full Changelog: v0.0.26...v0.0.27

    v0.0.26

    07 Jun 04:10
    Compare
    Choose a tag to compare

    Installation

    pip install openllm==0.0.26

    To upgrade from a previous version, use the following command:

    pip install --upgrade openllm==0.0.26

    Usage

    All available models: python -m openllm.models

    To start a LLM: python -m openllm start dolly-v2

    Full Changelog: v0.0.25...v0.0.26