bedrock

bedrock

A Wing library for working with Amazon Bedrock.

Prerequisites

• winglang.
• Model access to Amazon bedrock

Installation

npm i @winglibs/bedrock

Usage

bring bedrock;

pub class JokeMaker {
  claud: bedrock.Model;

  new() {
    this.claud = new bedrock.Model("anthropic.claude-v2") as "claude";
  }

  pub inflight makeJoke(topic: str): str {
    let res = this.claud.invoke({
      prompt: "\n\nHuman: Tell me a joke about {topic}\n\nAssistant:",
      max_tokens_to_sample: 300,
      temperature: 0.5,
      top_k: 250,
      top_p: 1,
      stop_sequences: [
        "\n\nHuman:"
      ],
      anthropic_version: "bedrock-2023-05-31"
    });

    return res["completion"].asStr();
  }
}

Development & Testing

When running in simulator using wing run, request are sent to Amazon Bedrock. When running tests using wing test or by running tests from within Wing Console, requests are handled by the mocked service.

Maintainers

@eladb, @ekeren

License

This library is licensed under the MIT License.