[Feature]: Command R & R+ on Amazon Bedrock

[Manouchehri]

The Feature

https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-cohere-command-r-plus.html

Chat model:

aws bedrock-runtime invoke-model-with-messages \
--model-id "cohere.command-r-plus-v1:0" \
--messages '[{"role":"user","content":[{"text":"what'\''s up?"}]},{"role":"assistant","content":[{"text":"Not much, what can I help you with today?"}]},{"role":"user","content":[{"text":"how are you today?"}]}]' \
--inference-config '{"maxTokens":400,"temperature":0.75,"topP":0.01,"stopSequences":[]}' \
--additional-model-request-fields '{"k":0}' \
--region us-east-1

Text interface:

aws bedrock-runtime invoke-model \
--model-id cohere.command-r-plus-v1:0 \
--body "{\"message\":\"what's up?\\nNot much, what can I help you with today?\",\"max_tokens\":400,\"temperature\":0.75,\"p\":0.01,\"k\":0,\"stop_sequences\":[]}" \
--cli-binary-format raw-in-base64-out \
--region us-east-1 \
invoke-model-output.txt

Motivation, pitch

https://aws.amazon.com/about-aws/whats-new/2024/04/cohere-command-r-r-plus-amazon-bedrock/

Twitter / LinkedIn details

https://twitter.com/DaveManouchehri