feat(community): Add support for Bedrock cross-region inference models

[keremnalbant]

Merged for LangChainJS: langchain-ai/langchainjs#6682
Closed PR as the Bedrock is deprecated in langchain-core: langchain-ai/langchain#26038

Hey, I recently I switched using to Bedrock Inference models.

With Inference models, Amazon introduced a new prefix which is a region code. If the modelId previously was anthropic.claude-3-5-sonnet-20240620-v1:0 now, with the change it's eu.anthropic.claude-3-5-sonnet-20240620-v1:0

This PR adds:

• Support for each AWS Bedrock supported regions.
• Support streaming for inference models in Converse API

Fixes #186

[keremnalbant]

Can you please check here, @efriis 👆🏼,

Thanks in advance 🙏🏼

[efriis]

@3coins if there's another approach for detecting the cross-region strings that would be more tolerant if other regions get added, please comment!

[3coins]

@keremnalbant
#184 fixes the support for region prefixes. I noticed that we are missing some regions e.g., il, me, af and us-govin that PR.

@efriis
One solution might be to decide if a prefix is present based on the no of parts. This would break if the provider or the model ended up adding a period in their names (we have not seen this so far). For example:

eu.anthropic.claude-3-5-sonnet-20240620-v1:0 # has 3 parts after splitting
anthropic.claude-3-5-sonnet-20240620-v1:0 # has 2 parts after splitting

[keremnalbant]

@keremnalbant #184 fixes the support for region prefixes. I noticed that we are missing some regions e.g., il, me, af and us-govin that PR.

@efriis One solution might be to decide if a prefix is present based on the no of parts. This would break if the provider or the model ended up adding a period in their names (we have not seen this so far). For example:

eu.anthropic.claude-3-5-sonnet-20240620-v1:0 # has 3 parts after splitting
anthropic.claude-3-5-sonnet-20240620-v1:0 # has 2 parts after splitting

Yes, but this is not really safe if we are looking for safety as they can pass anything as the first part.

Currently supported regions are just those I've added, please visit the link to view AWS Bedrock Documentation. However this will require extra effort if new regions get supported by AWS. I can add every region in AWS to overcome.

# ref: https://docs.aws.amazon.com/general/latest/gr/bedrock.html#bedrock_region
AWS_REGIONS = [
    "us",
    "ap",
    "ca",
    "eu",
    "sa",
    "us-gov",
]

[keremnalbant]

@3coins please see the commit which adds all AWS regions.

[rsgrewal-aws]

@3coins could you please review

[3coins]

@keremnalbant
Thanks for submitting this change. Can you rebase off main and re-submit.

[3coins]

Closing this in favor of #242.