What's the bedrock endpoint url? #17465
Replies: 1 comment
-
Hello @jeremyyang15! I'm here to help you with any bugs, questions, or contributions you have. Let's tackle this issue together! I couldn't find specific information about the default endpoint URL for the Bedrock service in the LlamaIndex codebase. However, the configuration for AWS service endpoints, specifically for Bedrock, is defined in several places within the codebase. These configurations check for available services and set the client to either "bedrock-runtime" or "bedrock" based on the available services in the session [1][2][3]. Regarding the configuration for AWS PrivateLink, I couldn't find specific instructions or examples in the LlamaIndex documentation. Similarly, there is no detailed guidance on setting up AWS PrivateLink for Bedrock service access or handling authentication for AWS services when running in an EKS environment using pod identities. For more detailed configuration, you might need to refer to AWS documentation or other resources related to AWS PrivateLink and EKS pod identities. To continue talking to Dosu, mention @dosu. Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other |
Beta Was this translation helpful? Give feedback.
-
According to documentation https://docs.llamaindex.ai/en/stable/api_reference/llms/bedrock/, we don't have to specify the endpoint to access bedrock service.
What's the default endpoint of the bedrock service?
According to https://aws.amazon.com/blogs/machine-learning/build-generative-ai-applications-on-amazon-bedrock-the-secure-compliant-and-responsible-foundation/, the AWS recommends to use private link to access the Bedrock service, how do we configure it in the llamaindex?
We have the python app running in EKS using pod identities to access the bedrock.
Beta Was this translation helpful? Give feedback.
All reactions