Does the Amazon Bedrock Mantle endpoint keep inference within the selected region?
Asked by
MellowCedar42
We need to ensure that model inference stays within the same AWS Region for compliance reasons. The Bedrock endpoint documentation suggests that Mantle endpoints do not support cross-Region inference, but it is not as explicit as the wording for standard Bedrock URLs. Can anyone confirm whether requests sent to a Mantle endpoint remain in the region where the endpoint is deployed, and whether future CRIS support could change that behavior?
Answers
Mantle endpoints are currently regional only. However, once CRIS becomes available for Mantle, you may need to deliberately choose a regional, non-CRIS option if keeping inference in a specific region is a requirement.
Reply to this answer
Yes. The documentation indicates that Mantle endpoints currently do not support cross-Region inference, so requests remain within the region associated with the endpoint.
Reply to this answer
Add your answer
Answers are reviewed before publication.
MellowCedar42: Thanks, that clears it up. I mainly wanted to confirm the regional behavior and understand what we may need to review when CRIS support is introduced.