We need to ensure that model inference stays within the same AWS Region for compliance reasons. The Bedrock endpoint documentation suggests that Mantle endpoints do not support cross-Region inference, but it is not as explicit as the wording for standard Bedrock URLs. Can anyone confirm whether requests sent to a Mantle endpoint remain in the region where the endpoint is deployed, and whether future CRIS support could change that behavior?
2 Answers
Yes. The documentation indicates that Mantle endpoints currently do not support cross-Region inference, so requests remain within the region associated with the endpoint.
Mantle endpoints are currently regional only. However, once CRIS becomes available for Mantle, you may need to deliberately choose a regional, non-CRIS option if keeping inference in a specific region is a requirement.
Thanks, that clears it up. I mainly wanted to confirm the regional behavior and understand what we may need to review when CRIS support is introduced.