We currently use Azure, but its mandatory content-filtering layer rejects legitimate student writing whenever it includes references to violence. The underlying models are suitable; the problem is Azure's additional filtering layer, which can apparently only be removed through an approved managed relationship or enterprise arrangement. Before migrating, I'd like to know whether Bedrock applies a similar filter to every request, or whether its Bedrock Guardrails feature is optional. I'm especially interested in whether model-specific built-in refusals are the only limitation when no Bedrock Guardrail is attached.
3 Answers
The important distinction is between the model’s own behavior and an extra service-layer guardrail. Bedrock does not treat all models as having one universal content filter, but no hosted provider gives access to completely untuned weights. Each model can still have refusals or safety tuning, and AWS-owned models may have their own policies as well. Try a few representative examples in the Bedrock playground before committing to the migration.
Bedrock Guardrails are generally opt-in, so AWS does not appear to add an Azure-style filtering layer to every model request. Without a Bedrock Guardrail, you mainly encounter whatever safety behavior the model provider built into that model, plus any applicable service-level abuse protections. The experience can vary significantly by model, so test the specific models you plan to use. Anthropic and Cohere models may still refuse some violence-related prompts, while some open-weight Llama or Mistral options may be less restrictive.
The quickest way to confirm suitability is to take prompts that fail in Azure and run them against the candidate models in Bedrock. Do not attach a Bedrock Guardrail during the test, and compare the results model by model. A model can still reject content because of its own tuning even when Bedrock has not added an extra guardrail.
That distinction is exactly what I needed. Azure’s separate mandatory layer is the issue; the models themselves handle the material acceptably. I’ll test the same examples across the Bedrock models I’m considering.