Why Is GPT-5.6 So Slow in Azure Foundry, and Is Prompt Caching Working?
GPT-5.6 in Azure Foundry has been extremely slow for me, especially when using the Responses API. Time to first token can be around a minute, making the model…
GPT-5.6 in Azure Foundry has been extremely slow for me, especially when using the Responses API. Time to first token can be around a minute, making the model…