My company is evaluating general-purpose AI chat platforms that support bring-your-own-key access to multiple LLM providers through APIs. We need SCIM and Entra ID SSO for roughly 1,500 users, along with usage metrics for tracking and forecasting token costs. Users should also be able to switch between available models on demand.
The platform should support a variety of departments without being narrowly focused on one workflow, and reliable vendor support would be a major plus. Many SaaS products I've reviewed seem designed for specific teams, such as marketing, rather than general organizational use. Has anyone deployed a platform like this and had a positive experience?
2 Answers
One important design question is whether users need individual provider API keys or whether the organization will manage shared keys centrally. Per-user keys may affect the platform choice, auditing model, and cost reporting, so it’s worth confirming that requirement before comparing products.
Open WebUI appears to cover much of this, especially when paired with LiteLLM for routing requests to different providers. That combination can provide a flexible general chat interface and model selection, though you’d want to validate its enterprise identity, SCIM, reporting, and support capabilities before rolling it out to 1,500 users.
I’ve used Open WebUI with LiteLLM in a personal lab, but replaced it later. I’m curious whether anyone has run it successfully in a business environment at this scale, particularly regarding administration and ongoing support.