I've been using AI Foundry for a while, funded by Azure Credits and sponsorship. Generally, everything has been fine, but recently I tried using some Anthropic and old Mistral models, and I was hit with a huge invoice – over four figures! The other models I used, like GPT, Kimi, and Grok, have all stayed within my sponsorship limits. I'm baffled because my invoice doesn't show any clear usage details, and it seems like something related to the Marketplace is causing the charges. Also, I can't find any 'Direct from Azure' badge anymore on the portal. Has anyone else faced similar issues?
I later discovered that the model publisher information is not visible unless you dig deep during resource creation, which seems quite frustrating! But what really annoys me is that I was charged over €1,000 for what I thought would just be around €130 worth of tokens based on monitoring data I can see. I've opened a support case, but I'm skeptical about getting a resolution. I'm a professional developer, not a heavy coder, so I can't see how my API costs are so high without any clear report.
3 Answers
Just a heads-up, some users are mentioning that the costs for Opus can skyrocket quickly. They clearly state the costs on the Marketplace, but it’s easy to overlook when you’re experimenting. Try keeping an eye on those token counts because the meters can be misleading if you don’t stay aware of what you're deploying.
It sounds like you might have come across some hidden costs associated with Marketplace models. I’ve heard similar stories where users weren't aware of the billing structure for those models. They can be pretty pricey if you're not on a consumption plan. If you're unsure, check if the models you used were preprovisioned or consumption-based; it can change the pricing drastically.
You should definitely look into whether you're using models that require a different pricing structure than what you expect. Some models can run up charges really fast. Also, be aware that Marketplace models don’t always show up clearly in your account. It's pretty frustrating! You might need to sift through your invoices to get clarity on specific charges.
Yeah, I agree! It's annoying that they don't clearly list all usage. Sometimes you might even miss information that's crucial to understanding your bill.
That's exactly my issue! I wasn't paying close attention to the spending as I usually am with sponsorships. I never expected it would run up to this level.