Hey everyone! I'm currently running my AI solution through AWS Bedrock for my business in the UK, but I'm hitting some rate limits and their support seems to be pretty slow. I'm on the lookout for a GDPR-compliant alternative that won't impose these limits. I need to process lengthy text documents roughly every 10 seconds for a couple of days, then shift to on-demand requests afterward. Ideally, I want to keep costs reasonable too. I've heard Azure might be a decent alternative, but how well does it handle such high request volumes? Am I likely to encounter red tape similar to AWS? SageMaker crossed my mind, but it looks a bit pricey. Any suggestions? Thanks in advance!
3 Answers
If you're focused on costs, Azure might be a good option. I've heard they handle high request volumes pretty well, but definitely check their compliance with GDPR to avoid any legal headaches.
Have you thought about just requesting an increase in your rate limits with AWS? It's usually the easiest route if you're okay with their pricing. They often raise limits when you ask, as they set defaults that suit most users. Might save you the hassle of switching providers entirely!
You're right; AWS defaults can really slow down operations. If switching to another API seems easier, most LLMs function similarly, especially if you set up a basic layer over the calls.
Finding a GDPR-compliant vendor is tricky! Not many can guarantee it, so make sure to do your research. If compliance is essential, ensure any alternative you choose aligns with those standards.
I did reach out for an increase, but they mentioned a lot of requests are in the queue, so I'm still waiting. My team is feeling the pressure since clients keep asking about updates. It seems like a mistake to ask for limits on all models at once! Thanks for your thoughts.