I'm exploring options for a cost-effective AI language model that can scan my wiki website and allow me to ask questions about the content. As a total newbie in this area, I'd appreciate any recommendations or advice!
5 Answers
If Bedrock is your choice, I recommend trying out the Amazon Nova models. The Micro and Lite versions are effective and really affordable.
Keep in mind to set up budget alerts if you're diving into AWS. Also, secure your account with MFA to avoid any unexpected costs — you’ll thank yourself later!
Using Bedrock's playground feature is a great way to compare different models. You can analyze latency and see how input/output tokens work, which will help you decide what fits your budget.
Have you looked into Ollama? It’s a user-friendly option, and you won’t need to self-host it. I'm curious if it can crawl data from your wiki too.
Thanks, is Ollama associated with AWS Bedrock? Is it capable of web crawling for data sources? What about Llama2?
You might want to check out Bedrock Knowledgebase. It's designed for this kind of task and allows you to link your website as a source.
Thanks! What can I use for a simple frontend with that?
I totally agree! It's essential to monitor costs, especially with AWS. Setting up a separate management account with permissions can save you a lot of headache.