Hey everyone! I'm trying to create a chatbot that can answer questions based on our internal documents. I opted for open-webui, but I've noticed that the responses are quite slow. I'm looking for suggestions on tools or methods that you've used successfully to improve reply speeds. Thanks for your help!
1 Answer
It sounds like you're diving into RAG (Retrieval-Augmented Generation), which is essential for this kind of task. Just a heads up, the setup might only be about 10% of the work, and you'll need to prepare for extensive document management. Honestly, I'm not fully convinced it's worth the effort you might have to put in, though.
I get that, and I'm aware of the effort involved. I don't have a ton of documents, so I think I can manage. I actually found a RAG tool that might help!