How to Build a Secure AI Chatbot for My Company?

Have you thought about just using Copilot directly? The annual cost can be justified by how much time and effort you save in building and maintaining your own solution. I find it's about $400 per user per year, and as long as the users actually utilize it, it could be a pretty good deal. In my experience, a lot of users get excited for the first few weeks, then kind of don’t use it much afterwards. I suggest tracking usage to make sure it’s being used properly, which helps a lot in understanding its value. Most users I see mainly summarize documents or use it during meetings. Also, consider compliance; if any content like web searches are off-limits, disabling those features can keep things focused and secure.

I completely get where you’re coming from! The hurdles can feel massive. If math is a concern, maybe look into how you can integrate other services for complex calculations so that your chatbot can do what it needs to without you having to reinvent the wheel. Also, being well-versed in your data's structure is crucial, especially for security. Understanding how to implement permissions correctly will be key to preventing leaks.

Copilot Studio might be worth a shot depending on your specific needs. It allows you to tailor the AI to your own data set, which could be beneficial. I’ve played around with it and found it to be quite handy, though I understand your concern about its math capabilities. If you're on the fence about whether to build your own agent or just purchase Copilot, weigh the pros and cons of both options carefully.