I'm curious about how my project's knowledge base affects chat length with Claude. If my knowledge base is over 90% as a pro user, does that restrict the length of my chats? I have one project with such a high knowledge base, and I'm having trouble even getting one turn to run. It makes me wonder what the point of having the knowledge base is if it limits my interactions.
2 Answers
It sounds like you're running into the model's context window limit. Even with a great knowledge base, you only get about 20k tokens to play with, which includes both your input and Claude's output. That's why you're struggling to get more than one prompt out of it; it's just not enough room for detailed conversations.
I think there's a caching aspect to it, but if you need the knowledge for context, it can't be cached in the usual sense. It might be worth looking into ways to compress your knowledge base or manage its size better so you can have more engaging chats.
Related Questions
xAI Grok Token Calculator
DeepSeek Token Calculator
Google Gemini Token Calculator
Meta LLaMA Token Calculator
OpenAI Token Calculator