I'm curious about how my project's knowledge base impacts my chat length with Claude. Specifically, if my knowledge base exceeds 90% as a pro user, does that mean my chat interactions will be limited? In one of my projects where the knowledge base is above 90%, I'm having trouble even getting it to run a single turn. What's the benefit of having such a strong knowledge base if it restricts how much I can interact?
2 Answers
It sounds like Claude caches project knowledge, which means it won't count against your chat length in terms of tokens. However, if you need that knowledge for context, then it can't really be cached like that. It might be possible to optimize things with some sort of compression, but that’s just a guess.
You're probably hitting the context window limit of the model. Even with a knowledge base over 90%, you're still limited to a 20k token context window for both your input and Claude's output. That might be why you're struggling to get even one prompt through, since 20k is pretty restrictive.
Gotcha, so what's the ideal capacity I should keep my knowledge base at to avoid these issues in the future?