Does a High Knowledge Base Limit Chat Length with Claude?

0
0
Asked By CuriousCat42 On

I have a knowledge base that's over 90% complete as a pro user, and I'm curious if this affects the length of my chats with Claude for that project. I've noticed that even with a >90% knowledge base, I can't manage to get a single turn of conversation going. What's the benefit of having a knowledge base if it restricts my interactions?

2 Answers

Answered By TokenMaster88 On

Just to add, it seems like Claude caches the project knowledge in a way that doesn’t count as input tokens. But if the knowledge is needed for context, it really can't be just cached as is. They might need to think about methods to compress it without losing any useful information.

Answered By ChatWizard99 On

It sounds like you're hitting the context window limit of the model, rather than any usage restrictions. With a knowledge base above 90%, you're essentially limited to a 20k token context window for both your inputs and Claude's responses. That's why you're struggling to get a single prompt across. It's relatively small, so it's understandable that you're running into problems.

Related Questions

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.