Why is Chat memory limit (top K) is removed in GA release? #3432
Unanswered
anupsajjan
asked this question in
Q&A
Replies: 1 comment 3 replies
-
Because in fact, according to the current Spring AI definition of |
Beta Was this translation helpful? Give feedback.
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I was using chatMemory custom implementation in 1.0-M6 version with 'lastN' parameter to fetch only the last 'N' messages as chat history. But now I see that the interface itself doesnt support 'limit' and I see that a MessageWindowChatMemory implementation has been provided, but I have use case where I want user to be able to see their chat history as long as needed, but to LLM I want to pass last N messages as 'ChatMemory' where LIMIT would come handy. Why even fetch all messages?
Previously this method supported 'lastN' parameter List get(String conversationId, int lastN);

Manually removing additional messages.

Beta Was this translation helpful? Give feedback.
All reactions