You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/docs
Shantanu Nair 53f3793504
Fast load conversationsummarymemory from existing summary (#7533)
- Description: Adds an optional buffer arg to the memory's
from_messages() method. If provided the existing memory will be loaded
instead of regenerating a summary from the loaded messages.
 
Why? If we have past messages to load from, it is likely we also have an
existing summary. This is particularly helpful in cases where the chat
is ephemeral and/or is backed by serverless where the chat history is
not stored but where the updated chat history is passed back and forth
between a backend/frontend.

Eg: Take a stateless qa backend implementation that loads messages on
every request and generates a response — without this addition, each
time the messages are loaded via from_messages, the summaries are
recomputed even though they may have just been computed during the
previous response. With this, the previously computed summary can be
passed in and avoid:
  1) spending extra $$$ on tokens, and 
2) increased response time by avoiding regenerating previously generated
summary.

Tag maintainer: @hwchase17
Twitter handle: https://twitter.com/ShantanuNair

---------

Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>
1 year ago
..
api_reference Wfh/ref links (#8454) 1 year ago
docs_skeleton doc(prompts): Follow up on broken Prompt Sublink pages (#8530) 1 year ago
extras Fixed bug7445 where a duplicate restuld_id is added to the vectorstore. (#7573) 1 year ago
snippets Fast load conversationsummarymemory from existing summary (#7533) 1 year ago
.local_build.sh Update local script for docs build (#8377) 1 year ago
package-lock.json docs: New experimental UI for Mendable Search (#6558) 1 year ago
vercel_requirements.txt Add api cross ref linking (#8275) 1 year ago