8 Commits (ba7a5ac9d7bbc1ad531916c8a0002d1791aa1335)

Author	SHA1	Message	Date
vowelparrot	4ffc58e07b	Add similarity_search_with_normalized_similarities (#2916) ... Add a method that exposes a similarity search with corresponding normalized similarity scores. Implement only for FAISS now. ### Motivation: Some memory definitions combine `relevance` with other scores, like recency , importance, etc. While many (but not all) of the `VectorStore`'s expose a `similarity_search_with_score` method, they don't all interpret the units of that score (depends on the distance metric and whether or not the the embeddings are normalized). This PR proposes a `similarity_search_with_normalized_similarities` method that lets consumers of the vector store not have to worry about the metric and embedding scale. *Most providers default to euclidean distance, with Pinecone being one exception (defaults to cosine _similarity_).* --------- Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>	1 year ago
Andrew White	c5015d77e2	Allow k to be higher than doc size in max_marginal_relevance_search (#1187) ... Fixes issue #1186. For some reason, #1117 didn't seem to fix it.	2 years ago
seanaedmiston	f0a258555b	Support similarity search by vector (in FAISS) (#961) ... Alternate implementation to PR #960 Again - only FAISS is implemented. If accepted can add this to other vectorstores or leave as NotImplemented? Suggestions welcome...	2 years ago
Harrison Chase	1e56879d38	Harrison/save faiss (#916) ... Co-authored-by: Shrey Joshi <shreyjoshi2004@gmail.com>	2 years ago
Harrison Chase	3f48eed5bd	Harrison/milvus (#856) ... Signed-off-by: Filip Haltmayer <filip.haltmayer@zilliz.com> Signed-off-by: Frank Liu <frank.liu@zilliz.com> Co-authored-by: Filip Haltmayer <81822489+filip-halt@users.noreply.github.com> Co-authored-by: Frank Liu <frank@frankzliu.com>	2 years ago
dham	e04b063ff4	add faiss local saving/loading (#676) ... - This uses the faiss built-in `write_index` and `load_index` to save and load faiss indexes locally - Also fixes #674 - The save/load functions also use the faiss library, so I refactored the dependency into a function	2 years ago
Samantha Whitmore	315b0c09c6	wip: add method for both docstore and embeddings (#119) ... this will break atm but wanted to get thoughts on implementation. 1. should add() be on docstore interface? 2. should InMemoryDocstore change to take a list of documents as init? (makes this slightly easier to implement in FAISS -- if we think it is less clean then could expose a method to get the number of documents currently in the dict, and perform the logic of creating the necessary dictionary in the FAISS.add_texts method. Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>	2 years ago
Harrison Chase	c02eb199b6	add few shot example (#148)	2 years ago