Commit Graph

12 Commits (main)

Author SHA1 Message Date
Harrison Chase f61858163d
bump version to 0.0.95 (#1324) 1 year ago
Harrison Chase 0824d65a5c
Harrison/indexing pipeline (#1317) 1 year ago
Harrison Chase 166cda2cc6
Harrison/deeplake (#1316)
Co-authored-by: Davit Buniatyan <d@activeloop.ai>
1 year ago
Harrison Chase aaad6cc954
Harrison/atlas db (#1315)
Co-authored-by: Brandon Duderstadt <brandonduderstadt@gmail.com>
1 year ago
Marc Puig 3989c793fd
Making it possible to use "certainty" as a parameter for the weaviate similarity_search (#1218)
Checking if weaviate similarity_search kwargs contains "certainty" and
use it accordingly. The minimal level of certainty must be a float, and
it is computed by normalized distance.
1 year ago
Sason cc7d2e5621
Correct typo in "Question Answering" How-To Guide (#1221) 1 year ago
Harrison Chase 047231840d
add docs for chroma persistance (#1202) 1 year ago
Harrison Chase 5bdb8dd6fe
Harrison/unstructured io (#1200) 1 year ago
Naveen Tatikonda 0118706fd6
Add Support for OpenSearch Vector database (#1191)
### Description
This PR adds a wrapper which adds support for the OpenSearch vector
database. Using opensearch-py client we are ingesting the embeddings of
given text into opensearch cluster using Bulk API. We can perform the
`similarity_search` on the index using the 3 popular searching methods
of OpenSearch k-NN plugin:

- `Approximate k-NN Search` use approximate nearest neighbor (ANN)
algorithms from the [nmslib](https://github.com/nmslib/nmslib),
[faiss](https://github.com/facebookresearch/faiss), and
[Lucene](https://lucene.apache.org/) libraries to power k-NN search.
- `Script Scoring` extends OpenSearch’s script scoring functionality to
execute a brute force, exact k-NN search.
- `Painless Scripting` adds the distance functions as painless
extensions that can be used in more complex combinations. Also, supports
brute force, exact k-NN search like Script Scoring.

### Issues Resolved 
https://github.com/hwchase17/langchain/issues/1054

---------

Signed-off-by: Naveen Tatikonda <navtat@amazon.com>
1 year ago
Harrison Chase 926c121b98
Harrison/text splitter docs (#1188) 1 year ago
Harrison Chase 91446a5e9b
clean up text splitting docs (#1184) 1 year ago
Harrison Chase 4f3fbd7267
improve docs for indexes (#1146) 1 year ago