You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/libs/community/langchain_community/vectorstores
Jael Gu a1aa3a657c
community[patch]: Milvus supports add & delete texts by ids (#16256)
# Description

To support [langchain
indexing](https://python.langchain.com/docs/modules/data_connection/indexing)
as requested by users, vectorstore Milvus needs to support:
- document addition by id (`add_documents` method with `ids` argument)
- delete by id (`delete` method with `ids` argument)

Example usage:

```python
from langchain.indexes import SQLRecordManager, index
from langchain.schema import Document
from langchain_community.vectorstores import Milvus
from langchain_openai import OpenAIEmbeddings

collection_name = "test_index"
embedding = OpenAIEmbeddings()
vectorstore = Milvus(embedding_function=embedding, collection_name=collection_name)

namespace = f"milvus/{collection_name}"
record_manager = SQLRecordManager(
    namespace, db_url="sqlite:///record_manager_cache.sql"
)
record_manager.create_schema()

doc1 = Document(page_content="kitty", metadata={"source": "kitty.txt"})
doc2 = Document(page_content="doggy", metadata={"source": "doggy.txt"})

index(
    [doc1, doc1, doc2],
    record_manager,
    vectorstore,
    cleanup="incremental",  # None, "incremental", or "full"
    source_id_key="source",
)
```

# Fix issues

Fix https://github.com/milvus-io/milvus/issues/30112

---------

Signed-off-by: Jael Gu <mengjia.gu@zilliz.com>
Co-authored-by: Bagatur <baskaryan@gmail.com>
8 months ago
..
docarray community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
redis community[patch]: Add missing async similarity_distance_threshold handling in RedisVectorStoreRetriever (#16359) 8 months ago
__init__.py community: Added integrations for ThirdAI's NeuralDB with Retriever and VectorStore frameworks (#15280) 8 months ago
alibabacloud_opensearch.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
analyticdb.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
annoy.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
astradb.py Fix AstraDB logical operator filtering (#15699) 9 months ago
atlas.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
awadb.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
azure_cosmos_db.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
azuresearch.py community: Fixing a performance issue with AzureSearch to perform batch embedding (#15594) 9 months ago
bageldb.py community[patch]: apply embedding functions during query if defined (#16646) 8 months ago
baiducloud_vector_search.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
bigquery_vector_search.py community[minor]: add additional support for `BigQueryVectorSearch` (#15904) 9 months ago
cassandra.py community[patch]: Use newer MetadataVectorCassandraTable in Cassandra vector store (#15987) 9 months ago
chroma.py docs, experimental[patch], langchain[patch], community[patch]: update storage imports (#15429) 9 months ago
clarifai.py Community : Modified doc strings and example notebook for Clarifai (#15816) 9 months ago
clickhouse.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
dashvector.py community[patch]: fix dashvector endpoint params error (#14484) 10 months ago
databricks_vector_search.py docs: Add Databricks Vector Search example notebook (#14158) 10 months ago
deeplake.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
dingo.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
elastic_vector_search.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
elasticsearch.py community[patch]: ElasticsearchStore enable max inner product (#16393) 9 months ago
epsilla.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
faiss.py community[patch]: fix a bug that mistakenly handle zip iterator in FAISS.from_embeddings (#16020) 9 months ago
hanavector.py community[minor]: VectorStore integration for SAP HANA Cloud Vector Engine (#16514) 8 months ago
hippo.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
hologres.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
jaguar.py community[patch]: jaguar vector store fix integer-element error when joining metadata values (#15939) 9 months ago
kdbai.py community[minor]: Add KDBAI vector store (#12797) 8 months ago
lancedb.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
lantern.py community: Added Lantern as VectorStore (#12951) 9 months ago
llm_rails.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
marqo.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
matching_engine.py community[patch]: Matching engine, return doc id (#14930) 10 months ago
meilisearch.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
milvus.py community[patch]: Milvus supports add & delete texts by ids (#16256) 8 months ago
momento_vector_index.py community[patch]: support momento vector index filter expressions (#14978) 10 months ago
mongodb_atlas.py community[patch]: Include scores in MongoDB Atlas QA chain results (#14666) 8 months ago
myscale.py community: fix myscale delete function bug (#15675) 9 months ago
neo4j_vector.py Fix RRF and lucene escape characters for neo4j vector store (#14646) 10 months ago
nucliadb.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
opensearch_vector_search.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
pgembedding.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
pgvecto_rs.py community[patch]: fix typo in pgvecto_rs debug msg (#16318) 9 months ago
pgvector.py community[patch]: Implement vector length definition at init time in PGVector for indexing (#16133) 9 months ago
pinecone.py community[patch]: add vector param to index query for pinecone vec store (#16054) 9 months ago
qdrant.py community[patch]: implement adelete from VectorStore in Qdrant (#16005) 9 months ago
rocksetdb.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
scann.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
semadb.py fix: correct spelling mistakes of "seperate, intialise, pre-defined" (#14647) 10 months ago
singlestoredb.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
sklearn.py docs: docstrings `langchain_community` update (#14889) 10 months ago
sqlitevss.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
starrocks.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
supabase.py Support `score_threshold` in SupabaseVectorStore similarity search (#14439) 9 months ago
surrealdb.py community[minor]: Fix to match SurrealDB 0.3.2 SDK (#15996) 9 months ago
tair.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
tencentvectordb.py docs: docstrings `langchain_community` update (#14889) 10 months ago
thirdai_neuraldb.py community: Added integrations for ThirdAI's NeuralDB with Retriever and VectorStore frameworks (#15280) 8 months ago
tigris.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
tiledb.py docs: docstrings `langchain_community` update (#14889) 10 months ago
timescalevector.py docs: docstrings `langchain_community` update (#14889) 10 months ago
typesense.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
usearch.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
utils.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
vald.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
vearch.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
vectara.py template: Update Vectara templates (#15363) 9 months ago
vespa.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
vikngdb.py community[minor]: add vikingdb vecstore (#15155) 9 months ago
weaviate.py community: Fixed schema discrepancy in from_texts function for weaviate vectorstore (#16693) 8 months ago
xata.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
yellowbrick.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
zep.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 10 months ago
zilliz.py community[patch]: Milvus supports add & delete texts by ids (#16256) 8 months ago