mirror of
https://github.com/hwchase17/langchain
synced 2024-11-08 07:10:35 +00:00
32 lines
2.1 KiB
Markdown
32 lines
2.1 KiB
Markdown
# Marqo
|
|
|
|
This page covers how to use the Marqo ecosystem within LangChain.
|
|
|
|
### **What is Marqo?**
|
|
|
|
Marqo is a tensor search engine that uses embeddings stored in in-memory HNSW indexes to achieve cutting edge search speeds. Marqo can scale to hundred-million document indexes with horizontal index sharding and allows for async and non-blocking data upload and search. Marqo uses the latest machine learning models from PyTorch, Huggingface, OpenAI and more. You can start with a pre-configured model or bring your own. The built in ONNX support and conversion allows for faster inference and higher throughput on both CPU and GPU.
|
|
|
|
Because Marqo include its own inference your documents can have a mix of text and images, you can bring Marqo indexes with data from your other systems into the langchain ecosystem without having to worry about your embeddings being compatible.
|
|
|
|
Deployment of Marqo is flexible, you can get started yourself with our docker image or [contact us about our managed cloud offering!](https://www.marqo.ai/pricing)
|
|
|
|
To run Marqo locally with our docker image, [see our getting started.](https://docs.marqo.ai/latest/)
|
|
|
|
## Installation and Setup
|
|
- Install the Python SDK with `pip install marqo`
|
|
|
|
## Wrappers
|
|
|
|
### VectorStore
|
|
|
|
There exists a wrapper around Marqo indexes, allowing you to use them within the vectorstore framework. Marqo lets you select from a range of models for generating embeddings and exposes some preprocessing configurations.
|
|
|
|
The Marqo vectorstore can also work with existing multimodel indexes where your documents have a mix of images and text, for more information refer to [our documentation](https://docs.marqo.ai/latest/#multi-modal-and-cross-modal-search). Note that instaniating the Marqo vectorstore with an existing multimodal index will disable the ability to add any new documents to it via the langchain vectorstore `add_texts` method.
|
|
|
|
To import this vectorstore:
|
|
```python
|
|
from langchain.vectorstores import Marqo
|
|
```
|
|
|
|
For a more detailed walkthrough of the Marqo wrapper and some of its unique features, see [this notebook](/docs/integrations/vectorstores/marqo.html)
|