2023-02-20 07:14:50 +00:00
|
|
|
Indexes
|
|
|
|
==========================
|
|
|
|
|
2023-03-27 02:49:46 +00:00
|
|
|
.. note::
|
|
|
|
`Conceptual Guide <https://docs.langchain.com/docs/components/indexing>`_
|
|
|
|
|
|
|
|
|
2023-06-03 21:44:32 +00:00
|
|
|
**Indexes** refer to ways to structure documents so that LLMs can best interact with them.
|
2023-03-24 14:46:49 +00:00
|
|
|
|
|
|
|
The most common way that indexes are used in chains is in a "retrieval" step.
|
|
|
|
This step refers to taking a user's query and returning the most relevant documents.
|
2023-06-03 21:44:32 +00:00
|
|
|
We draw this distinction because (1) an index can be used for other things besides retrieval, and
|
|
|
|
(2) retrieval can use other logic besides an index to find relevant documents.
|
|
|
|
We therefore have a concept of a **Retriever** interface - this is the interface that most chains work with.
|
2023-03-24 14:46:49 +00:00
|
|
|
|
2023-06-03 21:44:32 +00:00
|
|
|
Most of the time when we talk about indexes and retrieval we are talking about indexing and retrieving
|
|
|
|
unstructured data (like text documents).
|
|
|
|
For interacting with structured data (SQL tables, etc) or APIs, please see the corresponding use case
|
|
|
|
sections for links to relevant functionality.
|
2023-02-20 07:14:50 +00:00
|
|
|
|
2023-06-03 21:44:32 +00:00
|
|
|
|
|
|
|
|
- `Getting Started <./indexes/getting_started.html>`_: An overview of the indexes.
|
2023-03-27 02:49:46 +00:00
|
|
|
|
2023-02-20 07:14:50 +00:00
|
|
|
|
2023-06-03 21:44:32 +00:00
|
|
|
Index Types
|
|
|
|
---------------------
|
2023-02-20 07:14:50 +00:00
|
|
|
|
2023-06-03 21:44:32 +00:00
|
|
|
- `Document Loaders <./indexes/document_loaders.html>`_: How to load documents from a variety of sources.
|
2023-02-20 07:14:50 +00:00
|
|
|
|
2023-06-03 21:44:32 +00:00
|
|
|
- `Text Splitters <./indexes/text_splitters.html>`_: An overview and different types of the **Text Splitters**.
|
2023-03-27 02:49:46 +00:00
|
|
|
|
2023-06-03 21:44:32 +00:00
|
|
|
- `VectorStores <./indexes/vectorstores.html>`_: An overview and different types of the **Vector Stores**.
|
2023-03-27 02:49:46 +00:00
|
|
|
|
2023-06-03 21:44:32 +00:00
|
|
|
- `Retrievers <./indexes/retrievers.html>`_: An overview and different types of the **Retrievers**.
|
2023-03-27 02:49:46 +00:00
|
|
|
|
2023-02-20 07:14:50 +00:00
|
|
|
|
|
|
|
|
|
|
|
.. toctree::
|
|
|
|
:maxdepth: 1
|
2023-06-03 21:44:32 +00:00
|
|
|
:hidden:
|
2023-02-20 07:14:50 +00:00
|
|
|
|
2023-06-03 21:44:32 +00:00
|
|
|
./indexes/getting_started.ipynb
|
2023-03-27 02:49:46 +00:00
|
|
|
./indexes/document_loaders.rst
|
|
|
|
./indexes/text_splitters.rst
|
|
|
|
./indexes/vectorstores.rst
|
|
|
|
./indexes/retrievers.rst
|
|
|
|
|