langchain/docs/extras/use_cases/question_answering/index.mdx

86 lines
4.1 KiB
Plaintext
Raw Normal View History

# Question answering over documents
Question answering in this context refers to question answering over your document data.
2023-06-20 21:06:50 +00:00
For question answering over other types of data, please see other sources documentation like [SQL database Question Answering](/docs/use_cases/tabular.html) or [Interacting with APIs](/docs/use_cases/apis.html).
2023-02-27 15:45:54 +00:00
For question answering over many documents, you almost always want to create an index over the data.
This can be used to smartly access the most relevant documents for a given question, allowing you to avoid having to pass all the documents to the LLM (saving you time and money).
**Load Your Documents**
2023-02-27 15:45:54 +00:00
```python
from langchain.document_loaders import TextLoader
2023-06-20 21:06:50 +00:00
loader = TextLoader('../../modules/state_of_the_union.txt')
2023-02-27 15:45:54 +00:00
```
2023-06-20 21:06:50 +00:00
See [here](/docs/modules/data_connection/document_loaders/) for more information on how to get started with document loading.
2023-02-27 15:45:54 +00:00
**Create Your Index**
2023-02-27 15:45:54 +00:00
```python
from langchain.indexes import VectorstoreIndexCreator
index = VectorstoreIndexCreator().from_loaders([loader])
```
2023-02-27 15:45:54 +00:00
The best and most popular index by far at the moment is the VectorStore index.
**Query Your Index**
2023-02-27 15:45:54 +00:00
```python
query = "What did the president say about Ketanji Brown Jackson"
index.query(query)
```
2023-02-27 15:45:54 +00:00
Alternatively, use `query_with_sources` to also get back the sources involved
2023-02-27 15:45:54 +00:00
```python
query = "What did the president say about Ketanji Brown Jackson"
index.query_with_sources(query)
```
2023-06-20 21:06:50 +00:00
Again, these high level interfaces obfuscate a lot of what is going on under the hood, so please see [this notebook](/docs/modules/data_connection/) for a more thorough introduction to data modules.
2023-02-27 15:45:54 +00:00
## Document Question Answering
Question answering involves fetching multiple documents, and then asking a question of them.
The LLM response will contain the answer to your question, based on the content of the documents.
The recommended way to get started using a question answering chain is:
```python
from langchain.chains.question_answering import load_qa_chain
chain = load_qa_chain(llm, chain_type="stuff")
chain.run(input_documents=docs, question=query)
```
The following resources exist:
2023-06-20 21:06:50 +00:00
- [Question Answering Notebook](/docs/modules/chains/additional/question_answering.html): A notebook walking through how to accomplish this task.
- [VectorDB Question Answering Notebook](/docs/modules/chains/popular/vector_db_qa.html): A notebook walking through how to do question answering over a vector database. This can often be useful for when you have a LOT of documents, and you don't want to pass them all to the LLM, but rather first want to do some semantic search over embeddings.
2023-02-27 15:45:54 +00:00
## Adding in sources
There is also a variant of this, where in addition to responding with the answer the language model will also cite its sources (eg which of the documents passed in it used).
The recommended way to get started using a question answering with sources chain is:
```python
from langchain.chains.qa_with_sources import load_qa_with_sources_chain
chain = load_qa_with_sources_chain(llm, chain_type="stuff")
chain({"input_documents": docs, "question": query}, return_only_outputs=True)
```
2023-02-27 15:45:54 +00:00
## Additional Related Resources
Additional related resources include:
2023-06-20 21:06:50 +00:00
- [Building blocks for working with Documents](/docs/modules/data_connection/): Guides on how to use several of the utilities which will prove helpful for this task, including Text Splitters (for splitting up long documents) and Embeddings & Vectorstores (useful for the above Vector DB example).
2023-06-20 21:44:22 +00:00
- [CombineDocuments Chains](/docs/modules/chains/document/): A conceptual overview of specific types of chains by which you can accomplish this task.
## End-to-end examples
For examples to this done in an end-to-end manner, please see the following resources:
2023-06-20 21:06:50 +00:00
- [Semantic search over a group chat with Sources Notebook](/docs/use_cases/question_answering/semantic-search-over-chat.html): A notebook that semantically searches over a group chat conversation.
- [Document context aware text splitting and QA](/docs/use_cases/question_answering/document-context-aware-QA.html): A notebook that shows context aware splitting on markdown files and SelfQueryRetriever for QA using the resulting metadata.