forked from Archives/langchain
31303d0b11
This PR adds additional evaluation metrics for data-augmented QA, resulting in a report like this at the end of the notebook: ![Screen Shot 2023-03-08 at 8 53 23 AM](https://user-images.githubusercontent.com/398875/223731199-8eb8e77f-5ff3-40a2-a23e-f3bede623344.png) The score calculation is based on the [Critique](https://docs.inspiredco.ai/critique/) toolkit, an API-based toolkit (like OpenAI) that has minimal dependencies, so it should be easy for people to run if they choose. The code could further be simplified by actually adding a chain that calls Critique directly, but that probably should be saved for another PR if necessary. Any comments or change requests are welcome! |
||
---|---|---|
.. | ||
evaluation | ||
agents.md | ||
chatbots.md | ||
combine_docs.md | ||
evaluation.rst | ||
generate_examples.ipynb | ||
model_laboratory.ipynb | ||
question_answering.md | ||
summarization.md |