langchain/docs/use_cases/evaluation
Nicolas 91d7fd20ae
feat: add custom prompt for QAEvalChain chain (#610)
I originally had only modified the `from_llm` to include the prompt but
I realized that if the prompt keys used on the custom prompt didn't
match the default prompt, it wouldn't work because of how `apply` works.

So I made some changes to the evaluate method to check if the prompt is
the default and if not, it will check if the input keys are the same as
the prompt key and update the inputs appropriately.

Let me know if there is a better way to do this.

Also added the custom prompt to the QA eval notebook.
2023-01-14 07:23:48 -08:00
..
data_augmented_question_answering.ipynb Docs refactor (#480) 2023-01-02 08:24:09 -08:00
huggingface_datasets.ipynb Docs refactor (#480) 2023-01-02 08:24:09 -08:00
question_answering.ipynb feat: add custom prompt for QAEvalChain chain (#610) 2023-01-14 07:23:48 -08:00