forked from Archives/langchain
You cannot select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
67 lines
1.6 KiB
Python
67 lines
1.6 KiB
Python
# flake8: noqa
|
|
from langchain.prompts import PromptTemplate
|
|
from langchain.output_parsers.regex import RegexParser
|
|
|
|
output_parser = RegexParser(
|
|
regex=r"(.*?)\nScore: (.*)",
|
|
output_keys=["answer", "score"],
|
|
)
|
|
|
|
prompt_template = """Use the following pieces of context to answer the question at the end. If you don't know the answer, just say that you don't know, don't try to make up an answer.
|
|
|
|
In addition to giving an answer, also return a score of how fully it answered the user's question. This should be in the following format:
|
|
|
|
Question: [question here]
|
|
Helpful Answer: [answer here]
|
|
Score: [score between 0 and 100]
|
|
|
|
How to determine the score:
|
|
- Higher is a better answer
|
|
- Better responds fully to the asked question, with sufficient level of detail
|
|
- If you do not know the answer based on the context, that should be a score of 0
|
|
- Don't be overconfident!
|
|
|
|
Example #1
|
|
|
|
Context:
|
|
---------
|
|
Apples are red
|
|
---------
|
|
Question: what color are apples?
|
|
Helpful Answer: red
|
|
Score: 100
|
|
|
|
Example #2
|
|
|
|
Context:
|
|
---------
|
|
it was night and the witness forgot his glasses. he was not sure if it was a sports car or an suv
|
|
---------
|
|
Question: what type was the car?
|
|
Helpful Answer: a sports car or an suv
|
|
Score: 60
|
|
|
|
Example #3
|
|
|
|
Context:
|
|
---------
|
|
Pears are either red or orange
|
|
---------
|
|
Question: what color are apples?
|
|
Helpful Answer: This document does not answer the question
|
|
Score: 0
|
|
|
|
Begin!
|
|
|
|
Context:
|
|
---------
|
|
{context}
|
|
---------
|
|
Question: {question}
|
|
Helpful Answer:"""
|
|
PROMPT = PromptTemplate(
|
|
template=prompt_template,
|
|
input_variables=["context", "question"],
|
|
output_parser=output_parser,
|
|
)
|