You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Liang Zhang 6479aab74f community[patch]: Add param "task" to Databricks LLM to work around serialization of transform_output_fn (#14933) ... **What is the reproduce code?** ```python from langchain.chains import LLMChain, load_chain from langchain.llms import Databricks from langchain.prompts import PromptTemplate def transform_output(response): # Extract the answer from the responses. return str(response["candidates"][0]["text"]) def transform_input(**request): full_prompt = f"""{request["prompt"]} Be Concise. """ request["prompt"] = full_prompt return request chat_model = Databricks( endpoint_name="llama2-13B-chat-Brambles", transform_input_fn=transform_input, transform_output_fn=transform_output, verbose=True, ) print(f"Test chat model: {chat_model('What is Apache Spark')}") # This works llm_chain = LLMChain(llm=chat_model, prompt=PromptTemplate.from_template("{chat_input}")) llm_chain("colorful socks") # this works llm_chain.save("databricks_llm_chain.yaml") # transform_input_fn and transform_output_fn are not serialized into the model yaml file loaded_chain = load_chain("databricks_llm_chain.yaml") # The Databricks LLM is recreated with transform_input_fn=None, transform_output_fn=None. loaded_chain("colorful socks") # Thus this errors. The transform_output_fn is needed to produce the correct output ``` Error: ``` File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-6c34afab-3473-421d-877f-1ef18930ef4d/lib/python3.10/site-packages/pydantic/v1/main.py", line 341, in __init__ raise validation_error pydantic.v1.error_wrappers.ValidationError: 1 validation error for Generation text str type expected (type=type_error.str) request payload: {'query': 'What is a databricks notebook?'}'} ``` **What does the error mean?** When the LLM generates an answer, represented by a Generation data object. The Generation data object takes a str field called text, e.g. Generation(text=”blah”). However, the Databricks LLM tried to put a non-str to text, e.g. Generation(text={“candidates”:[{“text”: “blah”}]}) Thus, pydantic errors. **Why the output format becomes incorrect after saving and loading the Databricks LLM?** Databrick LLM does not support serializing transform_input_fn and transform_output_fn, so they are not serialized into the model yaml file. When the Databricks LLM is loaded, it is recreated with transform_input_fn=None, transform_output_fn=None. Without transform_output_fn, the output text is not unwrapped, thus errors. Missing transform_output_fn causes this error. Missing transform_input_fn causes the additional prompt “Be Concise.” to be lost after saving and loading. <!-- Thank you for contributing to LangChain! Replace this entire comment with: - **Description:** a description of the change, - **Issue:** the issue # it fixes (if applicable), - **Dependencies:** any dependencies required for this change, - **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below), - **Twitter handle:** we announce bigger features on Twitter. If your PR gets announced, and you'd like a mention, we'll gladly shout you out! Please make sure your PR is passing linting and testing before submitting. Run `make format`, `make lint` and `make test` to check this locally. See contribution guidelines for more information on how to write/run tests, lint, etc: https://python.langchain.com/docs/contributing/ If you're adding a new integration, please include: 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/extras` directory. If no one reviews your PR within a few days, please @-mention one of @baskaryan, @eyurtsev, @hwchase17. --> --------- Co-authored-by: Bagatur <baskaryan@gmail.com>		8 months ago
..
grammars	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
__init__.py	community[minor]: Add Aphrodite Engine support (#14759)	8 months ago
ai21.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
aleph_alpha.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
amazon_api_gateway.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
anthropic.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
anyscale.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
aphrodite.py	community[minor]: Add Aphrodite Engine support (#14759)	8 months ago
arcee.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
aviary.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
azureml_endpoint.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
baidu_qianfan_endpoint.py	community[patch]: make ak and sk optional in qianfan endpoint (#14835)	8 months ago
bananadev.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
baseten.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
beam.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
bedrock.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
bittensor.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
cerebriumai.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
chatglm.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
clarifai.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
cloudflare_workersai.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
cohere.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
ctransformers.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
ctranslate2.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
databricks.py	community[patch]: Add param "task" to Databricks LLM to work around serialization of transform_output_fn (#14933)	8 months ago
deepinfra.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
deepsparse.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
edenai.py	community: replace deprecated davinci models (#14860)	8 months ago
fake.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
fireworks.py	docs: docstrings `langchain_community` update (#14889)	8 months ago
forefrontai.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
gigachat.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
google_palm.py	google-genai[patch], community[patch]: Added support for new Google GenerativeAI models (#14530)	9 months ago
gooseai.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
gpt4all.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
gradient_ai.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
huggingface_endpoint.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
huggingface_hub.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
huggingface_pipeline.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
huggingface_text_gen_inference.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
human.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
javelin_ai_gateway.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
koboldai.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
llamacpp.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
loading.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
manifest.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
minimax.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
mlflow.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
mlflow_ai_gateway.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
modal.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
mosaicml.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
nlpcloud.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
octoai_endpoint.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
ollama.py	Add image support for Ollama (#14713)	8 months ago
opaqueprompts.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
openai.py	community: replace deprecated davinci models (#14860)	8 months ago
openllm.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
openlm.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
pai_eas_endpoint.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
petals.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
pipelineai.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
predibase.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
predictionguard.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
promptlayer_openai.py	community: replace deprecated davinci models (#14860)	8 months ago
replicate.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
rwkv.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
sagemaker_endpoint.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
self_hosted.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
self_hosted_hugging_face.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
stochasticai.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
symblai_nebula.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
textgen.py	docs: docstrings `langchain_community` update (#14889)	8 months ago
titan_takeoff.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
titan_takeoff_pro.py	docs: docstrings `langchain_community` update (#14889)	8 months ago
together.py	docs: docstrings `langchain_community` update (#14889)	8 months ago
tongyi.py	community[patch]: Update Tongyi default model_name (#14844)	8 months ago
utils.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
vertexai.py	Update Vertex AI to include Gemini (#14670)	9 months ago
vllm.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
volcengine_maas.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
watsonxllm.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
writer.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	9 months ago
xinference.py	docs: docstrings `langchain_community` update (#14889)	8 months ago
yandex.py	community[patch]: Add retry logic to Yandex GPT API Calls (#14907)	8 months ago