mirror of
https://github.com/hwchase17/langchain
synced 2024-10-29 17:07:25 +00:00
4322b246aa
This PR aims at showcasing how to use vLLM's OpenAI-compatible chat API. ### Context Lanchain already supports vLLM and its OpenAI-compatible `Completion` API. However, the `ChatCompletion` API was not aligned with OpenAI and for this reason I've waited for this [PR](https://github.com/vllm-project/vllm/pull/852) to be merged before adding this notebook to langchain. |
||
---|---|---|
.. | ||
anthropic_functions.ipynb | ||
anthropic.ipynb | ||
anyscale.ipynb | ||
azure_chat_openai.ipynb | ||
azureml_chat_endpoint.ipynb | ||
baidu_qianfan_endpoint.ipynb | ||
bedrock.ipynb | ||
ernie.ipynb | ||
google_vertex_ai_palm.ipynb | ||
index.mdx | ||
jinachat.ipynb | ||
konko.ipynb | ||
litellm.ipynb | ||
llama_api.ipynb | ||
minimax.ipynb | ||
ollama.ipynb | ||
openai.ipynb | ||
promptlayer_chatopenai.ipynb | ||
vllm.ipynb |