mirror of
https://github.com/hwchase17/langchain
synced 2024-11-04 06:00:26 +00:00
4322b246aa
This PR aims at showcasing how to use vLLM's OpenAI-compatible chat API. ### Context Lanchain already supports vLLM and its OpenAI-compatible `Completion` API. However, the `ChatCompletion` API was not aligned with OpenAI and for this reason I've waited for this [PR](https://github.com/vllm-project/vllm/pull/852) to be merged before adding this notebook to langchain. |
||
---|---|---|
.. | ||
_scripts | ||
api_reference | ||
docs_skeleton | ||
extras | ||
snippets | ||
.local_build.sh | ||
vercel_requirements.txt |