mirror of
https://github.com/hwchase17/langchain
synced 2024-10-29 17:07:25 +00:00
675d57df50
## Description: I've integrated CTranslate2 with LangChain. CTranlate2 is a recently popular library for efficient inference with Transformer models that compares favorably to alternatives such as HF Text Generation Inference and vLLM in [benchmarks](https://hamel.dev/notes/llm/inference/03_inference.html). |
||
---|---|---|
.. | ||
callbacks | ||
chat | ||
chat_loaders | ||
document_loaders | ||
document_transformers | ||
llms | ||
memory | ||
providers | ||
retrievers | ||
text_embedding | ||
toolkits | ||
tools | ||
vectorstores |