You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Ravindra Marella b3988621c5 Add C Transformers for GGML Models (#5218) ... # Add C Transformers for GGML Models I created Python bindings for the GGML models: https://github.com/marella/ctransformers Currently it supports GPT-2, GPT-J, GPT-NeoX, LLaMA, MPT, etc. See [Supported Models](https://github.com/marella/ctransformers#supported-models). It provides a unified interface for all models: ```python from langchain.llms import CTransformers llm = CTransformers(model='/path/to/ggml-gpt-2.bin', model_type='gpt2') print(llm('AI is going to')) ``` It can be used with models hosted on the Hugging Face Hub: ```py llm = CTransformers(model='marella/gpt-2-ggml') ``` It supports streaming: ```py from langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandler llm = CTransformers(model='marella/gpt-2-ggml', callbacks=[StreamingStdOutCallbackHandler()]) ``` Please see [README](https://github.com/marella/ctransformers#readme) for more details. --------- Co-authored-by: Dev 2049 <dev.dev2049@gmail.com>		1 year ago
..
vectara	Vectara (#5069)	1 year ago
ai21.md	docs: compound ecosystem and integrations (#4870)	1 year ago
aim_tracking.ipynb	docs: compound ecosystem and integrations (#4870)	1 year ago
analyticdb.md	docs: compound ecosystem and integrations (#4870)	1 year ago
anyscale.md	docs: compound ecosystem and integrations (#4870)	1 year ago
apify.md	docs: compound ecosystem and integrations (#4870)	1 year ago
atlas.md	docs: compound ecosystem and integrations (#4870)	1 year ago
bananadev.md	docs: compound ecosystem and integrations (#4870)	1 year ago
beam.md	Beam (#4996)	1 year ago
cerebriumai.md	docs: compound ecosystem and integrations (#4870)	1 year ago
chroma.md	docs: compound ecosystem and integrations (#4870)	1 year ago
clearml_tracking.ipynb	docs: compound ecosystem and integrations (#4870)	1 year ago
cohere.md	docs: compound ecosystem and integrations (#4870)	1 year ago
comet_tracking.ipynb	docs: compound ecosystem and integrations (#4870)	1 year ago
ctransformers.md	Add C Transformers for GGML Models (#5218)	1 year ago
databerry.md	docs: compound ecosystem and integrations (#4870)	1 year ago
databricks.ipynb	Add documentation for Databricks integration (#5013)	1 year ago
deepinfra.md	docs: compound ecosystem and integrations (#4870)	1 year ago
deeplake.md	docs: compound ecosystem and integrations (#4870)	1 year ago
docugami.md	docs: compound ecosystem and integrations (#4870)	1 year ago
forefrontai.md	docs: compound ecosystem and integrations (#4870)	1 year ago
google_search.md	docs: compound ecosystem and integrations (#4870)	1 year ago
google_serper.md	docs: compound ecosystem and integrations (#4870)	1 year ago
gooseai.md	docs: compound ecosystem and integrations (#4870)	1 year ago
gpt4all.md	docs: compound ecosystem and integrations (#4870)	1 year ago
graphsignal.md	docs: compound ecosystem and integrations (#4870)	1 year ago
hazy_research.md	docs: compound ecosystem and integrations (#4870)	1 year ago
helicone.md	docs: compound ecosystem and integrations (#4870)	1 year ago
huggingface.md	docs: compound ecosystem and integrations (#4870)	1 year ago
jina.md	docs: compound ecosystem and integrations (#4870)	1 year ago
lancedb.md	docs: compound ecosystem and integrations (#4870)	1 year ago
llamacpp.md	docs: compound ecosystem and integrations (#4870)	1 year ago
metal.md	docs: compound ecosystem and integrations (#4870)	1 year ago
milvus.md	docs: compound ecosystem and integrations (#4870)	1 year ago
mlflow_tracking.ipynb	docs: compound ecosystem and integrations (#4870)	1 year ago
modal.md	docs: compound ecosystem and integrations (#4870)	1 year ago
myscale.md	docs: compound ecosystem and integrations (#4870)	1 year ago
nlpcloud.md	docs: compound ecosystem and integrations (#4870)	1 year ago
openai.md	docs: compound ecosystem and integrations (#4870)	1 year ago
opensearch.md	docs: compound ecosystem and integrations (#4870)	1 year ago
openweathermap.md	docs: compound ecosystem and integrations (#4870)	1 year ago
petals.md	docs: compound ecosystem and integrations (#4870)	1 year ago
pgvector.md	docs: compound ecosystem and integrations (#4870)	1 year ago
pinecone.md	docs: compound ecosystem and integrations (#4870)	1 year ago
pipelineai.md	docs: compound ecosystem and integrations (#4870)	1 year ago
predictionguard.md	docs: compound ecosystem and integrations (#4870)	1 year ago
promptlayer.md	docs: compound ecosystem and integrations (#4870)	1 year ago
psychic.md	move docs	1 year ago
qdrant.md	docs: compound ecosystem and integrations (#4870)	1 year ago
rebuff.ipynb	docs: compound ecosystem and integrations (#4870)	1 year ago
redis.md	docs: compound ecosystem and integrations (#4870)	1 year ago
replicate.md	docs: compound ecosystem and integrations (#4870)	1 year ago
runhouse.md	docs: compound ecosystem and integrations (#4870)	1 year ago
rwkv.md	docs: compound ecosystem and integrations (#4870)	1 year ago
searx.md	docs: compound ecosystem and integrations (#4870)	1 year ago
serpapi.md	docs: compound ecosystem and integrations (#4870)	1 year ago
stochasticai.md	docs: compound ecosystem and integrations (#4870)	1 year ago
tair.md	docs: compound ecosystem and integrations (#4870)	1 year ago
unstructured.md	docs: compound ecosystem and integrations (#4870)	1 year ago
vectara.md	Vectara (#5069)	1 year ago
wandb_tracking.ipynb	docs: compound ecosystem and integrations (#4870)	1 year ago
weaviate.md	docs: compound ecosystem and integrations (#4870)	1 year ago
whylabs_profiling.ipynb	WhyLabs callback (#4906)	1 year ago
wolfram_alpha.md	docs: compound ecosystem and integrations (#4870)	1 year ago
writer.md	docs: compound ecosystem and integrations (#4870)	1 year ago
yeagerai.md	docs: compound ecosystem and integrations (#4870)	1 year ago
zilliz.md	docs: compound ecosystem and integrations (#4870)	1 year ago