Archives/langchain
2
0
Fork 1
mirror of https://github.com/hwchase17/langchain synced 2024-10-31 15:20:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
3223a97dc6
langchain/docs/integrations
History
Ravindra Marella b3988621c5
Add C Transformers for GGML Models (#5218) 
# Add C Transformers for GGML Models
I created Python bindings for the GGML models:
https://github.com/marella/ctransformers

Currently it supports GPT-2, GPT-J, GPT-NeoX, LLaMA, MPT, etc. See
[Supported
Models](https://github.com/marella/ctransformers#supported-models).


It provides a unified interface for all models:

```python
from langchain.llms import CTransformers

llm = CTransformers(model='/path/to/ggml-gpt-2.bin', model_type='gpt2')

print(llm('AI is going to'))
```

It can be used with models hosted on the Hugging Face Hub:

```py
llm = CTransformers(model='marella/gpt-2-ggml')
```

It supports streaming:

```py
from langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandler

llm = CTransformers(model='marella/gpt-2-ggml', callbacks=[StreamingStdOutCallbackHandler()])
```

Please see [README](https://github.com/marella/ctransformers#readme) for
more details.
---------

Co-authored-by: Dev 2049 <dev.dev2049@gmail.com>
2023-05-25 13:42:44 -07:00
..
vectara Vectara (#5069) 2023-05-24 01:24:58 -07:00
ai21.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
aim_tracking.ipynb docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
analyticdb.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
anyscale.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
apify.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
atlas.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
bananadev.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
beam.md Beam (#4996) 2023-05-24 01:25:18 -07:00
cerebriumai.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
chroma.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
clearml_tracking.ipynb docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
cohere.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
comet_tracking.ipynb docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
ctransformers.md Add C Transformers for GGML Models (#5218) 2023-05-25 13:42:44 -07:00
databerry.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
databricks.ipynb Add documentation for Databricks integration (#5013) 2023-05-20 22:06:24 -07:00
deepinfra.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
deeplake.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
docugami.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
forefrontai.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
google_search.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
google_serper.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
gooseai.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
gpt4all.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
graphsignal.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
hazy_research.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
helicone.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
huggingface.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
jina.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
lancedb.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
llamacpp.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
metal.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
milvus.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
mlflow_tracking.ipynb docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
modal.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
myscale.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
nlpcloud.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
openai.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
opensearch.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
openweathermap.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
petals.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
pgvector.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
pinecone.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
pipelineai.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
predictionguard.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
promptlayer.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
psychic.md move docs 2023-05-21 09:22:35 -07:00
qdrant.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
rebuff.ipynb docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
redis.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
replicate.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
runhouse.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
rwkv.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
searx.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
serpapi.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
stochasticai.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
tair.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
unstructured.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
vectara.md Vectara (#5069) 2023-05-24 01:24:58 -07:00
wandb_tracking.ipynb docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
weaviate.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
whylabs_profiling.ipynb WhyLabs callback (#4906) 2023-05-22 20:29:47 -07:00
wolfram_alpha.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
writer.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
yeagerai.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00
zilliz.md docs: compound ecosystem and integrations (#4870) 2023-05-18 09:29:57 -07:00