mirror of https://github.com/hwchase17/langchain synced 2024-11-06 03:20:49 +00:00

Leonid Ganeline e2d7677526

docs: compound ecosystem and integrations (#4870 )

# Docs: compound ecosystem and integrations

**Problem statement:** We have a big overlap between the
References/Integrations and Ecosystem/LongChain Ecosystem pages. It
confuses users. It creates a situation when new integration is added
only on one of these pages, which creates even more confusion.
- removed References/Integrations page (but move all its information
into the individual integration pages - in the next PR).
- renamed Ecosystem/LongChain Ecosystem into Integrations/Integrations.
I like the Ecosystem term. It is more generic and semantically richer
than the Integration term. But it mentally overloads users. The
`integration` term is more concrete.
UPDATE: after discussion, the Ecosystem is the term.
Ecosystem/Integrations is the page (in place of Ecosystem/LongChain
Ecosystem).

As a result, a user gets a single place to start with the individual
integration.

2023-05-18 09:29:57 -07:00

1.0 KiB

Raw Blame History

Llama.cpp

This page covers how to use llama.cpp within LangChain. It is broken into two parts: installation and setup, and then references to specific Llama-cpp wrappers.

Installation and Setup

Install the Python package with pip install llama-cpp-python
Download one of the supported models and convert them to the llama.cpp format per the instructions

Wrappers

LLM

There exists a LlamaCpp LLM wrapper, which you can access with

from langchain.llms import LlamaCpp

For a more detailed walkthrough of this, see this notebook

Embeddings

There exists a LlamaCpp Embeddings wrapper, which you can access with

from langchain.embeddings import LlamaCppEmbeddings