blob42/langchain
1
0
Fork 0
forked from Archives/langchain
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1c51d3db0f
langchain/docs/integrations/deepinfra.md
Harrison Chase 416c8b1da3
Harrison/deep infra (#5403) 
Co-authored-by: Yessen Kanapin <yessenzhar@gmail.com>
Co-authored-by: Yessen Kanapin <yessen@deepinfra.com>
2023-05-29 07:10:50 -07:00

912 B
Raw Blame History

DeepInfra

This page covers how to use the DeepInfra ecosystem within LangChain. It is broken into two parts: installation and setup, and then references to specific DeepInfra wrappers.

Installation and Setup

  • Get your DeepInfra api key from this link here.
  • Get an DeepInfra api key and set it as an environment variable (DEEPINFRA_API_TOKEN)

Available Models

DeepInfra provides a range of Open Source LLMs ready for deployment. You can list supported models here. google/flan* models can be viewed here.

You can view a list of request and response parameters here

Wrappers

LLM

There exists an DeepInfra LLM wrapper, which you can access with

from langchain.llms import DeepInfra