langchain/docs/extras/integrations/providers/fireworks.md
rjanardhan3 affaaea87b
Updates fireworks (#8765)
<!-- Thank you for contributing to LangChain!

Replace this comment with:
  - Description: Updates to Fireworks Documentation, 
  - Issue: N/A,
  - Dependencies: N/A,
  - Tag maintainer: @rlancemartin,

---------

Co-authored-by: Raj Janardhan <rajjanardhan@Rajs-Laptop.attlocal.net>
2023-08-04 10:32:22 -07:00

749 B

Fireworks

This page covers how to use the Fireworks models within Langchain.

Installation and Setup

  • To use the Fireworks model, you need to have a Fireworks API key. To generate one, sign up at platform.fireworks.ai
  • Authenticate by setting the FIREWORKS_API_KEY environment variable.

LLM

Fireworks integrates with Langchain through the LLM module, which allows for standardized usage of any models deployed on the Fireworks models.

In this example, we'll work the llama-v2-13b.

from langchain.llms.fireworks import Fireworks 

llm = Fireworks(model="fireworks-llama-v2-13b-chat", max_tokens=256, temperature=0.4)
llm("Name 3 sports.")

For a more detailed walkthrough, see here.