langchain/libs/partners/together
ccurme 181dfef118
core, standard tests, partner packages: add test for model params (#21677)
1. Adds `.get_ls_params` to BaseChatModel which returns
```python
class LangSmithParams(TypedDict, total=False):
    ls_provider: str
    ls_model_name: str
    ls_model_type: Literal["chat"]
    ls_temperature: Optional[float]
    ls_max_tokens: Optional[int]
    ls_stop: Optional[List[str]]
```
by default it will only return
```python
{ls_model_type="chat", ls_stop=stop}
```

2. Add these params to inheritable metadata in
`CallbackManager.configure`

3. Implement `.get_ls_params` and populate all params for Anthropic +
all subclasses of BaseChatOpenAI

Sample trace:
https://smith.langchain.com/public/d2962673-4c83-47c7-b51e-61d07aaffb1b/r

**OpenAI**:
<img width="984" alt="Screenshot 2024-05-17 at 10 03 35 AM"
src="https://github.com/langchain-ai/langchain/assets/26529506/2ef41f74-a9df-4e0e-905d-da74fa82a910">

**Anthropic**:
<img width="978" alt="Screenshot 2024-05-17 at 10 06 07 AM"
src="https://github.com/langchain-ai/langchain/assets/26529506/39701c9f-7da5-4f1a-ab14-84e9169d63e7">

**Mistral** (and all others for which params are not yet populated):
<img width="977" alt="Screenshot 2024-05-17 at 10 08 43 AM"
src="https://github.com/langchain-ai/langchain/assets/26529506/37d7d894-fec2-4300-986f-49a5f0191b03">
2024-05-17 13:51:26 -04:00
..
langchain_together core, standard tests, partner packages: add test for model params (#21677) 2024-05-17 13:51:26 -04:00
scripts together: add chat models, use openai base (#21337) 2024-05-06 17:47:06 -07:00
tests core, standard tests, partner packages: add test for model params (#21677) 2024-05-17 13:51:26 -04:00
.gitignore
LICENSE together: add chat models, use openai base (#21337) 2024-05-06 17:47:06 -07:00
Makefile together: add chat models, use openai base (#21337) 2024-05-06 17:47:06 -07:00
poetry.lock multiple: releases with relaxed core dep (#21724) 2024-05-15 19:29:35 +00:00
pyproject.toml multiple: releases with relaxed core dep (#21724) 2024-05-15 19:29:35 +00:00
README.md together: add chat models, use openai base (#21337) 2024-05-06 17:47:06 -07:00

langchain-together

This package contains the LangChain integrations for Together AI through their APIs.

Installation and Setup

  • Install the LangChain partner package
pip install -U langchain-together
  • Get your Together AI api key from the Together Dashboard and set it as an environment variable (TOGETHER_API_KEY)

Chat Completions

This package contains the ChatTogether class, which is the recommended way to interface with Together AI chat models.

ADD USAGE EXAMPLE HERE. Can we add this in the langchain docs?

NEED to add image endpoint + completions endpoint as well

Embeddings

See a usage example

Use togethercomputer/m2-bert-80M-8k-retrieval as the default model for embeddings.