langchain/libs/partners/together
ccurme 74c7198906
core, anthropic[patch]: support streaming tool calls when function has no arguments (#23915)
resolves https://github.com/langchain-ai/langchain/issues/23911

When an AIMessageChunk is instantiated, we attempt to parse tool calls
off of the tool_call_chunks.

Here we add a special-case to this parsing, where `""` will be parsed as
`{}`.

This is a reaction to how Anthropic streams tool calls in the case where
a function has no arguments:
```
{'id': 'toolu_01J8CgKcuUVrMqfTQWPYh64r', 'input': {}, 'name': 'magic_function', 'type': 'tool_use', 'index': 1}
{'partial_json': '', 'type': 'tool_use', 'index': 1}
```
The `partial_json` does not accumulate to a valid json string-- most
other providers tend to emit `"{}"` in this case.
2024-07-05 18:57:41 +00:00
..
langchain_together partners: add lint docstrings for azure-dynamic-sessions/together modules (#23303) 2024-06-24 16:26:54 -04:00
scripts partners: add lint docstrings for azure-dynamic-sessions/together modules (#23303) 2024-06-24 16:26:54 -04:00
tests core, anthropic[patch]: support streaming tool calls when function has no arguments (#23915) 2024-07-05 18:57:41 +00:00
.gitignore
LICENSE together: add chat models, use openai base (#21337) 2024-05-06 17:47:06 -07:00
Makefile infra: update mypy 1.10, ruff 0.5 (#23721) 2024-07-03 10:33:27 -07:00
poetry.lock infra: update mypy 1.10, ruff 0.5 (#23721) 2024-07-03 10:33:27 -07:00
pyproject.toml infra: update mypy 1.10, ruff 0.5 (#23721) 2024-07-03 10:33:27 -07:00
README.md together: add chat models, use openai base (#21337) 2024-05-06 17:47:06 -07:00

langchain-together

This package contains the LangChain integrations for Together AI through their APIs.

Installation and Setup

  • Install the LangChain partner package
pip install -U langchain-together
  • Get your Together AI api key from the Together Dashboard and set it as an environment variable (TOGETHER_API_KEY)

Chat Completions

This package contains the ChatTogether class, which is the recommended way to interface with Together AI chat models.

ADD USAGE EXAMPLE HERE. Can we add this in the langchain docs?

NEED to add image endpoint + completions endpoint as well

Embeddings

See a usage example

Use togethercomputer/m2-bert-80M-8k-retrieval as the default model for embeddings.