langchain/libs
WeichenXu e9fc87aab1
community[patch]: Make ChatDatabricks model supports streaming response (#19912)
**Description:** Make ChatDatabricks model supports stream
**Issue:** N/A
**Dependencies:** MLflow nightly build version (we will release next
MLflow version soon)
**Twitter handle:** N/A

Manually test:

(Before testing, please install `pip install
git+https://github.com/mlflow/mlflow.git`)

```python
# Test Databricks Foundation LLM model
from langchain.chat_models import ChatDatabricks

chat_model = ChatDatabricks(
    endpoint="databricks-llama-2-70b-chat",
    max_tokens=500
)
from langchain_core.messages import AIMessageChunk

for chunk in chat_model.stream("What is mlflow?"):
  print(chunk.content, end="|")
```

- [x] **Add tests and docs**: If you're adding a new integration, please
include
1. a test for the integration, preferably unit tests that do not rely on
network access,
2. an example notebook showing its use. It lives in
`docs/docs/integrations` directory.


- [x] **Lint and test**: Run `make format`, `make lint` and `make test`
from the root of the package(s) you've modified. See contribution
guidelines for more: https://python.langchain.com/docs/contributing/

Additional guidelines:
- Make sure optional dependencies are imported within a function.
- Please do not add dependencies to pyproject.toml files (even optional
ones) unless they are required for unit tests.
- Most PRs should not touch more than one package.
- Changes should be backwards compatible.
- If you are adding something to community, do not re-import it in
langchain.

If no one reviews your PR within a few days, please @-mention one of
baskaryan, efriis, eyurtsev, hwchase17.

---------

Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com>
Co-authored-by: Bagatur <baskaryan@gmail.com>
2024-04-16 23:34:49 +00:00
..
cli templates: readme langsmith not private beta (#20173) 2024-04-12 13:08:10 -07:00
community community[patch]: Make ChatDatabricks model supports streaming response (#19912) 2024-04-16 23:34:49 +00:00
core anthropic[patch]: serialization in partner package (#18828) 2024-04-16 16:05:58 -07:00
experimental community[patch]: update use of deprecated llm methods (#20393) 2024-04-12 17:28:23 -04:00
langchain update scheduled tests (#20526) 2024-04-16 16:49:46 -04:00
partners anthropic[patch]: serialization in partner package (#18828) 2024-04-16 16:05:58 -07:00
standard-tests standardized-tests[patch]: test tool call messages (#20519) 2024-04-16 23:25:50 +00:00
text-splitters text-splitters[minor]: Add lua code splitting (#20421) 2024-04-13 22:42:51 +00:00