docs: MLflow API and examples (#9547)

Added docs and links to the API and examples provided by MLflow itself
This commit is contained in:
Leonid Ganeline 2023-09-03 20:52:20 -07:00 committed by GitHub
parent 9bcfd58580
commit 03174c91d0
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -1,6 +1,9 @@
# MLflow AI Gateway # MLflow AI Gateway
>`The MLflow AI Gateway` service is a powerful tool designed to streamline the usage and management of various large language model (LLM) providers, such as OpenAI and Anthropic, within an organization. It offers a high-level interface that simplifies the interaction with these services by providing a unified endpoint to handle specific LLM related requests. See [the MLflow AI Gateway documentation](https://mlflow.org/docs/latest/gateway/index.html) for more details. >[The MLflow AI Gateway](https://www.mlflow.org/docs/latest/gateway/index.html) service is a powerful tool designed to streamline the usage and management of various large
> language model (LLM) providers, such as OpenAI and Anthropic, within an organization. It offers a high-level interface
> that simplifies the interaction with these services by providing a unified endpoint to handle specific LLM related requests.
> See [the MLflow AI Gateway documentation](https://mlflow.org/docs/latest/gateway/index.html) for more details.
## Installation and Setup ## Installation and Setup
@ -43,6 +46,16 @@ Start the Gateway server:
mlflow gateway start --config-path /path/to/config.yaml mlflow gateway start --config-path /path/to/config.yaml
``` ```
## Example provided by `MLflow`
>The `mlflow.langchain` module provides an API for logging and loading `LangChain` models.
> This module exports multivariate LangChain models in the langchain flavor and univariate LangChain
> models in the pyfunc flavor.
See the [API documentation and examples](https://www.mlflow.org/docs/latest/python_api/mlflow.langchain.html).
## Completions Example ## Completions Example
```python ```python