docs: Update deployments.md to include a BentoML example (#2661)

Add a new deployment example with BentoML, see more
https://github.com/ssheng/BentoChain.
fix_agent_callbacks
Sean Sheng 1 year ago committed by GitHub
parent bd9f095ed2
commit 90d5328eda
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -40,3 +40,7 @@ This includes: production ready endpoints, horizontal scaling across dependencie
## [Langchain-serve](https://github.com/jina-ai/langchain-serve)
This repository allows users to serve local chains and agents as RESTful, gRPC, or Websocket APIs thanks to [Jina](https://docs.jina.ai/). Deploy your chains & agents with ease and enjoy independent scaling, serverless and autoscaling APIs, as well as a Streamlit playground on Jina AI Cloud.
## [BentoML](https://github.com/ssheng/BentoChain)
This repository provides an example of how to deploy a LangChain application with [BentoML](https://github.com/bentoml/BentoML). BentoML is a framework that enables the containerization of machine learning applications as standard OCI images. BentoML also allows for the automatic generation of OpenAPI and gRPC endpoints. With BentoML, you can integrate models from all popular ML frameworks and deploy them as microservices running on the most optimal hardware and scaling independently.

Loading…
Cancel
Save