langchain/docs/modules/models/llms
M Waleed Kadous 5124c1e0d9
Add aviary support (#5661)
Aviary is an open source toolkit for evaluating and deploying open
source LLMs. You can find out more about it on
[http://github.com/ray-project/aviary). You can try it out at
[http://aviary.anyscale.com](aviary.anyscale.com).

This code adds support for Aviary in LangChain. To minimize
dependencies, it connects directly to the HTTP endpoint.

The current implementation is not accelerated and uses the default
implementation of `predict` and `generate`.

It includes a test and a simple example. 

@hwchase17 and @agola11 could you have a look at this?

---------

Co-authored-by: Dev 2049 <dev.dev2049@gmail.com>
2023-06-05 16:28:42 -07:00
..
examples docs: improve flow of llm caching notebook (#5309) 2023-05-26 13:34:11 -04:00
integrations Add aviary support (#5661) 2023-06-05 16:28:42 -07:00
getting_started.ipynb docs: update getting_started.ipynb (#2883) 2023-04-14 07:40:26 -07:00
how_to_guides.rst
integrations.rst