mirror of
https://github.com/hwchase17/langchain
synced 2024-10-31 15:20:26 +00:00
36 lines
1.2 KiB
Plaintext
36 lines
1.2 KiB
Plaintext
|
# Infino
|
||
|
|
|
||
|
|
>[Infino](https://github.com/infinohq/infino) is an open-source observability platform that stores both metrics and application logs together.
|
||
|
|
|
||
|
|
Key features of infino include:
|
||
|
|
- Metrics Tracking: Capture time taken by LLM model to handle request, errors, number of tokens, and costing indication for the particular LLM.
|
||
|
|
- Data Tracking: Log and store prompt, request, and response data for each LangChain interaction.
|
||
|
|
- Graph Visualization: Generate basic graphs over time, depicting metrics such as request duration, error occurrences, token count, and cost.
|
||
|
|
|
||
|
|
## Installation and Setup
|
||
|
|
|
||
|
|
First, you'll need to install the `infinopy` Python package as follows:
|
||
|
|
|
||
|
|
```bash
|
||
|
|
pip install infinopy
|
||
|
|
```
|
||
|
|
|
||
|
|
If you already have an Infino Server running, then you're good to go; but if
|
||
|
|
you don't, follow the next steps to start it:
|
||
|
|
|
||
|
|
- Make sure you have Docker installed
|
||
|
|
- Run the following in your terminal:
|
||
|
|
```
|
||
|
|
docker run --rm --detach --name infino-example -p 3000:3000 infinohq/infino:latest
|
||
|
|
```
|
||
|
|
|
||
|
|
|
||
|
|
|
||
|
|
## Using Infino
|
||
|
|
|
||
|
|
See a [usage example of `InfinoCallbackHandler`](/docs/modules/callbacks/integrations/infino.html).
|
||
|
|
|
||
|
|
```python
|
||
|
|
from langchain.callbacks import InfinoCallbackHandler
|
||
|
|
```
|