2023-06-21 08:38:20 +00:00
|
|
|
# Infino
|
|
|
|
|
|
|
|
>[Infino](https://github.com/infinohq/infino) is an open-source observability platform that stores both metrics and application logs together.
|
|
|
|
|
2023-08-29 00:42:11 +00:00
|
|
|
Key features of `Infino` include:
|
|
|
|
- **Metrics Tracking**: Capture time taken by LLM model to handle request, errors, number of tokens, and costing indication for the particular LLM.
|
|
|
|
- **Data Tracking**: Log and store prompt, request, and response data for each LangChain interaction.
|
|
|
|
- **Graph Visualization**: Generate basic graphs over time, depicting metrics such as request duration, error occurrences, token count, and cost.
|
2023-06-21 08:38:20 +00:00
|
|
|
|
|
|
|
## Installation and Setup
|
|
|
|
|
|
|
|
First, you'll need to install the `infinopy` Python package as follows:
|
|
|
|
|
|
|
|
```bash
|
|
|
|
pip install infinopy
|
|
|
|
```
|
|
|
|
|
2023-08-29 00:42:11 +00:00
|
|
|
If you already have an `Infino Server` running, then you're good to go; but if
|
2023-06-21 08:38:20 +00:00
|
|
|
you don't, follow the next steps to start it:
|
|
|
|
|
|
|
|
- Make sure you have Docker installed
|
|
|
|
- Run the following in your terminal:
|
|
|
|
```
|
|
|
|
docker run --rm --detach --name infino-example -p 3000:3000 infinohq/infino:latest
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## Using Infino
|
|
|
|
|
2023-08-29 00:42:11 +00:00
|
|
|
See a [usage example of `InfinoCallbackHandler`](/docs/integrations/callbacks/infino.html).
|
2023-06-21 08:38:20 +00:00
|
|
|
|
|
|
|
```python
|
|
|
|
from langchain.callbacks import InfinoCallbackHandler
|
|
|
|
```
|