You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/langchain/callbacks
Naman Modi 37a89918e0
Infino integration for simplified logs, metrics & search across LLM data & token usage (#6218)
### Integration of Infino with LangChain for Enhanced Observability

This PR aims to integrate [Infino](https://github.com/infinohq/infino),
an open source observability platform written in rust for storing
metrics and logs at scale, with LangChain, providing users with a
streamlined and efficient method of tracking and recording LangChain
experiments. By incorporating Infino into LangChain, users will be able
to gain valuable insights and easily analyze the behavior of their
language models.

#### Please refer to the following files related to integration:
- `InfinoCallbackHandler`: A [callback
handler](https://github.com/naman-modi/langchain/blob/feature/infino-integration/langchain/callbacks/infino_callback.py)
specifically designed for storing chain responses within Infino.
- Example `infino.ipynb` file: A comprehensive notebook named
[infino.ipynb](https://github.com/naman-modi/langchain/blob/feature/infino-integration/docs/extras/modules/callbacks/integrations/infino.ipynb)
has been included to guide users on effectively leveraging Infino for
tracking LangChain requests.
- [Integration
Doc](https://github.com/naman-modi/langchain/blob/feature/infino-integration/docs/extras/ecosystem/integrations/infino.mdx)
for Infino integration.

By integrating Infino, LangChain users will gain access to powerful
visualization and debugging capabilities. Infino enables easy tracking
of inputs, outputs, token usage, execution time of LLMs. This
comprehensive observability ensures a deeper understanding of individual
executions and facilitates effective debugging.

Co-authors: @vinaykakade @savannahar68
---------

Co-authored-by: Vinay Kakade <vinaykakade@gmail.com>
12 months ago
..
tracers Update Name (#6136) 12 months ago
__init__.py Infino integration for simplified logs, metrics & search across LLM data & token usage (#6218) 12 months ago
aim_callback.py Harrison/aim integration (#2178) 1 year ago
argilla_callback.py Extend `ArgillaCallbackHandler` support (#6153) 12 months ago
arize_callback.py Update arize_callback.py (#6433) 12 months ago
base.py Add support for tags (#5898) 12 months ago
clearml_callback.py Harrison/clear ml (#2179) 1 year ago
comet_ml_callback.py Fixing issue link for Comet callback (#3212) 1 year ago
file.py FileCallbackHandler (#5589) 1 year ago
human.py human approval callback (#5581) 1 year ago
infino_callback.py Infino integration for simplified logs, metrics & search across LLM data & token usage (#6218) 12 months ago
manager.py Improve Error Message for failed callback (#6247) 12 months ago
mlflow_callback.py Callback Handler for MLflow (#4150) 1 year ago
openai_info.py Added gpt-3.5-turbo 0613 16k and 16k-0613 pricing (#6287) 12 months ago
stdout.py bump ver to 200 (#6130) 12 months ago
streaming_aiter.py Empty check before pop (#4929) 1 year ago
streaming_stdout.py rfc: callback changes (#1165) 1 year ago
streaming_stdout_final_only.py QuickFix for FinalStreamingStdOutCallbackHandler: Ignore new lines & white spaces (#5497) 1 year ago
streamlit.py Make streamlit import optional (#6510) 12 months ago
utils.py Harrison/clear ml (#2179) 1 year ago
wandb_callback.py feat(integrations): Add WandbTracer (#4521) 1 year ago
whylabs_callback.py WhyLabs callback (#4906) 1 year ago