Ayo Ayibiowu ac1d7d9de8 community[feat]: Adds LLMLingua as a document compressor (#17711) ... **Description**: This PR adds support for using the [LLMLingua project ](https://github.com/microsoft/LLMLingua) especially the LongLLMLingua (Enhancing Large Language Model Inference via Prompt Compression) as a document compressor / transformer. The LLMLingua project is an interesting project that can greatly improve RAG system by compressing prompts and contexts while keeping their semantic relevance. **Issue**: https://github.com/microsoft/LLMLingua/issues/31 **Dependencies**: [llmlingua](https://pypi.org/project/llmlingua/) @baskaryan --------- Co-authored-by: Ayodeji Ayibiowu <ayodeji.ayibiowu@getinge.com> Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>		2024-02-27 19:23:56 -08:00
..
__init__.py	community[feat]: Adds LLMLingua as a document compressor (#17711)	2024-02-27 19:23:56 -08:00
llmlingua_filter.py	community[feat]: Adds LLMLingua as a document compressor (#17711)	2024-02-27 19:23:56 -08:00