You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/libs/community/langchain_community
Ayo Ayibiowu ac1d7d9de8
community[feat]: Adds LLMLingua as a document compressor (#17711)
**Description**: This PR adds support for using the [LLMLingua project
](https://github.com/microsoft/LLMLingua) especially the LongLLMLingua
(Enhancing Large Language Model Inference via Prompt Compression) as a
document compressor / transformer.

The LLMLingua project is an interesting project that can greatly improve
RAG system by compressing prompts and contexts while keeping their
semantic relevance.

**Issue**: https://github.com/microsoft/LLMLingua/issues/31
**Dependencies**: [llmlingua](https://pypi.org/project/llmlingua/)

@baskaryan

---------

Co-authored-by: Ayodeji Ayibiowu <ayodeji.ayibiowu@getinge.com>
Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>
5 months ago
..
adapters docs: added `community` modules descriptions (#17827) 5 months ago
agent_toolkits docs: added `community` modules descriptions (#17827) 5 months ago
callbacks community[minor] : adds callback handler for Fiddler AI (#17708) 5 months ago
chat_loaders Do not issue beta or deprecation warnings on internal calls (#15641) 7 months ago
chat_message_histories astradb: Add AstraDBChatMessageHistory to langchain-astradb package (#17732) 5 months ago
chat_models community[minor]: Add async_client for Anyscale Chat model (#18050) 5 months ago
docstore community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 8 months ago
document_compressors community[feat]: Adds LLMLingua as a document compressor (#17711) 5 months ago
document_loaders community[patch]: Skip `OpenAIWhisperParser` extremely small audio chunks to avoid api error (#11450) 5 months ago
document_transformers community[minor]: Adding asynchronous function implementation for Doctran (#15941) 7 months ago
embeddings community: Add Laser Embedding Integration (#18111) 5 months ago
example_selectors docs: added `community` modules descriptions (#17827) 5 months ago
graphs community[patch]: Fix GraphSparqlQAChain so that it works with Ontotext GraphDB (#15009) 5 months ago
indexes community: Add document manager and mongo document manager (#17320) 5 months ago
llms community[patch]: Remove model limitation on Anyscale LLM (#17662) 5 months ago
output_parsers langchain[patch], community[minor]: move `output_parsers.ernie_functions` (#16057) 7 months ago
retrievers community[patch]: fix llama index imports and fields access (#17870) 5 months ago
storage docs: Add docstring to AstraDBStore (#17793) 5 months ago
tools community[patch]: compatibility with SQLAlchemy 1.4.x (#17954) 5 months ago
utilities community[patch]: Fix GenericRequestsWrapper _aget_resp_content must be async (#18065) 5 months ago
utils Add the BQ job usage tracking from LangChain (#17123) 6 months ago
vectorstores community: vectorstores.kdbai - Added support for when no docs are present (#18103) 5 months ago
__init__.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 8 months ago
cache.py community[patch]: Graceful handling of redis errors in RedisCache and AsyncRedisCache (#17171) 5 months ago
py.typed community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 8 months ago