You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/tests/integration_tests/retrievers
German Martin 736a1819aa
LOTR: Lord of the Retrievers. A retriever that merge several retrievers together applying document_formatters to them. (#5798)
"One Retriever to merge them all, One Retriever to expose them, One
Retriever to bring them all and in and process them with Document
formatters."

Hi @dev2049! Here bothering people again!

I'm using this simple idea to deal with merging the output of several
retrievers into one.
I'm aware of DocumentCompressorPipeline and
ContextualCompressionRetriever but I don't think they allow us to do
something like this. Also I was getting in trouble to get the pipeline
working too. Please correct me if i'm wrong.

This allow to do some sort of "retrieval" preprocessing and then using
the retrieval with the curated results anywhere you could use a
retriever.
My use case is to generate diff indexes with diff embeddings and sources
for a more colorful results then filtering them with one or many
document formatters.

I saw some people looking for something like this, here:
https://github.com/hwchase17/langchain/issues/3991
and something similar here:
https://github.com/hwchase17/langchain/issues/5555

This is just a proposal I know I'm missing tests , etc. If you think
this is a worth it idea I can work on tests and anything you want to
change.
Let me know!

---------

Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>
1 year ago
..
document_compressors Update Cohere Reranker (#4180) 1 year ago
__init__.py Contextual compression retriever (#2915) 1 year ago
test_arxiv.py Add `arxiv` retriever (#4538) 1 year ago
test_azure_cognitive_search.py Add azure cognitive search retriever (#4467) 1 year ago
test_contextual_compression.py Contextual compression retriever (#2915) 1 year ago
test_merger_retriever.py LOTR: Lord of the Retrievers. A retriever that merge several retrievers together applying document_formatters to them. (#5798) 1 year ago
test_pupmed.py Harrison/pubmed integration (#5664) 1 year ago
test_weaviate_hybrid_search.py Remove unnecessary comment (#4845) 1 year ago
test_wikipedia.py added `Wikipedia` retriever (#4302) 1 year ago