mirror of
https://github.com/hwchase17/langchain
synced 2024-11-11 19:11:02 +00:00
c6660df58e
**Description** The DoctranTextTranslator has an async transform function that was not implemented because [the doctran library](https://github.com/psychic-api/doctran) uses a sync version of the `execute` method. - I implemented the `DoctranTextTranslator.atransform_documents()` method using `asyncio.to_thread` to run the function in a separate thread. - I updated the example in the Notebook with the new async version. - The performance improvements can be appreciated when a big document is divided into multiple chunks. Relates to: - Issue #14645: https://github.com/langchain-ai/langchain/issues/14645 - Issue #14437: https://github.com/langchain-ai/langchain/issues/14437 - https://github.com/langchain-ai/langchain/pull/15264 --------- Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com> |
||
---|---|---|
.. | ||
xsl | ||
__init__.py | ||
beautiful_soup_transformer.py | ||
doctran_text_extract.py | ||
doctran_text_qa.py | ||
doctran_text_translate.py | ||
embeddings_redundant_filter.py | ||
google_translate.py | ||
html2text.py | ||
long_context_reorder.py | ||
markdownify.py | ||
nuclia_text_transform.py | ||
openai_functions.py |