You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/libs/community/langchain_community/embeddings
Oguz Vuruskaner 5b35f077f9
[community][fix](DeepInfraEmbeddings): Implement chunking for large batches (#21189)
**Description:**
This PR introduces chunking logic to the `DeepInfraEmbeddings` class to
handle large batch sizes without exceeding maximum batch size of the
backend. This enhancement ensures that embedding generation processes
large batches by breaking them down into smaller, manageable chunks,
each conforming to the maximum batch size limit.

**Issue:**
Fixes #21189

**Dependencies:**
No new dependencies introduced.
4 months ago
..
__init__.py community: add SambaNova embeddings integration (#21227) 4 months ago
aleph_alpha.py community[minor]: import fix (#20995) 4 months ago
anyscale.py community[minor]: Add Anyscale embedding support (#17605) 5 months ago
awa.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
azure_openai.py (all): update removal in deprecation warnings from 0.2 to 0.3 (#21265) 4 months ago
baichuan.py infra: add print rule to ruff (#16221) 7 months ago
baidu_qianfan_endpoint.py community:qianfan endpoint support init params & remove useless params definietion (#15381) 8 months ago
bedrock.py community[minor]: import fix (#20995) 4 months ago
bookend.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
clarifai.py community[patch] : Tidy up and update Clarifai SDK functions (#18314) 6 months ago
cloudflare_workersai.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
cohere.py (all): update removal in deprecation warnings from 0.2 to 0.3 (#21265) 4 months ago
dashscope.py Fixing the Issue with DashScopeEmbeddings Handling More than 25 Rows of Data (#14662) 8 months ago
databricks.py community[patch]: docstrings update (#20301) 5 months ago
deepinfra.py [community][fix](DeepInfraEmbeddings): Implement chunking for large batches (#21189) 4 months ago
edenai.py infra: add -p to mkdir in lint steps (#17013) 7 months ago
elasticsearch.py elasticsearch[patch], community[patch]: update references, deprecate community classes (#18506) 6 months ago
embaas.py infra: add -p to mkdir in lint steps (#17013) 7 months ago
ernie.py community[patch]: deprecate ErnieBotChat and ErnieEmbeddings classes (#15862) 8 months ago
fake.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
fastembed.py community[patch]: support fastembed v1 and v2 (#19125) 6 months ago
gigachat.py community[minor]: Added GigaChat Embeddings support + updated previous GigaChat integration (#19516) 6 months ago
google_palm.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
gpt4all.py community: Instantiate GPT4AllEmbeddings with parameters (#21238) 4 months ago
gradient_ai.py infra: add -p to mkdir in lint steps (#17013) 7 months ago
huggingface.py Added additional headers for HuggingFaceInferenceAPIEmbeddings endpoint. (#21282) 4 months ago
huggingface_hub.py community[patch]: Fixed 'coroutine' object is not subscriptable error (#15986) 8 months ago
infinity.py docs: community docstring updates (#21040) 4 months ago
infinity_local.py community[patch]: docstrings update (#20301) 5 months ago
itrex.py community[minor]: Add ITREX optimized Embeddings (#18474) 6 months ago
javelin_ai_gateway.py community[patch]: docstrings update (#20301) 5 months ago
jina.py Refactor: use SecretStr for jina embeddings (#15068) 9 months ago
johnsnowlabs.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
laser.py community: Add Laser Embedding Integration (#18111) 7 months ago
llamacpp.py community[minor]: import fix (#20995) 4 months ago
llamafile.py community[minor]: llamafile embeddings support (#17976) 6 months ago
llm_rails.py infra: add -p to mkdir in lint steps (#17013) 7 months ago
localai.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
minimax.py infra: add -p to mkdir in lint steps (#17013) 7 months ago
mlflow.py docs: fix databricks document url (#19096) 6 months ago
mlflow_gateway.py community[patch]: docstrings update (#20301) 5 months ago
modelscope_hub.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
mosaicml.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
nemo.py mark NemoEmbeddings as deprecated (#21239) 4 months ago
nlpcloud.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
oci_generative_ai.py community[minor]: import fix (#20995) 4 months ago
octoai_embeddings.py community[patch]: octoai embeddings bug fix (#17216) 7 months ago
ollama.py community[patch]: OllamaEmbeddings - Pass headers to post request (#16880) 5 months ago
openai.py (all): update removal in deprecation warnings from 0.2 to 0.3 (#21265) 4 months ago
openvino.py community[minor]: import fix (#20995) 4 months ago
optimum_intel.py community: fix tqdm import (#20263) 5 months ago
oracleai.py community[minor]: Oraclevs integration (#21123) 4 months ago
premai.py docs: community docstring updates (#21040) 4 months ago
sagemaker_endpoint.py community[patch]: Add explicit error message to Bedrock error output. (#17328) 5 months ago
sambanova.py community: add SambaNova embeddings integration (#21227) 4 months ago
self_hosted.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
self_hosted_hugging_face.py docs: Update documentation to use 'model_id' rather than 'model_name' to match actual API (#16615) 8 months ago
sentence_transformer.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
solar.py (all): update removal in deprecation warnings from 0.2 to 0.3 (#21265) 4 months ago
spacy_embeddings.py infra: add -p to mkdir in lint steps (#17013) 7 months ago
sparkllm.py docs: community docstring updates (#21040) 4 months ago
tensorflow_hub.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
text2vec.py Update text2vec.py (#19657) 6 months ago
titan_takeoff.py docs: community docstring updates (#21040) 4 months ago
vertexai.py (all): update removal in deprecation warnings from 0.2 to 0.3 (#21265) 4 months ago
volcengine.py Feat add volcano embedding (#14693) 8 months ago
voyageai.py (all): update removal in deprecation warnings from 0.2 to 0.3 (#21265) 4 months ago
xinference.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 9 months ago
yandex.py community[patch]: YandexGPT API add ability to disable request logging (#20670) 5 months ago