langchain/libs/community/langchain_community/llms
Lance Martin d5c22b80a5
community[patch]: Fix Ollama for LLaMA3 (#20624)
We see verbose generations w/ LLaMA3 and Ollama - 

https://smith.langchain.com/public/88c4cd21-3d57-4229-96fe-53443398ca99/r

--- 

Fix here implies that when stop was being set to an empty list, the
stream had no conditions under which to stop, which could lead to
excessive or unintended output.

Test LLaMA2 - 

https://smith.langchain.com/public/57dfc64a-591b-46fa-a1cd-8783acaefea2/r

Test LLaMA3 - 

https://smith.langchain.com/public/76ff5f47-ac89-4772-a7d2-5caa907d3fd6/r

https://smith.langchain.com/public/a31d2fad-9094-4c93-949a-964b27630ccb/r

Test Mistral -

https://smith.langchain.com/public/a4fe7114-c308-4317-b9fd-6c86d31f1c5b/r

---------

Co-authored-by: Erick Friis <erick@langchain.dev>
2024-04-19 00:20:32 +00:00
..
grammars community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
__init__.py community[minor]: Unify Titan Takeoff Integrations and Adding Embedding Support (#18775) 2024-04-17 01:43:35 +00:00
ai21.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
aleph_alpha.py infra: add print rule to ruff (#16221) 2024-02-09 16:13:30 -08:00
amazon_api_gateway.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
anthropic.py community[patch]: move pdf text tests to integration (#18746) 2024-03-07 10:34:22 -08:00
anyscale.py community[patch]: Remove model limitation on Anyscale LLM (#17662) 2024-02-25 18:21:19 -08:00
aphrodite.py community[minor]: Add Aphrodite Engine support (#14759) 2023-12-20 01:16:57 -05:00
arcee.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
aviary.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
azureml_endpoint.py community[patch]: Support Streaming in Azure Machine Learning (#18246) 2024-03-28 23:38:20 +00:00
baichuan.py infra: add -p to mkdir in lint steps (#17013) 2024-02-05 11:22:06 -08:00
baidu_qianfan_endpoint.py community[patch]: Fix the error of Baidu Qianfan not passing the stop parameter (#18666) 2024-03-28 18:21:49 +00:00
bananadev.py community[patch]: introduce convert_to_secret() to bananadev llm (#14283) 2024-03-30 00:52:25 +00:00
baseten.py community: refactor Baseten integration with new API endpoints & docs (#15017) 2023-12-22 12:46:24 -08:00
beam.py infra: add print rule to ruff (#16221) 2024-02-09 16:13:30 -08:00
bedrock.py docs: aws docs updates (#20571) 2024-04-17 23:32:00 +00:00
bigdl_llm.py community[minor]: migrate bigdl-llm to ipex-llm (#19518) 2024-03-27 20:12:59 -07:00
bittensor.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
cerebriumai.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
chatglm3.py community: Add ChatGLM3 (#15265) 2024-01-29 20:30:52 -08:00
chatglm.py <langchain_community\llms\chatglm.py>: <Correcting "history"> (#16729) 2024-01-29 19:50:31 -08:00
clarifai.py community[patch] : Tidy up and update Clarifai SDK functions (#18314) 2024-03-07 19:47:44 -08:00
cloudflare_workersai.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
cohere.py cohere[patch]: add cohere as a partner package (#19049) 2024-03-25 20:23:47 +00:00
ctransformers.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
ctranslate2.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
databricks.py community[patch]: Databricks - fix scope of dangerous deserialization error in Databricks LLM connector (#20368) 2024-04-12 17:27:26 -04:00
deepinfra.py community[patch]: Invoke callback prior to yielding token fix [DeepInfra] (#20427) 2024-04-14 14:32:52 -04:00
deepsparse.py infra: add print rule to ruff (#16221) 2024-02-09 16:13:30 -08:00
edenai.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
fake.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
fireworks.py community[patch]: invoke callback prior to yielding token (fireworks) (#19388) 2024-03-22 16:44:06 -07:00
forefrontai.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
friendli.py community[minor]: Integration for Friendli LLM and ChatFriendli ChatModel. (#17913) 2024-03-08 02:20:47 +00:00
gigachat.py community[minor]: Added GigaChat Embeddings support + updated previous GigaChat integration (#19516) 2024-03-25 16:08:37 -07:00
google_palm.py multiple[patch]: fix deprecation versions (#18349) 2024-02-29 16:58:33 -08:00
gooseai.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
gpt4all.py community[patch]: Enable streaming for GPT4all (#16392) 2024-01-22 09:54:18 -08:00
gradient_ai.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
huggingface_endpoint.py community[patch]: Invoke callback prior to yielding token fix for HuggingFaceEndpoint (#20366) 2024-04-12 19:16:34 +00:00
huggingface_hub.py Community: Fuse HuggingFace Endpoint-related classes into one (#17254) 2024-02-19 10:33:15 -08:00
huggingface_pipeline.py docs: Update docs for HuggingFacePipeline (#19306) 2024-03-25 00:29:21 -07:00
huggingface_text_gen_inference.py community[patch]: Invoke callback prior to yielding token fix [HuggingFaceTextGenInference] (#20426) 2024-04-18 14:25:20 +00:00
human.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
ipex_llm.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
javelin_ai_gateway.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
koboldai.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
konko.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
layerup_security.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
llamacpp.py community[patch]: invoke callback prior to yielding token (llama.cpp) (#19392) 2024-03-22 16:17:56 -04:00
llamafile.py community[patch]: Invoke callback prior to yielding token fix for Llamafile (#20365) 2024-04-12 19:26:12 +00:00
loading.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
manifest.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
minimax.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
mlflow_ai_gateway.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
mlflow.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
mlx_pipeline.py community[minor]: Add support for MLX models (chat & llm) (#18152) 2024-04-09 14:17:07 +00:00
modal.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
moonshot.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
mosaicml.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
nlpcloud.py community[patch]: fix top_p type hint (#15452) 2024-01-15 11:59:39 -08:00
oci_data_science_model_deployment_endpoint.py docs, community[patch], experimental[patch], langchain[patch], cli[pa… (#15412) 2024-01-02 15:32:16 -05:00
oci_generative_ai.py community[patch]: docstrings (#16810) 2024-02-09 12:48:57 -08:00
octoai_endpoint.py community[patch]: update OctoAI endpoint to subclass BaseOpenAI (#19757) 2024-04-16 17:32:20 -07:00
ollama.py community[patch]: Fix Ollama for LLaMA3 (#20624) 2024-04-19 00:20:32 +00:00
opaqueprompts.py community[patch]: update use of deprecated llm methods (#20393) 2024-04-12 17:28:23 -04:00
openai.py community[patch]: invoke callback prior to yielding token (openai) (#19389) 2024-03-22 16:45:55 -07:00
openllm.py community[patch]: OpenLLM Async Client Fixes and Timeout Parameter (#20007) 2024-04-09 16:34:56 -04:00
openlm.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
pai_eas_endpoint.py community[patch]: Invoke callback prior to yielding token (pai_eas_endpoint) (#18627) 2024-03-20 07:56:58 -07:00
petals.py Refactor: use SecretStr for Petals llms (#15121) 2023-12-26 12:57:37 -08:00
pipelineai.py infra: add -p to mkdir in lint steps (#17013) 2024-02-05 11:22:06 -08:00
predibase.py community: for Predibase -- enable both Predibase-hosted and HuggingFace-hosted fine-tuned adapter repositories (#20370) 2024-04-12 08:32:00 -07:00
predictionguard.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
promptlayer_openai.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
replicate.py community[patch]: Invoke callback prior to yielding token (replicate) (#18626) 2024-03-20 07:57:27 -07:00
rwkv.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
sagemaker_endpoint.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
self_hosted_hugging_face.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
self_hosted.py community[major]: breaking change in some APIs to force users to opt-in for pickling (#18696) 2024-03-06 16:43:01 -05:00
solar.py upstage: init package (#20574) 2024-04-17 23:25:36 +00:00
sparkllm.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
stochasticai.py infra: add -p to mkdir in lint steps (#17013) 2024-02-05 11:22:06 -08:00
symblai_nebula.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
textgen.py infra: add print rule to ruff (#16221) 2024-02-09 16:13:30 -08:00
titan_takeoff.py community[minor]: Unify Titan Takeoff Integrations and Adding Embedding Support (#18775) 2024-04-17 01:43:35 +00:00
together.py together[minor]: add llm (#15853) 2024-01-10 17:55:34 -08:00
tongyi.py community[patch]: Fixed bug in merging generation_info during chunk concatenation in Tongyi and ChatTongyi (#19014) 2024-03-15 16:27:53 -07:00
utils.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
vertexai.py community[patch]: docstrings update (#20301) 2024-04-11 16:23:27 -04:00
vllm.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
volcengine_maas.py community[patch]: Invoke callback prior to yielding token (#18288) 2024-02-28 21:40:53 +00:00
watsonxllm.py ibm: added partners package langchain_ibm, added llm (#16512) 2024-02-14 12:12:19 -08:00
weight_only_quantization.py community[minor]: weight only quantization with intel-extension-for-transformers. (#14504) 2024-04-03 16:21:34 +00:00
writer.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
xinference.py docs: docstrings langchain_community update (#14889) 2023-12-19 08:58:24 -05:00
yandex.py community[patch]: YandexGPT Use recent yandexcloud sdk version (#19341) 2024-03-25 17:05:57 -07:00
yuan2.py community[patch]: fix yuan2 errors in LLMs (#19004) 2024-03-28 14:37:44 -07:00