langchain/docs/extras/integrations/llms
Taqi Jaffri 8f158b72fc
Added stop sequence support to replicate (#8107)
Stop sequences are useful if you are doing long-running completions and
need to early-out rather than running for the full max_length... not
only does this save inference cost on Replicate, it is also much faster
if you are going to truncate the output later anyway.

Other LLMs support stop sequences natively (e.g. OpenAI) but I didn't
see this for Replicate so adding this via their prediction cancel
method.

Housekeeping: I ran `make format` and `make lint`, no issues reported in
the files I touched.

I did update the replicate integration test and ran `poetry run pytest
tests/integration_tests/llms/test_replicate.py` successfully.

Finally, I am @tjaffri https://twitter.com/tjaffri for feature
announcement tweets... or if you could please tag @docugami
https://twitter.com/docugami we would really appreciate that :-)

Co-authored-by: Taqi Jaffri <tjaffri@docugami.com>
2023-07-24 17:34:13 -07:00
..
ai21.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
aleph_alpha.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
amazon_api_gateway_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
anyscale.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
azure_openai_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
azureml_endpoint_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
banana.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
baseten.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
beam.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
bedrock.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
cerebriumai_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
chatglm.ipynb Change with_history option to False for ChatGLM by default (#8076) 2023-07-24 15:46:02 -07:00
clarifai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
cohere.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
ctransformers.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
databricks.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
deepinfra_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
forefrontai_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
google_vertex_ai_palm.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
gooseai_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
gpt4all.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
huggingface_hub.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
huggingface_pipelines.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
huggingface_textgen_inference.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
index.mdx mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
jsonformer_experimental.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
koboldai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
llamacpp.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
llm_caching.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
manifest.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
modal.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
mosaicml.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
nlpcloud.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
octoai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
openai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
openllm.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
openlm.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
petals_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
pipelineai_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
predibase.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
predictionguard.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
promptlayer_openai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
rellm_experimental.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
replicate.ipynb Added stop sequence support to replicate (#8107) 2023-07-24 17:34:13 -07:00
runhouse.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
sagemaker.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
stochasticai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
textgen.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
tongyi.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
writer.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00