One Line Fix: missing text output with huggingface TGI LLM (#7972)

Small bug fix. The async _call method was missing a line to return the
generated text.

@baskaryan
pull/8007/head
Wian Stipp 1 year ago committed by GitHub
parent 493cbc9410
commit 0ffb7fc10c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -255,4 +255,5 @@ class HuggingFaceTextGenInference(LLM):
if not token.special:
if text_callback:
await text_callback(token.text)
text += token.text
return text

Loading…
Cancel
Save