One Line Fix: missing text output with huggingface TGI LLM (#7972)

Small bug fix. The async _call method was missing a line to return the
generated text.

@baskaryan
This commit is contained in:
Wian Stipp 2023-07-20 06:44:29 -07:00 committed by GitHub
parent 493cbc9410
commit 0ffb7fc10c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -255,4 +255,5 @@ class HuggingFaceTextGenInference(LLM):
if not token.special:
if text_callback:
await text_callback(token.text)
text += token.text
return text