community[patch]: Invoke callback prior to yielding token (titan_takeoff_pro) (#18624)

## PR title
community[patch]: Invoke callback prior to yielding token

## PR message
- Description: Invoke callback prior to yielding token in _stream_
method in llms/titan_takeoff_pro.
- Issue: #16913 
- Dependencies: None
pull/19342/head
Yudhajit Sinha 3 months ago committed by GitHub
parent 455a74486b
commit 7d216ad1e1
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

@ -207,9 +207,9 @@ class TitanTakeoffPro(LLM):
# Yield any remaining content in the buffer.
if buffer:
chunk = GenerationChunk(text=buffer.replace("</s>", ""))
yield chunk
if run_manager:
run_manager.on_llm_new_token(token=chunk.text)
yield chunk
@property
def _identifying_params(self) -> Mapping[str, Any]:

Loading…
Cancel
Save