mirror of https://github.com/hwchase17/langchain
docs(text_splitter): update document of character splitter with tiktoken (#10001)
The current document has not mentioned that splits larger than chunk size would happen. I update the related document and explain why it happens and how to solve it. related issue #1349 #3838 #2140pull/9999/head
parent
565c021730
commit
05664a6f20
Loading…
Reference in New Issue