Archives/langchain
2
0
Fork 1
mirror of https://github.com/hwchase17/langchain synced 2024-11-06 03:20:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
74045bf5c0
langchain/libs
History
Kunal 74045bf5c0
max length attribute for spacy splitter for large docs (#13875) 
For large size documents spacy splitter doesn't work it throws an error
as shown in below screenshot.
Reason its default max_length is 1000000 and there is no option to
increase it. So i added it in this PR.


![image](https://github.com/langchain-ai/langchain/assets/73680423/613625c3-0e21-4834-9aad-2a73cf56eecc)

---------

Co-authored-by: Bagatur <baskaryan@gmail.com>
2023-11-28 22:30:26 -05:00
..
cli Library Licenses (#13300) 2023-11-28 17:34:27 -08:00
core infra[patch]: add base deps and fix docs lint (#13998) 2023-11-28 17:27:37 -08:00
experimental Library Licenses (#13300) 2023-11-28 17:34:27 -08:00
langchain max length attribute for spacy splitter for large docs (#13875) 2023-11-28 22:30:26 -05:00