Commit Graph

8 Commits (a8806790523d88638dd904e456a3a8539a759b40)

Author SHA1 Message Date
blob42 a880679052 verbose catch of open() errors on TextLoader (#4481) 1 year ago
blob42 3805aef263 timeout on file encoding detection (#4481) 1 year ago
blob42 5837d18cbe move encoding detection to own file (#4481)
- encoding detection returns meaningful encodings schema
1 year ago
blob42 672fec896f add docstring and move encoding detection to own func (#4481) 1 year ago
blob42 b5d3e99f9b TextLoader autodetect encodings + better exception handling (#4481) 1 year ago
Travis Hammond e49284acde
Add encoding parameter to TextLoader (#2250)
This merge request proposes changes to the TextLoader class to make it
more flexible and robust when handling text files with different
encodings. The current implementation of TextLoader does not provide a
way to specify the encoding of the text file being read. As a result, it
might lead to incorrect handling of files with non-default encodings,
causing issues with loading the content.

Benefits:
- The proposed changes will make the TextLoader class more flexible,
allowing it to handle text files with different encodings.
- The changes maintain backward compatibility, as the encoding parameter
is optional.
1 year ago
Jeru2023 64b9843b5b
Update text.py (#2195)
Add encoding parameter when open txt file to support unicode files.
1 year ago
Harrison Chase e51fad1488
Harrison/0083 (#996)
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
1 year ago