mirror of
https://github.com/hwchase17/langchain
synced 2024-11-06 03:20:49 +00:00
e46202829f
# TextLoader auto detect encoding and enhanced exception handling - Add an option to enable encoding detection on `TextLoader`. - The detection is done using `chardet` - The loading is done by trying all detected encodings by order of confidence or raise an exception otherwise. ### New Dependencies: - `chardet` Fixes #4479 ## Before submitting <!-- If you're adding a new integration, include an integration test and an example notebook showing its use! --> ## Who can review? Community members can review the PR once tests pass. Tag maintainers/contributors who might be interested: - @eyurtsev --------- Co-authored-by: blob42 <spike@w530> |
||
|---|---|---|
| .. | ||
| example-non-utf8.txt | ||
| example-utf8.txt | ||