mirror of
https://github.com/hwchase17/langchain
synced 2024-11-13 19:10:52 +00:00
66828f4ecc
Previously, regardless of whether or not strip_whitespace was set to true or false, the strip text method in the SpacyTextSplitter class used `sent.text` to get the sentence. I modified this to include a ternary such that if strip_whitespace is false, it uses `sent.text_with_ws` I also modified the project.toml to include the spacy pipeline package and to lock the numpy version, as higher versions break spacy. - **Issue:** N/a - **Dependencies:** None |
||
---|---|---|
.. | ||
integration_tests | ||
test_data | ||
unit_tests | ||
__init__.py |