mirror of https://github.com/hwchase17/langchain
Use tiktoken for Python 3.8 (#2709)
Fixes issue #2677 `tiktoken` is supported for Python 3.8, so there is no need to use the fallback GPT-2 tokenizer.pull/2730/head
parent
186ca9d3e4
commit
f435f2267c
Loading…
Reference in New Issue