Commit Graph

10 Commits

Author SHA1 Message Date
Ted Sanders
4a565cdebb Ted/update token counting 0613 (#541)
* updates tiktoken counting function

* slight rewording

* updates ChatGPT guide with new models
2023-06-23 16:45:32 -07:00
Avery Khoo
a9f8eb3518 Update How_to_count_tokens_with_tiktoken.ipynb (#511)
Add support for gpt-3.5-*-0613 models
2023-06-23 16:10:30 -07:00
aiqinxuancai
4b869a71a3 Update How_to_count_tokens_with_tiktoken.ipynb (#368)
* Update How_to_count_tokens_with_tiktoken.ipynb

add c# tiktoken lib.

* Update How_to_count_tokens_with_tiktoken.ipynb

fix format.

* Update How_to_count_tokens_with_tiktoken.ipynb

fix format.
2023-05-05 13:09:05 -07:00
jiangying
df3bc473f0 add jtokkit to How_to_count_tokens_with_tiktoken.ipynb 2023-04-28 12:24:51 +08:00
dmitry-brazhenko
3c53f34e01 added sharptoken as exampel 2023-03-28 17:31:14 +02:00
Ted Sanders
f571555953 updates description of token counting function 2023-03-25 00:14:45 -07:00
Ted Sanders
867d6a3afa updates token counting guide 2023-03-24 21:09:25 -07:00
Ted Sanders
6ee7a82ac4 updates token counting function to work with gpt-4 2023-03-20 10:55:35 -07:00
Ted Sanders
5b956ab602 adds examples of counting tokens for the ChatGPT API 2023-03-02 12:52:26 -08:00
Ted Sanders
22baac6106 adds tiktoken example 2023-01-17 13:23:06 -08:00