simonpfish
|
6c00ce2ff5
|
Remove unnecessary cell outputs
|
2023-10-16 12:03:12 -07:00 |
|
Roger Zurawicki
|
fc5af842a2
|
Add tiktoken-rs to third-party library (#791)
|
2023-10-16 10:21:24 -07:00 |
|
Simón Fishman
|
c2959fd60b
|
[tiktoken_counting] fix tokenizer name (#741)
|
2023-09-27 16:12:31 -07:00 |
|
Eliah Kagan
|
63f95154b1
|
Add Tiktokenizer link in "How to count tokens" (#604)
This adds a link to Tiktokenizer webapp as another tool, in
addition to the OpenAI Tokenizer.
|
2023-08-28 10:28:19 -07:00 |
|
richzw
|
964dd85ed3
|
add tiktoken-go to How_to_count_tokens_with_tiktoken.ipynb (#605)
|
2023-07-24 15:54:52 -07:00 |
|
Ted Sanders
|
de3bd58434
|
Ted/update token counting 0613 (#541)
* updates tiktoken counting function
* slight rewording
* updates ChatGPT guide with new models
|
2023-06-23 16:45:32 -07:00 |
|
Avery Khoo
|
26978e9ed1
|
Update How_to_count_tokens_with_tiktoken.ipynb (#511)
Add support for gpt-3.5-*-0613 models
|
2023-06-23 16:10:30 -07:00 |
|
aiqinxuancai
|
23bd266fef
|
Update How_to_count_tokens_with_tiktoken.ipynb (#368)
* Update How_to_count_tokens_with_tiktoken.ipynb
add c# tiktoken lib.
* Update How_to_count_tokens_with_tiktoken.ipynb
fix format.
* Update How_to_count_tokens_with_tiktoken.ipynb
fix format.
|
2023-05-05 13:09:05 -07:00 |
|
jiangying
|
4d59bafe25
|
add jtokkit to How_to_count_tokens_with_tiktoken.ipynb
|
2023-04-28 12:24:51 +08:00 |
|
dmitry-brazhenko
|
be1f1187bd
|
added sharptoken as exampel
|
2023-03-28 17:31:14 +02:00 |
|
Ted Sanders
|
7622aa1d20
|
updates description of token counting function
|
2023-03-25 00:14:45 -07:00 |
|
Ted Sanders
|
b45d2b2346
|
updates token counting guide
|
2023-03-24 21:09:25 -07:00 |
|
Ted Sanders
|
a101157740
|
updates token counting function to work with gpt-4
|
2023-03-20 10:55:35 -07:00 |
|
Ted Sanders
|
8cd6b0f53b
|
adds examples of counting tokens for the ChatGPT API
|
2023-03-02 12:52:26 -08:00 |
|
Ted Sanders
|
5050739cf1
|
adds tiktoken example
|
2023-01-17 13:23:06 -08:00 |
|