Add tiktoken-rs

1 year ago · 54bcbec801
parent 1b616c1d43
commit 54bcbec801
1 changed files with 2 additions and 0 deletions
--- a/README.md
+++ b/README.md
@ -767,6 +767,8 @@ See also [About Rust’s Machine Learning Community](https://medium.com/@autumn_
 #### OpenAI

 * [64bit/async-openai](https://github.com/64bit/async-openai) [[async-openai](https://crates.io/crates/async-openai)] — Ergonomic Rust bindings for OpenAI API based on OpenAPI spec.
+* [zurawiki/tiktoken-rs](https://github.com/zurawiki/tiktoken-rs) [[tiktoken-rs](https://crates.io/crates/tiktoken-rs)] — Rust library for tokenizing text with OpenAI models using tiktoken. [![CI](https://github.com/zurawiki/tiktoken-rs/actions/workflows/ci.yml/badge.svg)](https://github.com/zurawiki/tiktoken-rs/actions/workflows/ci.yml)
+

 ### Astronomy