tiktoken_core

An experimental port of OpenAI's Tokenizer to lua

MIT

10,127

$ luarocks install tiktoken_core

The Lua module written in Rust that provides Tiktoken support for Lua.

0.2.5-11 year ago2,449 downloads

0.2.4-11 year ago522 downloads

0.2.3-11 year ago3,449 downloads

0.2.2-12 years ago1,415 downloads

0.2.1-12 years ago2,000 downloads

0.2.0-12 years ago21 downloads

0.1.0-12 years ago15 downloads

lua >= 5.1