An experimental port of OpenAI's Tokenizer to lua
1
Version 0.2.4-1 of tiktoken_core was uploaded 8 days ago. For lua >= 5.1