An experimental port of OpenAI's Tokenizer to lua
1
Version 0.2.5-1 of tiktoken_core was uploaded 4 days ago. For lua >= 5.1