toks is an open-source CLI tool that counts tokens in files for various large language model providers. It assists developers and AI researchers in analyzing context windows and preparing data for LLM applications.
toks is a CLI tools & terminal project. Helping developers and researchers count tokens in files for different LLM providers from the command line. toks is an open-source project aimed at developers and AI researchers. toks is open source under the MIT license. toks is available on the command line.
toks first shipped in 2026. Development happens publicly on GitHub with 10 commits in the last 90 days. Key capabilities include token counting, LLM provider support, and CLI interface.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do