tiktoken-tools is an open-source command-line utility for counting tokens in text, PDF, image, xlsx, csv, and docx files. It helps developers estimate token usage for LLM prompts and API calls, supporting multiple file formats for flexible workflow integration.
tiktoken-tools is an Other AI product. It focuses on counting tokens in various file formats for LLM usage estimation and prompt engineering. It is built as an open-source project for developers working with LLMs and token-based APIs. tiktoken-tools is open source under the MIT license. It runs on the command line.
raffishquartan builds and maintains tiktoken-tools, and the product first shipped in 2025. Development happens publicly on GitHub with 14 commits in the last 90 days. PulseGate's similarity index finds few close equivalents — tiktoken-tools occupies a relatively distinct niche. Key capabilities include token counting, PDF support, and CSV support.
Latest indexed changes and source events
tiktoken-tools discovered by the PulseGate indexer
Other apps tracked under the same category.