Who should use count-tokens?

count-tokens is an open-source project built for developers and prompt engineers working with LLMs.

Does count-tokens have a free plan?

Yes — count-tokens is open source under the MIT license and free to use.

What platforms does count-tokens run on?

count-tokens runs on the web and the command line.

Is count-tokens still maintained?

The GitHub repository shows 6 commits in the last 90 days.

Who develops count-tokens?

count-tokens is developed by izikeros.

When did count-tokens launch?

count-tokens first shipped in 2023.

Is count-tokens open source?

Yes — count-tokens is open source under the MIT license, developed on GitHub.

Back to the index

count-tokens

Name: count-tokens
Author: izikeros

github.comInfrastructure

count-tokens is an open-source command-line tool that counts the number of tokens in text files using OpenAI's tiktoken tokenizer. It helps developers and prompt engineers estimate LLM usage and optimize prompts.

Open SourceMITWebCLI

Visit github.com

14stars

4features

2023since

Overview

4 features

count-tokens sits in PulseGate's CLI tools & terminal category. Quickly determining the number of tokens in text files for LLM usage estimation and prompt engineering. count-tokens is an open-source project aimed at developers and prompt engineers working with LLMs. The project is open source (MIT). It runs on the web and the command line.

It is developed by izikeros, and it first shipped in 2023. Development happens publicly on GitHub with 14 stars and 6 commits in the last 90 days. Among its 4 catalogued features are token counting, tiktoken integration, and text file analysis.

Summary written by a language model from the project’s public pages.

Token counting
tiktoken integration
Text file analysis
CLI interface

Built with & integrations

AI providers

openai

Runs on

BrowserCLI

Trust & compliance

License

MIT

Verified signals

HTTPSOpen SourceFree tierGitHub · ★ 14Active maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed25 Jun · 18:01 UTC
Listing verified against its public source
Source: PulseGate · Open

Frequently asked questions about count-tokens

What does count-tokens do?: Quickly determining the number of tokens in text files for LLM usage estimation and prompt engineering. It is catalogued under CLI tools & terminal on PulseGate.
Who should use count-tokens?: count-tokens is an open-source project built for developers and prompt engineers working with LLMs.
Does count-tokens have a free plan?: Yes — count-tokens is open source under the MIT license and free to use.
What platforms does count-tokens run on?: count-tokens runs on the web and the command line.
Is count-tokens still maintained?: The GitHub repository shows 6 commits in the last 90 days.
Who develops count-tokens?: count-tokens is developed by izikeros.
When did count-tokens launch?: count-tokens first shipped in 2023.
Is count-tokens open source?: Yes — count-tokens is open source under the MIT license, developed on GitHub.

At a glance

Platforms: Cli
Languages: English
Open source: Yes · ★ 14
License: MIT
Built for: developers and prompt engineers working with LLMs
Model: Open source
Solves: Quickly determining the number of tokens in text files for LLM usage estimation and prompt engineering.

Registered as

GitHub: izikeros/count_tokens
PyPI: count-tokens

Developer

izikeros

Solo developer

GitHub

Open source

View on GitHub

Stars: 14
Forks: 0
Open issues: 0
Last commit: 18 Jun 2026
Commits 90d: 6
Contributors: 1
Authorship: Solo
Default branch: main
Latest release: v0.8.3 · 18 Jun 2026

Index record

Identity confidence: Low · 64
Indexed: 25 Jun 2026
Lifecycle: Alive
Last seen: 25 Jun 2026

Identity audit (12)

Slug: count-tokens-pypi-org
Lifecycle last checked: 8 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 25 Jun 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Written by a language model from the project's public pages.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Canonical URL: https://github.com/izikeros/count_tokens

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do