Skip to content
Back to the index

AI Tokenizer

visualstudio.comBrowser DevTools & extensions

PulseGate's liveness check found it on 2 Oct 2026; it is registered on the VS Code Marketplace and has been in the index since 1 Sep 2026. How this is checked

AI Tokenizer is a VS Code extension that counts tokens in files or selected text for Claude, GPT, and Gemini models. It helps developers check prompt size and context-window usage while working with Markdown and other text files.

Inferred · not functionally tested

FreeWebWindowsmacOSLinux
Visit visualstudio.com

Overview

6 features

Purpose: Helps developers estimate LLM token usage and context-window size before sending text to AI models.

Inferred · not functionally tested

Audience: developers using Claude, GPT, or Gemini in VS Code

Inferred · not functionally tested

Functions: analytics

Inferred · not functionally tested

Interfaces: API: unknown · MCP: unknown · CLI: unknown · Self-hosting: unknown

Recorded constraints: pricing: free · license: Proprietary · platforms: WEB · deployment: browser, windows, macos, linux

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: unknown.

AI Tokenizer sits in PulseGate's Browser DevTools & extensions category. Inferred · not functionally tested: It helps developers estimate LLM token usage and context-window size before sending text to AI models. Inferred · not functionally tested: It is built as a consumer product for developers using Claude, GPT, or Gemini in VS Code. Basis unknown · not verified: AI Tokenizer costs nothing to use. Basis unknown · not verified: It runs on the web, Windows, macOS, and Linux.

It is developed by Beata Humeniuk, and it first shipped in 2026. Inferred · not functionally tested: Among its 6 catalogued features are file token counting, text token counting, and claude support.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • File token counting
  • Text token counting
  • Claude support
  • GPT support
  • Gemini support
  • Context window checks

Topics: Inferred · not functionally tested

Tags
llm-token-countingcontext-windowvscode-extensionclaude-toolsgemini-tools
AI capabilities
Text
Inference: Local

JSON profile · Text profile · Access guide

Built with & integrations

AI providers
multiple
Connectors
vscode
Runs on
BrowserWindowsmacOSLinux

Trust & compliance

Public signals
HTTPSFree tierStore listing found

Indexing history

1

What PulseGate has recorded for this listing

  1. Indexed1 Sep · 04:13 UTC
    AI Tokenizer seen via VS Code Marketplace
    Source: VS Code Marketplace · Open

Frequently asked questions about AI Tokenizer

What is AI Tokenizer?
Inferred · not functionally tested: AI Tokenizer helps developers estimate LLM token usage and context-window size before sending text to AI models. It is catalogued under Browser DevTools & extensions on PulseGate.
Who should use AI Tokenizer?
Inferred · not functionally tested: AI Tokenizer is a consumer product built for developers using Claude, GPT, or Gemini in VS Code.
Is AI Tokenizer free?
Basis unknown · not verified: Yes — AI Tokenizer is free to use.
What platforms does AI Tokenizer run on?
Basis unknown · not verified: AI Tokenizer runs on the web, Windows, macOS, and Linux.
Is AI Tokenizer still active?
PulseGate's liveness check found it on 2 Oct 2026.
What are alternatives to AI Tokenizer?
Similar projects tracked by PulseGate include AI Token Checker, AI Token Monitor, and Enterprise AI Token Optimizer.AI Token CheckerAI Token MonitorEnterprise AI Token Optimizer
Who develops AI Tokenizer?
AI Tokenizer is developed by Beata Humeniuk.
When did AI Tokenizer launch?
AI Tokenizer first shipped in 2026.

Similar projects

Closest matches by what these projects do