PulseGatePost-LLM software, agents & workflows market (since 2022)
Coverage
166,990

Apps indexed

 

Freshness
28 min ago

Last update

 

Cadence
1,447/day

7-day average

Indexed today: 614

PulseGate

Market catalog for public software products, models, infra, and workflow tools.

Software is shipping faster than ever, and a growing share of it lives outside the official app stores. PulseGate is a free public catalog — built for builders, analysts, and everyday users.

Platform

  • All Apps
  • Categories
  • Industry Updates
  • Data Sources
  • Coverage Rules
  • Glossary
  • Embed Widget

Support

  • Help Center
  • Submit a Project
  • Report an Issue

Company

  • About
  • Press & Data
  • Contact
  • Platform Status

Legal

  • Privacy
  • Terms
  • Disclaimer

© 2026 PulseGate. Operated by Dymaxio s.r.o., Prague, Czech Republic.·

All systems operational
PulseGate
WH
whetkit
Visit ↗
  1. Home/
  2. LLM eval & observability/
  3. whetkit
←Back to results
W

whetkit

pypi.org·Infrastructure

whetkit is a command-line tool for AI researchers and developers to measure and improve how well LLM agents select and use tools exposed by Model Context Protocol (MCP) servers. It provides benchmarking and evaluation metrics for agent tool-use effectiveness. The project is open source and available on PyPI and GitHub.

Open SourceApache-2.0
CLI
W
Visit PyPI↗

Overview

5 features
  • ✓LLM agent evaluation
  • ✓Tool selection benchmarking
  • ✓MCP server integration
  • ✓Agent tool-use metrics
  • ✓Benchmarking suite

Tags

llm-evaluationtool-selectionmcp-protocol

AI capabilities

Code

Built with & integrations

Connectors
MCP
Runs on
CLI

Trust & compliance

LicenseApache-2.0
Verified signals
✓ HTTPS✓ Open Source✓ Free tier✓ GitHub

Recent events

Latest indexed changes and source events

  1. IndexedJul 7, 2:43 PM

    whetkit discovered by the PulseGate indexer

    Source: PulseGate indexerOpen ↗

At a glance

Platforms
Cli
Languages
English
Open source
Yes (GitHub)
License
Apache-2.0
First seen
Jul 7, 2026
Activity
🟢 Active
Status
🟢 Active
Built for
AI researchers and agent framework developers
Model
Open source
Solves
Evaluating and improving how effectively LLM agents select and use tools exposed by MCP servers.

Developer

benlamlih
↗ GitHub

Open source

View on GitHub →

PulseGate index

Confidence
Low · 64
Indexed
Jul 7, 2026
Lifecycle
Alive
Activity
Active
First seen
Jul 2026
Last seen
5d ago
Freshness
Unknown
Identity audit (9)
Entity ID
cmrare84n00kgxrx0q5sca13p
Slug
whetkit-pypi-org
Verification state
Indexed for public listing
Claim / listing state
Unclaimed · listed: yes
Index status
Included in index
Latest evidence snapshot
Jul 7, 2026
Timeline basis
Indexed-at chronology (no inferred launch/funding milestones).
Last updated
Jul 7, 2026
Canonical URL
https://pypi.org/project/whetkit

Similar apps

Other apps tracked under the same category.

  • wm-mcp
    pypi.org
  • mcp-checkup
    pypi.org
  • mcp-llm-eval
    pypi.org
  • Wetlab-MCP
    pypi.org
  • mcpgawk
    pypi.org
  • agent-audit-kit
    github.com