LaunchKit · 2026

Setup & Installation

npx skills add https://github.com/serpapi/skills --skill agent-usability-test
or paste the link and ask your coding assistant to install it
https://github.com/serpapi/skills/tree/master/skills/agent-usability-test
View on GitHub

What This Skill Does

A methodology skill for testing whether AI agents can discover and use your tool. It defines the five failure modes (non-discovery, wrong selection, parameter cargo-culting, response-schema blindness, auth/error cliffs), a ten-step protocol with WITH/WITHOUT baselines, proper isolation and randomization, adversarial error-handling conditions, sample-size guidance, and a pre-flight checklist. Lift over the no-tool baseline is the only metric that matters.

A bad score means fix the docs or the tool, not the agent — this turns "agents don't use our API" from an anecdote into a measured, reproducible experiment.

When to use it

  • Measuring whether agents find and call your MCP tool or CLI without coaching
  • Scoring which tool agents pick when competing tools are all available
  • Testing if agents recover from 401s, rate limits, timeouts, and malformed responses
  • Validating documentation changes with old-docs versus new-docs control runs
  • Avoiding false negatives from stale ground truths and leaky test isolation

More from SerpApi