Validate tool quickstart examples offline
tooldocstest.dev is a local-only command-line tool for MCP, API and SDK publishers. It checks the example arguments in your quickstart documentation against a versioned JSON contract and runs two allowlisted, data-only sandbox tools, then emits a deterministic evidence receipt.
What it does
- Deterministic pass / fail / unknown results. Unknown is never reported as a pass.
- Human-readable and machine-readable receipts that never echo your payload values.
- Two supported import adapters:
mcp-tools-list-v1andopenai-functions-v1.
Run it locally
node src/cli.mjs fixtures/failed.json
node src/cli.mjs fixtures/passing.json --markdown --receipt receipt.json
Exit codes: 0 pass, 1 fail, 2 unknown or invalid input.
What it does not do
Hosted evaluation, run history and billing are disabled. There is no upload endpoint, no production credentials and no remote-source verification. The hosted dashboard ships only after authentication, isolation, retention and deletion tests pass.
For the input contract, the adapters and their exact limits, see the documentation. For the five-category acceptance gate, see the acceptance fixture matrix.