agentbuilt
OfficialChecks whether the page is visible to AI crawlers such as Google-Extended and includes Google-Extended in robots.txt analysis.
Checks whether the page is legible to Perplexity's assistant and reports if PerplexityBot is blocked by robots.txt rules.
Provides a pay-per-result data tool that generates ChatGPT product feeds from Shopify stores.
Provides a pay-per-result data tool to retrieve YouTube transcripts and Substack content.
Provides a pay-per-result data tool to retrieve YouTube transcripts.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@agentbuiltRun an AI-readiness audit on https://example.com"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
agentbuilt MCP server
A small, stateless Model Context Protocol server that gives any AI agent a free AI-readiness audit of a URL, plus an A2A endpoint exposing the same capability as an agent. It runs as plain Vercel serverless functions — no framework, no database, no SDK.
Live endpoint: https://agentbuilt.dev/api/mcp (Streamable HTTP, protocol 2025-06-18).
Listed in the official MCP registry as dev.agentbuilt/agentbuilt.
Tools
Tool | What it does | Cost |
| Fetches a URL the way an AI crawler would and scores how legible it is to assistants: robots.txt rules for GPTBot / ClaudeBot / PerplexityBot / Google-Extended and friends, whether the page has real text without JavaScript, JSON-LD types, | free |
| Catalog of agentbuilt's pay-per-result data tools (YouTube transcripts, Substack, Shopify → ChatGPT product feeds, AI visibility audits) with a "how to call" block for each. | free |
| Requests the paid-tier audit (does ChatGPT / Perplexity actually recommend this brand?) — requires explicit consent and double opt-in by email. | free to request |
Related MCP server: maxaeo-ai-visibility-mcp
Use it from a client
Claude.ai / Claude Desktop — Settings → Connectors → Add custom connector → URL https://agentbuilt.dev/api/mcp.
Cursor — .cursor/mcp.json:
{ "mcpServers": { "agentbuilt": { "url": "https://agentbuilt.dev/api/mcp" } } }VS Code — .vscode/mcp.json:
{ "servers": { "agentbuilt": { "type": "http", "url": "https://agentbuilt.dev/api/mcp" } } }curl
curl -s https://agentbuilt.dev/api/mcp -H 'content-type: application/json' -H 'accept: application/json' \
-d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"audit_ai_readiness","arguments":{"url":"https://example.com"}}}'A2A — agent card at https://agentbuilt.dev/.well-known/agent-card.json; message/send to https://agentbuilt.dev/api/a2a with a message containing a URL.
Why the readiness check is built the way it is
SSRF-safe fetching (
api/_lib/net.js): the hostname is resolved once, every address is validated against private / link-local / CGNAT / metadata ranges (IPv4 and IPv6, including v4-mapped, NAT64 and 6to4 forms), and the HTTPS connection is pinned to the validated address via Node'slookupoption — so a hostile nameserver can't answer public for the check and private for the connect. Redirects are followed manually and re-validated per hop. Only ports 80 and 443.Honest crawler-access reporting: if a site refuses the anonymous request, the check retries as the documented AI crawler user-agents. A 403 to our spoofed GPTBot is reported as exactly that — bot managers such as Cloudflare verify real crawlers by IP and reject impostors — never as "GPTBot is blocked". We learned this the hard way on a real audit; the only proof of a block is a robots rule or the assistant itself failing to read the page.
Real-JSON / real-XML probes: a SPA that returns 200 HTML for
/llms.txtor/sitemap.xmlis not counted as having them.Stateless: no sessions, no storage for the free tool.
GETwithAccept: text/event-streamreturns 405 by design (no server-initiated streams).
Deploy your own
Fork, vercel deploy. The free tools need no environment variables. request_visibility_audit needs WAITLIST_KEY (32-byte base64, for sealing emails), APIFY_TOKEN and WAITLIST_DATASET_ID; without them it returns a clear error and the other tools keep working.
server.json is the registry manifest; PUBLISHING.md records the exact mcp-publisher commands and the gotchas we hit (schema version, description length, UTF-8 BOM).
About
agentbuilt is an AI-operated studio: an AI agent builds and runs it, and Matt Edward (Calgary, Canada) is the accountable human owner. The studio publishes its ledger and its data — e.g. AI share of voice: lease accounting software — at agentbuilt.dev.
MIT licensed. Issues and PRs welcome; an AI agent reads them, and the owner is accountable for what gets merged.
This server cannot be deployed
Maintenance
Related MCP Connectors
Audit any site's AI visibility from your assistant: crawler access, rendering, and schema.
21Checks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.
Scan any website's AI readiness: AI search visibility and AI agent usability. Free, no auth.
AEO audit: score any website 0-100 for AI visibility. Checks schema, meta, content, AI crawlers.
Related MCP Servers
AlicenseNot gradedqualityFmaintenanceExposes SEO and AI-readability audit tools to AI agents, enabling one-shot anonymous audits or full authenticated audits with PDF reports and organic traffic data.39 npmMIT- AlicenseAqualityBmaintenanceEnables AI agents to check whether a public website is crawlable, understandable, and ready for AI search workflows through local-only audits of robots.txt, sitemaps, metadata, and llms.txt.372 npm1MIT
- AlicenseNot gradedqualityCmaintenanceEnables AI agents to perform instant SEO audits, check robots.txt, sitemaps, and AI crawler access for any URL without API keys.MIT
- AlicenseNot gradedqualityAmaintenanceEnables AI coding agents like Claude and Cursor to audit websites for AI agent readiness, checking 199 rules across agentic discovery, content structure, and technical SEO.17Apache 2.0