Skip to main content
Glama

Agent Web Census

Server Details

Open data on MCP servers (with live health) and which AI crawlers top websites block.

If you are the author of this connector, you can claim ownership. Claimed connector authors can inspect health checks, view analytics, and manage their listing.
Status
Healthy
Uptime
100.0% over the last 24 hours
Last Tested
Transport
Streamable HTTP · MCP 2025-11-25
URL
Repository
jirizaloudek/agentwebcensus
GitHub Stars
0
ChatGPT
–
Claude
–

TDQS

A3.9/5.0

Scored across 4 tools

Disambiguation5/5

Each tool occupies a clearly distinct slot: ai_crawler_stats is the cross-site per-bot aggregate, site_ai_crawler_policy is the per-domain lookup, mcp_ecosystem_stats is registry-wide headline numbers, and find_mcp_servers is keyword search. The aggregate-vs-single-entity split mirrors the crawler pair on the MCP side, which makes the boundaries intuitive rather than confusing.

Naming Consistency4/5

All names are snake_case and follow a domain_topic_noun shape (ai_crawler_stats, mcp_ecosystem_stats, site_ai_crawler_policy), so the grouping by subject area is readable. find_mcp_servers breaks the pattern with a verb-first form, a minor but noticeable deviation.

Tool Count4/5

Four tools is light but defensible for a read-only statistics/lookup service with two query domains, each getting an aggregate plus a detail-style endpoint. Nothing redundant is included, though the surface sits near the thin end of the range.

Completeness3/5

The MCP side has search and ecosystem aggregates but no way to fetch a single server's full record by name, so a search hit can only be inspected via what the list view returns. The crawler side is better covered (per-bot aggregate and per-domain policy), but there is no way to enumerate available bot names or bulk-compare domains, leaving notable gaps for follow-up queries.

Available Tools

4 tools
ai_crawler_statsA
Read-only
Inspect

Aggregate AI-crawler blocking statistics across the top 10,000 websites: percentage of sites with a reachable robots.txt that fully block, partly restrict or explicitly allow each AI bot. Give a bot name for one bot, or omit for the overall table.

Inputs: bot.

find_mcp_serversA
Read-only
Inspect

Search the official MCP Registry (~65,000 servers) by keyword. Matches name, title and description; ranks servers whose remote endpoint passed a live initialize check first, then by number of tools. Returns name, title, description, remote/package types, health (ok = works without auth, auth = alive but needs auth, fail = unreachable), tool count and a registry link.

Inputs: query (required), limit, category, transport, +1 more.

mcp_ecosystem_statsA
Read-only
Inspect

Headline numbers of the MCP ecosystem: servers in the official registry, new servers in the last 7/30 days, remote vs package share, top package registries and categories, plus the weekly health check of remote servers (share working, requiring auth, failing, median tools and latency).

Inputs: no named parameters.

site_ai_crawler_policyA
Read-only
Inspect

Which AI crawlers does a website block in robots.txt? Looks up a domain in our scan of the top 10,000 websites (Tranco list) and returns, per AI bot (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, ...), whether it is blocked, partly restricted or explicitly allowed, plus llms.txt presence.

Inputs: domain (required).

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    Related MCP Connectors

    Related MCP Servers

    • A
      license
      Not graded
      quality
      A
      maintenance
      Behavioral trust scoring for MCP servers and AI agents. Live registry tracking 4,500+ servers with trust scores (0-100) based on interaction history, success rates, and latency
      2
      MIT
    • A
      license
      Not graded
      quality
      D
      maintenance
      Open-source MCP server that audits websites for AI search readiness, providing deterministic scoring (0-100) and prioritized fix lists for metrics like JSON-LD, llms.txt, heading hierarchy, and AI crawler access.
      1
      MIT
    Try in Browser

    Glama MCP Gateway

    Add one secure layer between your agents and this server.