Skip to main content
Glama

What crawlers fetched

crawl_report
Read-onlyIdempotent

What search engine, AI and SEO crawlers actually fetched in the last hours (default 24, up to 168), from the web server's access logs: per crawler the hits, status codes (404, 5xx, redirects), what kind of pages (filtered layered-navigation URLs, search, ordinary pages, static files, API), URLs with a query string, the most fetched, 404 and 5xx paths, Googlebot and Bingbot hits per hour, and for Googlebot and Bingbot how many hits really come from them (reverse DNS) and which addresses fake it. Use it for technical SEO (crawl budget, errors served to Google) next to Search Console data. Pass log for one site's access log when the server has several.

Input Schema

NameRequiredDescriptionDefault
logNoPath of an access log (combined format); default: all nginx/Apache access logs
hoursNo1 to 168, default 24
serverNoServer name or id. Optional when the account has one server.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already cover the safety profile (readOnly, idempotent, non-destructive, openWorld). The description goes further by disclosing the analyzable window (default 24h, up to 168), that it reads access logs, and that Googlebot/Bingbot are verified via reverse DNS including identification of spoofed addresses. It does not discuss rate limits or auth, but adds substantial context beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The core purpose is front-loaded, and every clause is informative, but it is delivered as one long run-on sentence with an embedded colon-list that is hard to parse. Appropriately sized for the tool's richness but poorly structured for a scanning agent.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description carries the return-value burden and does so thoroughly, enumerating hits, status codes, page categories, query-string URLs, top/404/5xx paths, per-hour Googlebot/Bingbot hits, and spoofing detection. Combined with the three documented parameters and safety annotations, an agent has enough to invoke it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so each parameter is already documented in the input schema, and the description largely restates those values (24/168 hours, combined-format log). It adds only a mild clarification of the log/server relationship when multiple servers exist, so the baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb+resource: reporting what search/AI/SEO crawlers fetched from the web server's access logs, with an explicit enumeration of what is measured. It distinguishes itself from the many gsc_* and bing_* siblings by framing itself as a log-side technical SEO tool used 'next to Search Console data'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives a clear use context ('technical SEO (crawl budget, errors served to Google)') and a routing instruction for the multi-server case ('Pass log for one site's access log when the server has several'). It implies complementarity with Search Console tools but does not name a specific alternative or an explicit when-not-to-use, so it stops short of a 5.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources