Skip to main content
Glama
Crawlora-org

Crawlora MCP

Official

datasets_llms_item

Get a site from the AI-readiness (llms.txt) dataset. Returns one site by its domain from dataset id enum value llms, including the stored /llms.txt and /llms-full.txt bodies (llms.body, full.body; body_truncated marks a cut…

Instructions

Get a site from the AI-readiness (llms.txt) dataset. Returns one site by its domain from dataset id enum value llms, including the stored /llms.txt and /llms-full.txt bodies (llms.body, full.body; body_truncated marks a cut file, and a body that tries to override an AI reader's instructions is withheld with body_withheld set to injection), their structure and classification, and the /robots.txt stance toward each tracked AI crawler. Returns 404 when the domain is not in the dataset or its owner asked for removal (privacy@crawlora.net).

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
domainYesSite domain, e.g. shopify.com (a scheme and www. are stripped)

Schema Changelog

Changes observed during successful MCP inspections.

  1. Addedv1.17.12

TDQS

Score is being calculated.

Deploy Server

Other Tools