Skip to main content
Glama
FlyCrawl-ai

FlyCrawl MCP Server

Official

flycrawl_scrape

Scrape a single webpage into clean, LLM-ready Markdown, JSON, or links for AI ingestion, with dynamic JavaScript rendering and low-token output.

Instructions

Scrape a single webpage and convert it into clean, noise-free, LLM-ready Fit-Markdown, JSON, or links with 90%+ token reduction.

BEHAVIOR & SAFETY: Read-only and idempotent. Makes no modifications to target servers. AUTHENTICATION: Requires valid FLYCRAWL_API_KEY (claim 100 free credits at https://flycrawl.net). RATE LIMITS & BILLING: Consumes 1 credit per successful page scrape. Fair billing guarantee: 0 credits are deducted if the target site returns 4xx/5xx errors or network timeouts. DYNAMIC JS RENDERING: Automatically executes dynamic client-side JavaScript (SPAs, React, Vue, Angular) and bypasses anti-bot systems (Cloudflare Turnstile, DataDome) using stealth residential IP pools. DIFFERENCE FROM flycrawl_extract: flycrawl_scrape extracts the complete readable text and layout of the page as Markdown. Use flycrawl_extract when you need specific JSON fields conforming to a schema. ERROR HANDLING: Returns structured error message with status code on failure without raising unhandled exceptions.

Input Schema

NameRequiredDescriptionDefault
urlYesThe complete URL of the webpage to scrape (must start with http:// or https://).
formatNoTarget output format ('markdown', 'json', 'links', 'summary', 'html'). Default: markdown.markdown
maxAgeNoCache TTL in seconds (default 86400 = 24h). Cached requests are instant and cost 0 credits.
onlyMainContentNoWhether to strip navigation, headers, footers, and ads (default: true).

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv1.0.1

TDQS

A4.5/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden and does so: read-only/idempotent, API key requirement, 1 credit per successful scrape with a no-charge guarantee on 4xx/5xx and timeouts, cache TTL cost behavior, JS rendering and anti-bot handling, and structured error returns. This is unusually rich behavioral context for a tool with zero annotation coverage.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Section labels (BEHAVIOR & SAFETY, AUTHENTICATION, RATE LIMITS, DIFFERENCE FROM) make it scannable and front-loaded with the purpose. It is longer than strictly necessary, and the format enumeration at the top is incomplete relative to the schema, but each block carries actionable information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With four parameters, no output schema, and no annotations, the description covers auth, cost, rendering, error format, and sibling differentiation adequately. The only shortfall is the incomplete output-format list, leaving the agent to discover summary and html from the schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3; the description adds value by explaining the billing implication of caching (cached requests cost 0 credits), which the maxAge schema does not state. It lists markdown/json/links but omits the summary and html enum values, a small gap rather than a contradiction.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (scrape) and resource (single webpage) plus the concrete output artifacts (Markdown, JSON, links). It explicitly names the sibling flycrawl_extract and the boundary between them, so an agent can distinguish the two without opening either schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives an explicit routing rule: use flycrawl_extract for schema-conforming JSON fields, this tool for full readable page text. It lacks guidance on when to prefer flycrawl_search, flycrawl_crawl, or flycrawl_map for multi-page work, but the primary alternative is clearly framed.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.