Web Research Agent MCP
You can use this MCP server to perform six web research tasks backed by the Web Research Agent API (RapidAPI key required).
Build a company profile from a website: name, description, socials, emails, key pages, pricing mentions, and tech stack.
Audit a page with a 0–100 score for SEO, performance hints, security headers, and broken internal links.
Convert a page to structured JSON: meta, Open Graph, JSON-LD, headings, links, images, and clean text.
Validate an email or domain via live DNS: syntax, MX/null-MX, SPF, DMARC, disposable/free/role flags, verdict, and score.
List URLs from sitemaps with lastmod/changefreq/priority and optional since, limit, and max_sitemaps filters.
Monitor page changes by comparing previous text/hash and returning added/removed lines; optional selector support.
The crawler respects robots.txt and refuses private/internal addresses.
Uses the Web Research Agent API hosted on RapidAPI with a RapidAPI key to power research tools such as company profiles, site audits, page-to-JSON extraction, email checks, sitemap URL retrieval, and page diffs.
This server has a remotely hosted endpoint. Open its connector listing for connection details, authentication requirements, and setup instructions:
web-research-agent-mcp
MCP server that gives Claude, Cursor or any MCP client six research tools: company_profile, site_audit, page_to_json, email_check, sitemap_urls and page_diff.
It is backed by the Web Research Agent API on RapidAPI. You need your own RapidAPI key. The free plan gives you 50 calls/month.
Setup
Subscribe on RapidAPI (Free plan) and copy your
X-RapidAPI-Key.Add the server to your MCP config:
{ "mcpServers": { "web-research-agent": { "command": "npx", "args": ["-y", "github:elaysuu/web-research-agent-mcp"], "env": { "RAPIDAPI_KEY": "YOUR_KEY" } } } }Related MCP server: BizIntel MCP
Tools
company_profile(url): name, description, logo, socials, emails, key pages, price mentions, tech stack.site_audit(url, max_links?): 0–100 score, SEO, performance, security-header and broken-link issues.page_to_json(url, max_text?): meta, OG, JSON-LD, headings, links, images, clean text.email_check(email? | domain?): syntax, MX/null-MX, SPF, DMARC policy, disposable/free/role flags, verdict and 0–100 score (live DNS, no SMTP probe).sitemap_urls(url, limit?, max_sitemaps?, since?): every URL a site publishes in its sitemaps, with lastmod;sincereturns only changed pages.page_diff(url, previous_text? | previous_hash?, selector?): content hash plus added/removed lines since your last check — a stateless change monitor.
The crawler respects robots.txt and refuses private and internal addresses. MIT license.
Hosted / pay-per-call
Also available hosted on MCPize with pay-per-call pricing (no RapidAPI key needed). Self-hosters of the backend can use direct mode with env WRA_DIRECT_URL and WRA_DIRECT_TOKEN.
Also by the author
AI Agent Prompt Pack: prompts for research and tool-using agents (source citing, fact-checking, guardrails). $9 on Payhip, or 9 USDC on Base at Setrov Store.
Other products (game textures, kids printables): Setrov Studio on Payhip.
Available Tools
6 toolscompany_profileAInspect
Research a company from its website: name, description, socials, emails, key pages, pricing mentions, tech stack.
Inputs: url (required).
email_checkAInspect
Validate an email address or domain via live DNS: syntax, MX/null-MX, SPF, DMARC policy, disposable/free/role flags, deliverability verdict and 0-100 score. No SMTP probe.
Inputs: email, domain.
page_diffAInspect
Monitor a page for changes: returns normalized text + SHA-256 content_hash; pass previous_text (or previous_hash) from an earlier call to get changed flag and added/removed lines.
Inputs: url (required), selector, previous_hash, previous_text.
page_to_jsonBInspect
Fetch a web page and return structured JSON: meta, Open Graph, JSON-LD, headings, links, images, clean text.
Inputs: url (required), max_text.
site_auditBInspect
Audit a web page: SEO, performance hints, security headers, broken internal links; returns score 0-100 and issues.
Inputs: url (required), max_links.
sitemap_urlsBInspect
List a site's URLs from its sitemaps (robots.txt Sitemap: lines, nested indexes, text sitemaps) with lastmod/changefreq/priority; optional since date filter.
Inputs: url (required), limit, since, max_sitemaps.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 6 tools
Each tool has a fairly distinct target: company aggregate research, SEO/security audit, raw page→JSON extraction, email validation, sitemap enumeration, and change monitoring. The main soft spot is overlap between company_profile, page_to_json, and page_diff, all of which fetch page content, but the descriptions make the differing outputs (profile summary vs. structural JSON vs. hash/diff) reasonably clear.
All six names are two-token snake_case phrases (company_profile, site_audit, page_to_json, email_check, sitemap_urls, page_diff), so the convention is predictable and readable. They are noun-first rather than verb_noun, which is slightly less explicit about the action but internally consistent.
Six tools is well-scoped for a web research agent, and each one covers a distinct capability with no filler. Nothing feels redundant or missing at the count level.
The surface covers fetching, extracting, auditing, validating, discovering URLs via sitemaps, and diffing — a solid research lifecycle with no dead ends. The notable gap is a general web/search or multi-page crawl tool, which agents may need for discovery beyond a known domain, though sitemap_urls plus page_to_json provides a partial workaround.
Maintenance
Related MCP Connectors
Pages, crawls and URL batches as clean Markdown and JSON for AI agents, with an Evidence Record.
Turn the web into structured, reliable, actionable enterprise data for AI Agents
Web pages as Markdown, site maps and crawls, AI data extraction and screenshots.
Website audits for AI agents: one-call AI visibility report, schema, WCAG, PageSpeed, AI crawlers.
Related MCP Servers
AlicenseAqualityCmaintenanceWeb data for AI agents: scrape, crawl, search, deep research, site monitoring, browser automation2274 npm3Apache 2.0- AlicenseNot gradedqualityFmaintenanceProvides real-time website audits, lead scoring, tech-stack detection, and local-business search for AI agents doing sales outreach and competitor research.MIT
- AlicenseAqualityBmaintenanceDomain and company intelligence for AI agents. Enables vetting companies, qualifying leads, and mapping targets from free public data without API keys.61MIT
- AlicenseNot gradedqualityCmaintenanceEnables targeted company discovery, real-time DNS MX deliverability diagnostics, and clean web Markdown extraction for AI agents.MIT