"How to scrape web content" matching MCP servers:

Web search (embedded SearXNG), content extraction, and library docs indexing with hybrid search. No API keys required.

Enables an agent to run ten ready-made research and monitoring workflows — competitor digests, cited reports, paper alerts, market maps, regulatory and due-diligence watches — pulling from Firecrawl, Tavily, GitHub and landing results in Notion, Slack, Google Docs, Sheets and Linear. Fields are filed with the user's own keys held in the operating system keychain, and every action that creates, sends or changes anything is shown and approved first.

Connect AI assistants to your Gramps Web family tree. Search and edit genealogy records, explore ancestors, descendants, relationships and timelines, and read document scans with vision-capable models. Includes guided research workflows, source citations, read-only mode, and privacy-aware media previews. Install with Docker or a Claude Desktop bundle.

Enables AI assistants to query distilled SEO expert tactics from public content, returning actionable insights linked to original source videos.

Enables searching live job postings, aggregating labour-market slices, and reporting how long listings have been open, with filters for titles, location, salary, and more.

A content exploration MCP server that helps LLMs surface high-signal, unsummarized web content through clean APIs and Markdown conversion, with intelligent frontmatter steering and citation tracking.

Enables AI clients to search, read, and accurately quote public-domain books from Project Gutenberg, with chapter detection and stable line numbers for citation. Its quote_check tool verifies whether a quotation actually appears in a book and reports how faithful the copy is.

MCP server that lets AI assistants like Claude Code and Codex drive the co-scientist engine to generate, review, rank, and evolve scientific hypotheses via an Elo tournament.

Simulate hundreds of AI agents to predict how communities react to events and policies. Upload any document (PDF, Markdown, text) and DeepMiro spawns a diverse swarm of AI agents that debate, share, and form opinions — then delivers a calibrated prediction report. Free and open-source.

Enables fetching any public web page through managed proxies, with optional JavaScript rendering, returning markdown, text, HTML, or structured JSON.

Enables AI agents to search and fetch high-quality information from multiple sources, including general web APIs, Wikipedia, arXiv, Hacker News, Stack Exchange, and Crossref, with optional pro-mode deep research and clean markdown page extraction.

MCP server for Tracetify — trace how any product actually grew, without leaving Claude Code or Cursor.

Enables AI agents to perform real-time web search, research, and content extraction using You.com's search infrastructure, with a free tier available.

Enables AI assistants to search multiple tech job boards at once, summarize what the market is asking for, and rank postings by how well they match a user's own skills.

Enables MCP clients to search Reddit, scrape post URLs with full comment threads, and pull bulk subreddit posts as structured JSON using Apify, without needing a Reddit API key or login.

Provides MCP tools to fetch and search AI, Malaysian, and Germany SWE job-market news briefings, retrieve article content and Hacker News discussions, and perform web search and deep research.

Enables AI clients to browse instruments, items, dimensions, expert assignments, and calculate Content Validity Index (CVI) via a standard MCP interface.

Zero-dependency MCP server: keyword difficulty, opportunity scoring, content briefs

Enables competitor content analysis by scraping pages, extracting keywords, identifying content gaps, comparing headings, scoring readability and quality, checking SERP features, and clustering competitors.

MCP server for the Internet Archive's Wayback Machine. Search archived snapshots, extract page text from a specific date, track how a site has changed over time, check if broken links are recoverable, and perform research across Internet Archive collections.