"Methods to Scrape a Website and Fetch Markdown Files from GitHub" matching MCP servers:

Fetches web pages and converts them to clean, readable markdown format by extracting main content while removing navigation, ads, and other non-essential elements to minimize token usage.

Fetches current and three-day weather forecasts for any city using the wttr weather service through a Docker-based MCP server.

An authless Cloudflare Workers server that provides tools to scrape, analyze, and answer questions about websites using Cloudflare's Browser Rendering and AI capabilities.

Enables agents to run Google searches across web, images, videos, news, books, shopping, scholar, patents, and AI Mode without an API key, using a cookie-bootstrapped HTTP fast path with a headless browser fallback, proxy rotation, and adaptive cooldowns. Every response reports an explicit status (ok, blocked, rate_limited, empty, error) so results are never fabricated.

A Model Context Protocol server that allows LLMs to retrieve and convert web content to markdown without robots.txt restrictions.

A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.

A headless browser MCP server that allows AI agents to fetch web content and perform Google searches without API keys, supporting various output formats like Markdown, JSON, HTML, and text.

Stdio MCP server for sandboxed file access — read files, search content, safely edit with checksums, and manage file structure.

Provides web search and page fetching capabilities using Ollama's API.

Enables AI to search, retrieve, list notes, and get backlinks from a published Markdown vault (Obsidian) via GitHub Pages.

Provides structured, addressable access to a local markdown vault with heading-anchored fragments, BM25 search, and stable IDs for verifiable retrieval.

Enables AI agents to search and compare live UK product prices from marketplaces like eBay and Amazon, returning normalised JSON with direct buy links.

Enables AI assistants to query a corpus of job offers via natural language, using BM25 search, facets, and trend analysis to answer questions about skills, positions, and timelines.

An MCP server that enables interaction with the YouTube Data API, allowing users to search videos, get video and channel details, analyze trends, and fetch video transcripts.

Provides AI-visibility scoring and site auditing capabilities for websites, enabling agents to check how sites appear in AI engines like ChatGPT and Perplexity, run full SEO/security audits, and monitor changes over time.

MCP server for web page fetching (converting to Markdown/text with automatic fallback between Tavily and Firecrawl) and web search via Tavily.

A generic Markdown vault MCP server with FTS5 full-text search, semantic vector search, frontmatter-aware indexing, incremental reindexing, and non-markdown attachment support that exposes search, read, write, and edit tools.

Provides functionality to fetch web content in various formats, including HTML, JSON, plain text, and Markdown.

Headless semantic MCP server for Obsidian, Logseq, Dendron, Foam, and any markdown folder. Features built-in hybrid semantic search, surgical AST editing, template scaffolding, zero-config local embeddings, and workflow tracking.

Searches Reddit for answers to questions and saves Q&A sessions to Notion.