Skip to main content
Glama
675,951 tools. Updated 2026-10-19 09:39

"Methods to Scrape a Website and Fetch Markdown Files from GitHub" matching MCP tools:

  • Fetch a full note by ID to access its Markdown, links, and commit-pinned GitHub citations, enabling verifiable source-checking.
    MIT
  • Extract text from local PDFs, PNGs, JPEGs, and WebP files, returning content as GitHub-flavored Markdown or structured JSON blocks.
    MIT
  • Scrape a public URL into markdown, HTML, links, or metadata. Fetches a single page and returns clean content, stripping navigation and boilerplate.
    MIT
  • Download a completed scrape as XLSX or CSV saved to your computer and return its file path. Use only after the scrape is done; existing files get numeric suffixes, never overwritten.
    MIT
  • Turn a single URL into clean markdown, HTML, or text, handling WAF, SPA, and e-commerce pages via auto strategy and proxy options for AI-ready content.
    -
  • Scrape a single webpage and extract HTML, markdown, text, links, screenshots, or PDFs with metadata. Handles JavaScript-heavy pages and anti-bot measures automatically.
    Server Side Public , v 1

Matching MCP Servers

  • A
    license
    A
    quality
    C
    maintenance
    Enables AI agents to fetch one or many web pages concurrently and receive clean, LLM-ready Markdown with navigation, ads and boilerplate stripped away, plus extracted metadata such as title, description, author, Open Graph tags and canonical URL. It runs locally over stdio with no API key or account, requiring only a single command.
    3
    MIT

Matching MCP Connectors

  • Anti-bot web scraper returning token-optimized Markdown for AI agents ($0.002 USDC on Base).

  • Convert any webpage to clean LLM-ready markdown, extraction-first, with article and news modes.

  • Fetch notebook explanations and code from GitHub to help students understand exercises and answer code-specific questions.
    Apache 2.0
  • Crawl a website using breadth-first link traversal and return each page as clean Markdown. Use to ingest documentation sites or sections of a site.
    MIT
  • Queue a brand identity generation from a website URL. Notra scrapes the site and extracts brand information, allowing polling for completion.
    MIT
  • Scrape multiple webpages simultaneously, bypassing bot detection and CAPTCHA, returning content in Markdown format.
    MIT
  • Access lecture slide content for a module from the dataflowr/slides repo. Returns cleaned markdown for studying and review.
    Apache 2.0
  • List markdown documentation files from a local repository's docs/ directory, with optional pattern filtering.
    MIT
  • Deploy multiple files to a website in one call. Pass file paths and content, and the CDN cache purges automatically.
    MIT
  • Search web, news, and image sources, then optionally scrape each result URL for markdown, HTML, links, or screenshots to support research and information gathering.
    Server Side Public , v 1
  • Crawl a website to discover and scrape multiple pages, following links up to a set depth. Filter URLs with regex and use saved or custom scraping configs.
    MIT
  • Scan PDF and Markdown files in library folders to extract table of contents and create searchable indexes for quick retrieval.
    MIT
  • Scrape up to 10 URLs simultaneously to extract markdown content and metadata. Ideal for competitor analysis, content gap analysis, and SERP comparisons.
    MIT
  • Crawl a website from a seed URL, follow links to a set depth, and scrape each discovered page into markdown or HTML for site analysis and data gathering.
    Server Side Public , v 1
  • Scrape up to 5 URLs to extract and return clean markdown content. Simplify web data extraction for digital business cards, lead capture, and service listings.
    MIT