mcp-server-webcrawl

guides.html•6.66 kB

<!DOCTYPE html> <html class="writer-html5" lang="en" data-content_root="./"> <head> <meta charset="utf-8" /><meta name="viewport" content="width=device-width, initial-scale=1" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> <title>Setup Guides — mcp-server-webcrawl documentation</title> <link rel="stylesheet" type="text/css" href="_static/pygments.css?v=80d5e7a1" /> <link rel="stylesheet" type="text/css" href="_static/css/theme.css?v=e59714d7" /> <script src="_static/jquery.js?v=5d32c60e"></script> <script src="_static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script> <script src="_static/documentation_options.js?v=5929fcd5"></script> <script src="_static/doctools.js?v=888ff710"></script> <script src="_static/sphinx_highlight.js?v=dc90522c"></script> <script src="_static/js/theme.js"></script> <link rel="index" title="Index" href="genindex.html" /> <link rel="search" title="Search" href="search.html" /> <link rel="next" title="ArchiveBox MCP Setup Guide" href="guides/archivebox.html" /> <link rel="prev" title="Installation" href="installation.html" /> </head> <body class="wy-body-for-nav"> <div class="wy-grid-for-nav"> <nav data-toggle="wy-nav-shift" class="wy-nav-side"> <div class="wy-side-scroll"> <div class="wy-side-nav-search" > <a href="index.html" class="icon icon-home"> mcp-server-webcrawl </a> <div role="search"> <form id="rtd-search-form" class="wy-form" action="search.html" method="get"> <input type="text" name="q" placeholder="Search docs" aria-label="Search docs" /> <input type="hidden" name="check_keywords" value="yes" /> <input type="hidden" name="area" value="default" /> </form> </div> </div><div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="Navigation menu"> <p class="caption" role="heading"><span class="caption-text">Contents:</span></p> <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="installation.html">Installation</a></li> <li class="toctree-l1 current"><a class="current reference internal" href="#">Setup Guides</a><ul> <li class="toctree-l2"><a class="reference internal" href="guides/archivebox.html">ArchiveBox MCP Setup Guide</a></li> <li class="toctree-l2"><a class="reference internal" href="guides/httrack.html">HTTrack MCP Setup Guide</a></li> <li class="toctree-l2"><a class="reference internal" href="guides/interrobot.html">InterroBot MCP Setup Guide</a></li> <li class="toctree-l2"><a class="reference internal" href="guides/katana.html">Katana MCP Setup Guide</a></li> <li class="toctree-l2"><a class="reference internal" href="guides/siteone.html">SiteOne MCP Setup Guide</a></li> <li class="toctree-l2"><a class="reference internal" href="guides/warc.html">WARC MCP Setup Guide</a></li> <li class="toctree-l2"><a class="reference internal" href="guides/wget.html">wget MCP Setup Guide</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="usage.html">Usage</a></li> <li class="toctree-l1"><a class="reference internal" href="prompts.html">Prompt Routines</a></li> <li class="toctree-l1"><a class="reference internal" href="modules.html">mcp_server_webcrawl</a></li> </ul> </div> </div> </nav> <section data-toggle="wy-nav-shift" class="wy-nav-content-wrap"><nav class="wy-nav-top" aria-label="Mobile navigation menu" > <i data-toggle="wy-nav-top" class="fa fa-bars"></i> <a href="index.html">mcp-server-webcrawl</a> </nav> <div class="wy-nav-content"> <div class="rst-content"> <div role="navigation" aria-label="Page navigation"> <ul class="wy-breadcrumbs"> <li><a href="index.html" class="icon icon-home" aria-label="Home"></a></li> <li class="breadcrumb-item active">Setup Guides</li> <li class="wy-breadcrumbs-aside"> <a href="_sources/guides.rst.txt" rel="nofollow"> View page source</a> </li> </ul> <hr/> </div> <div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article"> <div itemprop="articleBody"> <section id="setup-guides"> <h1>Setup Guides<a class="headerlink" href="#setup-guides" title="Link to this heading"></a></h1> <p>This section contains detailed setup guides for mcp-server-webcrawl in various environments and configurations.</p> <div class="toctree-wrapper compound"> <p class="caption" role="heading"><span class="caption-text">Available Guides:</span></p> <ul> <li class="toctree-l1"><a class="reference internal" href="guides/archivebox.html">ArchiveBox MCP Setup Guide</a></li> <li class="toctree-l1"><a class="reference internal" href="guides/httrack.html">HTTrack MCP Setup Guide</a></li> <li class="toctree-l1"><a class="reference internal" href="guides/interrobot.html">InterroBot MCP Setup Guide</a></li> <li class="toctree-l1"><a class="reference internal" href="guides/katana.html">Katana MCP Setup Guide</a></li> <li class="toctree-l1"><a class="reference internal" href="guides/siteone.html">SiteOne MCP Setup Guide</a></li> <li class="toctree-l1"><a class="reference internal" href="guides/warc.html">WARC MCP Setup Guide</a></li> <li class="toctree-l1"><a class="reference internal" href="guides/wget.html">wget MCP Setup Guide</a></li> </ul> </div> </section> </div> </div> <footer><div class="rst-footer-buttons" role="navigation" aria-label="Footer"> <a href="installation.html" class="btn btn-neutral float-left" title="Installation" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> Previous</a> <a href="guides/archivebox.html" class="btn btn-neutral float-right" title="ArchiveBox MCP Setup Guide" accesskey="n" rel="next">Next <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a> </div> <hr/> <div role="contentinfo"> <p>© Copyright 2025, pragmar.</p> </div> Built with <a href="https://www.sphinx-doc.org/">Sphinx</a> using a <a href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a> provided by <a href="https://readthedocs.org">Read the Docs</a>. </footer> </div> </div> </section> </div> <script> jQuery(function () { SphinxRtdTheme.Navigation.enable(true); }); </script> </body> </html>

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/pragmar/mcp_server_webcrawl'

If you have feedback or need assistance with the MCP directory API, please join our Discord server