[{"_1":2,"_380":-5,"_381":-5},"loaderData",{"_3":4,"_29":30,"_246":247},"root",{"_5":6,"_14":15},"toasts",[7],{"_8":9,"_10":11,"_12":13},"uid","019a3bce-44dc-7398-94aa-1ba6ce15e8b8","title","You need to sign in to access this page","type","error","visitor",{"_16":17,"_18":19},"viewportWidth",1280,"visitorSession",{"_20":21,"_23":24,"_25":-5,"_26":27,"_28":-5},"attributes",[22],"bot","id",22064646,"membership","referenceId","019a38ab-d78c-7356-ab8d-f3fb85281c4a","userAccount","routes/_public/mcp/servers/~namespace/~slug/_pages/_layout",{"_31":32,"_33":-5,"_34":35,"_36":48,"_163":164,"_245":150},"availableLocales",[],"githubUser","locale",{"_36":37,"_44":45,"_46":47},"mcpServer",{"_38":39,"_40":41,"_42":43},"description","Enables querying and retrieving webpage content from websites by parsing sitemap.xml files and fetching HTML content from specified URLs. Includes rate limiting protection and supports listing all available pages from a sitemap.","displayName","Webpage MCP Server","readme","# Webpage MCP Server\n\nA Model Context Protocol (MCP) server for querying webpages and page contents from a specific website.\n\n## Overview\n\nThis MCP server provides tools to list and retrieve webpage content by parsing a sitemap.xml file and fetching HTML content from specified URLs. It includes built-in rate limiting to protect against abuse.\n\n## Features\n\n- **List Pages**: Parse sitemap.xml to get all available webpage paths\n- **Get Page Content**: Fetch HTML content from any webpage\n- **Sitemap Resource**: Access the raw sitemap.xml file\n- **Rate Limiting**: 10 requests per minute per user to prevent abuse\n\n## Installation\n\n```bash\n# Install dependencies using uv\nuv sync\n\n# Or using pip\npip install -e .\n```\n\n## Configuration\n\nThe server uses environment variables for configuration:\n\n| Variable | Description | Default |\n|----------|-------------|---------|\n| `BASE_URL` | The base URL of the website to query | `https://example.com` |\n| `HOST` | Server host address | `0.0.0.0` |\n| `PORT` | Server port number | `8080` |\n\n### Environment Setup\n\nCreate a `.env.local` file in the project root:\n\n```bash\nBASE_URL=https://your-website.com\nHOST=0.0.0.0\nPORT=8080\n```\n\n### Sitemap Configuration\n\nPlace your sitemap.xml file in the `assets/` directory. The server will automatically read from:\n```\nassets/sitemap.xml\n```\n\n## Usage\n\n### Running the Server\n\n**STDIO Mode (for MCP clients):**\n```bash\nuv run python src/main.py --stdio\n```\n\n**HTTP Mode:**\n```bash\nuv run python src/main.py --port 8080\n# Server will be available at http://localhost:8080/mcp\n```\n\n**Test Mode:**\n```bash\nuv run python src/main.py --test\n```\n\n### Running Tests\n\n```bash\nuv run python tests/test_server.py\n```\n\n## Available Tools\n\n### 1. list_pages()\n\nLists all webpage paths from the sitemap.\n\n**Parameters:** None\n\n**Returns:** List of page paths\n\n**Example:**\n```python\nlist_pages()\n# Returns: [\"/\", \"/blog\", \"/blog/post-1\", \"/marketplace\", \"/pricing\"]\n```\n\n### 2. get_page(path, user_id=None)\n\nFetches HTML content from a webpage.\n\n**Parameters:**\n- `path` (str): The webpage path (e.g., \"/blog/post-1\")\n- `user_id` (str, optional): User identifier for rate limiting\n\n**Returns:** Dictionary with HTML content and metadata\n\n**Example:**\n```python\nget_page(\"/blog/post-1\")\n# Returns:\n# {\n# \"path\": \"/blog/post-1\",\n# \"url\": \"https://example.com/blog/post-1\",\n# \"html\": \"...\",\n# \"status_code\": 200,\n# \"content_type\": \"text/html\"\n# }\n```\n\n**Rate Limit Response:**\n```python\n# When rate limit is exceeded:\n{\n \"error\": \"Rate limit exceeded\",\n \"message\": \"Too many requests. Please wait 45 seconds before trying again.\",\n \"reset_in_seconds\": 45,\n \"limit\": \"10 requests per minute\"\n}\n```\n\n## Available Resources\n\n### sitemap://sitemap.xml\n\nAccess the raw sitemap.xml content.\n\n**Example:**\n```xml\n\n\n \n https://example.com/\n 2025-10-08T20:10:25.773Z\n weekly\n 1\n \n ...\n\n```\n\n## Deployment\n\n### Deploy to Dedalus\n\n```bash\ndedalus deploy ./src/main.py --name 'webpage-server'\n```\n\n### Use with Dedalus SDK\n\n```python\nfrom dedalus import Dedalus\n\nclient = Dedalus(\n mcp_servers=['your-org/webpage-server']\n)\n```\n\n## Rate Limiting\n\nThe server implements rate limiting to protect against abuse:\n\n- **Limit:** 10 requests per minute per user\n- **Window:** 60 seconds rolling window\n- **Identifier:** Uses `user_id` parameter or 'default' if not provided\n\nWhen the rate limit is exceeded, the server returns an error response with:\n- Time until the limit resets\n- Total number of allowed requests\n\n## Architecture\n\n```\nmcp-server-example-python/\n├── src/\n│ └── main.py # Main server implementation\n├── assets/\n│ └── sitemap.xml # Sitemap data source\n├── tests/\n│ └── test_server.py # Test suite\n├── docs/\n│ └── README.md # This documentation\n└── pyproject.toml # Project configuration\n```\n\n## Error Handling\n\nThe server handles various error conditions gracefully:\n\n1. **Missing Sitemap:** Returns error if `assets/sitemap.xml` doesn't exist\n2. **Invalid Path:** Returns error for malformed paths\n3. **Failed HTTP Request:** Returns error with details when webpage fetch fails\n4. **Rate Limit:** Returns structured error with reset time\n\n## Development\n\n### Adding New Tools\n\nTo add a new tool, use the `@mcp.tool()` decorator:\n\n```python\n@mcp.tool()\ndef your_tool_name(param: str) -> dict:\n \"\"\"Tool description\"\"\"\n # Implementation\n return {\"result\": \"value\"}\n```\n\n### Adding New Resources\n\nTo add a new resource, use the `@mcp.resource()` decorator:\n\n```python\n@mcp.resource('resource://resource-name')\ndef get_resource() -> str:\n \"\"\"Resource description\"\"\"\n return \"resource content\"\n```\n\n## License\n\nMIT License - See LICENSE file for details\n","name","English","tag","en-US",{"_49":50,"_20":51,"_58":39,"_59":39,"_40":41,"_23":60,"_61":62,"_94":95,"_102":-5,"_103":-5,"_104":105,"_153":154,"_158":-5,"_69":141,"_159":145,"_8":160,"_161":162},"addedAt","2025-10-11T02:02:31.977299Z",[52,53,54,55,56,57],"category:web-scraping","category:browser-automation","category:search","environment:network","hosting:hybrid","language:python","descriptionMarkdown","descriptionPlainText",12478,"integrations",[63,73,80,87],{"_64":65,"_38":71,"_8":72},"brand",{"_66":67,"_44":68,"_69":70},"logoSvgPath","M24 0v24H0V0h24ZM10.933 15.89H6.84v5.52h4.198v-.93H7.955v-1.503h2.77v-.93h-2.77v-1.224h2.978v-.934Zm2.146 0h-1.084v5.52h1.035v-3.6l2.226 3.6h1.118v-5.52h-1.036v3.686l-2.259-3.687Zm5.117 0h-1.208l1.973 5.52h1.19l1.976-5.52h-1.182l-1.352 4.085-1.397-4.086ZM5.4 19.68H3.72v1.68H5.4v-1.68Z",".ENV","slug","dotenv","Uses environment variables for server configuration including base URL, host, and port settings","wy6hae101m",{"_64":74,"_38":78,"_8":79},{"_66":75,"_44":76,"_69":77},"M14.25.18l.9.2.73.26.59.3.45.32.34.34.25.34.16.33.1.3.04.26.02.2-.01.13V8.5l-.05.63-.13.55-.21.46-.26.38-.3.31-.33.25-.35.19-.35.14-.33.1-.3.07-.26.04-.21.02H8.77l-.69.05-.59.14-.5.22-.41.27-.33.32-.27.35-.2.36-.15.37-.1.35-.07.32-.04.27-.02.21v3.06H3.17l-.21-.03-.28-.07-.32-.12-.35-.18-.36-.26-.36-.36-.35-.46-.32-.59-.28-.73-.21-.88-.14-1.05-.05-1.23.06-1.22.16-1.04.24-.87.32-.71.36-.57.4-.44.42-.33.42-.24.4-.16.36-.1.32-.05.24-.01h.16l.06.01h8.16v-.83H6.18l-.01-2.75-.02-.37.05-.34.11-.31.17-.28.25-.26.31-.23.38-.2.44-.18.51-.15.58-.12.64-.1.71-.06.77-.04.84-.02 1.27.05zm-6.3 1.98l-.23.33-.08.41.08.41.23.34.33.22.41.09.41-.09.33-.22.23-.34.08-.41-.08-.41-.23-.33-.33-.22-.41-.09-.41.09zm13.09 3.95l.28.06.32.12.35.18.36.27.36.35.35.47.32.59.28.73.21.88.14 1.04.05 1.23-.06 1.23-.16 1.04-.24.86-.32.71-.36.57-.4.45-.42.33-.42.24-.4.16-.36.09-.32.05-.24.02-.16-.01h-8.22v.82h5.84l.01 2.76.02.36-.05.34-.11.31-.17.29-.25.25-.31.24-.38.2-.44.17-.51.15-.58.13-.64.09-.71.07-.77.04-.84.01-1.27-.04-1.07-.14-.9-.2-.73-.25-.59-.3-.45-.33-.34-.34-.25-.34-.16-.33-.1-.3-.04-.25-.02-.2.01-.13v-5.34l.05-.64.13-.54.21-.46.26-.38.3-.32.33-.24.35-.2.35-.14.33-.1.3-.06.26-.04.21-.02.13-.01h5.84l.69-.05.59-.14.5-.21.41-.28.33-.32.27-.35.2-.36.15-.36.1-.35.07-.32.04-.28.02-.21V6.07h2.09l.14.01zm-6.47 14.25l-.23.33-.08.41.08.41.23.33.33.23.41.08.41-.08.33-.23.23-.33.08-.41-.08-.41-.23-.33-.33-.23-.41-.08-.41.08z","Python","python","Implemented as a Python-based MCP server with tools for parsing sitemaps and fetching webpage content","zzwi6mgd3u",{"_64":81,"_38":85,"_8":86},{"_66":82,"_44":83,"_69":84},"M.014 0h5.34v2.652H2.888v18.681h2.468V24H.015V0Zm17.622 5.049v2.78h-4.274v12.935h-3.008V7.83H6.059V5.05h11.577ZM23.986 24h-5.34v-2.652h2.467V2.667h-2.468V0h5.34v24Z","TOML","toml","Uses TOML format for project configuration through pyproject.toml file","8x90wklpoo",{"_64":88,"_38":92,"_8":93},{"_66":89,"_44":90,"_69":91},"M4.345 7.053c-.495.02-.44.725-.536 1.081-.157.583-.3 1.325-.347 1.926-.046.585-.008 1.127.066 1.719.058.46.191.767.07.89-.108.11-3.216 2.962-3.466 3.123-.26.169-.08.584.069.817.157.246.23.373.557.33.306-.042.405-.409.583-.606.228-.252 2.421-2.401 2.616-2.401.077.544.367 1.064.67 1.513.15.222.314.439.505.629.175.175.4.317.587.45.44.024.795-.301.35-.67-.17-.14-.735-.971-.927-1.43-.18-.43-.574-1.076-.146-1.428 1.494-1.23 3.72-2.262 4.247-2.313-.257 1.024-1.356 3.048-1.757 4.012-.14.333-.231.732-.185 1.094.055.434.383.774.587.806.417-.023.7-.387.946-.645.343-.357.634-.685.974-1.043.339-.356.672-.731.971-1.07.184-.207.674-.713.963-.713-.11.693-.716 1.552-.839 2.254-.125.716.531 1.596 1.217.956.623-.58 1.255-1.129 1.867-1.72.217-.208.175.037.224.242.05.208.176.91.275 1.1.18.346.496.592.897.598.362.006.727-.161.982-.414.19-.187.513-.699.154-.832-.23-.086-.217-.176-.495-.129-.172.029-.362.074-.507.179-.367-.003-.381-.89-.324-1.161.068-.327.207-.659.185-.998-.026-.418-.478-.69-.582-.72-.156-.076-.253.023-.458.212-.173.161-.363.332-.535.495-.34.322-.768.813-.942.813.305-.705.708-2.652-.643-2.48-.563.071-.95.377-1.394.71-.29.28-.683.641-.936.87-.236.216-.371.404-.496.404.132-.747 1.685-3.167.885-3.853-.158-.136-.313-.325-.515-.349a4.637 4.637 0 0 0-.833.19c-.565.18-2.78 1.28-4.19 2.289-.131.094-.214-.085-.231-.29-.087-1.058.199-2.19.496-3.188.208-.696-.557-1.225-.659-1.249zm18.177.874c-.166.364-.2.894-.248 1.319a24.307 24.307 0 0 0-1.246-.115c.238.296.691.588 1.056.724-.048.366-.434.67-.599 1.021.458-.127.676-.47.989-.821.362.22.791.627 1.26.636-.177-.376-.334-.695-.658-.966.269-.175.717-.362.924-.633-.345-.074-.718-.093-1.052-.015-.258-.284-.3-.772-.426-1.15zm-2.92.079c-.23.02-.613.49-.832.773-.807 1.039-1.542 3.15-1.661 3.542-.363 1.195-.502 2.672.28 3.722.456.612 1.258.66 2.041.434.405-.116.812-.406.95-.723.114-.263.174-.753-.404-.38-.224.145-.634.304-1.37.291-.247-.004-.651-.357-.76-.722-.192-.595-.11-1.393-.11-1.393.167-1.028.642-2.146 1.061-3.076.163-.36.658-1.259.842-1.546 0 0 .239-.373.131-.77-.031-.116-.091-.16-.168-.152zm3.072 2.976c-.12.264-.144.648-.18.956-.274-.031-.63-.066-.904-.083.172.215.501.426.766.525-.034.265-.314.486-.434.741.332-.092.49-.34.717-.596.263.16.575.456.914.462-.127-.273-.242-.504-.477-.701.195-.127.52-.262.67-.46a1.77 1.77 0 0 0-.763-.01c-.187-.206-.217-.56-.309-.834zm-1.123 2.422c-.083.183-.1.449-.125.662a12.6 12.6 0 0 0-.624-.058c.119.148.346.295.53.363-.025.184-.219.336-.301.513.23-.064.339-.236.496-.413.181.11.397.316.632.32-.088-.19-.168-.349-.33-.485.135-.087.36-.181.463-.317a1.22 1.22 0 0 0-.527-.008c-.13-.142-.151-.387-.214-.576z","XML","xml","Parses sitemap.xml files to extract webpage paths and provides access to raw XML sitemap content as a resource","237i0ki2oy","namespace",{"_96":97,"_69":101},"owner",{"_98":99},"githubAccount",{"_100":101},"login","brian-bfz","readmeMarkdown","redditPostExternalId","repository",{"_106":107,"_127":128,"_131":132,"_148":-5,"_149":150,"_151":-5,"_152":-5},"argumentsJsonSchema",{"_108":109,"_124":125,"_12":126},"properties",{"_110":111,"_116":117,"_120":121},"HOST",{"_112":113,"_38":114,"_12":115},"default","0.0.0.0","Server host address","string","PORT",{"_112":118,"_38":119,"_12":115},"8080","Server port number","BASE_URL",{"_112":122,"_38":123,"_12":115},"https://example.com","The base URL of the website to query","required",[],"object","githubProject",{"_42":43,"_129":130},"url","https://github.com/brian-bfz/fireworks2","githubRepository",{"_133":134,"_135":136,"_137":138,"_23":139,"_140":76,"_44":141,"_96":142,"_144":145,"_146":-5,"_147":145},"defaultBranch","main","fullName","brian-bfz/fireworks2","githubTreeId",1401600,29820,"language","fireworks2",{"_100":101,"_8":143},"arzadovxby","recentStargazers",0,"spdxLicense","stargazers","glamaJson","inspectable",false,"npmPackage","supportedPlatforms","scores",{"_155":-5,"_156":-5,"_157":-5},"license","quality","security","simpleIcon","toolCount","wh7c0vt89m","updatedAt","2025-10-11T02:02:57.029776Z","meta",[165,167,169,176,179,181,184,187,190,193,196,198,201,204,206,208,210,212,214],{"_10":166},"Webpage MCP Server | Glama",{"_168":39,"_44":38},"content",{"_170":171,"_172":173,"_174":175},"href","https://glama.ai/mcp/servers/@brian-bfz/fireworks2","rel","canonical","tagName","link",{"_168":41,"_177":178},"property","og:title",{"_168":39,"_177":180},"og:description",{"_168":182,"_177":183},"https://glama.ai/logo.png","og:logo",{"_168":185,"_177":186},"https://glama.ai/mcp/servers/@brian-bfz/fireworks2/og-image","og:image",{"_168":188,"_177":189},"630","og:image:height",{"_168":191,"_177":192},"1200","og:image:width",{"_168":194,"_177":195},"website","og:type",{"_168":171,"_177":197},"og:url",{"_168":199,"_177":200},"Glama – MCP Hosting Platform","og:site_name",{"_168":202,"_44":203},"summary_large_image","twitter:card",{"_168":199,"_44":205},"twitter:title",{"_168":39,"_44":207},"twitter:description",{"_168":185,"_44":209},"twitter:image",{"_168":188,"_44":211},"twitter:image:height",{"_168":191,"_44":213},"twitter:image:width",{"_215":216},"script:ld+json",{"_217":218,"_219":220},"@context","http://schema.org","@graph",[221],{"_217":222,"_223":224,"_225":226},"https://schema.org","@type","BreadcrumbList","itemListElement",[227,234,238,242],{"_223":228,"_229":230,"_44":231,"_232":233},"ListItem","item","/","Glama","position",1,{"_223":228,"_229":235,"_44":236,"_232":237},"/mcp","MCP",2,{"_223":228,"_229":239,"_44":240,"_232":241},"/mcp/servers","Servers",3,{"_223":228,"_229":243,"_44":41,"_232":244},"/mcp/servers/@brian-bfz/fireworks2",4,"visitorIsMaintainer","routes/_public/mcp/servers/~namespace/~slug/_pages/_explorer/blob/~commit/~/_route",{"_248":249,"_36":255,"_280":281,"_163":293,"_290":317,"_318":319},"blob",{"_168":250,"_251":252,"_253":254},"OPENAI_API_KEY=your-openai-api-key-here\nDEDALUS_API_KEY=your-dedalus-api-key-here\nGITHUB_TOKEN=your-github-token-here\n","fileName",".env.example","size",118,{"_49":50,"_20":256,"_58":39,"_59":39,"_40":41,"_23":60,"_61":257,"_94":266,"_102":-5,"_103":-5,"_104":269,"_153":279,"_158":-5,"_69":141,"_159":145,"_8":160,"_161":162},[52,53,54,55,56,57],[258,260,262,264],{"_64":259,"_38":71,"_8":72},{"_66":67,"_44":68,"_69":70},{"_64":261,"_38":78,"_8":79},{"_66":75,"_44":76,"_69":77},{"_64":263,"_38":85,"_8":86},{"_66":82,"_44":83,"_69":84},{"_64":265,"_38":92,"_8":93},{"_66":89,"_44":90,"_69":91},{"_96":267,"_69":101},{"_98":268},{"_100":101},{"_106":270,"_127":276,"_131":277,"_148":-5,"_149":150,"_151":-5,"_152":-5},{"_108":271,"_124":275,"_12":126},{"_110":272,"_116":273,"_120":274},{"_112":113,"_38":114,"_12":115},{"_112":118,"_38":119,"_12":115},{"_112":122,"_38":123,"_12":115},[],{"_42":43,"_129":130},{"_133":134,"_135":136,"_137":138,"_23":139,"_140":76,"_44":141,"_96":278,"_144":145,"_146":-5,"_147":145},{"_100":101,"_8":143},{"_155":-5,"_156":-5,"_157":-5},"member",{"_282":283,"_286":287,"_288":252,"_137":138,"_289":150,"_290":252,"_291":292,"_253":254,"_12":248},"commit",{"_284":285},"sha","f01f9665a4d70fce259ece41399ac72c2c654f7b","contentStoredObjectPointerId",15504148,"fullPath","indexable","path","safeToDisplayAsText",true,[294,296,298,300,302,303,304,306,307,308,309,310,311,312,313,314,315,316],{"_10":295},".env.example | Webpage MCP Server | Glama",{"_168":297,"_44":38},"Enterprise-grade security, privacy, and features like agents, MCP, prompt templates, and more.",{"_170":299,"_172":173,"_174":175},"https://glama.ai/mcp/servers/@brian-bfz/fireworks2/blob/f01f9665a4d70fce259ece41399ac72c2c654f7b/",{"_168":301,"_177":178},".env.example | Webpage MCP Server",{"_168":297,"_177":180},{"_168":182,"_177":183},{"_168":305,"_177":186},"https://glama.ai/generated-images/og?title=.env.example+%7C+Webpage+MCP+Server",{"_168":188,"_177":189},{"_168":191,"_177":192},{"_168":194,"_177":195},{"_168":299,"_177":197},{"_168":199,"_177":200},{"_168":202,"_44":203},{"_168":199,"_44":205},{"_168":297,"_44":207},{"_168":305,"_44":209},{"_168":188,"_44":211},{"_168":191,"_44":213},"","treeMembers",[320,324,327,330,333,336,339,341,344,347,350,353,356,359,362,365,368,371,374,377],{"_282":321,"_288":322,"_290":322,"_12":323},{"_284":285},"agents","tree",{"_282":325,"_288":326,"_290":326,"_12":323},{"_284":285},"assets",{"_282":328,"_288":329,"_290":329,"_12":323},{"_284":285},"docs",{"_282":331,"_288":332,"_290":332,"_12":323},{"_284":285},"logs",{"_282":334,"_288":335,"_290":335,"_12":323},{"_284":285},"src",{"_282":337,"_288":338,"_290":338,"_12":323},{"_284":285},"tests",{"_282":340,"_288":252,"_290":252,"_12":248},{"_284":285},{"_282":342,"_288":343,"_290":343,"_12":248},{"_284":285},"FLOW.md",{"_282":345,"_288":346,"_290":346,"_12":248},{"_284":285},".gitignore",{"_282":348,"_288":349,"_290":349,"_12":248},{"_284":285},"lib.py",{"_282":351,"_288":352,"_290":352,"_12":248},{"_284":285},"pyproject.toml",{"_282":354,"_288":355,"_290":355,"_12":248},{"_284":285},".python-version",{"_282":357,"_288":358,"_290":358,"_12":248},{"_284":285},"quick_test.py",{"_282":360,"_288":361,"_290":361,"_12":248},{"_284":285},"run_one_test.py",{"_282":363,"_288":364,"_290":364,"_12":248},{"_284":285},"run_single_test.py",{"_282":366,"_288":367,"_290":367,"_12":248},{"_284":285},"single_test.log",{"_282":369,"_288":370,"_290":370,"_12":248},{"_284":285},"test_action_generation.py",{"_282":372,"_288":373,"_290":373,"_12":248},{"_284":285},"test_cases.py",{"_282":375,"_288":376,"_290":376,"_12":248},{"_284":285},"test_kush.py",{"_282":378,"_288":379,"_290":379,"_12":248},{"_284":285},"test_results.log","actionData","errors"]

MCP directory API