A
securityA
licenseA
qualityEnables web content scanning and analysis by fetching, analyzing, and extracting information from web pages using tools like page fetching, link extraction, site crawling, and more.
Last updated -
6
12
MIT License
URL Text Fetcher MCP Server
Tiny MCP server for LM Studio that adds two tools:
fetch_url_text(url): returns visible page textfetch_page_links(url): returns all page links
Quick start
cd /Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server
python3.12 -m venv .venv
source .venv/bin/activate
python -m pip install -U pip setuptools wheel
python -m pip install -e .
LM Studio setup (paste this into mcp.json)
Use the absolute interpreter to avoid ENOENT errors.
{
"mcpServers": {
"url-text-fetcher": {
"command": "/Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server/.venv/bin/python",
"args": ["-m", "url_text_fetcher.mcp_server"],
"cwd": "/Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server"
}
}
}
Alternative using the console script:
{
"mcpServers": {
"url-text-fetcher": {
"command": "/Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server/.venv/bin/url-text-fetcher",
"args": [],
"cwd": "/Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server"
}
}
}
After saving, restart LM Studio if the tool does not appear.
Working prompts (use inside LM Studio)
Summarize a real page: “Use
url-text-fetcher.fetch_url_textonhttps://httpbin.org/html. Give a two‑sentence summary.”List links from a real site: “Call
url-text-fetcher.fetch_page_linksforhttps://www.python.org/and return the first 10 HTTPS links.”Answer using content: “Fetch text from
https://docs.python.org/3/whatsnew/3.12.html. What is one notable change in Python 3.12?” "Fetch text from https://www.python.org/. What’s the latest Python release mentioned and when was it announced?"
Troubleshooting
ENOENT
spawn python: Use the absolute interpreter shown above inmcp.json.Network/SSL errors: try another URL; some sites block scripted fetches.
Local run (optional)
source /Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server/.venv/bin/activate
python -m url_text_fetcher.mcp_server
Related MCP Servers
- -security-license-qualityEnables text extraction from web pages and PDFs, and execution of predefined commands, enhancing content processing and automation capabilities.
- AsecurityAlicenseAqualityEnables retrieval and processing of web page content for LLMs by converting HTML to markdown, with support for content truncation and pagination.Last updated -12MIT License
- AsecurityAlicenseAqualityEnables LLMs to autonomously retrieve and explore web content by fetching pages and recursively following links to a specified depth, particularly useful for learning about topics from documentation.Last updated -17MIT License