A
securityA
licenseA
qualityEnables web content scanning and analysis by fetching, analyzing, and extracting information from web pages using tools like page fetching, link extraction, site crawling, and more.
Last updated -
6
11
MIT License
URL Text Fetcher MCP Server
Tiny MCP server for LM Studio that adds two tools:
fetch_url_text(url): returns visible page textfetch_page_links(url): returns all page links
Quick start
cd /Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server
python3.12 -m venv .venv
source .venv/bin/activate
python -m pip install -U pip setuptools wheel
python -m pip install -e .
LM Studio setup (paste this into mcp.json)
Use the absolute interpreter to avoid ENOENT errors.
{
"mcpServers": {
"url-text-fetcher": {
"command": "/Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server/.venv/bin/python",
"args": ["-m", "url_text_fetcher.mcp_server"],
"cwd": "/Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server"
}
}
}
Alternative using the console script:
{
"mcpServers": {
"url-text-fetcher": {
"command": "/Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server/.venv/bin/url-text-fetcher",
"args": [],
"cwd": "/Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server"
}
}
}
After saving, restart LM Studio if the tool does not appear.
Working prompts (use inside LM Studio)
Summarize a real page: “Use
url-text-fetcher.fetch_url_textonhttps://httpbin.org/html. Give a two‑sentence summary.”List links from a real site: “Call
url-text-fetcher.fetch_page_linksforhttps://www.python.org/and return the first 10 HTTPS links.”Answer using content: “Fetch text from
https://docs.python.org/3/whatsnew/3.12.html. What is one notable change in Python 3.12?” "Fetch text from https://www.python.org/. What’s the latest Python release mentioned and when was it announced?"
Troubleshooting
ENOENT
spawn python: Use the absolute interpreter shown above inmcp.json.Network/SSL errors: try another URL; some sites block scripted fetches.
Local run (optional)
source /Users/lex/Learning/URL-Fetcher-LM-Studio-MCP-Server/.venv/bin/activate
python -m url_text_fetcher.mcp_server
local-only server
The server can only run on the client's local machine because it depends on local resources.
Enables fetching visible text content and extracting all links from web pages through URL requests. Designed specifically for LM Studio integration to provide web scraping capabilities.
Related MCP Servers
- AsecurityAlicenseAqualityEnables text extraction from web pages and PDFs, and execution of predefined commands, enhancing content processing and automation capabilities.
- AsecurityAlicenseAqualityEnables retrieval and processing of web page content for LLMs by converting HTML to markdown, with support for content truncation and pagination.Last updated -12MIT License
- AsecurityAlicenseAqualityEnables LLMs to autonomously retrieve and explore web content by fetching pages and recursively following links to a specified depth, particularly useful for learning about topics from documentation.Last updated -17MIT License