搜尋引擎與 AI 爬蟲工具箱
Server Details
搜尋引擎與 AI 爬蟲工具箱:搜尋指令、爬蟲驗證、收錄與 AEO 健檢。台灣繁體中文 MCP 工具。
- Status
- Healthy
- Uptime
- 100.0% over the last 24 hours
- Last Tested
- Transport
- Streamable HTTP · MCP 2025-11-25
- URL
- ChatGPT
- –
- Claude
- –
TDQS
Scored across 14 tools
Most tools have clearly distinct purposes, but there are potential overlaps in the crawler/robots cluster: ai_crawler_list vs verify_crawler_ip (both about crawler identity), and check_site_crawlers vs test_robots_txt (both about robots.txt rules). Descriptions clarify the differences, but an agent might still hesitate between the robots auditing and testing tools.
All 14 tools use consistent snake_case, predominantly verb_noun (build_search_urls, check_site_crawlers, generate_meta_tags, test_robots_txt, verify_crawler_ip). A few noun-first names (ai_crawler_list, search_operators) exist but stay within the same lowercase-underscore convention.
14 tools sit comfortably in the well-scoped 3-15 range. Each tool maps to a distinct SEO/crawler task (generate, test, audit, submit, inspect), so no tool feels redundant or padded.
The surface covers crawling, robots.txt generation/testing, meta tags, indexing submission, SERP preview, operators, market share and YouTube SEO—good lifecycle coverage. Minor gaps remain, such as sitemap or llms.txt generation (only checked, not created) and keyword/backlink tooling, but agents can work around these.
Available Tools
14 toolsai_crawler_listCInspect
AI 與搜尋引擎爬蟲 User-Agent 名單:業者、用途、是否遵守 robots.txt、官方 IP 清單。
Inputs: type.
build_search_urlsBInspect
一次產生 Google、Bing、Yahoo 奇摩、百度、YouTube 的進階搜尋網址(關鍵字、完全符合、排除字、限定網站、檔案類型、時間)。
Inputs: q (required), site, time, exact, +2 more.
check_site_crawlersCInspect
檢查網站的 robots.txt、Sitemap、llms.txt,以及 Googlebot、bingbot、GPTBot、ClaudeBot、PerplexityBot 等是否被封鎖,附改善建議。
Inputs: url (required).
generate_meta_tagsCInspect
產生 title、description、canonical、Open Graph、Twitter 卡片與 JSON-LD。
Inputs: title (required), url, type, image, +2 more.
generate_robots_txtCInspect
產生 robots.txt:allow_all、block_training(封鎖 AI 訓練保留搜尋)、block_all_ai、block_all,可加不抓路徑與 Sitemap。
Inputs: mode, sitemap, disallow.
geo_citation_auditBInspect
AEO/GEO 引用準備度健檢:檢查網頁能否被 ChatGPT、Perplexity、Google AI 摘要等答案引擎引用(爬蟲可讀、開頭直接回答、問句標題、表格、外部與權威來源、更新日期、JSON-LD citation、llms.txt、Markdown 版、Content-Digest),給分數與優先修正清單。
Inputs: url (required).
indexnow_submitAInspect
用 IndexNow 通知 Bing、Yandex、Naver 等搜尋引擎網址已更新(需先在網站放金鑰檔,最多 100 個網址)。
Inputs: key (required), host (required), urls (required), keyLocation.
search_operatorsBInspect
搜尋指令(site:、filetype:、intitle:、before: 等)在 Google、Bing、Yahoo、百度的支援對照與已失效指令。
Inputs: engine.
search_submit_guideCInspect
如何讓 Google、Bing、Yahoo、百度、YouTube、AI 搜尋收錄網站:工具、步驟與 API。
Inputs: no named parameters.
serp_previewBInspect
預覽 Google 搜尋結果標題與描述,估算中文像素寬度與截斷位置。
Inputs: title (required), url, description.
test_robots_txtCInspect
依 RFC 9309 測試某個 User-Agent 能否抓取某路徑。
Inputs: robots (required), user_agent (required), path.
verify_crawler_ipBInspect
驗證 IP 是否真的來自 Googlebot、bingbot、GPTBot、ClaudeBot、PerplexityBot、Applebot、Baiduspider 等(官方 IP 清單+反查 DNS)。
Inputs: ip (required), bot.
youtube_seo_checkCInspect
檢查 YouTube 章節時間碼(0:00 起、至少 3 段、每段 10 秒)與標題、說明、標籤、主題標籤數量上限。
Inputs: tags, title, chapters, duration, +1 more.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
llms.txt 檢查工具:檢查網站的 llms.txt、robots 與 sitemap。台灣繁體中文 MCP 工具。
檢查網站爬蟲設定、驗證爬蟲 IP、IndexNow 提交與 YouTube SEO 檢查。
檢查網站 llms.txt 與 AI 爬蟲 robots.txt 設定,並自動產生 llms.txt。
Related MCP Servers
- AlicenseAqualityBmaintenanceSEO MCP over Search Console, GA4, PageSpeed, Cloudflare, IndexNow, CrUX, and 7 technical-SEO HTTP tools.70669 PyPI501MIT
- AlicenseNot gradedqualityBmaintenanceMCP server for AI search crawler governance, brand safety, and search infrastructure auditing. Provides tools to audit robots.txt, canonical links, sitemaps, redirects, and send IndexNow notifications.MIT
- AlicenseAqualityCmaintenanceMCP server that checks a website's AI-search (GEO) readiness: robots.txt access for 16 AI crawlers (GPTBot, OAI-SearchBot, PerplexityBot, ClaudeBot, Google-Extended, Bingbot...), JSON-LD schema, llms.txt, sitemap and basic SEO tags. Python, stdio, MIT.3MIT
- AlicenseNot gradedqualityBmaintenanceFree, open-source desktop SEO crawler with a built-in MCP server. 250 technical SEO, GEO and AI-search checks across 23 areas, run locally; MCP tools list crawls, inspect issues, run Lighthouse, check AI-crawler access, and apply confirmation-gated WordPress fixes with rollback.15 PyPI21MIT
Glama MCP Gateway
Add one secure layer between your agents and this server.