"Information about web crawlers or scraping techniques" matching MCP connectors:
GET /v1/connectors – MCP directory API referenceMatching Connector Tools:
Company & brand data by domain or ticker/ISIN: industry, headcount, HQ, social, colors, logos.
B2B competitive intelligence, live sales battlecards, ICP prospect fit scoring, and tech stack teardowns over MCP and REST with source-grounded web evidence and citations.
Ask your AI assistant about your own website's SEO and get answers from your real data, not generic advice. One connector, all your channels: Google Search Console (rankings, clicks, indexing), Google Analytics (traffic and sources), Google Ads (campaigns and search terms), Google Business Profile (local visibility and reviews), Google Trends, keyword research, backlinks and link prospects, competitor rankings, site crawls, and AI visibility (does ChatGPT mention your site?). Ask things like: which keywords am I one push away from page 1 for? Why did traffic drop last month? Which competitor is outranking me, and where? Are my ads and SEO fighting over the same keywords? Then let it act. On a paid plan, your assistant can prepare SEO fixes, content campaigns, and article drafts. Nothing touches your site until you approve it in SEOmatic, and every change shows before-and-after results. Connect via OAuth: log in, pick your site, done. No API key needed.
Connect Claude or any MCP client to Thread Otter, a GTM agent for founders. Free tools with no key: find_buyer_threads (give it a website URL and get recent Reddit threads where that product's buyers are asking for it, report in ~3 minutes), reddit_demand_board (weekly demand across 40 communities with thread receipts), and subreddit_rules (promotion posture for 2,000+ profiled subreddits). With an API key: read your buying-intent mentions across Reddit, X, LinkedIn, and Bluesky, check your pipeline, and propose posts and reply drafts in your voice. Propose-only by design: nothing sends without your approval flow. Keys at threadotter.com/connect.
Access Versium's B2B2C identity graph directly through your AI agent. Generate targeted lead lists, enrich records with contact and firmographic data, validate emails, and size audiences — all through natural language. No manual exports or API coding required. Requires an active Versium REACH subscription with API access.
SEO + GEO tools in your AI editor: scan as ChatGPT and Google crawlers see it, fix order, llms.txt.
Audit any App Store or Google Play listing: measured ranks, keyword gaps, draft copy. Read-only.
Validate HTML/CSS, audit SEO and JSON-LD, check links, and capture responsive screenshots.
Paid advertising for agents: rankings, quotes and MPP or x402 wallet integrations.
Build, inspect and read adaptive A/B tests. Config travels in the URL; no account or API key needed.
Free SEO & AI-search (AEO) audits for any site or Shopify store, with emailed weekly score reports.
TopFood publishes digital restaurant menus with QR codes. Give it a menu (text, photo transcription, or description) and it creates a live, shareable menu page the restaurant owner can claim for free — no signup required upfront.
Technical SEO audit with the ready-made fix for each finding. Pay per call via x402 or credit.
A public 500-rank ad board where every bid decays 1%/h. Read it, buy a rank, or try it free.
Screenshot, PDF, OG-image, and page extraction (markdown/JSON) over MCP. Bearer key or x402.
Finds timely sources across news, social, and the web and writes posts worth publishing.
Answers on AEO, SEO, web and brand from GOJI's published material. Melbourne, Australia.
Promote your app or software with UGC creator videos. Agent drafts the campaign, a human funds it.
Turn product links or queries into tracked links that can earn. Carts and search too.
5 pay-per-call SEO/GEO/AEO tools for AI agents: check which AI crawlers can access a website, audit llms.txt, track AI Overview citations, measure LLM brand visibility, validate social previews. Free discovery + pricing_info tool; paid calls $0.01-0.02 in USDC on Base via x402 — you only pay for successful runs.
