AgentQL MCP Server
The AgentQL MCP Server extracts structured data from web pages using natural language prompts.
Extract structured data: Use the
extract-web-datatool to transform web content from any public URL into JSON-formatted data.Natural language input: Simply describe the data structure you need in plain language.
Integration support: Works with Claude, Cursor, Windsurf and other apps for seamless data extraction workflows.
Debugging capabilities: Access the MCP Inspector for troubleshooting.
Developer-friendly: Can be configured for local development and testing.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@AgentQL MCP Server extract product prices and names from https://example.com/products"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
AgentQL MCP Server
This is a Model Context Protocol (MCP) server that integrates AgentQL's data extraction capabilities.
Features
Tools
extract-web-data- extract structured data from a given 'url', using 'prompt' as a description of actual data and its fields to extract.
Related MCP server: @hauntapi/mcp-server
Installation
To use AgentQL MCP Server to extract data from web pages, you need to install it via npm, get an API key from our Dev Portal, and configure it in your favorite app that supports MCP.
Install the package
npm install -g agentql-mcpConfigure Claude
Open Claude Desktop Settings via
⌘+,(don't confuse with Claude Account Settings)Go to Developer sidebar section
Click Edit Config and open
claude_desktop_config.jsonfileAdd
agentqlserver insidemcpServersdictionary in the config fileRestart the app
{
"mcpServers": {
"agentql": {
"command": "npx",
"args": ["-y", "agentql-mcp"],
"env": {
"AGENTQL_API_KEY": "YOUR_API_KEY"
}
}
}
}Read more about MCP configuration in Claude here.
Configure VS Code
For one-click installation, click one of the install buttons below:
Manual Installation
Click the install buttons at the top of this section for the quickest installation method. For manual installation, follow these steps:
Add the following JSON block to your User Settings (JSON) file in VS Code. You can do this by pressing Ctrl + Shift + P and typing Preferences: Open User Settings (JSON).
{
"mcp": {
"inputs": [
{
"type": "promptString",
"id": "apiKey",
"description": "AgentQL API Key",
"password": true
}
],
"servers": {
"agentql": {
"command": "npx",
"args": ["-y", "agentql-mcp"],
"env": {
"AGENTQL_API_KEY": "${input:apiKey}"
}
}
}
}
}Optionally, you can add it to a file called .vscode/mcp.json in your workspace. This will allow you to share the configuration with others.
{
"inputs": [
{
"type": "promptString",
"id": "apiKey",
"description": "AgentQL API Key",
"password": true
}
],
"servers": {
"agentql": {
"command": "npx",
"args": ["-y", "agentql-mcp"],
"env": {
"AGENTQL_API_KEY": "${input:apiKey}"
}
}
}
}Configure Cursor
Open Cursor Settings
Go to MCP > MCP Servers
Click + Add new MCP Server
Enter the following:
Name: "agentql" (or your preferred name)
Type: "command"
Command:
env AGENTQL_API_KEY=YOUR_API_KEY npx -y agentql-mcp
Read more about MCP configuration in Cursor here.
Configure Windsurf
Open Windsurf: MCP Configuration Panel
Click Add custom server+
Alternatively you can open
~/.codeium/windsurf/mcp_config.jsondirectlyAdd
agentqlserver insidemcpServersdictionary in the config file
{
"mcpServers": {
"agentql": {
"command": "npx",
"args": ["-y", "agentql-mcp"],
"env": {
"AGENTQL_API_KEY": "YOUR_API_KEY"
}
}
}
}Read more about MCP configuration in Windsurf here.
Validate MCP integration
Give your agent a task that will require extracting data from the web. For example:
Extract the list of videos from the page https://www.youtube.com/results?search_query=agentql, every video should have a title, an author name, a number of views and a url to the video. Make sure to exclude ads items. Format this as a markdown table.In case your agent complains that it can't open urls or load content from the web instead of using AgentQL, try adding "use tools" or "use agentql tool" hint.
Development
Install dependencies:
npm installBuild the server:
npm run buildFor development with auto-rebuild:
npm run watchIf you want to try out development version, you can use the following config instead of the default one:
{
"mcpServers": {
"agentql": {
"command": "/path/to/agentql-mcp/dist/index.js",
"env": {
"AGENTQL_API_KEY": "YOUR_API_KEY"
}
}
}
}Don't forget to remove the default AgentQL MCP server config to not confuse Claude with two similar servers.
Debugging
Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:
npm run inspectorThe Inspector will provide a URL to access debugging tools in your browser.
Available Tools
1 toolextract-web-dataA
Extracts structured data as JSON from a web page given a URL using a Natural Language description of the data.
Inputs: url (required), prompt (required).
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 1 tool
With only one tool, there is no risk of confusion between tools, so disambiguation is perfect.
The single tool name 'extract-web-data' follows a clear verb_noun pattern, and consistency is trivially maintained.
A single tool is too few for a web scraping server, which typically requires tools for different actions (e.g., listing, configuring) or handling multiple extraction strategies.
The server only provides extraction via natural language, missing common features like pagination, multiple output formats, or error handling, leaving significant gaps for agents.
Maintenance
Related MCP Connectors
Turn the web into structured, reliable, actionable enterprise data for AI Agents
Web scraping, search, crawling, structured extraction and research for AI agents.
Live web data for AI agents: structured JSON from 248 websites through one API key.
Scrape any website, extract structured data, and collect web content at scale with AI agents
Related MCP Servers
- AlicenseCqualityDmaintenanceA server that provides web scraping and intelligent content searching capabilities using the Firecrawl API, enabling AI agents to extract structured data from websites and perform content searches.53MIT
- AlicenseAqualityBmaintenanceWeb extraction MCP server for AI agents. Extract structured data from any URL with built-in Cloudflare bypass, JavaScript rendering, and intelligent parsing. Returns clean markdown or JSON.5794 npm2MIT
- AlicenseAqualityFmaintenanceStructured web extraction for AI agents. Pass any URL and a prompt, get clean JSON data back. Native MCP server with 100 free requests/month.3794 npmMIT
- AlicenseNot gradedqualityDmaintenanceSecure, agent-driven web data extraction MCP server that extracts structured data from websites using APIs, RSS, and HTML without requiring a browser.100 npmApache 2.0
Appeared in Searches
- A server for unstructured data or information
- Understanding Web Scrubbing Techniques
- Creating a Due Diligence Report for Rizhao Urban Investment Using Audit Reports, Annual Reports, and Rating Reports
- General information about web search
- Searching for Rizhao Urban Investment's Annual Report and Rating Report for a Due Diligence Report