parquet mcp server
The Parquet MCP Server is a tool for web searches and similarity comparisons that allows you to:
Perform web searches and scrape results based on provided queries
Extract relevant information from previous search results
Handle multiple search queries simultaneously with pagination support
Utilize PostgreSQL functionality for vector similarity searches
Integrate with Claude Desktop for AI-powered workflows
Extend functionality through smithery for automatic installation or manual configuration
Converts Parquet files to DuckDB databases for efficient querying and analysis
Uses environment variables for configuration of embedding services, database connections, and model selection
Stores embedding vectors as NumPy arrays in the Parquet file output
Uses Ollama models to generate text embeddings from Parquet file columns
Converts Parquet files to PostgreSQL tables with pgvector support for vector similarity search
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@parquet mcp serversearch for 'latest macbook pro reviews' and scrape page 1 results"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
parquet_mcp_server
A powerful MCP (Model Control Protocol) server that provides tools for performing web searches and finding similar content. This server is designed to work with Claude Desktop and offers two main functionalities:
Web Search: Perform a web search and scrape results
Similarity Search: Extract relevant information from previous searches
This server is particularly useful for:
Applications requiring web search capabilities
Projects needing to find similar content based on search queries
Installation
Installing via Smithery
To install Parquet MCP Server for Claude Desktop automatically via Smithery:
npx -y @smithery/cli install @DeepSpringAI/parquet_mcp_server --client claudeClone this repository
git clone ...
cd parquet_mcp_serverCreate and activate virtual environment
uv venv
.venv\Scripts\activate # On Windows
source .venv/bin/activate # On macOS/LinuxInstall the package
uv pip install -e .Environment
Create a .env file with the following variables:
EMBEDDING_URL=http://sample-url.com/api/embed # URL for the embedding service
OLLAMA_URL=http://sample-url.com/ # URL for Ollama server
EMBEDDING_MODEL=sample-model # Model to use for generating embeddings
SEARCHAPI_API_KEY=your_searchapi_api_key
FIRECRAWL_API_KEY=your_firecrawl_api_key
VOYAGE_API_KEY=your_voyage_api_key
AZURE_OPENAI_ENDPOINT=http://sample-url.com/azure_openai
AZURE_OPENAI_API_KEY=your_azure_openai_api_keyRelated MCP server: my-mcp-server
Usage with Claude Desktop
Add this to your Claude Desktop configuration file (claude_desktop_config.json):
{
"mcpServers": {
"parquet-mcp-server": {
"command": "uv",
"args": [
"--directory",
"/home/${USER}/workspace/parquet_mcp_server/src/parquet_mcp_server",
"run",
"main.py"
]
}
}
}Available Tools
The server provides two main tools:
Search Web: Perform a web search and scrape results
Required parameters:
queries: List of search queries
Optional parameters:
page_number: Page number for the search results (defaults to 1)
Extract Info from Search: Extract relevant information from previous searches
Required parameters:
queries: List of search queries to merge
Example Prompts
Here are some example prompts you can use with the agent:
For Web Search:
"Please perform a web search for 'macbook' and 'laptop' and scrape the results from page 1"For Extracting Info from Search:
"Please extract relevant information from the previous searches for 'macbook'"Testing the MCP Server
The project includes a comprehensive test suite in the src/tests directory. You can run all tests using:
python src/tests/run_tests.pyOr run individual tests:
# Test Web Search
python src/tests/test_search_web.py
# Test Extract Info from Search
python src/tests/test_extract_info_from_search.pyYou can also test the server using the client directly:
from parquet_mcp_server.client import (
perform_search_and_scrape, # New web search function
find_similar_chunks # New extract info function
)
# Perform a web search
perform_search_and_scrape(["macbook", "laptop"], page_number=1)
# Extract information from the search results
find_similar_chunks(["macbook"])Troubleshooting
If you get SSL verification errors, make sure the SSL settings in your
.envfile are correctIf embeddings are not generated, check:
The Ollama server is running and accessible
The model specified is available on your Ollama server
The text column exists in your input Parquet file
If DuckDB conversion fails, check:
The input Parquet file exists and is readable
You have write permissions in the output directory
The Parquet file is not corrupted
If PostgreSQL conversion fails, check:
The PostgreSQL connection settings in your
.envfile are correctThe PostgreSQL server is running and accessible
You have the necessary permissions to create/modify tables
The pgvector extension is installed in your database
PostgreSQL Function for Vector Similarity Search
To perform vector similarity searches in PostgreSQL, you can use the following function:
-- Create the function for vector similarity search
CREATE OR REPLACE FUNCTION match_web_search(
query_embedding vector(1024), -- Adjusted vector size
match_threshold float,
match_count int -- User-defined limit for number of results
)
RETURNS TABLE (
id bigint,
metadata jsonb,
text TEXT, -- Added text column to the result
date TIMESTAMP, -- Using the date column instead of created_at
similarity float
)
LANGUAGE plpgsql
AS $$
BEGIN
RETURN QUERY
SELECT
web_search.id,
web_search.metadata,
web_search.text, -- Returning the full text of the chunk
web_search.date, -- Returning the date timestamp
1 - (web_search.embedding <=> query_embedding) as similarity
FROM web_search
WHERE 1 - (web_search.embedding <=> query_embedding) > match_threshold
ORDER BY web_search.date DESC, -- Sort by date in descending order (newest first)
web_search.embedding <=> query_embedding -- Sort by similarity
LIMIT match_count; -- Limit the results to the match_count specified by the user
END;
$$;This function allows you to perform similarity searches on vector embeddings stored in a PostgreSQL database, returning results that meet a specified similarity threshold and limiting the number of results based on user input. The results are sorted by date and similarity.
Postgres table creation
CREATE TABLE web_search (
id SERIAL PRIMARY KEY,
text TEXT,
metadata JSONB,
embedding VECTOR(1024),
-- This will be auto-updated
date TIMESTAMP DEFAULT NOW()
);Available Tools
2 toolsextract-info-from-searchD
Extract relative information from previous searches
| Name | Required | Description | Default |
|---|---|---|---|
| queries | Yes | List of search queries to merge |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description fails to disclose any behavioral traits. It does not indicate whether the tool is read-only, mutates state, requires authentication, or what side effects occur. The phrase 'extract' is not clarified.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely brief (4 words), but it sacrifices clarity for brevity. It is not front-loaded with key information and omits essential details, making it under-specified rather than appropriately concise.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the lack of annotations, output schema, and the tool's potential relation to 'search-web', the description is inadequate. It does not explain what the tool returns, how it uses the queries, or how it differs from a regular search. The tool appears to be for refining or summarizing previous searches, but this is not conveyed.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema provides a clear description for the only parameter: 'List of search queries to merge'. The tool description adds no value and even introduces confusion by using 'extract' instead of 'merge'. Schema coverage is 100%, so the description does not enhance parameter understanding.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description says 'Extract relative information from previous searches', which is vague. The term 'relative' is ambiguous (likely meant 'relevant'), and 'previous searches' is unclear—does it mean past user searches or the provided queries? The schema indicates the tool merges queries, but the description doesn't align, causing confusion.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like 'search-web'. There is no mention of prerequisites, context, or any criteria for appropriate usage.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search-webC
Perform a web search and scrape results
| Name | Required | Description | Default |
|---|---|---|---|
| queries | Yes | List of search queries | |
| page_number | No | Page number for the search results |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must disclose behavioral traits. It states that results are scraped but provides no details on output format, pagination behavior, rate limits, or error handling.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence with no extraneous information, making it efficiently front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Without an output schema or annotations, the description is insufficient for a web search tool. It does not explain return values, result structure, or how scraping integrates with search, leaving significant gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents both parameters. The description adds no additional meaning beyond the parameter descriptions, meeting the baseline of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's action: perform a web search and scrape results. It uses a specific verb-resource pair, but does not explicitly differentiate from the sibling tool 'extract-info-from-search'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus the sibling tool 'extract-info-from-search' or in what contexts it is appropriate.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.
2 tool updates
v1.0.0- First observed
extract-info-from-search - First observed
search-web
TDQS
The two tools have clearly distinct purposes: one for performing web searches and scraping results, the other for extracting information from those prior searches. While they are related, there is no functional overlap.
Both tool names follow a consistent snake_case verb_noun pattern. 'search-web' and 'extract-info-from-search' both clearly indicate action and target.
With only 2 tools, the server feels minimal for a web search and extraction domain. However, the tools cover a basic two-step workflow, making the count borderline acceptable.
The server provides a basic search and extraction cycle but lacks obvious features like managing search history, caching, or supporting different output formats. Minor gaps exist.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Connectors
Query, join, profile, clean and convert CSV/JSON/Parquet with server-side DuckDB over MCP.
Augments MCP Server - A comprehensive framework documentation provider for Claude Code
MCP server for querying and analyzing data from ad platforms, analytics tools, and spreadsheets
MCP server for progressive tool usage at any scale (see https://klavis.ai)
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceA Model Context Protocol server built with mcp-framework that allows users to create and manage custom tools for processing data, integrating with the Claude Desktop via CLI.235MIT
- FlicenseNot gradedqualityDmaintenanceA Model Context Protocol server that allows integration with Claude Desktop by creating and managing custom tools that can be executed through the MCP framework.88-
- FlicenseAqualityNot gradedmaintenanceA tutorial implementation MCP server that enables analysis of CSV and Parquet files. Allows users to summarize data and query file information through natural language interactions.2-
- AlicenseAqualityNot gradedmaintenanceAn MCP server that enables AI assistants to load, query, and analyze local CSV files using tools for filtering, aggregation, and grouping. It provides capabilities to describe schemas, calculate statistics, and sample data directly from CSV files.6-
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/DeepSpringAI/search_mcp_server'
If you have feedback or need assistance with the MCP directory API, please join our Discord server