A
security-
licenseA
qualityBuilt as a Model Context Protocol (MCP) server that provides advanced web search, content extraction, web crawling, and scraping capabilities using the Firecrawl API.
Last updated -
1
The MCP Server Firecrawl is an API-powered server providing multiple web data collection capabilities:
Web Scraping: Extract content from URLs with options for mobile emulation, ad blocking, content filtering, and structured data extraction in various formats (markdown, HTML, JSON).
Content Search: Perform intelligent searches with multi-language support, location-based results, and customizable result limits.
Site Crawling: Crawl websites with depth control, path filtering, rate limiting, and sitemap integration.
Site Mapping: Generate structural maps of websites with subdomain support and link analysis.
Data Extraction: Extract structured data from multiple URLs using schema validation, batch processing, and custom extraction prompts.
Supports using .env files to configure the Firecrawl API key for secure development environments.
Supports outputting scraped content in Markdown format for better readability and structure.
Provides TypeScript interfaces for the API, with examples written in TypeScript for better type safety and developer experience.
Firecrawl MCP Server
A Model Context Protocol (MCP) server for web scraping, content searching, site crawling, and data extraction using the Firecrawl API.
Features
Web Scraping: Extract content from any webpage with customizable options
Mobile device emulation
Ad and popup blocking
Content filtering
Structured data extraction
Multiple output formats
Content Search: Intelligent search capabilities
Multi-language support
Location-based results
Customizable result limits
Structured output formats
Site Crawling: Advanced web crawling functionality
Depth control
Path filtering
Rate limiting
Progress tracking
Sitemap integration
Site Mapping: Generate site structure maps
Subdomain support
Search filtering
Link analysis
Visual hierarchy
Data Extraction: Extract structured data from multiple URLs
Schema validation
Batch processing
Web search enrichment
Custom extraction prompts
Installation
# Global installation
npm install -g @modelcontextprotocol/mcp-server-firecrawl
# Local project installation
npm install @modelcontextprotocol/mcp-server-firecrawl
Quick Start
Get your Firecrawl API key from the developer portal
Set your API key:
Unix/Linux/macOS (bash/zsh):
export FIRECRAWL_API_KEY=your-api-keyWindows (Command Prompt):
set FIRECRAWL_API_KEY=your-api-keyWindows (PowerShell):
$env:FIRECRAWL_API_KEY = "your-api-key"Alternative: Using .env file (recommended for development):
# Install dotenv npm install dotenv # Create .env file echo "FIRECRAWL_API_KEY=your-api-key" > .envThen in your code:
import dotenv from 'dotenv'; dotenv.config();Run the server:
mcp-server-firecrawl
Integration
Claude Desktop App
Add to your MCP settings:
{
"firecrawl": {
"command": "mcp-server-firecrawl",
"env": {
"FIRECRAWL_API_KEY": "your-api-key"
}
}
}
Claude VSCode Extension
Add to your MCP configuration:
{
"mcpServers": {
"firecrawl": {
"command": "mcp-server-firecrawl",
"env": {
"FIRECRAWL_API_KEY": "your-api-key"
}
}
}
}
Usage Examples
Web Scraping
// Basic scraping
{
name: "scrape_url",
arguments: {
url: "https://example.com",
formats: ["markdown"],
onlyMainContent: true
}
}
// Advanced extraction
{
name: "scrape_url",
arguments: {
url: "https://example.com/blog",
jsonOptions: {
prompt: "Extract article content",
schema: {
title: "string",
content: "string"
}
},
mobile: true,
blockAds: true
}
}
Site Crawling
// Basic crawling
{
name: "crawl",
arguments: {
url: "https://example.com",
maxDepth: 2,
limit: 100
}
}
// Advanced crawling
{
name: "crawl",
arguments: {
url: "https://example.com",
maxDepth: 3,
includePaths: ["/blog", "/products"],
excludePaths: ["/admin"],
ignoreQueryParameters: true
}
}
Site Mapping
// Generate site map
{
name: "map",
arguments: {
url: "https://example.com",
includeSubdomains: true,
limit: 1000
}
}
Data Extraction
// Extract structured data
{
name: "extract",
arguments: {
urls: ["https://example.com/product1", "https://example.com/product2"],
prompt: "Extract product details",
schema: {
name: "string",
price: "number",
description: "string"
}
}
}
Configuration
See configuration guide for detailed setup options.
API Documentation
See API documentation for detailed endpoint specifications.
Development
# Install dependencies
npm install
# Build
npm run build
# Run tests
npm test
# Start in development mode
npm run dev
Examples
Check the examples directory for more usage examples:
Basic scraping: scrape.ts
Crawling and mapping: crawl-and-map.ts
Error Handling
The server implements robust error handling:
Rate limiting with exponential backoff
Automatic retries
Detailed error messages
Debug logging
Security
API key protection
Request validation
Domain allowlisting
Rate limiting
Safe error messages
Contributing
See CONTRIBUTING.md for contribution guidelines.
License
MIT License - see LICENSE for details.
Related MCP Servers
- Asecurity-licenseAqualityA server that provides tools to scrape websites and extract structured data from them using Firecrawl's APIs, supporting both basic website scraping in multiple formats and custom schema-based data extraction.Last updated -1
- -security-license-qualityA Model Context Protocol server that enables AI assistants to perform advanced web scraping, crawling, searching, and data extraction through the Firecrawl API.Last updated -39,239MIT License
- -security-license-qualityEnables intelligent web scraping through a browser automation tool that can search Google, navigate to webpages, and extract content from various websites including GitHub, Stack Overflow, and documentation sites.Last updated -1