MCP Web Research Agent

# Changelog All notable changes to this project will be documented in this file. The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html). ## [0.1.0] - 2024-11-10 ### Added - Initial release of MCP Web Research Agent - Core scraping functionality with keyword search - Search engine integration (SearXNG) - SQLite database for persistent storage - Multiple export formats (JSON, Markdown, CSV) - MCP protocol implementation with 5 tools - Comprehensive documentation and examples - Unit tests and CI/CD workflow ### Features - `scrape_url`: Single URL scraping with keyword matching - `search_and_scrape`: Web search with automatic result processing - `get_scraping_results`: Database querying with filtering - `export_results`: Multi-format data export - `get_scraping_stats`: Performance monitoring ### Technical - Async-compatible architecture - Configurable crawl depth and request delays - Intelligent content extraction - Link following with domain filtering - Error handling and logging