We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/SnotacusNexus/mcp-web-research-agent'
If you have feedback or need assistance with the MCP directory API, please join our Discord server
# Changelog
All notable changes to this project will be documented in this file.
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
## [0.1.0] - 2024-11-10
### Added
- Initial release of MCP Web Research Agent
- Core scraping functionality with keyword search
- Search engine integration (SearXNG)
- SQLite database for persistent storage
- Multiple export formats (JSON, Markdown, CSV)
- MCP protocol implementation with 5 tools
- Comprehensive documentation and examples
- Unit tests and CI/CD workflow
### Features
- `scrape_url`: Single URL scraping with keyword matching
- `search_and_scrape`: Web search with automatic result processing
- `get_scraping_results`: Database querying with filtering
- `export_results`: Multi-format data export
- `get_scraping_stats`: Performance monitoring
### Technical
- Async-compatible architecture
- Configurable crawl depth and request delays
- Intelligent content extraction
- Link following with domain filtering
- Error handling and logging