Update and apply crawl settings for a website via Bing Webmaster Tools API, enabling control over crawl rate, crawl boost availability, and crawl boost activation for improved site indexing.
Monitor the status of a Firecrawl HTML crawl job by providing its ID. Obtain real-time updates and insights into the crawl process, ensuring efficient management of web data extraction tasks.
Initiate an asynchronous web crawl to extract HTML content from a specified URL. Results are stored in an S3 bucket, with control over the maximum number of pages to crawl.
Unofficial MCP server wrapping crawl4ai that enables extraction and analysis of content from web pages, PDFs, Office documents, YouTube videos, and more, with AI-powered summarization and Google search integration to reduce token usage while preserving key information.
Crawls Korean stock market data from Naver Finance, providing real-time information on top searched stocks and detailed stock information by stock code.