Skip to main content
Glama

scrape_news

Fetch news articles from an RSS feed, site feed, or single URL, and get structured article data: title, URL, date, author, summary, and full text.

Instructions

Fetch news articles from an RSS/Atom feed, a news site (feed auto-discovered), or a single article, and return a list of article dicts (typically: title, url, published date, author, summary, and full text where available).

Provide exactly one of feed_url, site_url, or article_url. Fetches live content over the network at call time; results are not cached. article_url returns one article; feed_url and site_url return up to max_articles. Returns an empty list if the feed/site yields no articles or if a feed cannot be discovered or parsed.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
feed_urlNoString, direct URL to an RSS/Atom feed. Example: "https://example.com/rss.xml". Default: None.
site_urlNoString, news site homepage URL whose feed is auto-discovered. Example: "https://example.com". Default: None.
article_urlNoString, single article URL to extract full text from. Example: "https://example.com/2026/news-story". Default: None.
max_articlesNoInteger, max articles to return for feed_url or site_url; ignored for article_url. Example: 20. Default: 50.

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
dataNo
countNo
errorsNo
scraperNo
source_urlsNo

Schema Changelog

Changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. Changed4 schema fields changed
    • changedInput schema / properties / article_url / description
      Previous value: -"A single article URL to extract full text from."New value: +"String, single article URL to extract full text from. Example: \"https://example.com/2026/news-story\". Default: None."
    • changedInput schema / properties / feed_url / description
      Previous value: -"Direct URL to an RSS/Atom feed."New value: +"String, direct URL to an RSS/Atom feed. Example: \"https://example.com/rss.xml\". Default: None."
    • changedInput schema / properties / max_articles / description
      Previous value: -"Max articles to return from a feed (default 50)."New value: +"Integer, max articles to return for feed_url or site_url; ignored for article_url. Example: 20. Default: 50."
    • changedInput schema / properties / site_url / description
      Previous value: -"News site URL — its feed is auto-discovered."New value: +"String, news site homepage URL whose feed is auto-discovered. Example: \"https://example.com\". Default: None."
  2. Changed22 schema fields changedv1.3.3
    • addedInput schema / additionalProperties
      Added value: +false
    • addedInput schema / properties / article_url / description
      Added value: +"A single article URL to extract full text from."
    • removedInput schema / properties / article_url / title
      Removed value: -"Article Url"
    • addedInput schema / properties / feed_url / description
      Added value: +"Direct URL to an RSS/Atom feed."
    • removedInput schema / properties / feed_url / title
      Removed value: -"Feed Url"
    • addedInput schema / properties / max_articles / description
      Added value: +"Max articles to return from a feed (default 50)."
    • removedInput schema / properties / max_articles / title
      Removed value: -"Max Articles"
    • addedInput schema / properties / site_url / description
      Added value: +"News site URL — its feed is auto-discovered."
    • removedInput schema / properties / site_url / title
      Removed value: -"Site Url"
    • removedInput schema / title
      Removed value: -"scrape_newsArguments"
    • removedOutput schema / $defs
      Removed value: -{
      -  "ToolError": {
      -    "description": "A non-fatal problem encountered while scraping.",
      -    "properties": {
      -      "message": {
      -        "title": "Message",
      -        "type": "string"
      -      },
      -      "url": {
      -        "title": "Url",
      -        "type": "string"
      -      }
      -    },
      -    "required": [
      -      "url",
      -      "message"
      -    ],
      -    "title": "ToolError",
      -    "type": "object"
      -  }
      -}
    • removedOutput schema / properties / count / title
      Removed value: -"Count"
    • removedOutput schema / properties / data / title
      Removed value: -"Data"
    • removedOutput schema / properties / errors / items / $ref
      Removed value: -"#/$defs/ToolError"
    • addedOutput schema / properties / errors / items / description
      Added value: +"A non-fatal problem encountered while scraping."
    • addedOutput schema / properties / errors / items / properties
      Added value: +{
      +  "message": {
      +    "type": "string"
      +  },
      +  "url": {
      +    "type": "string"
      +  }
      +}
    • addedOutput schema / properties / errors / items / required
      Added value: +[
      +  "url",
      +  "message"
      +]
    • addedOutput schema / properties / errors / items / type
      Added value: +"object"
    • removedOutput schema / properties / errors / title
      Removed value: -"Errors"
    • removedOutput schema / properties / scraper / title
      Removed value: -"Scraper"
    • removedOutput schema / properties / source_urls / title
      Removed value: -"Source Urls"
    • removedOutput schema / title
      Removed value: -"ScrapeToolResult"
  3. First observedv1.1.6

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the transparency burden. It discloses that content is fetched live over the network, results are not cached, and an empty list is returned on no results or feed parse failure. This covers key behavioral traits, though it does not mention potential timeouts, rate limits, or detailed error handling.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise, with no redundant information. It front-loads the core function in the first sentence, then adds critical usage constraints and behavioral notes in a compact second paragraph. Every sentence earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's moderate complexity and the presence of an output schema, the description adequately covers return shape, parameter relationships, and edge cases like empty results and feed discovery failure. It is complete enough for an agent to select and invoke the tool, though it omits minor aspects like network error handling or auth requirements.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Although the schema already describes each parameter with examples, the description adds crucial semantics: the mutual exclusivity of feed_url, site_url, and article_url, and the differing return counts (one vs. up to max_articles). This goes beyond the schema and significantly aids correct invocation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's function: fetching news articles from RSS/Atom feeds, news sites with auto-discovery, or single articles, and returning article dicts. It uses specific verbs and resources, and the mention of news articles distinguishes it from generic scrapers like scrape_url.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear usage context: 'Provide exactly one of feed_url, site_url, or article_url' and explains that article_url returns one article while feed_url/site_url return up to max_articles. However, it does not explicitly mention when to prefer this tool over sibling tools or any exclusions, so it stops short of full alternative guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/mldsveda/PyScrappy'

If you have feedback or need assistance with the MCP directory API, please join our Discord server