Skip to main content
Glama
wlmwwx

Jina AI Remote MCP Server

by wlmwwx

read_url

Extract web page content and convert it to clean markdown format for reading articles, documentation, or bypassing paywalls.

Instructions

Extract and convert web page content to clean, readable markdown format. Perfect for reading articles, documentation, blog posts, or any web content. Use this when you need to analyze text content from websites, bypass paywalls, or get structured data.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
urlYesThe complete URL of the webpage or PDF file to read and convert (e.g., 'https://example.com/article'). Can be a single URL string or an array of URLs for parallel reading.
withAllLinksNoSet to true to extract and return all hyperlinks found on the page as structured data
withAllImagesNoSet to true to extract and return all images found on the page as structured data

Implementation Reference

  • MCP tool handler function that imports and calls the core readUrlFromConfig utility, handles errors, and formats the YAML response.
    async ({ url, withAllLinks, withAllImages }: { url: string; withAllLinks?: boolean; withAllImages?: boolean }) => {
    	try {
    		const props = getProps();
    
    		// Import the utility function
    		const { readUrlFromConfig } = await import("../utils/read.js");
    
    		// Use the shared utility function
    		const result = await readUrlFromConfig({ url, withAllLinks: withAllLinks || false, withAllImages: withAllImages || false }, props.bearerToken);
    
    		if ('error' in result) {
    			return createErrorResponse(result.error);
    		}
    
    		return {
    			content: [{
    				type: "text" as const,
    				text: yamlStringify(result.structuredData),
    			}],
    		};
    	} catch (error) {
    		return createErrorResponse(`Error: ${error instanceof Error ? error.message : String(error)}`);
    	}
    },
  • Zod schema for tool inputs: required URL, optional flags for including all links and images.
    {
    	url: z.string().url().describe("The complete URL of the webpage or PDF file to read and convert (e.g., 'https://example.com/article')"),
    	withAllLinks: z.boolean().optional().describe("Set to true to extract and return all hyperlinks found on the page as structured data"),
    	withAllImages: z.boolean().optional().describe("Set to true to extract and return all images found on the page as structured data")
  • Registration of the 'read_url' tool on the MCP server, including name, description, schema, and handler.
    server.tool(
    	"read_url",
    	"Extract and convert web page content to clean, readable markdown format. Perfect for reading articles, documentation, blog posts, or any web content. Use this when you need to analyze text content from websites, bypass paywalls, or get structured data. 💡 Tip: Use `parallel_read_url` if you need to read multiple web pages simultaneously.",
    	{
    		url: z.string().url().describe("The complete URL of the webpage or PDF file to read and convert (e.g., 'https://example.com/article')"),
    		withAllLinks: z.boolean().optional().describe("Set to true to extract and return all hyperlinks found on the page as structured data"),
    		withAllImages: z.boolean().optional().describe("Set to true to extract and return all images found on the page as structured data")
    	},
    	async ({ url, withAllLinks, withAllImages }: { url: string; withAllLinks?: boolean; withAllImages?: boolean }) => {
    		try {
    			const props = getProps();
    
    			// Import the utility function
    			const { readUrlFromConfig } = await import("../utils/read.js");
    
    			// Use the shared utility function
    			const result = await readUrlFromConfig({ url, withAllLinks: withAllLinks || false, withAllImages: withAllImages || false }, props.bearerToken);
    
    			if ('error' in result) {
    				return createErrorResponse(result.error);
    			}
    
    			return {
    				content: [{
    					type: "text" as const,
    					text: yamlStringify(result.structuredData),
    				}],
    			};
    		} catch (error) {
    			return createErrorResponse(`Error: ${error instanceof Error ? error.message : String(error)}`);
    		}
    	},
    );
  • Core utility function implementing the tool logic: normalizes URL, calls r.jina.ai API with custom headers, parses response into structured data including optional links/images, handles errors.
    export async function readUrlFromConfig(
        urlConfig: ReadUrlConfig,
        bearerToken?: string
    ): Promise<ReadUrlResponse> {
        try {
            // Normalize the URL first
            const normalizedUrl = normalizeUrl(urlConfig.url);
            if (!normalizedUrl) {
                return { error: "Invalid or unsupported URL", url: urlConfig.url };
            }
    
            const headers: Record<string, string> = {
                'Accept': 'application/json',
                'Content-Type': 'application/json',
                'X-Md-Link-Style': 'discarded',
            };
    
            // Add Authorization header if bearer token is available
            if (bearerToken) {
                headers['Authorization'] = `Bearer ${bearerToken}`;
            }
    
            if (urlConfig.withAllLinks) {
                headers['X-With-Links-Summary'] = 'all';
            }
    
            if (urlConfig.withAllImages) {
                headers['X-With-Images-Summary'] = 'true';
            } else {
                headers['X-Retain-Images'] = 'none';
            }
    
            const response = await fetch('https://r.jina.ai/', {
                method: 'POST',
                headers,
                body: JSON.stringify({ url: normalizedUrl }),
            });
    
            if (!response.ok) {
                return { error: `HTTP ${response.status}: ${response.statusText}`, url: urlConfig.url };
            }
    
            const data = await response.json() as any;
    
            if (!data.data) {
                return { error: "Invalid response data from r.jina.ai", url: urlConfig.url };
            }
    
            // Prepare structured data
            const structuredData: any = {
                url: data.data.url,
                title: data.data.title,
            };
    
            if (urlConfig.withAllLinks && data.data.links) {
                structuredData.links = data.data.links.map((link: [string, string]) => ({
                    anchorText: link[0],
                    url: link[1]
                }));
            }
    
            if (urlConfig.withAllImages && data.data.images) {
                structuredData.images = data.data.images;
            }
            structuredData.content = data.data.content || "";
    
            return {
                success: true,
                url: urlConfig.url,
                structuredData,
                withAllLinks: urlConfig.withAllLinks || false,
                withAllImages: urlConfig.withAllImages || false
            };
        } catch (error) {
            return {
                error: error instanceof Error ? error.message : String(error),
                url: urlConfig.url
            };
        }
    }
  • TypeScript interfaces and type for input configuration, success result, error, and union response type used by the helper function.
    export interface ReadUrlConfig {
        url: string;
        withAllLinks?: boolean;
        withAllImages?: boolean;
    }
    
    export interface ReadUrlResult {
        success: boolean;
        url: string;
        structuredData: any;
        withAllLinks: boolean;
        withAllImages: boolean;
    }
    
    export interface ReadUrlError {
        error: string;
        url: string;
    }
    
    export type ReadUrlResponse = ReadUrlResult | ReadUrlError;
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It describes the core functionality (extracting and converting content) and mentions bypassing paywalls as a behavioral trait. However, it doesn't address important behavioral aspects like rate limits, authentication requirements, error handling, or what happens with malformed URLs.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is perfectly front-loaded with the core purpose in the first sentence, followed by usage context. Every sentence earns its place by providing distinct value - the first states what it does, the second gives content examples, and the third provides usage scenarios. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 3 parameters, 100% schema coverage, but no annotations and no output schema, the description provides adequate but incomplete context. It covers the purpose and usage well but lacks behavioral details about rate limits, authentication, error handling, and doesn't describe the output format (though no output schema exists to document this).

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already fully documents all three parameters. The description doesn't add any parameter-specific information beyond what's in the schema. The baseline score of 3 is appropriate when the schema does the heavy lifting for parameter documentation.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose with specific verbs ('extract and convert') and resources ('web page content to clean, readable markdown format'). It distinguishes from sibling tools by focusing on content extraction/conversion rather than screenshot capture, PDF extraction, or search operations.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear context for when to use the tool ('when you need to analyze text content from websites, bypass paywalls, or get structured data') and gives examples of appropriate content types (articles, documentation, blog posts). However, it doesn't explicitly state when NOT to use it or name specific alternatives among the sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/wlmwwx/jina-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server