Skip to main content
Glama
Fadi88

LLM Inference Pricing Research Server

by Fadi88

In this project, you are going to make a chatbot to scrape LLM Inference Serving websites to research costs of serving various LLMs. You will do this by writing an MCP Server that hooks up to Firecrawl's API and saving the data in a SQLite Database. You should use the following websites to scrape:

  1. Make a venv with uv

  2. Sync venv with pyproject.toml (uv sync)

  3. Make an API Key on Anthropic and Firecrawl

  4. Complete the 2 tool calls in starter_server.py

  5. Change the server_config.json to point to your server file

  6. Complete any section in starter_client.py that has "#complete".

  7. Test using any methods taught in the course

  8. Use the following prompts in your chatbot but play around with all the LLM providers in the list above:

Available Tools

2 tools
extract_scraped_infoC
Extract information about a scraped website.

Args:
    identifier: The provider name, full URL, or domain to look for
    
Returns:
    Formatted JSON string with the scraped information
ParametersJSON Schema
NameRequiredDescriptionDefault
identifierYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden of behavioral disclosure. It states the tool extracts information, implying a read operation, but doesn't cover key aspects like whether it requires authentication, has rate limits, or what happens if the identifier isn't found. The description is too vague for a tool with no annotation support.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is appropriately sized and front-loaded, with the purpose stated first, followed by brief sections for args and returns. There's no wasted text, but the structure could be slightly improved by integrating usage context more naturally.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has an output schema (returns 'Formatted JSON string'), the description doesn't need to explain return values in detail. However, with no annotations and low schema coverage, it lacks completeness regarding behavioral traits and usage guidelines. It's minimally adequate but has clear gaps for a tool with one parameter.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema description coverage is 0%, so the description must compensate. It adds meaning by explaining that 'identifier' can be a 'provider name, full URL, or domain to look for,' which clarifies the parameter's purpose beyond the schema's basic type. However, it doesn't detail format constraints or examples, leaving gaps in understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Extract information about a scraped website.' It specifies the verb ('extract') and resource ('scraped website'), making it understandable. However, it doesn't explicitly differentiate from its sibling 'scrape_websites' (which likely performs scraping rather than extraction), so it doesn't reach the highest score.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives. It doesn't mention the sibling tool 'scrape_websites' or explain the relationship between scraping and extraction. There's no context about prerequisites, such as whether scraping must occur first, leaving usage unclear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

scrape_websitesB
Scrape multiple websites using Firecrawl and store their content.

Args:
    websites: Dictionary of provider_name -> URL mappings
    formats: List of formats to scrape ['markdown', 'html'] (default: both)
    api_key: Firecrawl API key (if None, expects environment variable)
    
Returns:
    List of provider names for successfully scraped websites
ParametersJSON Schema
NameRequiredDescriptionDefault
websitesYes
formatsNo
api_keyNo

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It mentions that content is stored, which implies persistence, but doesn't specify where or how. It also mentions the API key fallback to environment variables, which is useful context. However, it lacks critical behavioral details like rate limits, error handling, authentication requirements beyond the API key, or what happens if scraping fails for some websites.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is appropriately sized and well-structured. It starts with a clear purpose statement, then lists parameters with helpful explanations, and ends with return information. Every sentence adds value with no redundancy or unnecessary details.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (3 parameters, nested objects, no annotations) and the presence of an output schema (which covers return values), the description does a good job. It explains parameters thoroughly and states the return type. However, for a tool that performs web scraping and storage operations, more behavioral context (like error handling or storage details) would make it more complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The description adds significant meaning beyond the input schema, which has 0% description coverage. It explains that 'websites' is a dictionary mapping provider names to URLs, clarifies that 'formats' accepts specific values with a default, and describes the 'api_key' parameter's behavior with environment variable fallback. This compensates well for the schema's lack of descriptions, though it doesn't fully document all parameter nuances.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Scrape multiple websites using Firecrawl and store their content.' This includes a specific verb ('scrape'), resource ('websites'), and technology ('Firecrawl'), making it easy to understand what the tool does. However, it doesn't explicitly differentiate from its sibling tool 'extract_scraped_info'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives. There's no mention of the sibling tool 'extract_scraped_info' or any other context about appropriate use cases. The only implied usage is for scraping websites with Firecrawl, but no explicit when/when-not guidance is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

TDQS

B3.1/5.0
Disambiguation5/5

The two tools have clearly distinct purposes: 'scrape_websites' performs the scraping operation to gather data, while 'extract_scraped_info' retrieves and formats previously scraped information. There is no overlap in functionality - one creates data, the other queries it.

Naming Consistency4/5

Both tools use snake_case naming which is consistent, but they follow different verb patterns: 'scrape_websites' uses a verb_noun format while 'extract_scraped_info' uses verb_adjective_noun. This minor deviation prevents a perfect score, but the naming is still clear and readable.

Tool Count2/5

With only 2 tools for a 'LLM Inference Pricing Research Server', the surface feels severely underpowered. The server's name suggests comprehensive pricing research capabilities, but the tools only cover basic website scraping and data extraction - missing essential operations like price comparison, model benchmarking, cost analysis, or API integration that would be expected for this domain.

Completeness2/5

The toolset is severely incomplete for the stated purpose of 'LLM Inference Pricing Research'. While scraping and extraction are useful first steps, there are no tools for analyzing pricing data, comparing providers, calculating costs, or generating research reports. The server provides only data collection capabilities without the analysis tools needed to fulfill its research purpose.

Maintenance

ActivitySlowing
ResponsivenessSyncing

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Connectors

Related MCP Servers

  • F
    license
    Not graded
    quality
    D
    maintenance
    Enables querying and comparing product prices across different marketplaces with real-time updates. Deployable on Cloudflare Workers with tools for searching products, comparing prices, and retrieving price history.
  • A
    license
    Not graded
    quality
    D
    maintenance
    Empowers LLMs to scrape web pages and generate sitemaps through the Firecrawl Simple API, with support for JavaScript rendering and configurable options.
    22
    1
    MIT
  • F
    license
    Not graded
    quality
    C
    maintenance
    Enables scraping LLM inference pricing from websites like Cloudrift, DeepInfra, Fireworks, and Groq, storing results in SQLite for cost comparison.

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/Fadi88/UDACITY_MCP'

If you have feedback or need assistance with the MCP directory API, please join our Discord server