Skip to main content
Glama

NYC Open Data

by io.github.pipeworx-io

AI Visibility Check

ai_visibility_check
Read-onlyIdempotent

Probe one or more LLMs for what they know about a business / brand / product / topic and score visibility (0-100) per model. Default model is Workers AI Llama-3.3-70b (free); pass _apiKey to also probe Anthropic (BYO key — you pay Anthropic directly for those calls). Returns per-model {score, confidence, signals, raw_response} + a combined view. Useful for AI-marketing audits, pre-launch brand checks, competitive monitoring.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
entityYesThe thing to ask about. Brand/business name, product name, person, or topic. E.g. "Pipeworx", "OpenInvoice", "Acme Corp pricing".
modelsNoWhich models to probe. Supported: "workers-ai" (free default), "anthropic" (requires _apiKey). Omit for just workers-ai.
_apiKeyNoOptional Anthropic API key (sk-ant-...) — only needed if "anthropic" is in models. Passed straight through to api.anthropic.com.
contextNoOptional: a phrase locating the entity (e.g. "Boston restaurant", "B2B SaaS"). Helps disambiguate common names.

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnly, idempotent, openWorld. Description adds value by specifying default model (Workers AI Llama-3.3-70b free), charging model for Anthropic (BYO key), and return structure (per-model {score, confidence, signals, raw_response} + combined view). No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three sentences, front-loaded with core purpose. Every sentence adds value: action, parameter details, return format and use cases. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 4 parameters, one required, no output schema, the description covers all necessary aspects: purpose, parameters with defaults, optional key, return format, and appropriate use cases. Complete for a probing tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions. Description adds meaningful context: default for 'models', pass-through nature of '_apiKey', and examples for 'entity' and 'context'. Enhances understanding beyond schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses specific verb 'probe' and resource 'LLMs' with clear output (visibility score 0-100). It distinguishes itself from siblings like 'scan_competitor_ai_presence' by focusing on direct LLM probing for brand visibility.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides explicit use cases: AI-marketing audits, pre-launch brand checks, competitive monitoring. Explains default model and when to use _apiKey for Anthropic. Lacks explicit comparison to alternative tools but context is clear enough.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

All NYC Open Data toolsInspect
Try in Browser
RayrunBuild, deploy, and operate MCP servers without becoming an infrastructure team.ray.runAd

Glama MCP Gateway

Add one secure layer between your agents and this server.

TDQS

A3.7/5.0
Disambiguation2/5

Several tools have heavily overlapping purposes: ask_pipeworx, ask_pipeworx_beta, and ask_pipeworx_grounded are nearly identical routers, and the five polymarket_* tools all perform prediction-market analysis. Even with detailed descriptions, an agent could easily select the wrong one, especially since the server name 'NYC Open Data' does not hint at this focus.

Naming Consistency4/5

Most tools follow a consistent lowercase snake_case verb_noun pattern (e.g., list_subscriptions, generate_llms_txt, resolve_entity) and families share prefixes like polymarket_ and pipeworx_. Minor deviations exist with one-word names like datasets, metadata, and forget, but overall the naming is readable and predictable.

Tool Count2/5

34 tools is far too many for a server labeled 'NYC Open Data,' where only 3 tools (datasets, metadata, query) actually serve that purpose. The rest form a general-purpose data platform, but even then the count is high and includes many redundant meta-tools and overlapping Polymarket utilities, making the set feel bloated.

Completeness3/5

For the NYC Open Data domain, the three dedicated tools cover search, metadata, and query—adequate core functionality but missing export or dataset management capabilities. For the broader Pipeworx platform, coverage is strong (routing, grounded answers, deep research, entity profiles, subscriptions, memory), but the severe mismatch between the server name and actual scope leaves a major completeness gap.

Resources