Skip to main content
Glama

Server Details

Manage and optimize SiteSpeakAI chatbots from an AI agent in plain English: read analytics, tune prompts and model, manage knowledge sources and suggested messages, enable lead capture and human handoff, and triage the inbox.

Status
Unhealthy
Last Tested
Transport
Streamable HTTP
URL

Glama MCP Gateway

Connect through Glama MCP Gateway for full control over tool access and complete visibility into every call.

MCP client
Glama
MCP server

Full call logging

Every tool call is logged with complete inputs and outputs, so you can debug issues and audit what your agents are doing.

Tool access control

Enable or disable individual tools per connector, so you decide what your agents can and cannot do.

Managed credentials

Glama handles OAuth flows, token storage, and automatic rotation, so credentials never expire on your clients.

Usage analytics

See which tools your agents call, how often, and when, so you can understand usage patterns and catch anomalies.

100% free. Your data is private.
Tool DescriptionsA

Average 3.8/5 across 15 of 15 tools scored. Lowest: 3.1/5.

Server CoherenceA
Disambiguation5/5

Each tool targets a distinct resource and action (sources, suggested messages, chatbots, inbox, leads, analytics, insights). There is no ambiguity between tool purposes.

Naming Consistency5/5

All tool names follow a consistent verb_noun pattern (add_, get_, list_, recrawl_, update_). The naming convention is uniform and predictable.

Tool Count5/5

15 tools is well-scoped for a chatbot manager. The set covers all key functional areas without being excessive or insufficient.

Completeness3/5

The tool surface is largely complete but lacks delete operations: there is no 'remove_suggested_message' (though referenced in a description) and no way to delete a source. These are notable gaps.

Available Tools

15 tools
add_sourceAdd Source ToolAInspect

Add a website knowledge source by URL and start indexing it. Provide a single page or site URL.

ParametersJSON Schema
NameRequiredDescriptionDefault
urlYesThe website URL to index.
titleNoOptional label; defaults to the URL.
chatbot_idYesThe chatbot id.
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present, so the description must carry the burden. It mentions 'start indexing' but does not clarify if this is asynchronous, permissions needed, or what happens with invalid URLs.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences with no wasted words, efficiently conveying the core action.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema and no annotations, the description is adequate but incomplete; missing details like indexing time, chatbot_id requirement, or error handling.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. The description adds minimal value by clarifying the URL is a 'single page or site URL', but otherwise repeats schema info.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool adds a website knowledge source by URL and starts indexing, distinguishing it from siblings like recrawl_source and list_sources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for adding a single page or site URL but does not explicitly state when to use this tool versus alternatives like recrawl_source.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

add_suggested_messageAdd Suggested Message ToolAInspect

Add a suggested message (a clickable prompt shown to visitors). For type "ai" (default) provide a prompt - the message sent when clicked. For redirect/email types provide an action (a URL or email address).

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYesThe button label shown to visitors (max 100), e.g. "Pricing Plans".
typeNoai (default), redirect, email, intercom, follow_up, follow_up_link, follow_up_email, escalate.
actionNoA URL or email (max 200). Required for type redirect, email, follow_up_link, follow_up_email.
promptNoThe message sent when clicked (max 200). Required for type ai and follow_up.
chatbot_idYesThe chatbot id.
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With empty annotations, the description carries full burden. It adequately implies the tool creates a new message, but does not disclose side effects, permissions, or idempotency. Adequate but not comprehensive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with no waste. The first sentence states the purpose, the second provides conditional details. Front-loaded and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 5 parameters (2 required) and no output schema, the description covers the main logic and required inputs. Could mention defaults or ordering, but largely complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% (baseline 3). The description adds value by explaining the conditional relationship between 'type' and 'action'/'prompt', which is not fully captured in the schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it adds a suggested message (clickable prompt) and specifies the different types and what to provide for each, distinguishing it from sibling tools like update_suggested_message.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear context on when to use which type (ai vs redirect/email) and what input is required for each, but does not explicitly mention when not to use this tool or suggest alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_chatbotGet Chatbot ToolAInspect

Get a chatbot's current settings plus the models allowed on its plan and the credit cost per model. Read this before changing settings.

ParametersJSON Schema
NameRequiredDescriptionDefault
chatbot_idYesThe chatbot id (from list_chatbots).
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden. It discloses that the tool returns settings, plan models, and credit costs, implying a read-only operation. It does not mention side effects, which is acceptable for a read operation, but could explicitly state it is non-destructive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences long: the first defines functionality, the second provides usage guidance. It is front-loaded and efficient, though the second sentence could be integrated for even tighter structure.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description covers the return content (settings, plan models, credit cost). The parameter is well-documented via schema. It is complete enough for a simple get tool, though additional details on the exact keys or structure would improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with a single parameter already described as 'The chatbot id (from list_chatbots).' The description adds no additional parameter details, achieving baseline adequacy.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves a chatbot's current settings, plan models, and credit cost per model. It uses a specific verb ('Get') and resource ('chatbot'), and distinguishes itself from sibling tools like 'get_chatbot_analytics' and 'get_chatbot_insights'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description advises using this tool before changing settings, providing clear context for when to use it. While it does not explicitly mention when not to use or alternatives, the implicit guidance is strong given the sibling list.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_chatbot_analyticsGet Chatbot Analytics ToolBInspect

Get a chatbot's analytics for a period: conversation volume, feedback, answered-question %, negative-sentiment %, popular sources/categories, top countries.

ParametersJSON Schema
NameRequiredDescriptionDefault
toNoISO date; used when period=custom.
fromNoISO date; used when period=custom.
periodNolast_7_days, last_30_days (default), or custom.
chatbot_idYesThe chatbot id.
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; the description does not disclose any behavioral traits beyond what is listed. No mention of side effects, rate limits, authentication, or data freshness.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence front-loading the purpose. Efficient but could be slightly more structured (e.g., listing metrics in a clearer way). No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema, but description lists key metrics. However, it lacks detail on return structure (e.g., whether metrics are aggregated or time-series). Adequate but not fully complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description adds little extra meaning. It mentions period and chatbot_id but no additional semantics beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves analytics for a chatbot, listing specific metrics (conversation volume, feedback, percentages, popular categories, top countries). It effectively distinguishes from siblings like get_chatbot or get_chatbot_insights.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., get_chatbot_insights). The description does not mention prerequisites or context for use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_chatbot_insightsGet Chatbot Insights ToolAInspect

Get AI-clustered question themes for a chatbot: top unanswered questions (knowledge/source gaps) and top answered questions. Use unanswered themes to suggest new content and messages.

ParametersJSON Schema
NameRequiredDescriptionDefault
toNoISO date (default today).
fromNoISO date (default 30 days ago).
chatbot_idYesThe chatbot id.
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations are empty, so the description must disclose behavioral traits. It mentions the output (AI-clustered themes) but lacks details on side effects, authentication needs, rate limits, or data freshness. For a read-only tool, it provides minimal behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences: first defines the output exactly, second suggests a use case. It is concise, front-loaded, and contains no unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description partially explains return values (top unanswered and answered questions) but does not specify the structure or format of the themes. Given moderate complexity, the description is adequate but could be more complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description adds no additional meaning beyond the schema for the three parameters—'chatbot_id', 'from', and 'to'—which are already described with ISO dates and defaults.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves AI-clustered question themes for a chatbot, specifically top unanswered and top answered questions. It uses a specific verb ('Get') and resource ('chatbot insights'), and distinguishes itself from siblings like get_chatbot and get_chatbot_analytics by focusing on themes.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description hints at when to use the tool ('Use unanswered themes to suggest new content and messages') but does not explicitly state when not to use it or how it compares to alternatives like get_chatbot_analytics. Guidance is implied but not explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_thread_messagesGet Thread Messages ToolAInspect

Get the messages in one inbox thread (visitor), oldest first. Returns the most recent messages by default; use offset with has_older to page back through long threads.

ParametersJSON Schema
NameRequiredDescriptionDefault
limitNoMax messages per page (default 100, max 200).
offsetNoSkip this many of the most recent messages to page further back (default 0).
chatbot_idYesThe chatbot id.
visitor_idYesThe thread/visitor id (from list_inbox_threads).
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, description discloses ordering, default behavior, and paging mechanism. Could mention read-only nature or authentication, but sufficient for a read operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, no fluff. All information is directly relevant and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Covers key aspects (ordering, paging, defaults) without output schema. Could detail message structure but adequate for basic usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, but description adds context on offset and limit usage (paging, defaults, max). Supplements the schema meaningfully.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the action (get), resource (messages in one inbox thread), and ordering (oldest first). Distinguishes from sibling tools like list_inbox_threads which list threads.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides guidance on paging with offset and has_older. Does not explicitly state when not to use or compare to alternatives, but the context is clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_chatbotsList Chatbots ToolAInspect

List the chatbots your account can manage (your current team's chatbots). Returns each chatbot id, name and type. Use the id with the other tools.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, description does not explicitly declare read-only or safe nature, but from context it's implied. No contradiction.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences, front-loaded with purpose, no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequate for a no-param, simple list tool. Tells return format and usage. Lacks mention of pagination, but not critical here.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

No parameters, schema coverage 100%. Description adds value by listing return fields and usage hint (id for other tools), exceeding baseline of 4.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states action (list), resource (chatbots), scope (account/team), and return fields (id, name, type). Differentiates from siblings like get_chatbot or list_sources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

States when to use (list chatbots) and hints at using IDs with other tools, but does not explicitly exclude or compare to alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_inbox_threadsList Inbox Threads ToolAInspect

List inbox conversation threads for a chatbot. Filter by status (open/closed/all) and feedback (positive/negative), and search message text.

ParametersJSON Schema
NameRequiredDescriptionDefault
pageNoPage number (15 per page).
searchNoSearch message text.
statusNoopen (default), closed, or all.
feedbackNoFilter threads by message feedback: positive or negative.
chatbot_idYesThe chatbot id.
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must fully disclose behavior. It mentions filtering and search but omits sorting, pagination limits, or any side effects. The schema covers the 'page' parameter, so the description adds minimal transparency beyond that.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, focused sentence that includes all essential information without redundancy. Every word serves a purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a listing tool with filters, the description is largely complete. It doesn't mention that chatbot_id is required or that page defaults to 15 per page, but those are in the schema. The lack of an output schema reduces the burden on description completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description lists filter options (status, feedback, search) but adds no additional meaning beyond the schema, such as usage examples or parameter interactions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('list') and resource ('inbox conversation threads'), and includes specific filters (status, feedback, search). This distinguishes it from sibling tools like get_thread_messages (which retrieves individual messages) and update_thread_status (which modifies).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for listing filtered threads but does not explicitly state when not to use it or mention alternatives (e.g., get_thread_messages). No context about prerequisites or constraints is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_leadsList Leads ToolAInspect

List a chatbot's captured leads (visitors who submitted an email or phone via the lead-capture form). Newest first, paginated 50 per page.

ParametersJSON Schema
NameRequiredDescriptionDefault
pageNoPage number (50 per page).
chatbot_idYesThe chatbot id.
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With empty annotations, description carries full burden. Discloses pagination (50 per page) and ordering (newest first), implying read-only operation. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single, front-loaded sentence with key details. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema, so description should ideally describe return format. It mentions leads as visitors who submitted email/phone, but not structure of each lead. Adequate but could be more complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. Description adds context about pagination and ordering, but parameters are equally described in schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb (list), resource (leads), and specifics (newest first, paginated 50 per page). Clearly distinguishes from sibling tools which deal with chatbots, sources, threads, etc.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or when-not-to-use guidance. Context from sibling names implies it's for listing leads, but no alternatives or exclusions mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_sourcesList Sources ToolAInspect

List a chatbot's knowledge sources and their training status. Paginated at 50 per page.

ParametersJSON Schema
NameRequiredDescriptionDefault
pageNoPage number (50 per page).
chatbot_idYesThe chatbot id.
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations are absent, so description must cover behavioral traits. It mentions pagination (50 per page) but does not explicitly state read-only nature or any side effects. Partially informative.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise, well-structured sentences. Front-loaded with purpose, no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema, but description states it returns sources with training status. Missing response structure details, but given low complexity (2 params), it is mostly complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% for both parameters. Description adds no extra meaning beyond the schema, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Specifically states 'List a chatbot's knowledge sources and their training status', which clearly identifies the resource and action, differentiating it from siblings like add_source or recrawl_source.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., add_source, recrawl_source). Mentioning pagination is helpful but does not qualify as usage context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_suggested_messagesList Suggested Messages ToolAInspect

List a chatbot's suggested messages (the clickable prompts shown to visitors). Use the returned id with update_suggested_message or remove_suggested_message.

ParametersJSON Schema
NameRequiredDescriptionDefault
chatbot_idYesThe chatbot id.
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations are empty, so the description carries the full burden. It indicates a read operation (list) but does not disclose additional behavioral traits like pagination or ordering. For a simple list tool, this is adequate but leaves gaps.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences with no wasted words. It front-loads the purpose clearly and adds a practical usage hint in the second sentence.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and low complexity (1 param), the description explains what the tool returns and how to use the results. It lacks details on filtering or ordering but is sufficient for a simple list.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and the description does not add extra meaning beyond what the schema's parameter description ("The chatbot id.") provides. Baseline of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it lists a chatbot's suggested messages, specifying they are clickable prompts. It distinguishes from siblings by mentioning the returned id can be used with update_suggested_message or remove_suggested_message.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly explains the output's downstream use with two sibling tools, giving clear context for usage. However, it does not explicitly state when not to use this tool or cover all alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

recrawl_sourceRecrawl Source ToolAInspect

Re-index an existing knowledge source to pick up its latest content.

ParametersJSON Schema
NameRequiredDescriptionDefault
source_idYesThe source id (from list_sources).
chatbot_idYesThe chatbot id.
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full responsibility. It states 're-index' which implies mutation but gives no details on aspects like whether it is asynchronous, if it replaces or appends, or any side effects on other tools.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence with no unnecessary words. Every word contributes to the purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with 2 parameters and no output schema, the description is functional but fails to address potential concerns like whether the operation is instantaneous or requires confirmation, or what happens if the source is already being re-indexed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for both parameters (source_id and chatbot_id). The description adds no additional meaning beyond the schema, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb 're-index' with a clear resource 'existing knowledge source' and states the outcome 'pick up its latest content'. It clearly distinguishes from sibling tools like add_source and list_sources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when you want to update an existing source's content. No explicit alternatives or when-not-to-use, but the context of sibling tools makes the intended use clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update_chatbot_settingsUpdate Chatbot Settings ToolAInspect

Update a chatbot's settings. Only the fields you pass are changed. Call get_chatbot first to see allowed_models before changing gpt_model.

ParametersJSON Schema
NameRequiredDescriptionDefault
topKNoRetrieved-chunk count 1-3.
gpt_modelNoLLM model id. Must be one of the chatbot's allowed_models.
chatbot_idYesThe chatbot id.
temperatureNoSampling temperature 0-2.
history_countNoConversation history turns 0-10.
default_answerNoFallback answer when the bot cannot answer.
welcome_messageNoWelcome message (max 500 chars). Separate multiple bubbles with a blank line.
escalations_emailNoSemicolon-separated email addresses notified on escalation.
enable_escalationsNoTurn human-handoff escalations on/off.
enable_lead_captureNoTurn the lead-capture form on/off.
instructions_promptNoSystem/instructions prompt (max 20000 chars).
lead_capture_fieldsNoLead-capture field definitions {type,name,required,enabled,order}. Required when enabling lead capture.
escalate_message_thresholdNoMessages before a human handoff is offered (1-10).
enable_escalations_round_robinNoRotate escalation emails round-robin across the addresses.
enable_escalations_notificationNoEmail a notification when a conversation escalates.
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Discloses partial update behavior (only passed fields are changed) but does not describe error handling, success/failure responses, or any side effects beyond the update.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with no redundant information; front-loaded with the core purpose and key behavioral note.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 15 parameters and no output schema or annotations, the description is minimal; it covers partial update and one prerequisite but lacks details on return value, errors, and broader behavioral context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All 15 parameters have schema descriptions (100% coverage), and the description adds value by explaining partial update semantics and the prerequisite for the gpt_model parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool updates a chatbot's settings with a partial update pattern, and the title and sibling context differentiate it from read-only tools like get_chatbot.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly advises calling get_chatbot first to inspect allowed_models before modifying gpt_model, providing clear when-to-use guidance and a prerequisite.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update_suggested_messageUpdate Suggested Message ToolAInspect

Update an existing suggested message. Only the fields you pass are changed. Get the id from list_suggested_messages.

ParametersJSON Schema
NameRequiredDescriptionDefault
nameNoThe button label (max 100).
typeNoai, redirect, email, intercom, follow_up, follow_up_link, follow_up_email, escalate.
actionNoA URL or email (max 200).
promptNoThe message sent when clicked (max 200).
chatbot_idYesThe chatbot id.
suggested_message_idYesThe suggested message id (from list_suggested_messages).
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, so description carries full burden. It discloses partial update behavior, which is key. However, it doesn't mention return value, error handling, or any side effects. For an update tool, this is adequate but not thorough.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences, front-loaded with action and partial update. Every sentence contributes essential information. No fluff.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 100% schema coverage and no output schema, the description covers the core use case well. It could be improved by mentioning the response format or typical errors, but for a partial update tool it is sufficiently complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. The description adds value by clarifying that only passed fields change (partial update), which is not in the schema. This goes beyond the schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the action (update) and resource (existing suggested message). It distinguishes from sibling 'add_suggested_message' by implying this is for existing messages. The partial update behavior is explicitly mentioned, and it tells where to get the required id.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Description indicates when to use (update existing) and provides a prerequisite (get id from list_suggested_messages). It doesn't explicitly state when not to use or alternative tools, but the sibling set is known. This is clear but could be more explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update_thread_statusUpdate Thread Status ToolBInspect

Set an inbox thread status. Use "archived" to mark a thread as done. Allowed: read, unread, archived, priority, snooze.

ParametersJSON Schema
NameRequiredDescriptionDefault
statusYesread | unread | archived | priority | snooze. "archived" = done.
chatbot_idYesThe chatbot id.
visitor_idYesThe thread/visitor id.
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Without annotations, the description carries full burden for behavioral disclosure. It only states the action and allowed statuses, but does not reveal side effects, permission requirements, idempotency, or impact on other parts of the system.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise with two short sentences, no filler, and clearly states the purpose and allowed values. Every part earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with 3 required parameters and no output schema, the description is minimally adequate. It covers the basic action and allowed statuses, but lacks context on status applicability (e.g., limitations per thread state) and return behavior. Output schema is absent, so some return info would help completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and all parameters already have descriptions in the schema. The description adds no new semantic information beyond what is in the schema, e.g., for 'status' it repeats the allowed values and the 'archived = done' note already present in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('Set') and resource ('inbox thread status'), clearly stating the tool's function. It lists all allowed statuses, but does not explicitly distinguish itself from sibling update tools like update_chatbot_settings or update_suggested_message.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, nor does it mention any prerequisites or exclusions. It only implies usage by stating the action, but lacks explicit when/when-not context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Discussions

No comments yet. Be the first to start the discussion!

Try in Browser

Your Connectors

Sign in to create a connector for this server.

Resources