Skip to main content
Glama

Add Callouts

callout
Destructive

Annotate videos or screenshots with timed boxes, text labels, and arrows to highlight details; specify start and end seconds per item and render an edited output.

Instructions

Annotate a video or screenshot with timed boxes, text labels, and arrows. Fallback fonts used are listed in fallbackFonts; characters no font covers are reported in warnings.

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "input": "<input>",
      "items": "<items>"
    },
    "name": "callout"
  }
}

Input Schema

NameRequiredDescriptionDefault
inputYesPath to the source video or image (png/jpg; from/to are ignored for an image).
itemsYesBoxes, text labels, and arrows, drawn in order (later on top), in video pixels. Each shows from..to seconds (default: whole video); color is a name, #RRGGBB, or name@alpha.
outputNoOptional output path. Defaults under SCREENCAST_HOME/edits.
fontFileNoFont: a .ttf/.otf/.ttc path or a C:\Windows\Fonts file name. Default: bundled Inter, with a covering system font for scripts it lacks (CJK, emoji, Arabic, ...).
overwriteNoAllow replacing an existing file at the output path (default false).

Output Schema

NameRequiredDescriptionDefault
outputPathYesPath of the file written.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changedv0.49.1
    • changedInput schema / properties / input / description
      Previous value: -"Path to the source video."New value: +"Path to the source video or image (png/jpg; from/to are ignored for an image)."
  2. Changed4 schema fields changedv0.47.0
    • addedInput schema / properties / fontFile
      Added value: +{
      +  "description": "Font: a .ttf/.otf/.ttc path or a C:\\Windows\\Fonts file name. Default: bundled Inter, with a covering system font for scripts it lacks (CJK, emoji, Arabic, ...).",
      +  "minLength": 1,
      +  "type": "string"
      +}
    • changedInput schema / properties / items / description
      Previous value: -"Annotations, drawn in order (later on top). Each is a box, a text label, or an arrow, shown between from and to (seconds). Coordinates are video pixels."New value: +"Boxes, text labels, and arrows, drawn in order (later on top), in video pixels. Each shows from..to seconds (default: whole video); color is a name, #RRGGBB, or name@alpha."
    • changedInput schema / properties / items / items / oneOf
      Previous value: -[
      -  {
      -    "properties": {
      -      "color": {
      -        "description": "Color name, #RRGGBB, or name@alpha.",
      -        "type": "string"
      -      },
      -      "fill": {
      -        "description": "Fill instead of outline.",
      -        "type": "boolean"
      -      },
      -      "from": {
      -        "description": "Show from this second (default: start).",
      -        "minimum": 0,
      -        "type": "number"
      -      },
      -      "height": {
      -        "exclusiveMinimum": 0,
      -        "type": "number"
      -      },
      -      "thickness": {
      -        "description": "Outline px (default 4).",
      -        "exclusiveMinimum": 0,
      -        "type": "number"
      -      },
      -      "to": {
      -        "description": "Hide after this second (default: end).",
      -        "exclusiveMinimum": 0,
      -        "type": "number"
      -      },
      -      "type": {
      -        "const": "box",
      -        "type": "string"
      -      },
      -      "width": {
      -        "exclusiveMinimum": 0,
      -        "type": "number"
      -      },
      -      "x": {
      -        "type": "number"
      -      },
      -      "y": {
      -        "type": "number"
      -      }
      -    },
      -    "required": [
      -      "type",
      -      "x",
      -      "y",
      -      "width",
      -      "height"
      -    ],
      -    "type": "object"
      -  },
      -  {
      -    "properties": {
      -      "background": {
      -        "description": "Dark panel behind the text (default true).",
      -        "type": "boolean"
      -      },
      -      "color": {
      -        "description": "Color name, #RRGGBB, or name@alpha.",
      -        "type": "string"
      -      },
      -      "from": {
      -        "description": "Show from this second (default: start).",
      -        "minimum": 0,
      -        "type": "number"
      -      },
      -      "size": {
      -        "description": "Font size px (default 32).",
      -        "exclusiveMinimum": 0,
      -        "type": "number"
      -      },
      -      "text": {
      -        "minLength": 1,
      -        "type": "string"
      -      },
      -      "to": {
      -        "description": "Hide after this second (default: end).",
      -        "exclusiveMinimum": 0,
      -        "type": "number"
      -      },
      -      "type": {
      -        "const": "text",
      -        "type": "string"
      -      },
      -      "x": {
      -        "type": "number"
      -      },
      -      "y": {
      -        "type": "number"
      -      }
      -    },
      -    "required": [
      -      "type",
      -      "x",
      -      "y",
      -      "text"
      -    ],
      -    "type": "object"
      -  },
      -  {
      -    "properties": {
      -      "color": {
      -        "description": "Color name, #RRGGBB, or name@alpha.",
      -        "type": "string"
      -      },
      -      "from": {
      -        "description": "Show from this second (default: start).",
      -        "minimum": 0,
      -        "type": "number"
      -      },
      -      "thickness": {
      -        "description": "Shaft px (default 8).",
      -        "exclusiveMinimum": 0,
      -        "type": "number"
      -      },
      -      "to": {
      -        "description": "Hide after this second (default: end).",
      -        "exclusiveMinimum": 0,
      -        "type": "number"
      -      },
      -      "type": {
      -        "const": "arrow",
      -        "type": "string"
      -      },
      -      "x1": {
      -        "description": "Tail x.",
      -        "type": "number"
      -      },
      -      "x2": {
      -        "description": "Head x: the point the arrow points at.",
      -        "type": "number"
      -      },
      -      "y1": {
      -        "description": "Tail y.",
      -        "type": "number"
      -      },
      -      "y2": {
      -        "description": "Head y.",
      -        "type": "number"
      -      }
      -    },
      -    "required": [
      -      "type",
      -      "x1",
      -      "y1",
      -      "x2",
      -      "y2"
      -    ],
      -    "type": "object"
      -  }
      -]New value: +[
      +  {
      +    "properties": {
      +      "color": {
      +        "type": "string"
      +      },
      +      "fill": {
      +        "description": "Fill instead of outline.",
      +        "type": "boolean"
      +      },
      +      "from": {
      +        "minimum": 0,
      +        "type": "number"
      +      },
      +      "height": {
      +        "exclusiveMinimum": 0,
      +        "type": "number"
      +      },
      +      "thickness": {
      +        "description": "Outline px (default 4).",
      +        "exclusiveMinimum": 0,
      +        "type": "number"
      +      },
      +      "to": {
      +        "exclusiveMinimum": 0,
      +        "type": "number"
      +      },
      +      "type": {
      +        "const": "box",
      +        "type": "string"
      +      },
      +      "width": {
      +        "exclusiveMinimum": 0,
      +        "type": "number"
      +      },
      +      "x": {
      +        "type": "number"
      +      },
      +      "y": {
      +        "type": "number"
      +      }
      +    },
      +    "required": [
      +      "type",
      +      "x",
      +      "y",
      +      "width",
      +      "height"
      +    ],
      +    "type": "object"
      +  },
      +  {
      +    "properties": {
      +      "background": {
      +        "description": "Dark panel behind the text (default true).",
      +        "type": "boolean"
      +      },
      +      "color": {
      +        "type": "string"
      +      },
      +      "from": {
      +        "minimum": 0,
      +        "type": "number"
      +      },
      +      "size": {
      +        "description": "Font size px (default 32).",
      +        "exclusiveMinimum": 0,
      +        "type": "number"
      +      },
      +      "text": {
      +        "minLength": 1,
      +        "type": "string"
      +      },
      +      "to": {
      +        "exclusiveMinimum": 0,
      +        "type": "number"
      +      },
      +      "type": {
      +        "const": "text",
      +        "type": "string"
      +      },
      +      "x": {
      +        "type": "number"
      +      },
      +      "y": {
      +        "type": "number"
      +      }
      +    },
      +    "required": [
      +      "type",
      +      "x",
      +      "y",
      +      "text"
      +    ],
      +    "type": "object"
      +  },
      +  {
      +    "properties": {
      +      "color": {
      +        "type": "string"
      +      },
      +      "from": {
      +        "minimum": 0,
      +        "type": "number"
      +      },
      +      "thickness": {
      +        "description": "Shaft px (default 8).",
      +        "exclusiveMinimum": 0,
      +        "type": "number"
      +      },
      +      "to": {
      +        "exclusiveMinimum": 0,
      +        "type": "number"
      +      },
      +      "type": {
      +        "const": "arrow",
      +        "type": "string"
      +      },
      +      "x1": {
      +        "type": "number"
      +      },
      +      "x2": {
      +        "description": "Head (x2,y2) is the point the arrow points at.",
      +        "type": "number"
      +      },
      +      "y1": {
      +        "type": "number"
      +      },
      +      "y2": {
      +        "type": "number"
      +      }
      +    },
      +    "required": [
      +      "type",
      +      "x1",
      +      "y1",
      +      "x2",
      +      "y2"
      +    ],
      +    "type": "object"
      +  }
      +]
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "$schema": "http://json-schema.org/draft-07/schema#",
      +  "additionalProperties": {},
      +  "properties": {
      +    "outputPath": {
      +      "description": "Path of the file written.",
      +      "type": "string"
      +    }
      +  },
      +  "required": [
      +    "outputPath"
      +  ],
      +  "type": "object"
      +}
  3. First observedv0.32.0

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already disclose the safety profile (destructiveHint=true, readOnlyHint=false, idempotentHint=false), and the schema documents the overwrite and output-path behavior. The description adds only the font-fallback and warning reporting behavior, which is useful but largely restates return-value information; it never warns that writing to an existing path is destructive or that overwrite defaults to false.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two tight sentences with the core purpose front-loaded and no filler. The second sentence is somewhat narrower in relevance (font fallbacks and warnings) but still earns its place by flagging a non-obvious output behavior.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With five parameters fully described in the schema, an output schema present, and annotations covering mutability and destructiveness, the description supplies enough for correct invocation. The main gap is the absence of any guidance on choosing this tool over related overlay/annotation siblings.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already explains input, items, output, fontFile, and overwrite in detail. The description adds no parameter-level meaning beyond that baseline, which is the expected 3 when the schema does all the work.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description gives a specific verb and resource ('Annotate a video or screenshot') plus the three overlay types it supports (timed boxes, text labels, arrows), which clearly separates it from pure-edit siblings like crop or compress. It does not name or contrast with any sibling such as add_marker, so it stops short of full differentiation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is only implied by the verb 'Annotate' — an agent can infer it applies when overlays are wanted, but there is no explicit when-to-use, when-not, or pointer to an alternative for simpler marker/overlay needs. No prerequisites (e.g. source file requirements) are stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.