analyze_screenshot
Detect visual anomalies in screenshots by encoding images with a ViT encoder and comparing frames to compute surprise scores, flagging unexpected changes.
Instructions
Encode a screenshot through the ViT encoder and optionally compute a surprise score vs a previous frame. Returns embedding vector, cosine similarity, MSE, and anomaly flag.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| source | Yes | File path to an image (png/jpg/webp) OR base64-encoded image data (with or without data URL prefix). | |
| previous_source | No | Optional: file path or base64 of a previous screenshot to compare against. If omitted, uses the last screenshot passed to this tool. | |
| anomaly_threshold | No | Normalized surprise multiplier above which to flag as anomaly (default 2.0 = 2× baseline). |