addedInput schema / examples
Added value: +[
+ {
+ "metric": "clip_score",
+ "score": 72
+ }
+]
removedInput schema / properties / action / description
Removed value: -"guide (default) = reference thresholds/interpretation. clip_score/fid_score/vqa_accuracy = compute that metric. pipeline = run all three."
changedInput schema / properties / api_key / description
Previous value: -"[vqa_accuracy] Your API key for the provider (BYOK)."New value: +"[vqa_accuracy] Key for the model's provider."
changedInput schema / properties / clip / description
Previous value: -"[pipeline] {image_url, text} for CLIP."New value: +"[pipeline] {image_url, text}"
changedInput schema / properties / fid / description
Previous value: -"[pipeline] {real_images, generated_images} for FID."New value: +"[pipeline] {real_images, generated_images}"
changedInput schema / properties / generated_images / description
Previous value: -"[fid_score] Array of generated image URLs."New value: +"[fid_score] URLs."
changedInput schema / properties / image_base64 / description
Previous value: -"[clip_score/vqa_accuracy] Base64-encoded image data."New value: +"[clip_score, vqa_accuracy]"
changedInput schema / properties / image_mime_type / description
Previous value: -"[clip_score/vqa_accuracy] MIME type for base64 image."New value: +"[clip_score, vqa_accuracy]"
changedInput schema / properties / image_url / description
Previous value: -"[clip_score/vqa_accuracy] Public URL of the image."New value: +"[clip_score, vqa_accuracy] Public image URL."
changedInput schema / properties / metric / description
Previous value: -"[guide only] Metric to explain."New value: +"[guide]"
changedInput schema / properties / model / description
Previous value: -"[vqa_accuracy] VLM model ID (default: gpt-4o)."New value: +"[vqa_accuracy] Default gpt-4o."
changedInput schema / properties / real_images / description
Previous value: -"[fid_score] Array of real image URLs."New value: +"[fid_score] URLs."
changedInput schema / properties / score / description
Previous value: -"[guide only] Optional score value to interpret."New value: +"[guide] A score to interpret."
changedInput schema / properties / system_prompt / description
Previous value: -"[vqa_accuracy] Optional system prompt."New value: +"[vqa_accuracy]"
changedInput schema / properties / test_cases / description
Previous value: -"[vqa_accuracy] Array of {question, accepted_answers} objects."New value: +"[vqa_accuracy]"
changedInput schema / properties / text / description
Previous value: -"[clip_score only] Text description to compare against the image."New value: +"[clip_score] Text to compare with the image."
changedInput schema / properties / vqa / description
Previous value: -"[pipeline] VQA config object (same inputs as vqa_accuracy)."New value: +"[pipeline] Same inputs as vqa_accuracy."