prepare_figure_search
Analyze scientific figures or images to extract English search terms and retrieve related biomedical literature from PubMed.
Instructions
Analyze a scientific figure or image for literature search.
═══════════════════════════════════════════════════════════════════════ 🔬 VISION-TO-LITERATURE SEARCH (Experimental) ═══════════════════════════════════════════════════════════════════════
This tool enables searching for scientific literature based on images.
WORKFLOW (the host agent performs the analysis and search): ─────────────────────────────────────────────────────────
Provide an image (URL or base64-encoded)
This tool returns the image using MCP ImageContent protocol
YOU (the Agent) analyze the image using your vision capabilities
Extract relevant ENGLISH search terms from the image
Call
search_biomedical_images()orunified_search()with extracted terms when literature retrieval is within the user-requested scopeReturn both the analysis and search results to the user
⚠️ IMPORTANT RULES: ────────────────
ALL search queries must be in ENGLISH (Open-i requirement)
This tool returns an image and guidance; it does not invoke a vision model
The host agent controls any subsequent search within its permissions
If the image shows a medical condition, extract the medical term in English
SEARCH TYPES: ─────────────
"comprehensive": General analysis, extract all relevant terms (default)
"methodology": Focus on methods, equipment, techniques shown
"results": Focus on data, graphs, statistical findings
"structure": Focus on molecular/chemical structures
"medical": Focus on clinical/medical imaging findings
USE CASES: ──────────
📊 Scientific figures → Find papers with similar data/charts
🔬 Microscopy images → Find related research
🧬 Molecular structures → Find papers about the compound
📈 Graphs/plots → Find papers with similar analyses
🏥 Medical images → Find case reports or clinical studies
⚗️ Lab equipment → Find methodology papers
IMPORTANT: ────────── Image observations are search hypotheses that require source verification. Follow the user-requested scope and the host agent's execution rules. Use English medical terminology in all search queries.
Args: source: Exactly one typed image source: {"kind": "base64", "data": "data:image/png;base64,..."} or {"kind": "url", "url": "https://example.org/figure.png"}. context: Optional context about what to look for in the image search_type: Type of analysis focus (comprehensive/methodology/results/structure/medical)
Returns: List containing: - ImageContent: The image for you to analyze - TextContent: Instructions for next steps
Example: prepare_figure_search(source={"kind": "url", "url": "https://example.com/figure1.png"}) prepare_figure_search( source={"kind": "base64", "data": "data:image/png;base64,iVBORw0..."} )
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| source | Yes | ||
| context | No | ||
| search_type | No | comprehensive |