BioMCP

# Skill Validation Guide This guide defines how to evaluate whether a BioMCP skill run is complete and trustworthy. Validation is checklist-driven and attached directly to each skill markdown file. ## Validation Model Each skill should provide: 1. **Quick Check** to confirm command path health. 2. **Full Workflow** with explicit step intent. 3. **Validation Checklist** with concrete expected outcomes. A run is considered valid when checklist items can be traced to command output. ## Reviewer Checklist Use this short rubric when reviewing a skill execution log: | Criterion | Pass condition | |-----------|----------------| | Command fidelity | Steps match the skill workflow commands | | Evidence traceability | Output includes IDs (PMID/NCT/variant IDs) where relevant | | Clinical relevance | Summary ties findings back to disease/variant/drug context | | Constraint awareness | Eligibility/safety/limitations noted when applicable | | Reproducibility | Another reviewer can rerun commands and get equivalent structure | ## Common Failure Patterns - Commands run out of order and lose context. - Final summary omits the evidence IDs returned by commands. - Trial matching lacks criterion-level explanation. - Resistance and alternative-treatment claims are made without supporting queries. ## Practical Tips - Keep raw output snippets for each checklist line item. - Prefer explicit command reruns over inferred claims. - Mark no-result cases clearly (for example, no recruiting trials found) rather than leaving gaps.