Provides multimodal analysis capabilities for images, audio, and video files using Perplexity's API to answer questions about media content
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
A lightweight Model Context Protocol (MCP) server that lets you ask any question about an image, audio, or video file and returns an answer powered by state-of-the-art multimodal models served through fal.ai.
Python 3.11+
A fal.ai account & API key
A Perplexity account & API key
Related MCP server: fal.ai MCP Server
git clone --recurse-submodules https://github.com/lintyourcode/perception-mcp.git
cd perception-mcp
cp mcp_agent.secrets_template.yaml mcp_agent.secrets.yaml
$EDITOR mcp_agent.secrets.yamlAdd Perception-MCP to Claude Desktop (v0.3.7+) by adding the following to your claude_desktop_config.json file:
{
"mcpServers": {
"perception-mcp": {
"command": "fastmcp",
"args": ["run", "perception-mcp", "serve"]
}
}
}Perception-MCP provides the following tools:
query_image: Answer a question about an image's contents
query_audio: Answer a question about an audio file's contents
query_video: Answer a question about a video's contents
uv run pytest -qRecent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
This server cannot be deployed
Answer a question about what is on the screen or in a recording; solves text, images and audio.
Transform video, audio and images, and generate media from prompts. FFmpeg, captions, models.
Transcribes audio and video files to text, SRT, VTT and timestamped chunks for RAG.
OCR, transcription, file extraction, and image generation for AI agents via MCP.
