Perception-MCP
Provides multimodal analysis capabilities for images, audio, and video files using Perplexity's API to answer questions about media content
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
Perception-MCP
A lightweight Model Context Protocol (MCP) server that lets you ask any question about an image, audio, or video file and returns an answer powered by state-of-the-art multimodal models served through fal.ai.
Prerequisites
Python 3.11+
A fal.ai account & API key
A Perplexity account & API key
Related MCP server: fal.ai MCP Server
Installation
git clone --recurse-submodules https://github.com/lintyourcode/perception-mcp.git
cd perception-mcp
cp mcp_agent.secrets_template.yaml mcp_agent.secrets.yaml
$EDITOR mcp_agent.secrets.yamlUsage
Add Perception-MCP to Claude Desktop (v0.3.7+) by adding the following to your claude_desktop_config.json file:
{
"mcpServers": {
"perception-mcp": {
"command": "fastmcp",
"args": ["run", "perception-mcp", "serve"]
}
}
}Tools
Perception-MCP provides the following tools:
query_image: Answer a question about an image's contentsquery_audio: Answer a question about an audio file's contentsquery_video: Answer a question about a video's contents
Development
Running tests
uv run pytest -qThis server cannot be deployed
Maintenance
Related MCP Connectors
Answer a question about what is on the screen or in a recording; solves text, images and audio.
Transform video, audio and images, and generate media from prompts. FFmpeg, captions, models.
OCR, transcription, file extraction, and image generation for AI agents via MCP.
Transcribe audio and video into speaker-labelled transcripts, subtitles, clips, and cited Q&A.
Related MCP Servers
- AlicenseAqualityDmaintenanceEnables Claude Desktop and other MCP clients to generate images, videos, music, and audio using Fal.ai models. Supports text-to-image generation, video creation, music composition, text-to-speech, audio transcription, and image enhancement through natural language prompts.1861MIT
- AlicenseNot gradedqualityDmaintenanceProvides access to over 600 AI models on fal.ai for generating and editing images, videos, music, and speech directly within Claude. It supports high-performance models like FLUX, Kling, and Whisper for various creative and analytical tasks.431 npm1MIT
- AlicenseAqualityDmaintenanceEnables local media processing (video/audio) using FFmpeg and FFprobe, allowing frame extraction, audio conversion, and metadata retrieval through natural language.5MIT
- AlicenseNot gradedqualityDmaintenanceEnables image and video generation from text, image editing, and text-to-video workflows using AI models via OpenRouter and fal.ai.MIT