Catalyst
This server analyzes local and online videos and returns structured evidence plus unverified model findings for visual, language, or multimodal research.
Analyze a local video visually using an audio-free copy, with low/default detail.
Inspect a precise time window in a local video for visual-only analysis.
Research a public Bilibili video via legacy mode, including metadata, optional sampled comments, and language/vision/multimodal workflows.
Research Bilibili or YouTube URLs with captions/ASR, media, opt-in comments, source-quality controls, timeouts, and structured capability/evidence/error output.
Enables research on Bilibili public videos, including video metadata, available captions or audio/ASR fallback, media analysis, optional sampled comments, and a legacy Bilibili-specific analysis tool.
Enables research on YouTube public videos, including metadata, available manual or automatic JSON3 captions, and media analysis; comment sampling is unsupported in this preview.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Catalyst analyze this YouTube video: what animals are visible in the first 15 seconds?"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Catalyst
简体中文 · English
Catalyst provides Bilibili candidate discovery, video research and Xiaohongshu image/text note research for existing agents, with explicit evidence sources, original image-page numbers or source-time ranges, availability states, and analysis limits.
Catalyst evolves from Bilibili Video Research, retaining its Git history and existing BVR tools. This is an early preview, installed from source.
Preview scope
Source | Scope |
Bilibili | Experimental candidate discovery, public video metadata, available captions or audio fallback, media research, and optional sampled comments. Access and source quality depend on the platform, video and authorized account. |
YouTube | Public video metadata, available manual or automatic JSON3 captions, and media research. Comment sampling reports |
Xiaohongshu (experimental) | A dedicated note entry reads body text, per-page OCR and image content, routing confirmed videos to the existing video workflow. Accepts note/share URLs and copied share text. Platform captions and comments remain unsupported. |
Local files | Existing visual analysis and silent-window inspection tools. |
Douyin | Acquisition research candidate; no preview support claim. |
Catalyst reads individual sources and returns their evidence, coverage and source-local analysis. The host agent (harness) owns conversation context, source selection, comparisons and answers across sources. Long-video checkpoints preserve progress within one source. Bounded Bilibili search returns candidates for the host to select; cross-platform search is not implemented.
Related MCP server: youtube-research-mcp
Installation
Requirements:
Node.js 24 or newer.
Python 3.10 or newer when using a Python-based yt-dlp distribution.
A working yt-dlp installation with EJS for YouTube, plus FFmpeg.
A StepFun or Gemini credential for model analysis.
git clone https://github.com/7oMB2006/Catalyst.git
cd Catalyst
npm ci
npm run build
cp .env.example .env
# Configure the provider and any external binary paths in .env.
npm run doctor
npm testOn Windows, use Copy-Item .env.example .env in place of cp; use py -3 -m pip or a configured python -m pip if python3 is not available.
Bundled media dependencies are used when available. For an external downloader, install the official Python distribution and set its executable path:
python3 -m pip install 'yt-dlp[default]'YTDLP_PATH=/absolute/path/to/yt-dlp
# Set this when the selected downloader needs a specific Python interpreter.
YTDLP_PYTHON=/absolute/path/to/python
FFMPEG_PATH=/absolute/path/to/ffmpegThe inherited yt-dlp-exec package is optional. Its install hook invokes python; when that command is absent or too old, npm can omit this optional dependency. Use an external yt-dlp installation through YTDLP_PATH, or make Python >=3.10 available as python in the installation environment if you want the optional bundle. YTDLP_PYTHON controls runtime execution; it does not change that install hook. FFmpeg's bundled binary may also be unavailable on a particular platform; FFMPEG_PATH is the explicit fallback.
npm run doctor runs the compiled dist/doctor.js, so build first. It checks local executable versions and whether a provider credential is configured. It does not contact video platforms or providers, read browser cookies, or test account balance. EJS detection can be inconclusive for standalone binaries; review any warning before a YouTube request. See the upstream EJS setup guide.
Start the MCP server
npm startThis starts the compiled stdio server. In an MCP host, use node as the command and the absolute path to dist/index.js as its argument. Set DOTENV_CONFIG_PATH to the absolute path to the local .env file when the host starts in a different directory. Configure the host's tool timeout to cover the requested research timeout and startup overhead.
Provider credentials belong in the process environment or local .env, rather than the host's checked-in configuration. CODEX_VIDEO_PROVIDER remains the historical provider selector: stepfun by default, or gemini.
Read a selected link
Give the host a link and a question. For a complete selected video or Bilibili part, use the segmented reader without manually choosing an opening window:
analyze_long_video_url({
url: "https://www.bilibili.com/video/BV1DTxXzUEvW/?p=17",
question: "Which self-attention mechanisms does this lesson introduce, and what does each address?",
mode: "language",
language: "en",
max_detail_windows: 0,
timeout_seconds: 1800
})The reader plans every overview window in the selected source interval. A Bilibili p selects one part, not the whole collection. Defaults are 600-second segments and at most 12 overview segments; a larger plan is rejected before media acquisition rather than silently sampling the beginning. Use vision or multimodal when the question needs pictures, diagrams or visible actions. See long-video reading and limits.
Mode | Evidence used |
| Available platform captions first; otherwise audio/ASR. Video frames are excluded. |
| Video with its audio removed. Visible text remains valid visual evidence. |
| Original audio and visual channels, with explicit ASR for long-video language evidence. |
Overview media is prepared at up to 360p/1fps, and detail media at up to 720p/5fps. Complete overview coverage does not establish that every frame or formula was read. Defaults are a 512 MiB cumulative acquired-file budget, a 32 MiB prepared upload limit, and a 900-second shared deadline (configurable up to 1,800 seconds; the host timeout must be longer). Budget or deadline failures retain partial reports. Media is acquired by source window.
Save and resume a reading
Long-video reading saves progress locally by default (save_session: true). After a timeout, cancellation or server restart, the host can resume unfinished work for the same question:
resume_long_video_research({
session_id: "<session.id from the original result>",
timeout_seconds: 1800,
window_timeout_seconds: 300
})
get_research_session({ session_id: "<session.id>" })
list_research_sessions({})
delete_research_session({ session_id: "<session.id>" })Completed overview and detail segments keep their reports, captions/ASR and citations. Resume processes unfinished segments, then rebuilds the source-local answer and coverage report. Successful segments are not downloaded, transcribed or analyzed again. Runtime deadlines and the acquired-file budget start afresh; session.reused_segments and session.processed_segments distinguish retained work from this invocation.
get and list make no source or provider calls. Records live in ~/.catalyst/sessions, or CATALYST_SESSION_DIR, and contain sanitized results and progress without media, credentials or signed acquisition URLs. Set save_session: false for an unsaved run. Resume keeps the original question, source/part, mode, language, quality and window plan. An optional fresh url must still resolve to the same source. See session storage and recovery.
Let the host manage the conversation
For example, the user provides tutorials A and B and asks how their Agent designs differ. The host reads each link, keeps the evidence and compares it in its own context. If the user later supplies tutorial C, the host reads C and combines its evidence with the retained A/B results. Catalyst does not need a separate multi-source task or an “append source” operation.
For a new question such as “turn tutorial A into minimum implementation steps,” the host can reason over the retained captions, ASR, body text or OCR. If a saved video's evidence is no longer in context, get_research_session retrieves it without rereading the source. The host retains note results itself. Missing information can trigger a selected new time window or image-page read. Earlier generated answers and visual interpretations are not raw source text; a new question requiring visual inspection needs the relevant pictures or clips to be checked.
The default server exposes 11 tools:
Purpose | Tools |
Find candidates |
|
Read one source |
|
Recover saved video progress |
|
Existing BVR tools |
|
Discover Bilibili candidates
discover_bilibili_videos({
question: "Which approaches reduce the computation required by self-attention?",
queries: ["高效注意力 Linformer", "稀疏注意力 原理"],
max_candidates: 10,
timeout_seconds: 30
})The tool returns search metadata and ranked source links, with the originating queries and original result positions. Candidates are marked content_status: "not_read" and media_access: "not_checked"; search snippets and ordering do not establish what a video contains or whether its media can be acquired. Results without an explicit part retain part_number: null; search durations have not been verified for a selected part.
The host supplies up to three short queries. If omitted, the question itself is the single query; a question longer than 200 characters requires explicit short queries. Defaults are ten candidates and a 30-second shared deadline. Each query requests one page of up to twenty rows. The tool performs no model calls, ASR, media downloads, automatic retries or browser-cookie reads, and needs no model credential. Select a candidate and pass its URL to an existing research tool, which revalidates source and part identity before reading content.
This is an experimental anonymous Bilibili Web search path, not a stable official API. Access restrictions can produce partial or unavailable results; blocking, authentication requirements and rate limits stop remaining queries. Every result declares search_exhaustive: false, and reports candidates omitted by the requested return limit. See the discovery design, references and acceptance criteria.
Inspect a selected video window
When the host needs a specific visual check, it can select an original source interval:
analyze_video_url({
url: "https://www.youtube.com/watch?v=jNQXAC9IVRw",
question: "Which animals are visible, and what features can actually be seen?",
mode: "vision",
media_detail: "default",
include_comments: false,
start_seconds: 0,
end_seconds: 15,
timeout_seconds: 240
})This is an explicitly chosen interval, not the default scope for reading a pasted link. Provide start_seconds and end_seconds together. For media longer than 900 seconds, the generic tool requires a window of at most 900 seconds; otherwise it returns WINDOW_REQUIRED. Caption-only language reading has separate text limits. Use inspect_video_window with an absolute video_path and source-time bounds for a local file; analyze_video analyzes a local file visually.
The generic video tool uses an available source by default and records its actual quality. Visual and multimodal acquisition prefer formats at or below 1080p. Its media-file budget defaults to 256 MiB, configurable through CATALYST_MAX_MEDIA_MB; acquisition can download the whole source before cutting the requested interval. Independent calls have no shared media or transcription cache. To impose a quality threshold, supply:
source_quality: { profile: "high", on_unavailable: "error" }Profiles inherited from BVR are standard (1080p30), high (1440p30), and custom with explicit resolution/fps. A missing target fails by default; on_unavailable: "warn" allows a reported fallback. Requesting higher quality cannot recover detail absent from the original video.
For Xiaohongshu, paste an original note URL, official xhslink.com/xhslink.cn short URL, or share text containing one link. Retain original share parameters. HTTP short links are upgraded to HTTPS; public results hide acquisition parameters and signed image/media URLs. Collections and live content remain unsupported. An empty video-format list does not establish that a source is an image note; use the dedicated note entry below.
Research a Xiaohongshu image/text note
analyze_xiaohongshu_note({
url: "https://xhslink.cn/o/Af8twEpdOVh",
question: "What Agent architecture does the author describe? Cite original image pages.",
mode: "text",
language: "en"
})The entry confirms the actual source type. For image notes, text reads the body and per-page OCR, vision inspects pictures and diagrams, and combined uses both. Confirmed video notes use the existing language/vision/multimodal workflow respectively. Image-note evidence distinguishes platform body, generated OCR and model visual observations, citing original 1-based image pages without invented durations or timestamps.
All images are selected by default, up to 50 per request. Longer notes require an inclusive start_page/end_page pair; cover-only processing never counts as full-note coverage. A page selection excludes the full-note body. Missing or unreadable pages, OCR failures and invalid citations preserve acquired evidence as partial results.
The default image-note vision/combined path requires provider-native JSON Schema output support on the configured model and channel. Each batch returns one observation per image in input order; Catalyst binds these to the original page numbers. Invalid output rejects that batch while retaining completed batches and OCR. This validates output structure and page mapping, not observation accuracy. No new MCP parameters are needed; see model compatibility for tested scope and provider details.
The final image-note model call requests one set of cited answer points. Catalyst assembles analysis from accepted findings, original page locators and per-point limitations, so substantive content cannot remain only in Findings. Findings remain unverified. With no accepted findings, analysis is null and the partial result retains its evidence; uncited free text is not used as a fallback. An independent analysis returned by an older executor no longer contributes to an image-note answer, so necessary qualifications belong in each finding's limitations. Confirmed video notes keep the existing video workflow.
macOS prefers local OCR through an available Swift/Vision runtime; other environments or unavailable local runtimes send images to the configured model provider for OCR. CATALYST_OCR_ENGINE=provider or apple_vision selects an explicit path. OCR may misread characters; use vision/combined for layouts and arrows. Images are limited to 12 MiB each and 128 MiB total, with at most four images per model batch. AVIF responses are normalized to a single-frame PNG using FFmpeg before OCR or visual analysis; decoded images are capped at 40 million pixels, and normalized files obey the same byte limits. Note-page fetching currently uses anonymous access; XIAOHONGSHU_COOKIES_* applies to the video downloader.
Evidence and results
The generic tool returns structured results together with readable text. The result records video identity, requested mode/window, per-capability states, evidence, findings, warnings, errors, and processing information.
Caption evidence retains source cue times and language.
A media window records the interval supplied for analysis. It does not give every generated sentence a verified timestamp.
Model findings remain
verification: "unverified". References to real evidence IDs validate the reference structure, not the truth of each statement.Frame numbers and precise times generated by a model are not deterministic extraction records. Missing or unconfirmed precision stays explicit.
complete,partial, andunavailabledistinguish an analysis response from retained evidence or a failure. Unavailable provider usage and monetary cost remain unknown.
Review supporting source material before relying on a specific claim. The architecture and validation record describe these boundaries.
BVR compatibility
The existing tools remain available:
analyze_bilibili_video: the Bilibili-specific tool and its legacy text/provenance format.analyze_video: visual analysis of a local video.inspect_video_window: visual analysis of a local source interval.
The legacy Bilibili tool retains its strict default 1080p30 quality policy. The generic tool's default is available source quality. Existing STEPFUN_*, GEMINI_*, and BILIBILI_* settings remain supported.
Authentication is explicit and platform-scoped. Set an authorized cookies file or browser source only for its intended platform; adapters do not reuse another platform's credentials. Xiaohongshu uses XIAOHONGSHU_COOKIES_FILE or XIAOHONGSHU_COOKIES_FROM_BROWSER when explicitly configured. Public metadata, selected captions/audio/video, and optional community content may be sent to the configured model provider.
Earlier workflow compatibility
The task manager, comparison, follow-up planner and new-question tools are retained through a separate compatibility server. They are absent from the default dist/index.js tool list. Existing integrations that require them can explicitly use this MCP entry instead:
node /absolute/path/to/Catalyst/dist/legacy-research.jsThis entry exposes the 11 source tools plus the earlier nine workflow tools. The task CLI (npm run task -- …) connects to it automatically. Existing task and session records are neither migrated nor deleted; local show, list and delete commands continue to work. For new host integrations, keep conversation state, source selection, comparisons and new-question answering in the harness.
The retained contracts are documented in link tasks, task follow-up, comparison, follow-up planning, selected-round tasks, and long-video follow-up.
Development
npm run dev
npm run typecheck
npm test
npm run buildTests are local and do not require provider credentials or live video platforms. The compiled generic tool has been exercised on YouTube captions, a nonzero YouTube visual window, and Bilibili audio/ASR fallback. The latter returned partial with explicit caption access and discarded-citation warnings. These checks validate integration and citation structure, not model accuracy. Exact observations and deployment checks are listed in validation.
After building, a production deployment can retain dist and install with npm ci --omit=dev. Both npm start and npm run doctor then run compiled JavaScript without tsx; external media dependencies and provider configuration still need to pass doctor.
License
MIT. Original BVR history and attribution are retained.
Available Tools
4 toolsanalyze_bilibili_videoResearch a Bilibili VideoARead-only
Resolves a public Bilibili URL, always returns public metadata and an explicit community-context status, and optionally samples 20 most-liked root comments while displaying only 3 hot comments plus up to 2 distinct high-signal comments. Supports language-only, visual-only, and multimodal research.
Inputs: url (required), mode (required), question (required), end_seconds, +4 more.
analyze_videoAnalyze a Video VisuallyARead-only
Creates an audio-free copy of a local video and sends it to the configured video-analysis provider for visual research. Visible interfaces, code, charts, labels, and subtitles remain usable visual evidence.
Inputs: question (required), video_path (required), media_detail.
analyze_video_urlResearch a Video with CatalystARead-only
Research a public Bilibili or YouTube video using a shared language, vision or multimodal workflow. Returns structured evidence, capability states, source-time precision and explicitly unverified model findings. Source quality follows the available source unless explicitly requested. Comments are opt-in.
Inputs: url (required), mode (required), question (required), language, +6 more. Returns: video, errors, status, request, +7 more
inspect_video_windowInspect a Precise Video WindowARead-only
Extracts an audio-free temporary clip for the requested source-video time window, then sends that clip to the configured video-analysis provider for visual-only analysis. Temporary media and remote uploads are removed after the answer.
Inputs: question (required), video_path (required), end_seconds (required), start_seconds (required), +1 more.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 4 tools
The tools are related but have overlapping boundaries: analyze_video_url and analyze_bilibili_video both handle public video URLs, especially Bilibili, while analyze_video and inspect_video_window both process local videos. Descriptions clarify differences like time windows and comment sampling, but an agent could still hesitate between the URL-based tools.
All names use snake_case and mostly follow an analyze_<target> pattern, but inspect_video_window breaks the verb pattern and analyze_bilibili_video versus analyze_video_url orders the target inconsistently. The deviations are minor and still readable.
Four tools is a reasonable scope for a video-analysis server, covering local video, local time-window clips, and public URL analysis. The count is appropriate, though the Bilibili-specific tool overlaps with the generic URL tool enough to question whether both earn their place.
The surface covers local and remote video analysis, time-window inspection, and Bilibili metadata/comment context, which is a fairly complete lifecycle for visual research. There are minor gaps around broader platform-specific handling and non-visual/audio analysis, but core workflows are covered.
Maintenance
Related MCP Connectors
YouTube transcripts, search, channel/playlist listings and upload tracking for AI agents.
YouTube for AI agents: transcripts, comments, video stats, channel monitor, Shorts captions.
Transcripts, summaries, chapters and timestamped search for video links, for AI agents.
YouTube search, whole channels, video stats, comments and full transcripts with timestamps.
Related MCP Servers
- AlicenseCqualityCmaintenanceEnables AI agents to search, analyze, and extract insights from YouTube videos including transcripts, visual frames, and benchmarks without requiring API keys. Supports semantic search across playlists, sentiment analysis, and visual content indexing with automatic fallback chains for reliable access.41150 npm36MIT
- AlicenseCqualityDmaintenanceEnables AI assistants to research YouTube videos by collecting captions, comments, and channel information for analysis and comparison.1014 PyPI10MIT
- FlicenseAqualityCmaintenanceEnables AI assistants to fetch YouTube video metadata, chapters, and timestamped transcripts (including paginated and language-specific caption retrieval) so they can produce summaries, study notes, comparisons, and source-referenced answers. The returned transcript evidence also carries explicit coverage status, letting the assistant know when a transcript is partial or unavailable.4-
- AlicenseNot gradedqualityBmaintenanceEnables AI agents to read videos from YouTube links, web pages, media URLs, or local files by returning timestamped transcripts, labelled frame contact sheets, and lossless audio or spectrograms. Also searches YouTube, channels, pages, and folders to find videos worth reading.MIT