Skip to main content
Glama

Transcribe Audio / Video with Whisper

replicate_transcribe_audio

Transcribe audio or video files to text using Whisper models with automatic language detection and optional English translation.

Instructions

Transcribe an audio or video file to text using Whisper-family models on Replicate.

Args:

  • audio (URL): URL of the audio (or video) to transcribe.

  • model (default "incredibly-fast-whisper"): Curated key (whisper, incredibly-fast-whisper, whisperx, scribe) or "owner/name".

  • language (string, optional): ISO-639 hint (e.g. "en", "it"). Default: auto-detect.

  • translate_to_english (bool, optional): Translate the transcript to English instead of preserving source language.

  • extra_input (object, optional): Model-specific extras (e.g. {batch_size: 24} for incredibly-fast-whisper).

Returns: PredictionResult with text_output containing the transcript.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
audioYesURL of the audio (or video) file to transcribe.
modelNoSpeech-to-text model. Curated: whisper, incredibly-fast-whisper, whisperx, scribe. Or "owner/name".incredibly-fast-whisper
downloadNoOutput is text — default false.
languageNoISO-639 language hint (e.g. 'en', 'it'). Default: auto-detect.
timeout_msNoMax ms to wait for the prediction. If exceeded, returns the prediction ID so you can poll via replicate_get_prediction. Default: 300000 (5min).
extra_inputNo
translate_to_englishNoIf true, translate the transcript to English.
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate readOnlyHint=false and destructiveHint=false, which are consistent with the description (creates a prediction, not destructive). The description adds details on return format (PredictionResult with text_output), timeout behavior (returns prediction ID if exceeded), and model options, providing context beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise and front-loaded with the main purpose. It lists parameters clearly without redundancy. It could be slightly more structured (e.g., separating description from args), but it is efficient and focused.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (7 parameters, nested objects, no output schema), the description covers the return type, timeout behavior, and optional parameters. It does not specify file size limits or supported formats, but these are likely implied by the Replicate platform.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 86% schema coverage, the baseline is 3. The description adds value by explaining the model parameter (curated keys vs 'owner/name'), the translate_to_english boolean, and the extra_input object for model-specific options, which supplements the schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Transcribe an audio or video file to text using Whisper-family models on Replicate', with a specific verb (transcribe) and resource (audio/video to text). It distinguishes itself from sibling tools like replicate_generate_speech (text-to-speech) and replicate_vision (image processing).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for transcription tasks and explains parameters like model selection, language hint, and translation. However, it does not explicitly mention when not to use this tool (e.g., for real-time transcription) or compare to alternatives like replicate_run_model with custom models.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/sena-labs/replicate-mcp-server'

If you have feedback or need assistance with the MCP directory API, please join our Discord server