wDVC MCP
OfficialGenerates Docker run commands for wDVC data download workers, with configurable resources like CPUs, memory, and shared memory.
Provides tools for architecting DVC data pipelines, including pipeline stage blueprints, worker queue patterns, and project scaffolding.
Provides usage examples for the Gradio web UI, enabling queue submission and status monitoring for wDVC pipelines.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@wDVC MCPGenerate a Docker worker command for data download"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
wDVC MCP
wDVC MCP — Model Context Protocol server for wDVC (DVC Data Pipeline Management). Provides tools for architecting DVC pipelines, generating Docker worker commands for data download, and scaffolding wDVC projects.
Features
Feature | Description |
Architect Blueprints | Complete reference for DVC pipeline stages, worker queue, Gradio API, file downloader |
Docker Worker Command | Generate exact |
API Usage | Gradio web UI examples for queue submission and status monitoring |
Pattern Catalog | Searchable patterns from official/community repos with local fallbacks |
Project Scaffolding | Generate complete wDVC project structure with templates |
Type Safety | Fully typed, mypy clean |
Related MCP server: @lex-tools/codebase-context-dumper
Installation
pip install wdvc-mcpOr for development:
git clone https://github.com/wisrovi/wDVC-mcp.git
cd wDVC-mcp
pip install -e ".[dev]"
pre-commit installQuick Start
Run the MCP Server
# Stdio transport (for Claude Desktop, etc.)
wdvc-mcp
# SSE transport (for HTTP clients)
wdvc-mcp --transport sse --port 8000Available Tools
Tool | Description |
| Complete reference for all wDVC patterns |
| Generate Docker run command for data download |
| Gradio web UI usage examples |
| Search pattern catalog |
Example: Get Docker Worker Command
from wdvc_mcp.server import get_wdvc_worker_command
# Default command
cmd = get_wdvc_worker_command()
print(cmd)Output:
mkdir -p ./projects
docker run -it --rm \
--name worker \
--hostname wDVC \
--shm-size=16g \
--cpus="4.0" \
--memory="4g" \
-e IP_HOST=192.168.1.84 \
-e REDIS_HOST=192.168.10.108 \
-v ./projects:/app/projects \
-w /app \
wisrovi/dataset-ia:worker-v1 \
zshCustomize the Command
cmd = get_wdvc_worker_command(
ip_host="10.0.0.1",
redis_host="10.0.0.2",
projects_path="/data/my_projects",
image="myorg/dataset-ia:latest",
cpus="8.0",
memory="16g",
shm_size="32g",
)Project Scaffolding
Generate a complete wDVC project structure:
from wdvc_mcp.templates import TemplateGenerator
bp = TemplateGenerator.get_files_blueprint("standard", "my_pipeline")
# bp contains: main.py, config/settings.py, worker/worker.py, api/api.py,
# dvc.yaml, Dockerfile.worker, docker-compose.worker.yaml, run_worker.sh, etc.Scaffold Types
Type | Description | Folders |
| Full worker + API + config | config, worker, api, scripts, tests, .wdvc |
| Worker only | config, worker, scripts, tests, .wdvc |
| API only | config, api, tests, .wdvc |
| Everything + CI/CD | config, worker, api, scripts, pipeline, tests, examples, .wdvc, .github/workflows |
Architecture
��─────────────────────────────────────────────────────────────��
│ wDVC Architecture │
├─────────────────────────────────────────────────────────────��
│ │
│ ��──────────────�� ��──────────────�� ��──────────────�� │
│ │ Gradio UI │ │ Python SDK │ │ MCP Tools │ │
│ │ (api.py) │ │ (worker.py) │ │ (server.py) │ │
│ └──────��───────�� └──────��───────�� └──────��───────�� │
│ │ │ │ │
│ └───────────────────��───────────────────�� │
│ �� │
│ ��─────────────────────�� │
│ │ Redis (wredis) │ │
│ │ Queue + Hash + │ │
│ │ SortedSet │ │
│ └──────────��──────────�� │
│ │ │
│ ��───────────────────��───────────────────�� │
│ �� �� �� │
│ ��─────────────�� ��─────────────�� ��─────────────�� │
│ │ Docker │ │ DVC Pipeline│ │ S3 Remote │ │
│ │ Worker │ │ (dvc.yaml) │ │ (DVC push) │ │
│ │ (container) │ │ │ │ │ │
│ └─────────────�� └─────────────�� └─────────────�� │
│ │
��─────────────────────────────────────────────────────────────��Development
# Install dev dependencies
pip install -e ".[dev]"
# Run tests
make test
# Run with coverage
make test-cov
# Lint & format
make lint
make format
# Type check
make typecheck
# Build package
make build
# Publish to PyPI
make publishConfiguration
Environment Variables
Variable | Default | Description |
|
| Redis server hostname |
|
| Redis server port |
|
| Redis database number |
|
| Redis password |
| Auto-detected | Worker IP for registration |
Docker Worker
The worker container requires:
Redis accessible at
REDIS_HOSTVolume mount for
projects/(contains DVC repo + data)Resources: 4 CPUs, 4GB RAM, 16GB SHM (configurable)
Related Projects
wredis - Redis control with Python (sync/async, decorators, HA)
wredis-mcp - MCP server for wRedis architecting
wsqlite - SQLite with Pydantic models
wsqlite-mcp - MCP server for wSQLite
wpipe - Pipeline orchestration
wpipe-mcp - MCP server for wPipe
License
MIT — see LICENSE for details.
Generated by wDVC MCP by wisrovi
👤 Autor & Afiliación Oficial
William Steve Rodriguez Villamizar (Wisrovi)
Cargo: Principal AI Engineer & Applied AI Solutions Architect | Scientific Researcher
📧 Email: wisrovi.rodriguez@gmail.com
🌐 Portal Oficial: wisrovi.dev
💼 LinkedIn: wisrovi-rodriguez
🆔 ORCID: 0009-0005-0710-1861
📦 PyPI: pypi.org/user/wisrovi/
🐙 GitHub: @wisrovi
This server cannot be deployed
Maintenance
Related MCP Connectors
A Model Context Protocol server for Wix AI tools
MCP server for progressive tool usage at any scale (see https://klavis.ai)
Model Context Protocol server for the Apideck Unified API. Connect any MCP-compatible agent framework to 100+ accounting systems, HRIS platforms, file storage providers, and more through one integration. More information https://www.apideck.com/mcp-server
Model Context Protocol server for Studex tools, notifications, and profile integrations
Related MCP Servers
- FlicenseNot gradedqualityDmaintenanceThis server implements the Model Context Protocol to facilitate meaningful interaction and understanding development between humans and AI through structured tools and progressive interaction patterns.57-
- AlicenseAqualityDmaintenanceA Model Context Protocol (MCP) server designed to easily dump your codebase context into Large Language Models (LLMs).16 npm3Apache 2.0
- AlicenseBqualityDmaintenanceA Model Context Protocol (MCP) server based on OpenRPC, providing JSON-RPC function invocation and method discovery services.21Apache 2.0
- AlicenseNot gradedqualityDmaintenanceModel Context Protocol server that standardizes tool discovery, execution, and context management for AI applications.MIT