Skip to main content
Glama
samouh-waleed

PrompyAI

by samouh-waleed
OverviewSchemaSourceRelated ServersDiscussionsAdmin
TypeScript
Local

What It Does

When you write a prompt in Claude CLI, PrompyAI automatically evaluates it against your actual project and returns:

  • Score (0–100) across 4 dimensions

  • Suggestions tailored to your project

  • AI-enhanced prompt rewritten with real file paths, verified symbols, and codebase context

Prompt Score: 43/100 [D]

  Specificity         3/25  ==..............
  Context Completeness 13/25  ========........
  Task Clarity        15/25  =========.......
  File & Folder Anchoring 10/25  ======..........

Key improvements:
  1. Expand your prompt with more context
  2. Add file paths using @mentions
  3. Specify what format you expect the output in
  4. Add acceptance criteria

Try something more like:

  "Build the VS Code extension in packages/vscode-extension/ that integrates
   with the PrompyAI MCP server at packages/mcp-server/. It should provide
   real-time prompt scoring in the editor sidebar, show score breakdowns
   (specificity, context, clarity, anchoring), and offer a 'rewrite prompt'
   action. Use the shared types from packages/shared/."

Related MCP server: PromptArchitect MCP

Quick Start

claude mcp add prompyai -- npx prompyai-mcp serve

That's it. No sign-up, no config files. Works immediately.

Requires Node.js 20+ and Claude CLI.

How AI Enhancement Works

PrompyAI uses a two-layer architecture so all users get AI-enhanced output:

User type

How it works

API key users (ANTHROPIC_API_KEY set)

PrompyAI calls Claude Haiku directly for fast, dedicated AI rewrites

Subscription users (no API key)

PrompyAI returns codebase context to Claude, and Claude itself generates the enhanced prompt using your existing session

Either way, the enhanced prompt is grounded in your real project — actual file paths, verified function names, and project architecture.

Scoring Dimensions

Each dimension scores 0–25, total 0–100.

Dimension

What it measures

Specificity

Concrete actions vs vague verbs, output format, quantitative constraints

Context Completeness

File references, error messages, expected vs actual behavior

Task Clarity

Single focused task, success criteria, unambiguous language

File & Folder Anchoring

@mentions, project entity references, verified symbol names

Grades: A (90+) · B (70+) · C (50+) · D (30+) · F (<30)

Features

  • Auto-scoring — Evaluates every prompt automatically, no manual trigger needed

  • AI-enhanced for everyone — API key users get Haiku rewrites; subscription users get Claude-powered rewrites via codebase context

  • Context-aware — Indexes your file tree, tech stack, git state, and code symbols via the TypeScript Compiler API

  • Session-aware — Reads Claude Code conversation history for multi-turn context

  • Symbol verification — Confirms that function/class names you reference actually exist in your code

  • Monorepo support — Detects tech stacks across workspace packages

  • Toggle — Say "pause prompyai" or "enable prompyai" at any time

MCP Tools

evaluate_prompt

Automatically called on every user message. Scores your prompt against your project.

Parameter

Required

Description

prompt

yes

The prompt text to evaluate

workspace_path

yes

Absolute path to your project

active_file

no

Currently open file path

session_id

no

Claude Code session ID for multi-turn context

get_context

Returns your project summary: tech stack, recent files, key folders, AI instruction files.

Parameter

Required

Description

workspace_path

yes

Absolute path to your project

prompyai_toggle

Turns auto-evaluation on or off.

Parameter

Required

Description

enabled

yes

true to enable, false to disable

Environment Variables

Variable

Required

Description

ANTHROPIC_API_KEY

No

Enables direct AI suggestions via Claude Haiku (optional — works without it)

PROMPYAI_TELEMETRY

No

Set to false to opt out of anonymous telemetry

Architecture

PrompyAI/
├── packages/
│   ├── mcp-server/     ← Core product (npm: prompyai-mcp)
│   ├── landing/        ← Website (prompyai.com)
│   └── shared/         ← Shared types for future IDE extensions
├── CLAUDE.md
└── README.md

Scoring Pipeline

User prompt
  → WorkspaceIndexer (file tree, stack, symbols)
  → ContextResolver (map prompt to codebase)
  → HeuristicScorer (20+ rules, 4 dimensions)
  → AISuggestionGenerator (Haiku or Claude-as-AI-layer)
  → DisplayFormatter (pre-formatted output)

Development

pnpm install          # Install dependencies
pnpm test             # Run tests (220 tests)
pnpm typecheck        # Type check
pnpm build            # Build

Links

License

MIT

This server cannot be deployed

One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

Maintenance

ActivityInactive
ResponsivenessNo issues

Resources

Related MCP Connectors

Related MCP Servers

  • MCP Prompt Enhancer

    soniankur948
    F
    license
    Not graded
    quality
    D
    maintenance
    Intelligently analyzes codebases to enhance LLM prompts with relevant context, featuring adaptive context management and task detection to produce higher quality AI responses.
    2
    -

  • PromptArchitect MCP

    MerabyLabs
    F
    license
    A
    quality
    C
    maintenance
    Refines and improves AI prompts using workspace-aware context from your project's tech stack, structure, and dependencies. Includes tools to analyze prompt quality and generate well-structured prompts from raw ideas.
    4
    209 npm
    5
    -

  • vibe-prompt-mcp

    saurabhjambure-pixel
    A
    license
    D
    quality
    C
    maintenance
    Fix your vibe coding prompts before they reach the AI. Scores and rewrites across 4 dimensions — no API key, no server, just npx. Now with codebase-aware context injection for design, database, API, auth, testing, and state management.
    2
    4 npm
    MIT
  • ctxray by ctxray

    ctxrayofficial

    ctxray
    A
    license
    Not graded
    quality
    C
    maintenance
    Context intelligence for AI coding sessions. 7 MCP tools to score, compare, compress, build, and scan prompts across 9 AI tools. Rule-based, <5ms/prompt, all analysis runs locally.
    46
    MIT