Skip to main content
Glama
slider79

Vellum

by slider79

Vellum

An MCP server that gives exact answers about text · By Shuja Jamal

A language model reads tokens, not characters. Ask one how many letters are in a paragraph and it estimates, often badly. The same is true of diffing two files by eye, or predicting what a regular expression will match without running it.

These are not hard problems. They are simply not the kind of problem a model is built to solve. So it should ask instead.

Live

vellum-mcp.vercel.app

Smithery

sjshujaj/vellum

Write-up

EXPERIENCE.md, on using existing MCPs before building this


The five tools

Tool

What it answers

Instead of

count_text

Characters, words, lines, sentences, bytes

an estimate from token count

score_readability

Flesch reading ease, grade level, longest sentence

an impression

diff_texts

Unified diff, lines added and removed, similarity

reading both and describing

test_regex

Every match, its position and capture groups

reasoning about the pattern

hash_text

md5, sha1, sha256, sha512

nothing, it cannot

count_text reports visible characters separately from code points, because café is four characters to a person, five to len(), and six bytes. Which of those you want depends on why you asked, so it returns all three.


Related MCP server: Text Counter MCP Server

Using it

Claude Code

claude mcp add --transport http vellum https://vellum-mcp.vercel.app/mcp

Or locally, over stdio:

claude mcp add vellum -- python -m vellum.server

One thing that cost me time when installing somebody else's server: a server added mid-session shows as connected but its tools are not callable until the session restarts. A working install and a usable install are different states.

Claude Desktop

In claude_desktop_config.json:

{
  "mcpServers": {
    "vellum": {
      "command": "python",
      "args": ["-m", "vellum.server"],
      "cwd": "/path/to/vellum-mcp"
    }
  }
}

Running it

pip install -r requirements.txt
python -m vellum.server

That is stdio, which is what a local client speaks. For the HTTP transport and the landing page:

python -m vellum.server --http --port 8000

Then http://localhost:8000 for the page and http://localhost:8000/mcp for the endpoint.


Testing

python tests/test_vellum.py

46 checks. The first half calls the analysis functions directly. The second half is the part that matters: it launches the server as a subprocess and speaks MCP to it, doing the real handshake, listing the tools, calling them and reading the results back. A server whose functions are correct can still fail to speak the protocol, and only the second half would catch that.

python tests/test_deploy.py

Checks the deployed shape before deploying it: that a rewritten request reaches the MCP app at the path it expects, that ?action=demo reaches the demo instead, that the static server card describes tools that actually exist, and that there is exactly one function because that is what the runtime builds.


Deploying

Vercel, for the hosting

vercel

No environment variables and no secrets: every tool is a pure function of its arguments.

The routing is deliberate and worth explaining, because the obvious version does not work.

A Vercel rewrite does not hand the function the path the browser asked for. Rewriting /(.*) to a single function means every request arrives as /api/index, so an app that routes on path answers every URL with its own 404 while looking, from outside, completely dead. I lost an afternoon to exactly that on an earlier project.

And the Python runtime builds one function for the whole project, not one per file. I had api/demo.py sitting next to api/index.py, declared in vercel.json and bundled into the deployment, and /api/demo still returned Vercel's own 404. vercel inspect showed the reason plainly: a single python lambda. Filesystem routing across several Python entrypoints does not happen.

So the deployment is one function plus static files:

/                                  static    public/index.html
/.well-known/mcp/server-card.json  static    generated by build_card.py
/mcp             -> /api/index     function
/api/demo        -> /api/index     function, told apart by ?action=demo

api/index.py dispatches on the query string, because that is the part a rewrite preserves while it replaces the path, and it puts the path back before the MCP app routes on it. There are tests for both, because neither is something you want to discover from a live URL.

The two things that worked first time were the landing page and the server card, and they are exactly the two that never touch a function.

Smithery, for the listing

Smithery's current model is bring your own hosting: you give it a public HTTPS URL to a streamable HTTP server and its gateway proxies to it. There is no container to build.

  1. Deploy to Vercel first and note the URL

  2. Go to smithery.ai/new

  3. Enter https://your-deployment.vercel.app/mcp

  4. Complete the publishing flow

Smithery then reads the server's tools for the listing page. The documented path is a live scan, with a static card at /.well-known/mcp/server-card.json as the fallback when a scan cannot complete.

In practice the fallback was the primary path. The publish log reads:

Server metadata discovered (server card: 5 tools).
Using .well-known/mcp/server-card.json: (5 tools)

So the card was not insurance against a failure, it was the mechanism. build_card.py generates it from the server's own tool definitions, which is why it could not have listed tools that do not exist.

The log also warns that no config schema was provided. That is correct and intended here: every tool is a pure function of its arguments, so there is nothing to prompt a user for. The warning matters for a server that wraps an API and needs a key.

smithery.yaml records the details the publishing flow asks for. Note that it does not drive a build: the older container-based deployment path is no longer how this works.

Both tiers are free. Vercel's hobby tier hosts the function and the static files; Smithery's registry listing costs nothing.


How it is put together

vellum/
  analysis.py    the actual work, with no MCP anywhere in it
  server.py      the five tools, their descriptions, and the transports
api/
  index.py       the one Vercel function: MCP, and the demo behind a query flag
public/
  index.html     the landing page
  .well-known/mcp/server-card.json   generated
tests/
  test_vellum.py  analysis, then a real MCP handshake over stdio
  test_deploy.py  the routing and the card

analysis.py imports nothing from MCP. That is what lets the tests call it directly, and it is why the landing page's demo can call the same functions the tools call rather than being a second implementation that drifts.


Notes on writing tools for a model

The description is the interface. It is not documentation for a developer; it is the only thing the model reads when deciding whether a tool is relevant. A vague one means the tool is never chosen, a wrong one means it is chosen at the wrong moment. So count_text does not say "returns a dictionary of counts". It says to use this when the answer needs to be a precise number, because reading tokens is not the same as counting characters.

Failure should be readable. A broken regex comes back as {"valid": false, "error": ...} rather than an exception, and an unknown hash algorithm names the ones that exist. A model can act on that; it cannot act on a stack trace.

Pick something the model genuinely cannot do. The temptation is to wrap an API and call it a tool, but a "summarise this text" tool adds a network round trip to something the model already does better itself. Counting, hashing and running a regex are real gaps. Filling a real gap is what makes a tool get used rather than politely ignored.


By Shuja Jamal, August 2026.

Available Tools

5 tools
count_textCount textA

Count characters, words, lines, sentences and bytes in a piece of text, exactly. Use this whenever the answer needs to be a precise number, because reading tokens is not the same as counting characters. Reports visible characters separately from code points, which differ for accents and emoji.

ParametersJSON Schema
NameRequiredDescriptionDefault
textYesThe text to measure.

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden. It discloses a key behavioral nuance: reports visible characters separately from code points, which differ for accents and emoji. It also guarantees exact counting. This adds meaningful context beyond the title, though it does not cover edge cases like empty input.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences with zero filler. It front-loads the core function ('Count characters, words, lines, sentences and bytes') and then adds usage guidance and a behavioral nuance, all in a compact structure.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple one-parameter tool with no output schema, the description covers the main operational aspects: what is counted, precision, and the visible-character/codepoint distinction. It does not explicitly state the return format or handle edge cases, but the described behavior is sufficient for an agent to invoke it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already describes the 'text' parameter with 100% coverage, so the baseline is 3. The description does not add further parameter-specific detail, such as encoding or size limits, so it neither enhances nor detracts from the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description explicitly states the tool counts characters, words, lines, sentences, and bytes, with a specific verb and resource. It also emphasizes exactness and distinguishes from token-based reading, making the purpose unambiguous even without naming siblings.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear guidance on when to use the tool: 'whenever the answer needs to be a precise number.' It also explains why ('reading tokens is not the same as counting characters'). It does not explicitly list alternative tools or exclusion conditions, so it stops short of full when/when-not coverage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

diff_textsDiff two textsA

Compare two versions of a text and return a unified diff plus exact counts of lines added and removed and a similarity percentage. Use it rather than reading both versions and describing the difference.

ParametersJSON Schema
NameRequiredDescriptionDefault
afterYesThe changed text.
beforeYesThe original text.
contextNoContext lines around each change.

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden. It discloses the tool's outputs (unified diff, line counts, similarity percentage) and its read-only nature implicitly. It does not list limitations or side effects, but since this is a pure comparison function, the disclosed behavior is adequate and clear.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences with zero filler. The core behavior is stated first, followed by a direct usage recommendation. It is efficient and front-loaded, earning a perfect score for conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with three parameters, two required, and no output schema, the description adequately covers what the tool does and what it returns. It does not specify the exact diff format or similarity algorithm, but these are likely not essential for correct invocation. The description is sufficient for an agent to call this tool accurately.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema provides 100% coverage with descriptions for all parameters ('original text', 'changed text', 'context lines around each change'). The tool description itself adds no additional meaning to the parameters—it only mentions the purpose in general terms. Since schema coverage is full, the baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's function: compare two versions of a text and return a unified diff, exact line counts added/removed, and a similarity percentage. It uses a specific verb and resource, and it differentiates from siblings by explicitly contrasting with manual description, making the purpose unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides direct usage guidance by saying 'Use it rather than reading both versions and describing the difference,' which tells the agent when to prefer this tool over the obvious alternative. It does not discuss edge cases or exclusions, but for a simple diff tool this is sufficient context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

hash_textHash textA

Compute a cryptographic hash of some text. Deterministic, and not something that can be worked out by reading.

ParametersJSON Schema
NameRequiredDescriptionDefault
textYesThe text to hash.
algorithmNoWhich digest to use.sha256

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present, so the description carries the behavioral burden. It does add useful traits: determinism and non-reversibility ('not something that can be worked out by reading'). However, it does not mention output encoding, the effect of the selected algorithm, or whether any side effects exist, leaving a moderately complete behavioral picture.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is short, front-loaded with the core action, and free of filler. The second sentence is slightly vague, but it contributes a behavioral distinction rather than padding, so the length and structure are strong.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple two-parameter tool with fully described schema fields and an algorithm enum/default, the description covers the essential invocation context. It does not specify the return format, but that is a minor gap given the task's simplicity and the absence of an output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so both text and algorithm are already documented in the schema. The description adds no new parameter-level meaning beyond 'some text', so the baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific action and resource: 'Compute a cryptographic hash of some text'. This clearly distinguishes it from the sibling text-analysis tools (count_text, score_readability, diff_texts, test_regex), leaving no ambiguity about what the tool does.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no explicit guidance about when to use this tool versus alternatives. The intended usage is implied by the self-describing operation, but the description does not state conditions, exclusions, or when a sibling tool would be more appropriate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

score_readabilityScore readabilityA

Score how hard a piece of text is to read, using Flesch reading ease and a grade level, with a plain description of what the number means. Also reports the longest sentence, which is usually the reason prose scores badly.

ParametersJSON Schema
NameRequiredDescriptionDefault
textYesThe prose to score.

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It goes beyond a simple one-liner by explaining not only the metrics (Flesch ease, grade level) but also that it provides a plain-language interpretation of the number and reports the longest sentence as a likely cause of poor readability. This gives the agent a clear picture of what the tool does and what it outputs, though it does not mention every detail (e.g., range of scores or edge cases).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences with zero filler. The main purpose is front-loaded ('Score how hard a piece of text is to read'), followed by the specific metrics and an additional behavior (longest sentence). Every sentence earns its place and the structure is highly efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given there is no output schema, the description does a good job of explaining what the tool returns: Flesch score, grade level, plain language interpretation, and longest sentence. This is sufficient for an agent to understand the tool's behavior and call it correctly. It could be more complete by specifying numeric ranges or examples, but those are not strictly necessary for correct invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%: the only parameter 'text' is described as 'The prose to score.' The description adds minimal semantic value beyond this, only referring to 'a piece of text' and 'prose' again. Since the schema fully documents the parameter, a baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's function: scoring how hard a text is to read, with specific metrics (Flesch reading ease and grade level). It also distinguishes itself from all sibling tools (count, diff, regex, hash) by focusing on readability assessment. The verb 'score' and resource 'a piece of text' are specific and unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage through its purpose: use this when you need readability metrics for prose. However, it does not explicitly state when to use this tool versus alternatives, nor does it mention exclusions or specific conditions. Since the sibling tools are clearly different (counting, diffing, regex testing, hashing), the intended use is inferable but not explicitly articulated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

test_regexTest a regular expressionA

Run a regular expression against text and report every match with its position and capture groups. An invalid pattern comes back as an error message rather than an exception. Use it to check a pattern actually does what it looks like it does.

ParametersJSON Schema
NameRequiredDescriptionDefault
textYesThe text to search.
flagsNoAny of i (ignore case), m (multiline), s (dotall), x (verbose).
patternYesThe regular expression, in Python syntax.

TDQS

A4.5/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations present, the description fully carries the behavioral burden. It discloses the return content (all matches, positions, capture groups), error handling for invalid patterns, and the read-only nature of the operation. This is meaningful behavioral information beyond what the schema provides.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three short sentences, each earning its place: the first states the core action and output, the second clarifies error behavior, and the third gives the intended use case. It is front-loaded and contains no filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple regex-testing utility, the description provides everything an agent needs: the operation, the output shape, error handling, and the use case. There is no output schema, so the description appropriately fills that gap by explaining what the tool reports.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents pattern, text, and flags. The description adds a little context by mentioning positions and capture groups, but it does not need to describe parameters further since the schema already does so adequately.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific action ('Run a regular expression against text') and a precise output ('every match with its position and capture groups'). It also distinguishes this from sibling tools like count_text, score_readability, diff_texts, and hash_text by focusing on regex behavior rather than counting, scoring, diffing, or hashing.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The final sentence gives a clear usage context: 'Use it to check a pattern actually does what it looks like it does.' This tells an agent when the tool is appropriate, though it does not explicitly name alternative tools or state when not to use it. The context is clear enough that an agent can route to this tool for regex verification.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 5 tool updatesv1.0.0
    • First observedcount_text
    • First observeddiff_texts
    • First observedhash_text
    • First observedscore_readability
    • First observedtest_regex

TDQS

A4.2/5.0

Scored across 5 tools

Disambiguation5/5

Each tool performs a unique, clearly distinguishable operation: counting metrics, readability assessment, diffing, regex testing, and hashing. There is no overlap or ambiguity between them, so an agent can reliably pick the right tool for a given task.

Naming Consistency5/5

All tool names follow a consistent verb_noun pattern (count_text, score_readability, diff_texts, test_regex, hash_text) using snake_case throughout. The naming is predictable and immediately conveys the action and object.

Tool Count5/5

With exactly five tools, the server is well-scoped for a text utility purpose. Each tool covers a distinct need without bloat, and the count is within the ideal range for clarity and usability.

Completeness4/5

The set covers core text analysis and manipulation operations (counting, readability, diffing, regex, hashing). Minor gaps like string transformation or encoding conversion exist, but these are not obvious dead-ends for the primary use cases, so the surface is reasonably complete.

Maintenance

ActivityMaintained
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • A
    license
    A
    quality
    C
    maintenance
    Provides a tool to calculate basic text metrics including character count, characters without spaces, and word count.
    1
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Provides text statistics and readability scores (Flesch Reading Ease, Flesch-Kincaid Grade Level) via offline, keyless tools.
    5 npm
    MIT
  • F
    license
    A
    quality
    B
    maintenance
    Provides 9 text processing tools for analysis, sentiment, language detection, summarization, spelling, and readability tips.
    9
    -