Skip to main content
Glama
Semantic Cache Query Matcher

Semantic Cache Query Matcher

by Alpha-Park

Semantic Cache Query Matcher Skill for Autonomous Agents

MCP Compatible Python 3.9+ License: MIT Zero External Dependencies

High-performance in-memory semantic cache designed to slash LLM inference costs and latency by caching query-response pairs with fuzzy cosine term-vector matching.

Key Features

  • Cosine Term Vector Matching: Zero external vector database; computes term-frequency vector similarity in pure Python.

  • Configurable Similarity Threshold: Tunable confidence threshold (e.g. 0.75 - 0.95) to prevent false-positive matches.

  • Hit Rate Telemetry: Tracks hits, misses, and saved token estimations.

Related MCP server: genpark-agentic-cache-semantic-deduplicator-skill

MCP Server Integration

python mcp_server.py

Available MCP Tools

  • cache_set: Store query and generated response.

  • cache_get: Lookup semantic match for an incoming prompt.

  • cache_stats: Return total entries, hits, and cache utilization.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    Related MCP Connectors

    Related MCP Servers

    • -
      license
      Not graded
      quality
      Not graded
      maintenance
      Semantic caching MCP server for AI agent tool calls, providing exact and similarity-based cache lookup, store, invalidation, and metrics via MCP tools.
      -