Skip to main content
Glama

Semantic Cache Query Matcher Skill for Autonomous Agents

MCP Compatible Python 3.9+ License: MIT Zero External Dependencies

High-performance in-memory semantic cache designed to slash LLM inference costs and latency by caching query-response pairs with fuzzy cosine term-vector matching.

Key Features

  • Cosine Term Vector Matching: Zero external vector database; computes term-frequency vector similarity in pure Python.

  • Configurable Similarity Threshold: Tunable confidence threshold (e.g. 0.75 - 0.95) to prevent false-positive matches.

  • Hit Rate Telemetry: Tracks hits, misses, and saved token estimations.

Related MCP server: genpark-agentic-cache-semantic-deduplicator-skill

MCP Server Integration

python mcp_server.py

Available MCP Tools

  • cache_set: Store query and generated response.

  • cache_get: Lookup semantic match for an incoming prompt.

  • cache_stats: Return total entries, hits, and cache utilization.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    Related MCP Connectors

    Related MCP Servers

    • A
      license
      Not graded
      quality
      D
      maintenance
      Enables AI agents to store, retrieve, and manage contextual knowledge across sessions using semantic search with PostgreSQL and vector embeddings. Supports memory relationships, clustering, multi-agent isolation, and intelligent caching for persistent conversational context.
      62 npm
      50
      MIT
    • A
      license
      Not graded
      quality
      D
      maintenance
      Enables AI agents to store, recall, update, delete, and analyze persistent memories with semantic search, decay, and anomaly retrieval across hosted, self-hosted, or fully local storage modes.
      46 npm
      23
      MIT