Skip to main content
Glama

Semantic Cache Query Matcher Skill for Autonomous Agents

MCP Compatible Python 3.9+ License: MIT Zero External Dependencies

High-performance in-memory semantic cache designed to slash LLM inference costs and latency by caching query-response pairs with fuzzy cosine term-vector matching.

Key Features

  • Cosine Term Vector Matching: Zero external vector database; computes term-frequency vector similarity in pure Python.

  • Configurable Similarity Threshold: Tunable confidence threshold (e.g. 0.75 - 0.95) to prevent false-positive matches.

  • Hit Rate Telemetry: Tracks hits, misses, and saved token estimations.

Related MCP server: genpark-agentic-cache-semantic-deduplicator-skill

MCP Server Integration

python mcp_server.py

Available MCP Tools

  • cache_set: Store query and generated response.

  • cache_get: Lookup semantic match for an incoming prompt.

  • cache_stats: Return total entries, hits, and cache utilization.

Maintenance

ActivityMaintained
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables AI agents to store, retrieve, and manage contextual knowledge across sessions using semantic search with PostgreSQL and vector embeddings. Supports memory relationships, clustering, multi-agent isolation, and intelligent caching for persistent conversational context.
    8 npm
    50
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables AI agents to store, recall, update, delete, and analyze persistent memories with semantic search, decay, and anomaly retrieval across hosted, self-hosted, or fully local storage modes.
    31 npm
    22
    MIT