Semantic Cache Query Matcher
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
Semantic Cache Query Matcher Skill for Autonomous Agents
High-performance in-memory semantic cache designed to slash LLM inference costs and latency by caching query-response pairs with fuzzy cosine term-vector matching.
Key Features
Cosine Term Vector Matching: Zero external vector database; computes term-frequency vector similarity in pure Python.
Configurable Similarity Threshold: Tunable confidence threshold (e.g. 0.75 - 0.95) to prevent false-positive matches.
Hit Rate Telemetry: Tracks hits, misses, and saved token estimations.
Related MCP server: genpark-agentic-cache-semantic-deduplicator-skill
MCP Server Integration
python mcp_server.pyAvailable MCP Tools
cache_set: Store query and generated response.cache_get: Lookup semantic match for an incoming prompt.cache_stats: Return total entries, hits, and cache utilization.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
Semantic answer cache for agents: reuse answers to repeated or reworded questions, $0.002 per hit.
Persistent memory and knowledge management for AI agents with semantic search and 50+ tools.
Universal memory for AI agents and tools. Save, organize and search context anywhere.
Memory system for AI agents with semantic search. Store and recall memories with ease.
Related MCP Servers
- -licenseNot gradedqualityNot gradedmaintenanceSemantic caching MCP server for AI agent tool calls, providing exact and similarity-based cache lookup, store, invalidation, and metrics via MCP tools.-
- FlicenseNot gradedqualityBmaintenanceEnables agents to deduplicate semantic prompt caches by measuring Jaccard token overlap, preventing redundant LLM calls and reducing cost. It provides deterministic lookup-or-insert cache behavior through an MCP-compatible interface.8-
- AlicenseNot gradedqualityBmaintenanceEnables high-throughput semantic query caching and approximate deduplication by combining exact SHA-256 matching, cosine similarity threshold checks, and LRU eviction.7MIT
- AlicenseNot gradedqualityNot gradedmaintenanceEnables agents to cache and deduplicate semantic queries using exact SHA-256 matching and cosine similarity thresholds with LRU eviction, reducing redundant LLM calls and improving throughput.MIT