Skip to main content
Glama
index.html92.2 kB
<!doctype html> <html lang="en" class="no-js"> <head> <meta charset="utf-8"> <meta name="viewport" content="width=device-width,initial-scale=1"> <meta name="description" content="Memory persistence for AI assistants with temporal decay"> <meta name="author" content="prefrontal-systems"> <link rel="canonical" href="https://cortexgraph.dev/architecture/"> <link rel="prev" href="../configuration/"> <link rel="next" href="../api/"> <link rel="icon" href="../assets/images/favicon.png"> <meta name="generator" content="mkdocs-1.6.1, mkdocs-material-9.7.0"> <title>Architecture - CortexGraph Documentation</title> <link rel="stylesheet" href="../assets/stylesheets/main.618322db.min.css"> <link rel="stylesheet" href="../assets/stylesheets/palette.ab4e12ef.min.css"> <link rel="preconnect" href="https://fonts.gstatic.com" crossorigin> <link rel="stylesheet" href="https://fonts.googleapis.com/css?family=Roboto:300,300i,400,400i,700,700i%7CRoboto+Mono:400,400i,700,700i&display=fallback"> <style>:root{--md-text-font:"Roboto";--md-code-font:"Roboto Mono"}</style> <script>__md_scope=new URL("..",location),__md_hash=e=>[...e].reduce(((e,_)=>(e<<5)-e+_.charCodeAt(0)),0),__md_get=(e,_=localStorage,t=__md_scope)=>JSON.parse(_.getItem(t.pathname+"."+e)),__md_set=(e,_,t=localStorage,a=__md_scope)=>{try{t.setItem(a.pathname+"."+e,JSON.stringify(_))}catch(e){}}</script> </head> <body dir="ltr" data-md-color-scheme="default" data-md-color-primary="indigo" data-md-color-accent="indigo"> <input class="md-toggle" data-md-toggle="drawer" type="checkbox" id="__drawer" autocomplete="off"> <input class="md-toggle" data-md-toggle="search" type="checkbox" id="__search" autocomplete="off"> <label class="md-overlay" for="__drawer"></label> <div data-md-component="skip"> <a href="#cortexgraph-architecture" class="md-skip"> Skip to content </a> </div> <div data-md-component="announce"> </div> <header class="md-header" data-md-component="header"> <nav class="md-header__inner md-grid" aria-label="Header"> <a href=".." title="CortexGraph Documentation" class="md-header__button md-logo" aria-label="CortexGraph Documentation" data-md-component="logo"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M12 8a3 3 0 0 0 3-3 3 3 0 0 0-3-3 3 3 0 0 0-3 3 3 3 0 0 0 3 3m0 3.54C9.64 9.35 6.5 8 3 8v11c3.5 0 6.64 1.35 9 3.54 2.36-2.19 5.5-3.54 9-3.54V8c-3.5 0-6.64 1.35-9 3.54"/></svg> </a> <label class="md-header__button md-icon" for="__drawer"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M3 6h18v2H3zm0 5h18v2H3zm0 5h18v2H3z"/></svg> </label> <div class="md-header__title" data-md-component="header-title"> <div class="md-header__ellipsis"> <div class="md-header__topic"> <span class="md-ellipsis"> CortexGraph Documentation </span> </div> <div class="md-header__topic" data-md-component="header-topic"> <span class="md-ellipsis"> Architecture </span> </div> </div> </div> <form class="md-header__option" data-md-component="palette"> <input class="md-option" data-md-color-media="(prefers-color-scheme: light)" data-md-color-scheme="default" data-md-color-primary="indigo" data-md-color-accent="indigo" aria-label="Switch to dark mode" type="radio" name="__palette" id="__palette_0"> <label class="md-header__button md-icon" title="Switch to dark mode" for="__palette_1" hidden> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M12 8a4 4 0 0 0-4 4 4 4 0 0 0 4 4 4 4 0 0 0 4-4 4 4 0 0 0-4-4m0 10a6 6 0 0 1-6-6 6 6 0 0 1 6-6 6 6 0 0 1 6 6 6 6 0 0 1-6 6m8-9.31V4h-4.69L12 .69 8.69 4H4v4.69L.69 12 4 15.31V20h4.69L12 23.31 15.31 20H20v-4.69L23.31 12z"/></svg> </label> <input class="md-option" data-md-color-media="(prefers-color-scheme: dark)" data-md-color-scheme="slate" data-md-color-primary="indigo" data-md-color-accent="indigo" aria-label="Switch to light mode" type="radio" name="__palette" id="__palette_1"> <label class="md-header__button md-icon" title="Switch to light mode" for="__palette_0" hidden> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M12 18c-.89 0-1.74-.2-2.5-.55C11.56 16.5 13 14.42 13 12s-1.44-4.5-3.5-5.45C10.26 6.2 11.11 6 12 6a6 6 0 0 1 6 6 6 6 0 0 1-6 6m8-9.31V4h-4.69L12 .69 8.69 4H4v4.69L.69 12 4 15.31V20h4.69L12 23.31 15.31 20H20v-4.69L23.31 12z"/></svg> </label> </form> <script>var palette=__md_get("__palette");if(palette&&palette.color){if("(prefers-color-scheme)"===palette.color.media){var media=matchMedia("(prefers-color-scheme: light)"),input=document.querySelector(media.matches?"[data-md-color-media='(prefers-color-scheme: light)']":"[data-md-color-media='(prefers-color-scheme: dark)']");palette.color.media=input.getAttribute("data-md-color-media"),palette.color.scheme=input.getAttribute("data-md-color-scheme"),palette.color.primary=input.getAttribute("data-md-color-primary"),palette.color.accent=input.getAttribute("data-md-color-accent")}for(var[key,value]of Object.entries(palette.color))document.body.setAttribute("data-md-color-"+key,value)}</script> <label class="md-header__button md-icon" for="__search"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M9.5 3A6.5 6.5 0 0 1 16 9.5c0 1.61-.59 3.09-1.56 4.23l.27.27h.79l5 5-1.5 1.5-5-5v-.79l-.27-.27A6.52 6.52 0 0 1 9.5 16 6.5 6.5 0 0 1 3 9.5 6.5 6.5 0 0 1 9.5 3m0 2C7 5 5 7 5 9.5S7 14 9.5 14 14 12 14 9.5 12 5 9.5 5"/></svg> </label> <div class="md-search" data-md-component="search" role="dialog"> <label class="md-search__overlay" for="__search"></label> <div class="md-search__inner" role="search"> <form class="md-search__form" name="search"> <input type="text" class="md-search__input" name="query" aria-label="Search" placeholder="Search" autocapitalize="off" autocorrect="off" autocomplete="off" spellcheck="false" data-md-component="search-query" required> <label class="md-search__icon md-icon" for="__search"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M9.5 3A6.5 6.5 0 0 1 16 9.5c0 1.61-.59 3.09-1.56 4.23l.27.27h.79l5 5-1.5 1.5-5-5v-.79l-.27-.27A6.52 6.52 0 0 1 9.5 16 6.5 6.5 0 0 1 3 9.5 6.5 6.5 0 0 1 9.5 3m0 2C7 5 5 7 5 9.5S7 14 9.5 14 14 12 14 9.5 12 5 9.5 5"/></svg> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M20 11v2H8l5.5 5.5-1.42 1.42L4.16 12l7.92-7.92L13.5 5.5 8 11z"/></svg> </label> <nav class="md-search__options" aria-label="Search"> <button type="reset" class="md-search__icon md-icon" title="Clear" aria-label="Clear" tabindex="-1"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M19 6.41 17.59 5 12 10.59 6.41 5 5 6.41 10.59 12 5 17.59 6.41 19 12 13.41 17.59 19 19 17.59 13.41 12z"/></svg> </button> </nav> <div class="md-search__suggest" data-md-component="search-suggest"></div> </form> <div class="md-search__output"> <div class="md-search__scrollwrap" tabindex="0" data-md-scrollfix> <div class="md-search-result" data-md-component="search-result"> <div class="md-search-result__meta"> Initializing search </div> <ol class="md-search-result__list" role="presentation"></ol> </div> </div> </div> </div> </div> <div class="md-header__source"> <a href="https://github.com/prefrontal-systems/cortexgraph" title="Go to repository" class="md-source" data-md-component="source"> <div class="md-source__icon md-icon"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 512 512"><!--! Font Awesome Free 7.1.0 by @fontawesome - https://fontawesome.com License - https://fontawesome.com/license/free (Icons: CC BY 4.0, Fonts: SIL OFL 1.1, Code: MIT License) Copyright 2025 Fonticons, Inc.--><path d="M173.9 397.4c0 2-2.3 3.6-5.2 3.6-3.3.3-5.6-1.3-5.6-3.6 0-2 2.3-3.6 5.2-3.6 3-.3 5.6 1.3 5.6 3.6m-31.1-4.5c-.7 2 1.3 4.3 4.3 4.9 2.6 1 5.6 0 6.2-2s-1.3-4.3-4.3-5.2c-2.6-.7-5.5.3-6.2 2.3m44.2-1.7c-2.9.7-4.9 2.6-4.6 4.9.3 2 2.9 3.3 5.9 2.6 2.9-.7 4.9-2.6 4.6-4.6-.3-1.9-3-3.2-5.9-2.9M252.8 8C114.1 8 8 113.3 8 252c0 110.9 69.8 205.8 169.5 239.2 12.8 2.3 17.3-5.6 17.3-12.1 0-6.2-.3-40.4-.3-61.4 0 0-70 15-84.7-29.8 0 0-11.4-29.1-27.8-36.6 0 0-22.9-15.7 1.6-15.4 0 0 24.9 2 38.6 25.8 21.9 38.6 58.6 27.5 72.9 20.9 2.3-16 8.8-27.1 16-33.7-55.9-6.2-112.3-14.3-112.3-110.5 0-27.5 7.6-41.3 23.6-58.9-2.6-6.5-11.1-33.3 2.6-67.9 20.9-6.5 69 27 69 27 20-5.6 41.5-8.5 62.8-8.5s42.8 2.9 62.8 8.5c0 0 48.1-33.6 69-27 13.7 34.7 5.2 61.4 2.6 67.9 16 17.7 25.8 31.5 25.8 58.9 0 96.5-58.9 104.2-114.8 110.5 9.2 7.9 17 22.9 17 46.4 0 33.7-.3 75.4-.3 83.6 0 6.5 4.6 14.4 17.3 12.1C436.2 457.8 504 362.9 504 252 504 113.3 391.5 8 252.8 8M105.2 352.9c-1.3 1-1 3.3.7 5.2 1.6 1.6 3.9 2.3 5.2 1 1.3-1 1-3.3-.7-5.2-1.6-1.6-3.9-2.3-5.2-1m-10.8-8.1c-.7 1.3.3 2.9 2.3 3.9 1.6 1 3.6.7 4.3-.7.7-1.3-.3-2.9-2.3-3.9-2-.6-3.6-.3-4.3.7m32.4 35.6c-1.6 1.3-1 4.3 1.3 6.2 2.3 2.3 5.2 2.6 6.5 1 1.3-1.3.7-4.3-1.3-6.2-2.2-2.3-5.2-2.6-6.5-1m-11.4-14.7c-1.6 1-1.6 3.6 0 5.9s4.3 3.3 5.6 2.3c1.6-1.3 1.6-3.9 0-6.2-1.4-2.3-4-3.3-5.6-2"/></svg> </div> <div class="md-source__repository"> prefrontal-systems/cortexgraph </div> </a> </div> </nav> </header> <div class="md-container" data-md-component="container"> <nav class="md-tabs" aria-label="Tabs" data-md-component="tabs"> <div class="md-grid"> <ul class="md-tabs__list"> <li class="md-tabs__item"> <a href=".." class="md-tabs__link"> Home </a> </li> <li class="md-tabs__item"> <a href="../installation/" class="md-tabs__link"> Getting Started </a> </li> <li class="md-tabs__item md-tabs__item--active"> <a href="./" class="md-tabs__link"> Documentation </a> </li> <li class="md-tabs__item"> <a href="../deployment/" class="md-tabs__link"> Deployment </a> </li> <li class="md-tabs__item"> <a href="../CONTRIBUTING/" class="md-tabs__link"> Development </a> </li> <li class="md-tabs__item"> <a href="../features/auto-recall-conversation/" class="md-tabs__link"> Features </a> </li> <li class="md-tabs__item"> <a href="../LICENSE/" class="md-tabs__link"> About </a> </li> </ul> </div> </nav> <main class="md-main" data-md-component="main"> <div class="md-main__inner md-grid"> <div class="md-sidebar md-sidebar--primary" data-md-component="sidebar" data-md-type="navigation" > <div class="md-sidebar__scrollwrap"> <div class="md-sidebar__inner"> <nav class="md-nav md-nav--primary md-nav--lifted" aria-label="Navigation" data-md-level="0"> <label class="md-nav__title" for="__drawer"> <a href=".." title="CortexGraph Documentation" class="md-nav__button md-logo" aria-label="CortexGraph Documentation" data-md-component="logo"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M12 8a3 3 0 0 0 3-3 3 3 0 0 0-3-3 3 3 0 0 0-3 3 3 3 0 0 0 3 3m0 3.54C9.64 9.35 6.5 8 3 8v11c3.5 0 6.64 1.35 9 3.54 2.36-2.19 5.5-3.54 9-3.54V8c-3.5 0-6.64 1.35-9 3.54"/></svg> </a> CortexGraph Documentation </label> <div class="md-nav__source"> <a href="https://github.com/prefrontal-systems/cortexgraph" title="Go to repository" class="md-source" data-md-component="source"> <div class="md-source__icon md-icon"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 512 512"><!--! Font Awesome Free 7.1.0 by @fontawesome - https://fontawesome.com License - https://fontawesome.com/license/free (Icons: CC BY 4.0, Fonts: SIL OFL 1.1, Code: MIT License) Copyright 2025 Fonticons, Inc.--><path d="M173.9 397.4c0 2-2.3 3.6-5.2 3.6-3.3.3-5.6-1.3-5.6-3.6 0-2 2.3-3.6 5.2-3.6 3-.3 5.6 1.3 5.6 3.6m-31.1-4.5c-.7 2 1.3 4.3 4.3 4.9 2.6 1 5.6 0 6.2-2s-1.3-4.3-4.3-5.2c-2.6-.7-5.5.3-6.2 2.3m44.2-1.7c-2.9.7-4.9 2.6-4.6 4.9.3 2 2.9 3.3 5.9 2.6 2.9-.7 4.9-2.6 4.6-4.6-.3-1.9-3-3.2-5.9-2.9M252.8 8C114.1 8 8 113.3 8 252c0 110.9 69.8 205.8 169.5 239.2 12.8 2.3 17.3-5.6 17.3-12.1 0-6.2-.3-40.4-.3-61.4 0 0-70 15-84.7-29.8 0 0-11.4-29.1-27.8-36.6 0 0-22.9-15.7 1.6-15.4 0 0 24.9 2 38.6 25.8 21.9 38.6 58.6 27.5 72.9 20.9 2.3-16 8.8-27.1 16-33.7-55.9-6.2-112.3-14.3-112.3-110.5 0-27.5 7.6-41.3 23.6-58.9-2.6-6.5-11.1-33.3 2.6-67.9 20.9-6.5 69 27 69 27 20-5.6 41.5-8.5 62.8-8.5s42.8 2.9 62.8 8.5c0 0 48.1-33.6 69-27 13.7 34.7 5.2 61.4 2.6 67.9 16 17.7 25.8 31.5 25.8 58.9 0 96.5-58.9 104.2-114.8 110.5 9.2 7.9 17 22.9 17 46.4 0 33.7-.3 75.4-.3 83.6 0 6.5 4.6 14.4 17.3 12.1C436.2 457.8 504 362.9 504 252 504 113.3 391.5 8 252.8 8M105.2 352.9c-1.3 1-1 3.3.7 5.2 1.6 1.6 3.9 2.3 5.2 1 1.3-1 1-3.3-.7-5.2-1.6-1.6-3.9-2.3-5.2-1m-10.8-8.1c-.7 1.3.3 2.9 2.3 3.9 1.6 1 3.6.7 4.3-.7.7-1.3-.3-2.9-2.3-3.9-2-.6-3.6-.3-4.3.7m32.4 35.6c-1.6 1.3-1 4.3 1.3 6.2 2.3 2.3 5.2 2.6 6.5 1 1.3-1.3.7-4.3-1.3-6.2-2.2-2.3-5.2-2.6-6.5-1m-11.4-14.7c-1.6 1-1.6 3.6 0 5.9s4.3 3.3 5.6 2.3c1.6-1.3 1.6-3.9 0-6.2-1.4-2.3-4-3.3-5.6-2"/></svg> </div> <div class="md-source__repository"> prefrontal-systems/cortexgraph </div> </a> </div> <ul class="md-nav__list" data-md-scrollfix> <li class="md-nav__item"> <a href=".." class="md-nav__link"> <span class="md-ellipsis"> Home </span> </a> </li> <li class="md-nav__item md-nav__item--nested"> <input class="md-nav__toggle md-toggle md-toggle--indeterminate" type="checkbox" id="__nav_2" > <label class="md-nav__link" for="__nav_2" id="__nav_2_label" tabindex="0"> <span class="md-ellipsis"> Getting Started </span> <span class="md-nav__icon md-icon"></span> </label> <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_2_label" aria-expanded="false"> <label class="md-nav__title" for="__nav_2"> <span class="md-nav__icon md-icon"></span> Getting Started </label> <ul class="md-nav__list" data-md-scrollfix> <li class="md-nav__item"> <a href="../installation/" class="md-nav__link"> <span class="md-ellipsis"> Installation </span> </a> </li> <li class="md-nav__item"> <a href="../quickstart/" class="md-nav__link"> <span class="md-ellipsis"> Quick Start </span> </a> </li> <li class="md-nav__item"> <a href="../configuration/" class="md-nav__link"> <span class="md-ellipsis"> Configuration </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item md-nav__item--active md-nav__item--section md-nav__item--nested"> <input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_3" checked> <label class="md-nav__link" for="__nav_3" id="__nav_3_label" tabindex=""> <span class="md-ellipsis"> Documentation </span> <span class="md-nav__icon md-icon"></span> </label> <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_3_label" aria-expanded="true"> <label class="md-nav__title" for="__nav_3"> <span class="md-nav__icon md-icon"></span> Documentation </label> <ul class="md-nav__list" data-md-scrollfix> <li class="md-nav__item md-nav__item--active"> <input class="md-nav__toggle md-toggle" type="checkbox" id="__toc"> <label class="md-nav__link md-nav__link--active" for="__toc"> <span class="md-ellipsis"> Architecture </span> <span class="md-nav__icon md-icon"></span> </label> <a href="./" class="md-nav__link md-nav__link--active"> <span class="md-ellipsis"> Architecture </span> </a> <nav class="md-nav md-nav--secondary" aria-label="Table of contents"> <label class="md-nav__title" for="__toc"> <span class="md-nav__icon md-icon"></span> Table of contents </label> <ul class="md-nav__list" data-md-component="toc" data-md-scrollfix> <li class="md-nav__item"> <a href="#overview" class="md-nav__link"> <span class="md-ellipsis"> Overview </span> </a> </li> <li class="md-nav__item"> <a href="#core-concepts" class="md-nav__link"> <span class="md-ellipsis"> Core Concepts </span> </a> <nav class="md-nav" aria-label="Core Concepts"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#temporal-decay" class="md-nav__link"> <span class="md-ellipsis"> Temporal Decay </span> </a> </li> <li class="md-nav__item"> <a href="#half-life" class="md-nav__link"> <span class="md-ellipsis"> Half-Life </span> </a> </li> <li class="md-nav__item"> <a href="#reinforcement" class="md-nav__link"> <span class="md-ellipsis"> Reinforcement </span> </a> </li> <li class="md-nav__item"> <a href="#promotion-criteria" class="md-nav__link"> <span class="md-ellipsis"> Promotion Criteria </span> </a> </li> <li class="md-nav__item"> <a href="#garbage-collection" class="md-nav__link"> <span class="md-ellipsis"> Garbage Collection </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#natural-spaced-repetition" class="md-nav__link"> <span class="md-ellipsis"> Natural Spaced Repetition </span> </a> <nav class="md-nav" aria-label="Natural Spaced Repetition"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#review-priority-calculation" class="md-nav__link"> <span class="md-ellipsis"> Review Priority Calculation </span> </a> </li> <li class="md-nav__item"> <a href="#cross-domain-usage-detection" class="md-nav__link"> <span class="md-ellipsis"> Cross-Domain Usage Detection </span> </a> </li> <li class="md-nav__item"> <a href="#automatic-reinforcement" class="md-nav__link"> <span class="md-ellipsis"> Automatic Reinforcement </span> </a> </li> <li class="md-nav__item"> <a href="#blended-search-results" class="md-nav__link"> <span class="md-ellipsis"> Blended Search Results </span> </a> </li> <li class="md-nav__item"> <a href="#configuration" class="md-nav__link"> <span class="md-ellipsis"> Configuration </span> </a> </li> <li class="md-nav__item"> <a href="#memory-model-extensions" class="md-nav__link"> <span class="md-ellipsis"> Memory Model Extensions </span> </a> </li> <li class="md-nav__item"> <a href="#usage-pattern-conversational" class="md-nav__link"> <span class="md-ellipsis"> Usage Pattern (Conversational) </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#system-architecture" class="md-nav__link"> <span class="md-ellipsis"> System Architecture </span> </a> <nav class="md-nav" aria-label="System Architecture"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#layers" class="md-nav__link"> <span class="md-ellipsis"> Layers </span> </a> </li> <li class="md-nav__item"> <a href="#storage-format-jsonl" class="md-nav__link"> <span class="md-ellipsis"> Storage Format (JSONL) </span> </a> </li> <li class="md-nav__item"> <a href="#memory-states" class="md-nav__link"> <span class="md-ellipsis"> Memory States </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#data-flow" class="md-nav__link"> <span class="md-ellipsis"> Data Flow </span> </a> <nav class="md-nav" aria-label="Data Flow"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#saving-a-memory" class="md-nav__link"> <span class="md-ellipsis"> Saving a Memory </span> </a> </li> <li class="md-nav__item"> <a href="#searching-memories" class="md-nav__link"> <span class="md-ellipsis"> Searching Memories </span> </a> </li> <li class="md-nav__item"> <a href="#touching-a-memory" class="md-nav__link"> <span class="md-ellipsis"> Touching a Memory </span> </a> </li> <li class="md-nav__item"> <a href="#promotion-flow" class="md-nav__link"> <span class="md-ellipsis"> Promotion Flow </span> </a> </li> <li class="md-nav__item"> <a href="#garbage-collection_1" class="md-nav__link"> <span class="md-ellipsis"> Garbage Collection </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#clustering-for-consolidation" class="md-nav__link"> <span class="md-ellipsis"> Clustering for Consolidation </span> </a> <nav class="md-nav" aria-label="Clustering for Consolidation"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#similarity-based-clustering" class="md-nav__link"> <span class="md-ellipsis"> Similarity-Based Clustering </span> </a> </li> <li class="md-nav__item"> <a href="#cluster-actions" class="md-nav__link"> <span class="md-ellipsis"> Cluster Actions </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#integration-points" class="md-nav__link"> <span class="md-ellipsis"> Integration Points </span> </a> <nav class="md-nav" aria-label="Integration Points"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#basic-memory-obsidian" class="md-nav__link"> <span class="md-ellipsis"> Basic Memory (Obsidian) </span> </a> </li> <li class="md-nav__item"> <a href="#sentence-transformers-optional" class="md-nav__link"> <span class="md-ellipsis"> Sentence Transformers (Optional) </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#performance-considerations" class="md-nav__link"> <span class="md-ellipsis"> Performance Considerations </span> </a> <nav class="md-nav" aria-label="Performance Considerations"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#database" class="md-nav__link"> <span class="md-ellipsis"> Database </span> </a> </li> <li class="md-nav__item"> <a href="#embeddings" class="md-nav__link"> <span class="md-ellipsis"> Embeddings </span> </a> </li> <li class="md-nav__item"> <a href="#scaling" class="md-nav__link"> <span class="md-ellipsis"> Scaling </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#configuration-tuning" class="md-nav__link"> <span class="md-ellipsis"> Configuration Tuning </span> </a> <nav class="md-nav" aria-label="Configuration Tuning"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#decay-rate" class="md-nav__link"> <span class="md-ellipsis"> Decay Rate (λ) </span> </a> </li> <li class="md-nav__item"> <a href="#thresholds" class="md-nav__link"> <span class="md-ellipsis"> Thresholds </span> </a> </li> <li class="md-nav__item"> <a href="#use-count-weight" class="md-nav__link"> <span class="md-ellipsis"> Use Count Weight (β) </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#future-enhancements" class="md-nav__link"> <span class="md-ellipsis"> Future Enhancements </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="../api/" class="md-nav__link"> <span class="md-ellipsis"> API Reference </span> </a> </li> <li class="md-nav__item"> <a href="../graph_features/" class="md-nav__link"> <span class="md-ellipsis"> Knowledge Graph </span> </a> </li> <li class="md-nav__item"> <a href="../scoring_algorithm/" class="md-nav__link"> <span class="md-ellipsis"> Scoring Algorithm </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item md-nav__item--nested"> <input class="md-nav__toggle md-toggle md-toggle--indeterminate" type="checkbox" id="__nav_4" > <label class="md-nav__link" for="__nav_4" id="__nav_4_label" tabindex="0"> <span class="md-ellipsis"> Deployment </span> <span class="md-nav__icon md-icon"></span> </label> <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_4_label" aria-expanded="false"> <label class="md-nav__title" for="__nav_4"> <span class="md-nav__icon md-icon"></span> Deployment </label> <ul class="md-nav__list" data-md-scrollfix> <li class="md-nav__item"> <a href="../deployment/" class="md-nav__link"> <span class="md-ellipsis"> Deployment Guide </span> </a> </li> <li class="md-nav__item"> <a href="../security/" class="md-nav__link"> <span class="md-ellipsis"> Security </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item md-nav__item--nested"> <input class="md-nav__toggle md-toggle md-toggle--indeterminate" type="checkbox" id="__nav_5" > <label class="md-nav__link" for="__nav_5" id="__nav_5_label" tabindex="0"> <span class="md-ellipsis"> Development </span> <span class="md-nav__icon md-icon"></span> </label> <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_5_label" aria-expanded="false"> <label class="md-nav__title" for="__nav_5"> <span class="md-nav__icon md-icon"></span> Development </label> <ul class="md-nav__list" data-md-scrollfix> <li class="md-nav__item"> <a href="../CONTRIBUTING/" class="md-nav__link"> <span class="md-ellipsis"> Contributing </span> </a> </li> <li class="md-nav__item"> <a href="../ROADMAP/" class="md-nav__link"> <span class="md-ellipsis"> Roadmap </span> </a> </li> <li class="md-nav__item"> <a href="../future_roadmap/" class="md-nav__link"> <span class="md-ellipsis"> Future Plans </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item md-nav__item--nested"> <input class="md-nav__toggle md-toggle md-toggle--indeterminate" type="checkbox" id="__nav_6" > <label class="md-nav__link" for="__nav_6" id="__nav_6_label" tabindex="0"> <span class="md-ellipsis"> Features </span> <span class="md-nav__icon md-icon"></span> </label> <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_6_label" aria-expanded="false"> <label class="md-nav__title" for="__nav_6"> <span class="md-nav__icon md-icon"></span> Features </label> <ul class="md-nav__list" data-md-scrollfix> <li class="md-nav__item"> <a href="../features/auto-recall-conversation/" class="md-nav__link"> <span class="md-ellipsis"> Auto-Recall </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item md-nav__item--nested"> <input class="md-nav__toggle md-toggle md-toggle--indeterminate" type="checkbox" id="__nav_7" > <label class="md-nav__link" for="__nav_7" id="__nav_7_label" tabindex="0"> <span class="md-ellipsis"> About </span> <span class="md-nav__icon md-icon"></span> </label> <nav class="md-nav" data-md-level="1" aria-labelledby="__nav_7_label" aria-expanded="false"> <label class="md-nav__title" for="__nav_7"> <span class="md-nav__icon md-icon"></span> About </label> <ul class="md-nav__list" data-md-scrollfix> <li class="md-nav__item"> <a href="../LICENSE/" class="md-nav__link"> <span class="md-ellipsis"> License </span> </a> </li> <li class="md-nav__item"> <a href="../CHANGELOG/" class="md-nav__link"> <span class="md-ellipsis"> Changelog </span> </a> </li> </ul> </nav> </li> </ul> </nav> </div> </div> </div> <div class="md-sidebar md-sidebar--secondary" data-md-component="sidebar" data-md-type="toc" > <div class="md-sidebar__scrollwrap"> <div class="md-sidebar__inner"> <nav class="md-nav md-nav--secondary" aria-label="Table of contents"> <label class="md-nav__title" for="__toc"> <span class="md-nav__icon md-icon"></span> Table of contents </label> <ul class="md-nav__list" data-md-component="toc" data-md-scrollfix> <li class="md-nav__item"> <a href="#overview" class="md-nav__link"> <span class="md-ellipsis"> Overview </span> </a> </li> <li class="md-nav__item"> <a href="#core-concepts" class="md-nav__link"> <span class="md-ellipsis"> Core Concepts </span> </a> <nav class="md-nav" aria-label="Core Concepts"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#temporal-decay" class="md-nav__link"> <span class="md-ellipsis"> Temporal Decay </span> </a> </li> <li class="md-nav__item"> <a href="#half-life" class="md-nav__link"> <span class="md-ellipsis"> Half-Life </span> </a> </li> <li class="md-nav__item"> <a href="#reinforcement" class="md-nav__link"> <span class="md-ellipsis"> Reinforcement </span> </a> </li> <li class="md-nav__item"> <a href="#promotion-criteria" class="md-nav__link"> <span class="md-ellipsis"> Promotion Criteria </span> </a> </li> <li class="md-nav__item"> <a href="#garbage-collection" class="md-nav__link"> <span class="md-ellipsis"> Garbage Collection </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#natural-spaced-repetition" class="md-nav__link"> <span class="md-ellipsis"> Natural Spaced Repetition </span> </a> <nav class="md-nav" aria-label="Natural Spaced Repetition"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#review-priority-calculation" class="md-nav__link"> <span class="md-ellipsis"> Review Priority Calculation </span> </a> </li> <li class="md-nav__item"> <a href="#cross-domain-usage-detection" class="md-nav__link"> <span class="md-ellipsis"> Cross-Domain Usage Detection </span> </a> </li> <li class="md-nav__item"> <a href="#automatic-reinforcement" class="md-nav__link"> <span class="md-ellipsis"> Automatic Reinforcement </span> </a> </li> <li class="md-nav__item"> <a href="#blended-search-results" class="md-nav__link"> <span class="md-ellipsis"> Blended Search Results </span> </a> </li> <li class="md-nav__item"> <a href="#configuration" class="md-nav__link"> <span class="md-ellipsis"> Configuration </span> </a> </li> <li class="md-nav__item"> <a href="#memory-model-extensions" class="md-nav__link"> <span class="md-ellipsis"> Memory Model Extensions </span> </a> </li> <li class="md-nav__item"> <a href="#usage-pattern-conversational" class="md-nav__link"> <span class="md-ellipsis"> Usage Pattern (Conversational) </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#system-architecture" class="md-nav__link"> <span class="md-ellipsis"> System Architecture </span> </a> <nav class="md-nav" aria-label="System Architecture"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#layers" class="md-nav__link"> <span class="md-ellipsis"> Layers </span> </a> </li> <li class="md-nav__item"> <a href="#storage-format-jsonl" class="md-nav__link"> <span class="md-ellipsis"> Storage Format (JSONL) </span> </a> </li> <li class="md-nav__item"> <a href="#memory-states" class="md-nav__link"> <span class="md-ellipsis"> Memory States </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#data-flow" class="md-nav__link"> <span class="md-ellipsis"> Data Flow </span> </a> <nav class="md-nav" aria-label="Data Flow"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#saving-a-memory" class="md-nav__link"> <span class="md-ellipsis"> Saving a Memory </span> </a> </li> <li class="md-nav__item"> <a href="#searching-memories" class="md-nav__link"> <span class="md-ellipsis"> Searching Memories </span> </a> </li> <li class="md-nav__item"> <a href="#touching-a-memory" class="md-nav__link"> <span class="md-ellipsis"> Touching a Memory </span> </a> </li> <li class="md-nav__item"> <a href="#promotion-flow" class="md-nav__link"> <span class="md-ellipsis"> Promotion Flow </span> </a> </li> <li class="md-nav__item"> <a href="#garbage-collection_1" class="md-nav__link"> <span class="md-ellipsis"> Garbage Collection </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#clustering-for-consolidation" class="md-nav__link"> <span class="md-ellipsis"> Clustering for Consolidation </span> </a> <nav class="md-nav" aria-label="Clustering for Consolidation"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#similarity-based-clustering" class="md-nav__link"> <span class="md-ellipsis"> Similarity-Based Clustering </span> </a> </li> <li class="md-nav__item"> <a href="#cluster-actions" class="md-nav__link"> <span class="md-ellipsis"> Cluster Actions </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#integration-points" class="md-nav__link"> <span class="md-ellipsis"> Integration Points </span> </a> <nav class="md-nav" aria-label="Integration Points"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#basic-memory-obsidian" class="md-nav__link"> <span class="md-ellipsis"> Basic Memory (Obsidian) </span> </a> </li> <li class="md-nav__item"> <a href="#sentence-transformers-optional" class="md-nav__link"> <span class="md-ellipsis"> Sentence Transformers (Optional) </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#performance-considerations" class="md-nav__link"> <span class="md-ellipsis"> Performance Considerations </span> </a> <nav class="md-nav" aria-label="Performance Considerations"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#database" class="md-nav__link"> <span class="md-ellipsis"> Database </span> </a> </li> <li class="md-nav__item"> <a href="#embeddings" class="md-nav__link"> <span class="md-ellipsis"> Embeddings </span> </a> </li> <li class="md-nav__item"> <a href="#scaling" class="md-nav__link"> <span class="md-ellipsis"> Scaling </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#configuration-tuning" class="md-nav__link"> <span class="md-ellipsis"> Configuration Tuning </span> </a> <nav class="md-nav" aria-label="Configuration Tuning"> <ul class="md-nav__list"> <li class="md-nav__item"> <a href="#decay-rate" class="md-nav__link"> <span class="md-ellipsis"> Decay Rate (λ) </span> </a> </li> <li class="md-nav__item"> <a href="#thresholds" class="md-nav__link"> <span class="md-ellipsis"> Thresholds </span> </a> </li> <li class="md-nav__item"> <a href="#use-count-weight" class="md-nav__link"> <span class="md-ellipsis"> Use Count Weight (β) </span> </a> </li> </ul> </nav> </li> <li class="md-nav__item"> <a href="#future-enhancements" class="md-nav__link"> <span class="md-ellipsis"> Future Enhancements </span> </a> </li> </ul> </nav> </div> </div> </div> <div class="md-content" data-md-component="content"> <article class="md-content__inner md-typeset"> <a href="https://github.com/prefrontal-systems/cortexgraph/edit/main/docs/architecture.md" title="Edit this page" class="md-content__button md-icon" rel="edit"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M10 20H6V4h7v5h5v3.1l2-2V8l-6-6H6c-1.1 0-2 .9-2 2v16c0 1.1.9 2 2 2h4zm10.2-7c.1 0 .3.1.4.2l1.3 1.3c.2.2.2.6 0 .8l-1 1-2.1-2.1 1-1c.1-.1.2-.2.4-.2m0 3.9L14.1 23H12v-2.1l6.1-6.1z"/></svg> </a> <h1 id="cortexgraph-architecture">CortexGraph Architecture<a class="headerlink" href="#cortexgraph-architecture" title="Permanent link">&para;</a></h1> <h2 id="overview">Overview<a class="headerlink" href="#overview" title="Permanent link">&para;</a></h2> <p>CortexGraph implements a biologically-inspired memory system with temporal decay and reinforcement, designed to give AI assistants human-like memory dynamics.</p> <h2 id="core-concepts">Core Concepts<a class="headerlink" href="#core-concepts" title="Permanent link">&para;</a></h2> <h3 id="temporal-decay">Temporal Decay<a class="headerlink" href="#temporal-decay" title="Permanent link">&para;</a></h3> <p>Memories naturally fade over time using exponential decay:</p> <div class="highlight"><pre><span></span><code><a id="__codelineno-0-1" name="__codelineno-0-1" href="#__codelineno-0-1"></a>score(t) = (use_count^β) * exp(-λ * Δt) * strength </code></pre></div> <p>Where: - <code>Δt = now - last_used</code> (time since last access) - <code>λ</code> (lambda): Decay constant controlling decay rate - <code>β</code> (beta): Exponent weighting the importance of use_count - <code>strength</code>: Base multiplier (1.0-2.0)</p> <h3 id="half-life">Half-Life<a class="headerlink" href="#half-life" title="Permanent link">&para;</a></h3> <p>The decay constant λ is typically defined by a half-life period:</p> <div class="highlight"><pre><span></span><code><a id="__codelineno-1-1" name="__codelineno-1-1" href="#__codelineno-1-1"></a>λ = ln(2) / halflife_seconds </code></pre></div> <p>Default: 3-day half-life → <code>λ ≈ 2.673e-6</code></p> <p>This means a memory's score will drop to 50% of its current value after 3 days without access.</p> <h3 id="reinforcement">Reinforcement<a class="headerlink" href="#reinforcement" title="Permanent link">&para;</a></h3> <p>Each time a memory is accessed: 1. <code>last_used</code> is updated to current time (resets decay) 2. <code>use_count</code> is incremented (increases base score) 3. Optionally, <code>strength</code> can be boosted (max 2.0)</p> <p>This implements a "use it or lose it" principle: frequently accessed information persists.</p> <h3 id="promotion-criteria">Promotion Criteria<a class="headerlink" href="#promotion-criteria" title="Permanent link">&para;</a></h3> <p>A memory is promoted to long-term storage if:</p> <p><strong>Score-based</strong>: <code>score &gt;= promote_threshold</code> (default: 0.65)</p> <p>OR</p> <p><strong>Usage-based</strong>: <code>use_count &gt;= N</code> (default: 5) within time window (default: 14 days)</p> <p>Once promoted, the memory is: 1. Written to Obsidian vault as a Markdown note 2. Marked as <code>PROMOTED</code> in the database 3. Retained with a redirect pointer to the vault location</p> <h3 id="garbage-collection">Garbage Collection<a class="headerlink" href="#garbage-collection" title="Permanent link">&para;</a></h3> <p>Memories are forgotten (deleted) if:</p> <p><code>score &lt; forget_threshold</code> (default: 0.05)</p> <p>This prevents indefinite accumulation of unused memories.</p> <h2 id="natural-spaced-repetition">Natural Spaced Repetition<a class="headerlink" href="#natural-spaced-repetition" title="Permanent link">&para;</a></h2> <p>CortexGraph implements a natural spaced repetition system inspired by how humans remember concepts better when they appear across different contexts - the "Maslow effect" (remembering Maslow's hierarchy better when it appears in history, economics, and sociology classes).</p> <p><strong>Key principle:</strong> No flashcards, no explicit review sessions. Reinforcement happens naturally through conversation.</p> <h3 id="review-priority-calculation">Review Priority Calculation<a class="headerlink" href="#review-priority-calculation" title="Permanent link">&para;</a></h3> <p>Memories are prioritized for review based on their position in the "danger zone" - the decay score range where memories are most at risk of being forgotten:</p> <div class="highlight"><pre><span></span><code><a id="__codelineno-2-1" name="__codelineno-2-1" href="#__codelineno-2-1"></a><span class="k">def</span><span class="w"> </span><span class="nf">calculate_review_priority</span><span class="p">(</span><span class="n">memory</span><span class="p">:</span> <span class="n">Memory</span><span class="p">)</span> <span class="o">-&gt;</span> <span class="nb">float</span><span class="p">:</span> <a id="__codelineno-2-2" name="__codelineno-2-2" href="#__codelineno-2-2"></a><span class="w"> </span><span class="sd">&quot;&quot;&quot;Calculate review priority using inverted parabola curve.</span> <a id="__codelineno-2-3" name="__codelineno-2-3" href="#__codelineno-2-3"></a> <a id="__codelineno-2-4" name="__codelineno-2-4" href="#__codelineno-2-4"></a><span class="sd"> Priority peaks at the midpoint of the danger zone (0.25 by default).</span> <a id="__codelineno-2-5" name="__codelineno-2-5" href="#__codelineno-2-5"></a><span class="sd"> Returns 0.0-1.0 priority score.</span> <a id="__codelineno-2-6" name="__codelineno-2-6" href="#__codelineno-2-6"></a><span class="sd"> &quot;&quot;&quot;</span> <a id="__codelineno-2-7" name="__codelineno-2-7" href="#__codelineno-2-7"></a> <span class="n">score</span> <span class="o">=</span> <span class="n">calculate_score</span><span class="p">(</span><span class="n">memory</span><span class="p">)</span> <a id="__codelineno-2-8" name="__codelineno-2-8" href="#__codelineno-2-8"></a> <a id="__codelineno-2-9" name="__codelineno-2-9" href="#__codelineno-2-9"></a> <span class="k">if</span> <span class="n">score</span> <span class="o">&lt;</span> <span class="n">danger_zone_min</span> <span class="ow">or</span> <span class="n">score</span> <span class="o">&gt;</span> <span class="n">danger_zone_max</span><span class="p">:</span> <a id="__codelineno-2-10" name="__codelineno-2-10" href="#__codelineno-2-10"></a> <span class="k">return</span> <span class="mf">0.0</span> <span class="c1"># Outside danger zone</span> <a id="__codelineno-2-11" name="__codelineno-2-11" href="#__codelineno-2-11"></a> <a id="__codelineno-2-12" name="__codelineno-2-12" href="#__codelineno-2-12"></a> <span class="c1"># Inverted parabola: peaks at midpoint</span> <a id="__codelineno-2-13" name="__codelineno-2-13" href="#__codelineno-2-13"></a> <span class="n">midpoint</span> <span class="o">=</span> <span class="p">(</span><span class="n">danger_zone_min</span> <span class="o">+</span> <span class="n">danger_zone_max</span><span class="p">)</span> <span class="o">/</span> <span class="mi">2</span> <a id="__codelineno-2-14" name="__codelineno-2-14" href="#__codelineno-2-14"></a> <span class="n">range_width</span> <span class="o">=</span> <span class="n">danger_zone_max</span> <span class="o">-</span> <span class="n">danger_zone_min</span> <a id="__codelineno-2-15" name="__codelineno-2-15" href="#__codelineno-2-15"></a> <a id="__codelineno-2-16" name="__codelineno-2-16" href="#__codelineno-2-16"></a> <span class="c1"># Normalize to 0-1 range</span> <a id="__codelineno-2-17" name="__codelineno-2-17" href="#__codelineno-2-17"></a> <span class="n">normalized</span> <span class="o">=</span> <span class="p">(</span><span class="n">score</span> <span class="o">-</span> <span class="n">danger_zone_min</span><span class="p">)</span> <span class="o">/</span> <span class="n">range_width</span> <a id="__codelineno-2-18" name="__codelineno-2-18" href="#__codelineno-2-18"></a> <a id="__codelineno-2-19" name="__codelineno-2-19" href="#__codelineno-2-19"></a> <span class="c1"># Inverted parabola: 1 - 4*(x - 0.5)^2</span> <a id="__codelineno-2-20" name="__codelineno-2-20" href="#__codelineno-2-20"></a> <span class="n">priority</span> <span class="o">=</span> <span class="mf">1.0</span> <span class="o">-</span> <span class="mf">4.0</span> <span class="o">*</span> <span class="p">(</span><span class="n">normalized</span> <span class="o">-</span> <span class="mf">0.5</span><span class="p">)</span> <span class="o">**</span> <span class="mi">2</span> <a id="__codelineno-2-21" name="__codelineno-2-21" href="#__codelineno-2-21"></a> <a id="__codelineno-2-22" name="__codelineno-2-22" href="#__codelineno-2-22"></a> <span class="k">return</span> <span class="nb">max</span><span class="p">(</span><span class="mf">0.0</span><span class="p">,</span> <span class="nb">min</span><span class="p">(</span><span class="mf">1.0</span><span class="p">,</span> <span class="n">priority</span><span class="p">))</span> </code></pre></div> <p><strong>Danger zone defaults:</strong> - Lower bound: 0.15 (memories decaying rapidly) - Upper bound: 0.35 (memories still reasonably strong) - Peak priority: 0.25 (midpoint - maximum urgency)</p> <h3 id="cross-domain-usage-detection">Cross-Domain Usage Detection<a class="headerlink" href="#cross-domain-usage-detection" title="Permanent link">&para;</a></h3> <p>The system detects when memories are used in different contexts by comparing the memory's original tags with the current conversation context tags:</p> <div class="highlight"><pre><span></span><code><a id="__codelineno-3-1" name="__codelineno-3-1" href="#__codelineno-3-1"></a><span class="k">def</span><span class="w"> </span><span class="nf">detect_cross_domain_usage</span><span class="p">(</span><span class="n">memory</span><span class="p">:</span> <span class="n">Memory</span><span class="p">,</span> <span class="n">context_tags</span><span class="p">:</span> <span class="nb">list</span><span class="p">[</span><span class="nb">str</span><span class="p">])</span> <span class="o">-&gt;</span> <span class="nb">bool</span><span class="p">:</span> <a id="__codelineno-3-2" name="__codelineno-3-2" href="#__codelineno-3-2"></a><span class="w"> </span><span class="sd">&quot;&quot;&quot;Detect if memory is being used in a different domain.</span> <a id="__codelineno-3-3" name="__codelineno-3-3" href="#__codelineno-3-3"></a> <a id="__codelineno-3-4" name="__codelineno-3-4" href="#__codelineno-3-4"></a><span class="sd"> Uses Jaccard similarity: intersection / union</span> <a id="__codelineno-3-5" name="__codelineno-3-5" href="#__codelineno-3-5"></a><span class="sd"> If similarity &lt; 30%, tags are sufficiently different to indicate cross-domain usage.</span> <a id="__codelineno-3-6" name="__codelineno-3-6" href="#__codelineno-3-6"></a><span class="sd"> &quot;&quot;&quot;</span> <a id="__codelineno-3-7" name="__codelineno-3-7" href="#__codelineno-3-7"></a> <span class="k">if</span> <span class="ow">not</span> <span class="n">memory</span><span class="o">.</span><span class="n">tags</span> <span class="ow">or</span> <span class="ow">not</span> <span class="n">context_tags</span><span class="p">:</span> <a id="__codelineno-3-8" name="__codelineno-3-8" href="#__codelineno-3-8"></a> <span class="k">return</span> <span class="kc">False</span> <a id="__codelineno-3-9" name="__codelineno-3-9" href="#__codelineno-3-9"></a> <a id="__codelineno-3-10" name="__codelineno-3-10" href="#__codelineno-3-10"></a> <span class="n">memory_tags</span> <span class="o">=</span> <span class="nb">set</span><span class="p">(</span><span class="n">memory</span><span class="o">.</span><span class="n">tags</span><span class="p">)</span> <a id="__codelineno-3-11" name="__codelineno-3-11" href="#__codelineno-3-11"></a> <span class="n">context_tags_set</span> <span class="o">=</span> <span class="nb">set</span><span class="p">(</span><span class="n">context_tags</span><span class="p">)</span> <a id="__codelineno-3-12" name="__codelineno-3-12" href="#__codelineno-3-12"></a> <a id="__codelineno-3-13" name="__codelineno-3-13" href="#__codelineno-3-13"></a> <span class="n">intersection</span> <span class="o">=</span> <span class="n">memory_tags</span> <span class="o">&amp;</span> <span class="n">context_tags_set</span> <a id="__codelineno-3-14" name="__codelineno-3-14" href="#__codelineno-3-14"></a> <span class="n">union</span> <span class="o">=</span> <span class="n">memory_tags</span> <span class="o">|</span> <span class="n">context_tags_set</span> <a id="__codelineno-3-15" name="__codelineno-3-15" href="#__codelineno-3-15"></a> <a id="__codelineno-3-16" name="__codelineno-3-16" href="#__codelineno-3-16"></a> <span class="n">jaccard_similarity</span> <span class="o">=</span> <span class="nb">len</span><span class="p">(</span><span class="n">intersection</span><span class="p">)</span> <span class="o">/</span> <span class="nb">len</span><span class="p">(</span><span class="n">union</span><span class="p">)</span> <a id="__codelineno-3-17" name="__codelineno-3-17" href="#__codelineno-3-17"></a> <a id="__codelineno-3-18" name="__codelineno-3-18" href="#__codelineno-3-18"></a> <span class="k">return</span> <span class="n">jaccard_similarity</span> <span class="o">&lt;</span> <span class="mf">0.3</span> <span class="c1"># &lt;30% overlap = cross-domain</span> </code></pre></div> <p><strong>Example:</strong> - Memory tags: <code>[security, jwt, preferences]</code> - Context tags: <code>[api, auth, backend]</code> - Jaccard similarity: 0.0 (no overlap) → <strong>Cross-domain detected</strong> - Result: Memory gets strength boost (1.0 → 1.1-1.2)</p> <h3 id="automatic-reinforcement">Automatic Reinforcement<a class="headerlink" href="#automatic-reinforcement" title="Permanent link">&para;</a></h3> <p>When a memory is used in conversation, the <code>observe_memory_usage</code> tool:</p> <ol> <li><strong>Updates usage statistics</strong>: Increments <code>use_count</code>, updates <code>last_used</code></li> <li><strong>Increments review count</strong>: Tracks how many times memory has been reinforced</li> <li><strong>Detects cross-domain usage</strong>: Compares memory tags with context tags</li> <li><strong>Applies strength boost</strong>: If cross-domain, increases strength (capped at 2.0)</li> <li><strong>Recalculates priority</strong>: Updates review priority for next search</li> </ol> <div class="highlight"><pre><span></span><code><a id="__codelineno-4-1" name="__codelineno-4-1" href="#__codelineno-4-1"></a><span class="k">def</span><span class="w"> </span><span class="nf">reinforce_memory</span><span class="p">(</span><span class="n">memory</span><span class="p">:</span> <span class="n">Memory</span><span class="p">,</span> <span class="n">cross_domain</span><span class="p">:</span> <span class="nb">bool</span> <span class="o">=</span> <span class="kc">False</span><span class="p">)</span> <span class="o">-&gt;</span> <span class="n">Memory</span><span class="p">:</span> <a id="__codelineno-4-2" name="__codelineno-4-2" href="#__codelineno-4-2"></a><span class="w"> </span><span class="sd">&quot;&quot;&quot;Reinforce a memory through usage.</span> <a id="__codelineno-4-3" name="__codelineno-4-3" href="#__codelineno-4-3"></a> <a id="__codelineno-4-4" name="__codelineno-4-4" href="#__codelineno-4-4"></a><span class="sd"> Args:</span> <a id="__codelineno-4-5" name="__codelineno-4-5" href="#__codelineno-4-5"></a><span class="sd"> memory: Memory to reinforce</span> <a id="__codelineno-4-6" name="__codelineno-4-6" href="#__codelineno-4-6"></a><span class="sd"> cross_domain: Whether this is cross-domain usage (gets extra boost)</span> <a id="__codelineno-4-7" name="__codelineno-4-7" href="#__codelineno-4-7"></a> <a id="__codelineno-4-8" name="__codelineno-4-8" href="#__codelineno-4-8"></a><span class="sd"> Returns:</span> <a id="__codelineno-4-9" name="__codelineno-4-9" href="#__codelineno-4-9"></a><span class="sd"> Updated memory with reinforced values</span> <a id="__codelineno-4-10" name="__codelineno-4-10" href="#__codelineno-4-10"></a><span class="sd"> &quot;&quot;&quot;</span> <a id="__codelineno-4-11" name="__codelineno-4-11" href="#__codelineno-4-11"></a> <span class="n">now</span> <span class="o">=</span> <span class="nb">int</span><span class="p">(</span><span class="n">time</span><span class="o">.</span><span class="n">time</span><span class="p">())</span> <a id="__codelineno-4-12" name="__codelineno-4-12" href="#__codelineno-4-12"></a> <a id="__codelineno-4-13" name="__codelineno-4-13" href="#__codelineno-4-13"></a> <span class="c1"># Standard reinforcement</span> <a id="__codelineno-4-14" name="__codelineno-4-14" href="#__codelineno-4-14"></a> <span class="n">memory</span><span class="o">.</span><span class="n">last_used</span> <span class="o">=</span> <span class="n">now</span> <a id="__codelineno-4-15" name="__codelineno-4-15" href="#__codelineno-4-15"></a> <span class="n">memory</span><span class="o">.</span><span class="n">use_count</span> <span class="o">+=</span> <span class="mi">1</span> <a id="__codelineno-4-16" name="__codelineno-4-16" href="#__codelineno-4-16"></a> <span class="n">memory</span><span class="o">.</span><span class="n">review_count</span> <span class="o">+=</span> <span class="mi">1</span> <a id="__codelineno-4-17" name="__codelineno-4-17" href="#__codelineno-4-17"></a> <span class="n">memory</span><span class="o">.</span><span class="n">last_review_at</span> <span class="o">=</span> <span class="n">now</span> <a id="__codelineno-4-18" name="__codelineno-4-18" href="#__codelineno-4-18"></a> <a id="__codelineno-4-19" name="__codelineno-4-19" href="#__codelineno-4-19"></a> <span class="c1"># Cross-domain bonus</span> <a id="__codelineno-4-20" name="__codelineno-4-20" href="#__codelineno-4-20"></a> <span class="k">if</span> <span class="n">cross_domain</span><span class="p">:</span> <a id="__codelineno-4-21" name="__codelineno-4-21" href="#__codelineno-4-21"></a> <span class="n">memory</span><span class="o">.</span><span class="n">cross_domain_count</span> <span class="o">+=</span> <span class="mi">1</span> <a id="__codelineno-4-22" name="__codelineno-4-22" href="#__codelineno-4-22"></a> <span class="c1"># Boost strength (capped at 2.0)</span> <a id="__codelineno-4-23" name="__codelineno-4-23" href="#__codelineno-4-23"></a> <span class="n">boost</span> <span class="o">=</span> <span class="mf">0.1</span> <a id="__codelineno-4-24" name="__codelineno-4-24" href="#__codelineno-4-24"></a> <span class="n">memory</span><span class="o">.</span><span class="n">strength</span> <span class="o">=</span> <span class="nb">min</span><span class="p">(</span><span class="mf">2.0</span><span class="p">,</span> <span class="n">memory</span><span class="o">.</span><span class="n">strength</span> <span class="o">+</span> <span class="n">boost</span><span class="p">)</span> <a id="__codelineno-4-25" name="__codelineno-4-25" href="#__codelineno-4-25"></a> <a id="__codelineno-4-26" name="__codelineno-4-26" href="#__codelineno-4-26"></a> <span class="c1"># Recalculate priority</span> <a id="__codelineno-4-27" name="__codelineno-4-27" href="#__codelineno-4-27"></a> <span class="n">memory</span><span class="o">.</span><span class="n">review_priority</span> <span class="o">=</span> <span class="n">calculate_review_priority</span><span class="p">(</span><span class="n">memory</span><span class="p">)</span> <a id="__codelineno-4-28" name="__codelineno-4-28" href="#__codelineno-4-28"></a> <a id="__codelineno-4-29" name="__codelineno-4-29" href="#__codelineno-4-29"></a> <span class="k">return</span> <span class="n">memory</span> </code></pre></div> <h3 id="blended-search-results">Blended Search Results<a class="headerlink" href="#blended-search-results" title="Permanent link">&para;</a></h3> <p>The <code>search_memory</code> tool automatically blends review candidates into search results:</p> <ol> <li><strong>Query primary index</strong>: Get relevant memories matching search criteria</li> <li><strong>Get review queue</strong>: Retrieve memories with highest review priority</li> <li><strong>Filter for relevance</strong>: Remove review candidates not relevant to query</li> <li><strong>Blend results</strong>: Interleave primary results with review candidates</li> <li>Default: 70% primary results, 30% review candidates</li> <li>Configurable via <code>CORTEXGRAPH_REVIEW_BLEND_RATIO</code></li> </ol> <p><strong>Example flow:</strong> <div class="highlight"><pre><span></span><code><a id="__codelineno-5-1" name="__codelineno-5-1" href="#__codelineno-5-1"></a>User searches for &quot;typescript preferences&quot; <a id="__codelineno-5-2" name="__codelineno-5-2" href="#__codelineno-5-2"></a>→ Primary results: 7 matches (sorted by relevance × decay score) <a id="__codelineno-5-3" name="__codelineno-5-3" href="#__codelineno-5-3"></a>→ Review queue: 10 memories in danger zone <a id="__codelineno-5-4" name="__codelineno-5-4" href="#__codelineno-5-4"></a>→ Filter review queue: Keep only typescript-related (3 matches) <a id="__codelineno-5-5" name="__codelineno-5-5" href="#__codelineno-5-5"></a>→ Blend: [primary[0], primary[1], review[0], primary[2], primary[3], review[1], ...] <a id="__codelineno-5-6" name="__codelineno-5-6" href="#__codelineno-5-6"></a>→ Return top 5 blended results </code></pre></div></p> <p>This ensures memories needing reinforcement naturally surface during relevant searches, without disrupting the user experience.</p> <h3 id="configuration">Configuration<a class="headerlink" href="#configuration" title="Permanent link">&para;</a></h3> <div class="highlight"><pre><span></span><code><a id="__codelineno-6-1" name="__codelineno-6-1" href="#__codelineno-6-1"></a><span class="c1"># Natural Spaced Repetition</span> <a id="__codelineno-6-2" name="__codelineno-6-2" href="#__codelineno-6-2"></a><span class="nv">CORTEXGRAPH_REVIEW_BLEND_RATIO</span><span class="o">=</span><span class="m">0</span>.3<span class="w"> </span><span class="c1"># 30% review candidates in search</span> <a id="__codelineno-6-3" name="__codelineno-6-3" href="#__codelineno-6-3"></a><span class="nv">CORTEXGRAPH_REVIEW_DANGER_ZONE_MIN</span><span class="o">=</span><span class="m">0</span>.15<span class="w"> </span><span class="c1"># Lower bound of danger zone</span> <a id="__codelineno-6-4" name="__codelineno-6-4" href="#__codelineno-6-4"></a><span class="nv">CORTEXGRAPH_REVIEW_DANGER_ZONE_MAX</span><span class="o">=</span><span class="m">0</span>.35<span class="w"> </span><span class="c1"># Upper bound of danger zone</span> <a id="__codelineno-6-5" name="__codelineno-6-5" href="#__codelineno-6-5"></a><span class="nv">CORTEXGRAPH_AUTO_REINFORCE</span><span class="o">=</span><span class="nb">true</span><span class="w"> </span><span class="c1"># Auto-reinforce on observe</span> </code></pre></div> <h3 id="memory-model-extensions">Memory Model Extensions<a class="headerlink" href="#memory-model-extensions" title="Permanent link">&para;</a></h3> <p>Natural spaced repetition adds four fields to the <code>Memory</code> model:</p> <div class="highlight"><pre><span></span><code><a id="__codelineno-7-1" name="__codelineno-7-1" href="#__codelineno-7-1"></a><span class="k">class</span><span class="w"> </span><span class="nc">Memory</span><span class="p">(</span><span class="n">BaseModel</span><span class="p">):</span> <a id="__codelineno-7-2" name="__codelineno-7-2" href="#__codelineno-7-2"></a> <span class="c1"># ... existing fields ...</span> <a id="__codelineno-7-3" name="__codelineno-7-3" href="#__codelineno-7-3"></a> <a id="__codelineno-7-4" name="__codelineno-7-4" href="#__codelineno-7-4"></a> <span class="c1"># Review tracking (v0.5.1+)</span> <a id="__codelineno-7-5" name="__codelineno-7-5" href="#__codelineno-7-5"></a> <span class="n">review_priority</span><span class="p">:</span> <span class="nb">float</span> <span class="o">=</span> <span class="n">Field</span><span class="p">(</span><span class="n">default</span><span class="o">=</span><span class="mf">0.0</span><span class="p">,</span> <span class="n">ge</span><span class="o">=</span><span class="mi">0</span><span class="p">,</span> <span class="n">le</span><span class="o">=</span><span class="mi">1</span><span class="p">)</span> <span class="c1"># 0.0-1.0 urgency</span> <a id="__codelineno-7-6" name="__codelineno-7-6" href="#__codelineno-7-6"></a> <span class="n">last_review_at</span><span class="p">:</span> <span class="nb">int</span> <span class="o">|</span> <span class="kc">None</span> <span class="o">=</span> <span class="n">Field</span><span class="p">(</span><span class="n">default</span><span class="o">=</span><span class="kc">None</span><span class="p">)</span> <span class="c1"># Last reinforcement timestamp</span> <a id="__codelineno-7-7" name="__codelineno-7-7" href="#__codelineno-7-7"></a> <span class="n">review_count</span><span class="p">:</span> <span class="nb">int</span> <span class="o">=</span> <span class="n">Field</span><span class="p">(</span><span class="n">default</span><span class="o">=</span><span class="mi">0</span><span class="p">)</span> <span class="c1"># Total reinforcements</span> <a id="__codelineno-7-8" name="__codelineno-7-8" href="#__codelineno-7-8"></a> <span class="n">cross_domain_count</span><span class="p">:</span> <span class="nb">int</span> <span class="o">=</span> <span class="n">Field</span><span class="p">(</span><span class="n">default</span><span class="o">=</span><span class="mi">0</span><span class="p">)</span> <span class="c1"># Cross-domain usages</span> </code></pre></div> <p>These fields are backward-compatible - existing memories default to 0/None.</p> <h3 id="usage-pattern-conversational">Usage Pattern (Conversational)<a class="headerlink" href="#usage-pattern-conversational" title="Permanent link">&para;</a></h3> <p>The natural spaced repetition system works entirely through conversation:</p> <ol> <li><strong>User asks question</strong> with implicit context (tags, topics)</li> <li><strong>System searches</strong> (automatically includes review candidates in results)</li> <li><strong>System uses memories</strong> to form intelligent response</li> <li><strong>System observes</strong> memory usage with <code>observe_memory_usage(memory_ids, context_tags)</code></li> <li><strong>Cross-domain detection</strong> triggers if tags differ significantly</li> <li><strong>Automatic reinforcement</strong> updates memory statistics and priority</li> <li><strong>Next search</strong> naturally surfaces memories in danger zone</li> </ol> <p><strong>No explicit review commands. No interruptions. Just natural strengthening through use.</strong></p> <h2 id="system-architecture">System Architecture<a class="headerlink" href="#system-architecture" title="Permanent link">&para;</a></h2> <h3 id="layers">Layers<a class="headerlink" href="#layers" title="Permanent link">&para;</a></h3> <div class="highlight"><pre><span></span><code><a id="__codelineno-8-1" name="__codelineno-8-1" href="#__codelineno-8-1"></a>┌─────────────────────────────────────┐ <a id="__codelineno-8-2" name="__codelineno-8-2" href="#__codelineno-8-2"></a>│ MCP Tools (API Layer) │ <a id="__codelineno-8-3" name="__codelineno-8-3" href="#__codelineno-8-3"></a>│ save, search, touch, gc, promote │ <a id="__codelineno-8-4" name="__codelineno-8-4" href="#__codelineno-8-4"></a>└─────────────────┬───────────────────┘ <a id="__codelineno-8-5" name="__codelineno-8-5" href="#__codelineno-8-5"></a> │ <a id="__codelineno-8-6" name="__codelineno-8-6" href="#__codelineno-8-6"></a>┌─────────────────▼───────────────────┐ <a id="__codelineno-8-7" name="__codelineno-8-7" href="#__codelineno-8-7"></a>│ Core Logic Layer │ <a id="__codelineno-8-8" name="__codelineno-8-8" href="#__codelineno-8-8"></a>│ decay, scoring, clustering │ <a id="__codelineno-8-9" name="__codelineno-8-9" href="#__codelineno-8-9"></a>└─────────────────┬───────────────────┘ <a id="__codelineno-8-10" name="__codelineno-8-10" href="#__codelineno-8-10"></a> │ <a id="__codelineno-8-11" name="__codelineno-8-11" href="#__codelineno-8-11"></a>┌─────────────────▼───────────────────┐ <a id="__codelineno-8-12" name="__codelineno-8-12" href="#__codelineno-8-12"></a>│ Storage Layer (JSONL) │ <a id="__codelineno-8-13" name="__codelineno-8-13" href="#__codelineno-8-13"></a>│ human-readable files + models │ <a id="__codelineno-8-14" name="__codelineno-8-14" href="#__codelineno-8-14"></a>└─────────────────────────────────────┘ </code></pre></div> <h3 id="storage-format-jsonl">Storage Format (JSONL)<a class="headerlink" href="#storage-format-jsonl" title="Permanent link">&para;</a></h3> <p>Each memory is stored as a JSON object, one per line, in <code>memories.jsonl</code>. Relations in <code>relations.jsonl</code>.</p> <p>Example line: <div class="highlight"><pre><span></span><code><a id="__codelineno-9-1" name="__codelineno-9-1" href="#__codelineno-9-1"></a>{&quot;id&quot;:&quot;...&quot;,&quot;content&quot;:&quot;...&quot;,&quot;meta&quot;:{&quot;tags&quot;:[&quot;...&quot;]},&quot;created_at&quot;:1736275200,&quot;last_used&quot;:1736275200,&quot;use_count&quot;:0,&quot;strength&quot;:1.0,&quot;status&quot;:&quot;active&quot;} </code></pre></div></p> <p>In-memory indexes are built at startup for fast queries; periodic compaction rewrites files to remove tombstones and duplicates.</p> <h3 id="memory-states">Memory States<a class="headerlink" href="#memory-states" title="Permanent link">&para;</a></h3> <div class="highlight"><pre><span></span><code><a id="__codelineno-10-1" name="__codelineno-10-1" href="#__codelineno-10-1"></a>ACTIVE → [high score/usage] → PROMOTED <a id="__codelineno-10-2" name="__codelineno-10-2" href="#__codelineno-10-2"></a> ↓ <a id="__codelineno-10-3" name="__codelineno-10-3" href="#__codelineno-10-3"></a>[low score] <a id="__codelineno-10-4" name="__codelineno-10-4" href="#__codelineno-10-4"></a> ↓ <a id="__codelineno-10-5" name="__codelineno-10-5" href="#__codelineno-10-5"></a>ARCHIVED or DELETED </code></pre></div> <ul> <li><strong>ACTIVE</strong>: Normal short-term memory undergoing decay</li> <li><strong>PROMOTED</strong>: Moved to long-term storage (Obsidian)</li> <li><strong>ARCHIVED</strong>: Low-scoring but preserved (optional)</li> </ul> <h2 id="data-flow">Data Flow<a class="headerlink" href="#data-flow" title="Permanent link">&para;</a></h2> <h3 id="saving-a-memory">Saving a Memory<a class="headerlink" href="#saving-a-memory" title="Permanent link">&para;</a></h3> <div class="highlight"><pre><span></span><code><a id="__codelineno-11-1" name="__codelineno-11-1" href="#__codelineno-11-1"></a>User/AI → save_memory(content, tags) <a id="__codelineno-11-2" name="__codelineno-11-2" href="#__codelineno-11-2"></a> ↓ <a id="__codelineno-11-3" name="__codelineno-11-3" href="#__codelineno-11-3"></a>Generate embedding (optional) <a id="__codelineno-11-4" name="__codelineno-11-4" href="#__codelineno-11-4"></a> ↓ <a id="__codelineno-11-5" name="__codelineno-11-5" href="#__codelineno-11-5"></a>Create Memory object <a id="__codelineno-11-6" name="__codelineno-11-6" href="#__codelineno-11-6"></a> ↓ <a id="__codelineno-11-7" name="__codelineno-11-7" href="#__codelineno-11-7"></a>Append to JSONL storage <a id="__codelineno-11-8" name="__codelineno-11-8" href="#__codelineno-11-8"></a> ↓ <a id="__codelineno-11-9" name="__codelineno-11-9" href="#__codelineno-11-9"></a>Return memory_id </code></pre></div> <h3 id="searching-memories">Searching Memories<a class="headerlink" href="#searching-memories" title="Permanent link">&para;</a></h3> <div class="highlight"><pre><span></span><code><a id="__codelineno-12-1" name="__codelineno-12-1" href="#__codelineno-12-1"></a>User/AI → search_memory(query, filters) <a id="__codelineno-12-2" name="__codelineno-12-2" href="#__codelineno-12-2"></a> ↓ <a id="__codelineno-12-3" name="__codelineno-12-3" href="#__codelineno-12-3"></a>Database query (tags, window, status) <a id="__codelineno-12-4" name="__codelineno-12-4" href="#__codelineno-12-4"></a> ↓ <a id="__codelineno-12-5" name="__codelineno-12-5" href="#__codelineno-12-5"></a>Calculate decay scores for each <a id="__codelineno-12-6" name="__codelineno-12-6" href="#__codelineno-12-6"></a> ↓ <a id="__codelineno-12-7" name="__codelineno-12-7" href="#__codelineno-12-7"></a>[Optional] Calculate semantic similarity <a id="__codelineno-12-8" name="__codelineno-12-8" href="#__codelineno-12-8"></a> ↓ <a id="__codelineno-12-9" name="__codelineno-12-9" href="#__codelineno-12-9"></a>Rank by combined score <a id="__codelineno-12-10" name="__codelineno-12-10" href="#__codelineno-12-10"></a> ↓ <a id="__codelineno-12-11" name="__codelineno-12-11" href="#__codelineno-12-11"></a>Return top_k results </code></pre></div> <h3 id="touching-a-memory">Touching a Memory<a class="headerlink" href="#touching-a-memory" title="Permanent link">&para;</a></h3> <div class="highlight"><pre><span></span><code><a id="__codelineno-13-1" name="__codelineno-13-1" href="#__codelineno-13-1"></a>User/AI → touch_memory(id) <a id="__codelineno-13-2" name="__codelineno-13-2" href="#__codelineno-13-2"></a> ↓ <a id="__codelineno-13-3" name="__codelineno-13-3" href="#__codelineno-13-3"></a>Get existing memory <a id="__codelineno-13-4" name="__codelineno-13-4" href="#__codelineno-13-4"></a> ↓ <a id="__codelineno-13-5" name="__codelineno-13-5" href="#__codelineno-13-5"></a>Update: last_used=now, use_count+=1, strength+=boost <a id="__codelineno-13-6" name="__codelineno-13-6" href="#__codelineno-13-6"></a> ↓ <a id="__codelineno-13-7" name="__codelineno-13-7" href="#__codelineno-13-7"></a>Calculate new score <a id="__codelineno-13-8" name="__codelineno-13-8" href="#__codelineno-13-8"></a> ↓ <a id="__codelineno-13-9" name="__codelineno-13-9" href="#__codelineno-13-9"></a>Save updated memory <a id="__codelineno-13-10" name="__codelineno-13-10" href="#__codelineno-13-10"></a> ↓ <a id="__codelineno-13-11" name="__codelineno-13-11" href="#__codelineno-13-11"></a>Return old/new scores </code></pre></div> <h3 id="promotion-flow">Promotion Flow<a class="headerlink" href="#promotion-flow" title="Permanent link">&para;</a></h3> <div class="highlight"><pre><span></span><code><a id="__codelineno-14-1" name="__codelineno-14-1" href="#__codelineno-14-1"></a>[Automatic or Manual Trigger] <a id="__codelineno-14-2" name="__codelineno-14-2" href="#__codelineno-14-2"></a> ↓ <a id="__codelineno-14-3" name="__codelineno-14-3" href="#__codelineno-14-3"></a>Identify candidates (score/usage criteria) <a id="__codelineno-14-4" name="__codelineno-14-4" href="#__codelineno-14-4"></a> ↓ <a id="__codelineno-14-5" name="__codelineno-14-5" href="#__codelineno-14-5"></a>[Optional: Dry-run preview] <a id="__codelineno-14-6" name="__codelineno-14-6" href="#__codelineno-14-6"></a> ↓ <a id="__codelineno-14-7" name="__codelineno-14-7" href="#__codelineno-14-7"></a>For each candidate: <a id="__codelineno-14-8" name="__codelineno-14-8" href="#__codelineno-14-8"></a> ├─ Generate Markdown note <a id="__codelineno-14-9" name="__codelineno-14-9" href="#__codelineno-14-9"></a> ├─ Write to Obsidian vault <a id="__codelineno-14-10" name="__codelineno-14-10" href="#__codelineno-14-10"></a> ├─ Update status=PROMOTED <a id="__codelineno-14-11" name="__codelineno-14-11" href="#__codelineno-14-11"></a> └─ Store vault path </code></pre></div> <h3 id="garbage-collection_1">Garbage Collection<a class="headerlink" href="#garbage-collection_1" title="Permanent link">&para;</a></h3> <div class="highlight"><pre><span></span><code><a id="__codelineno-15-1" name="__codelineno-15-1" href="#__codelineno-15-1"></a>gc(dry_run, archive_instead) <a id="__codelineno-15-2" name="__codelineno-15-2" href="#__codelineno-15-2"></a> ↓ <a id="__codelineno-15-3" name="__codelineno-15-3" href="#__codelineno-15-3"></a>Get all ACTIVE memories <a id="__codelineno-15-4" name="__codelineno-15-4" href="#__codelineno-15-4"></a> ↓ <a id="__codelineno-15-5" name="__codelineno-15-5" href="#__codelineno-15-5"></a>Calculate scores <a id="__codelineno-15-6" name="__codelineno-15-6" href="#__codelineno-15-6"></a> ↓ <a id="__codelineno-15-7" name="__codelineno-15-7" href="#__codelineno-15-7"></a>Filter: score &lt; forget_threshold <a id="__codelineno-15-8" name="__codelineno-15-8" href="#__codelineno-15-8"></a> ↓ <a id="__codelineno-15-9" name="__codelineno-15-9" href="#__codelineno-15-9"></a>[Optional: Dry-run preview] <a id="__codelineno-15-10" name="__codelineno-15-10" href="#__codelineno-15-10"></a> ↓ <a id="__codelineno-15-11" name="__codelineno-15-11" href="#__codelineno-15-11"></a>Delete or Archive <a id="__codelineno-15-12" name="__codelineno-15-12" href="#__codelineno-15-12"></a> ↓ <a id="__codelineno-15-13" name="__codelineno-15-13" href="#__codelineno-15-13"></a>Return statistics </code></pre></div> <h2 id="clustering-for-consolidation">Clustering for Consolidation<a class="headerlink" href="#clustering-for-consolidation" title="Permanent link">&para;</a></h2> <h3 id="similarity-based-clustering">Similarity-Based Clustering<a class="headerlink" href="#similarity-based-clustering" title="Permanent link">&para;</a></h3> <ol> <li><strong>Embedding Generation</strong>: Use sentence-transformers to create vectors</li> <li><strong>Pairwise Similarity</strong>: Calculate cosine similarity between memories</li> <li><strong>Linking</strong>: Connect memories with similarity &gt; threshold (default: 0.83)</li> <li><strong>Cluster Formation</strong>: Single-linkage clustering</li> <li><strong>Cohesion Calculation</strong>: Average intra-cluster similarity</li> </ol> <h3 id="cluster-actions">Cluster Actions<a class="headerlink" href="#cluster-actions" title="Permanent link">&para;</a></h3> <ul> <li><strong>Auto-merge</strong> (cohesion ≥ 0.9): Clear duplicates</li> <li><strong>LLM-review</strong> (0.75 ≤ cohesion &lt; 0.9): Require human/LLM review</li> <li><strong>Keep-separate</strong> (cohesion &lt; 0.75): Different enough to keep apart</li> </ul> <h2 id="integration-points">Integration Points<a class="headerlink" href="#integration-points" title="Permanent link">&para;</a></h2> <h3 id="basic-memory-obsidian">Basic Memory (Obsidian)<a class="headerlink" href="#basic-memory-obsidian" title="Permanent link">&para;</a></h3> <p>When promoting to long-term:</p> <ol> <li>Create note in <code>vault/STM/</code> directory</li> <li>Add YAML frontmatter with metadata</li> <li>Format content with sections</li> <li>Include backlinks to related notes (future feature)</li> <li>Tag appropriately for graph view</li> </ol> <h3 id="sentence-transformers-optional">Sentence Transformers (Optional)<a class="headerlink" href="#sentence-transformers-optional" title="Permanent link">&para;</a></h3> <p>For semantic search and clustering:</p> <ol> <li>Load model (default: <code>all-MiniLM-L6-v2</code>)</li> <li>Encode content → 384-dim vector</li> <li>Store as BLOB in database</li> <li>Use for similarity search and clustering</li> </ol> <h2 id="performance-considerations">Performance Considerations<a class="headerlink" href="#performance-considerations" title="Permanent link">&para;</a></h2> <h3 id="database">Database<a class="headerlink" href="#database" title="Permanent link">&para;</a></h3> <ul> <li>JSONL is simple and git-friendly for single-machine use</li> <li>Indexes on frequently queried fields</li> <li>BLOB storage for embeddings (efficient)</li> <li>Typical operations: &lt; 10ms</li> </ul> <h3 id="embeddings">Embeddings<a class="headerlink" href="#embeddings" title="Permanent link">&para;</a></h3> <ul> <li>Optional feature (disabled by default)</li> <li>Model loads on first use (~50MB memory)</li> <li>Encoding: ~10-50ms per text</li> <li>Consider batch encoding for bulk operations</li> </ul> <h3 id="scaling">Scaling<a class="headerlink" href="#scaling" title="Permanent link">&para;</a></h3> <p>Current design targets: - 1,000-10,000 active memories - Single user, single machine - Local-first architecture</p> <p>For larger scales, consider: - External databases (e.g., PostgreSQL) are out of scope for this project - Vector database (e.g., Qdrant, Weaviate) - Distributed MCP architecture</p> <h2 id="configuration-tuning">Configuration Tuning<a class="headerlink" href="#configuration-tuning" title="Permanent link">&para;</a></h2> <h3 id="decay-rate">Decay Rate (λ)<a class="headerlink" href="#decay-rate" title="Permanent link">&para;</a></h3> <ul> <li><strong>Fast decay</strong> (1-day half-life): <code>λ = 8.02e-6</code></li> <li><strong>Default</strong> (3-day half-life): <code>λ = 2.673e-6</code></li> <li><strong>Slow decay</strong> (7-day half-life): <code>λ = 1.145e-6</code></li> </ul> <h3 id="thresholds">Thresholds<a class="headerlink" href="#thresholds" title="Permanent link">&para;</a></h3> <p>Adjust based on usage patterns:</p> <ul> <li><code>forget_threshold</code>: Lower → keep more memories</li> <li><code>promote_threshold</code>: Lower → promote more aggressively</li> <li><code>promote_use_count</code>: Higher → require more reinforcement</li> </ul> <h3 id="use-count-weight">Use Count Weight (β)<a class="headerlink" href="#use-count-weight" title="Permanent link">&para;</a></h3> <ul> <li><strong>Low</strong> (β = 0.3): Linear-ish, less emphasis on repetition</li> <li><strong>Default</strong> (β = 0.6): Balanced</li> <li><strong>High</strong> (β = 1.0): Linear, heavy emphasis on use count</li> </ul> <h2 id="future-enhancements">Future Enhancements<a class="headerlink" href="#future-enhancements" title="Permanent link">&para;</a></h2> <ol> <li><strong>LLM Consolidation</strong>: Automatic memory merging with LLM review</li> <li><strong>Relationship Tracking</strong>: Link related memories explicitly</li> <li><strong>Context Windows</strong>: Group memories by temporal/semantic context</li> <li><strong>Adaptive Decay</strong>: Learn optimal decay rates per memory type</li> <li><strong>Multi-user Support</strong>: Shared memory spaces with access control</li> <li><strong>Incremental Promotion</strong>: Partial content promotion before full commit</li> </ol> </article> </div> <script>var target=document.getElementById(location.hash.slice(1));target&&target.name&&(target.checked=target.name.startsWith("__tabbed_"))</script> </div> <button type="button" class="md-top md-icon" data-md-component="top" hidden> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M13 20h-2V8l-5.5 5.5-1.42-1.42L12 4.16l7.92 7.92-1.42 1.42L13 8z"/></svg> Back to top </button> </main> <footer class="md-footer"> <div class="md-footer-meta md-typeset"> <div class="md-footer-meta__inner md-grid"> <div class="md-copyright"> Made with <a href="https://squidfunk.github.io/mkdocs-material/" target="_blank" rel="noopener"> Material for MkDocs </a> </div> <div class="md-social"> <a href="https://github.com/prefrontal-systems/cortexgraph" target="_blank" rel="noopener" title="github.com" class="md-social__link"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 512 512"><!--! Font Awesome Free 7.1.0 by @fontawesome - https://fontawesome.com License - https://fontawesome.com/license/free (Icons: CC BY 4.0, Fonts: SIL OFL 1.1, Code: MIT License) Copyright 2025 Fonticons, Inc.--><path d="M173.9 397.4c0 2-2.3 3.6-5.2 3.6-3.3.3-5.6-1.3-5.6-3.6 0-2 2.3-3.6 5.2-3.6 3-.3 5.6 1.3 5.6 3.6m-31.1-4.5c-.7 2 1.3 4.3 4.3 4.9 2.6 1 5.6 0 6.2-2s-1.3-4.3-4.3-5.2c-2.6-.7-5.5.3-6.2 2.3m44.2-1.7c-2.9.7-4.9 2.6-4.6 4.9.3 2 2.9 3.3 5.9 2.6 2.9-.7 4.9-2.6 4.6-4.6-.3-1.9-3-3.2-5.9-2.9M252.8 8C114.1 8 8 113.3 8 252c0 110.9 69.8 205.8 169.5 239.2 12.8 2.3 17.3-5.6 17.3-12.1 0-6.2-.3-40.4-.3-61.4 0 0-70 15-84.7-29.8 0 0-11.4-29.1-27.8-36.6 0 0-22.9-15.7 1.6-15.4 0 0 24.9 2 38.6 25.8 21.9 38.6 58.6 27.5 72.9 20.9 2.3-16 8.8-27.1 16-33.7-55.9-6.2-112.3-14.3-112.3-110.5 0-27.5 7.6-41.3 23.6-58.9-2.6-6.5-11.1-33.3 2.6-67.9 20.9-6.5 69 27 69 27 20-5.6 41.5-8.5 62.8-8.5s42.8 2.9 62.8 8.5c0 0 48.1-33.6 69-27 13.7 34.7 5.2 61.4 2.6 67.9 16 17.7 25.8 31.5 25.8 58.9 0 96.5-58.9 104.2-114.8 110.5 9.2 7.9 17 22.9 17 46.4 0 33.7-.3 75.4-.3 83.6 0 6.5 4.6 14.4 17.3 12.1C436.2 457.8 504 362.9 504 252 504 113.3 391.5 8 252.8 8M105.2 352.9c-1.3 1-1 3.3.7 5.2 1.6 1.6 3.9 2.3 5.2 1 1.3-1 1-3.3-.7-5.2-1.6-1.6-3.9-2.3-5.2-1m-10.8-8.1c-.7 1.3.3 2.9 2.3 3.9 1.6 1 3.6.7 4.3-.7.7-1.3-.3-2.9-2.3-3.9-2-.6-3.6-.3-4.3.7m32.4 35.6c-1.6 1.3-1 4.3 1.3 6.2 2.3 2.3 5.2 2.6 6.5 1 1.3-1.3.7-4.3-1.3-6.2-2.2-2.3-5.2-2.6-6.5-1m-11.4-14.7c-1.6 1-1.6 3.6 0 5.9s4.3 3.3 5.6 2.3c1.6-1.3 1.6-3.9 0-6.2-1.4-2.3-4-3.3-5.6-2"/></svg> </a> <a href="https://github.com/prefrontal-systems/cortexgraph/discussions" target="_blank" rel="noopener" title="github.com" class="md-social__link"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 576 512"><!--! Font Awesome Free 7.1.0 by @fontawesome - https://fontawesome.com License - https://fontawesome.com/license/free (Icons: CC BY 4.0, Fonts: SIL OFL 1.1, Code: MIT License) Copyright 2025 Fonticons, Inc.--><path d="M384 144c0 97.2-86 176-192 176-26.7 0-52.1-5-75.2-14l-81.6 43.2c-9.3 4.9-20.7 3.2-28.2-4.2s-9.2-18.9-4.2-28.2l35.6-67.2C14.3 220.2 0 183.6 0 144 0 46.8 86-32 192-32s192 78.8 192 176m0 368c-94.1 0-172.4-62.1-188.8-144 120-1.5 224.3-86.9 235.8-202.7 83.3 19.2 145 88.3 145 170.7 0 39.6-14.3 76.2-38.4 105.6l35.6 67.2c4.9 9.3 3.2 20.7-4.2 28.2s-18.9 9.2-28.2 4.2L459.2 498c-23.1 9-48.5 14-75.2 14"/></svg> </a> </div> </div> </div> </footer> </div> <div class="md-dialog" data-md-component="dialog"> <div class="md-dialog__inner md-typeset"></div> </div> <script id="__config" type="application/json">{"annotate": null, "base": "..", "features": ["navigation.instant", "navigation.tracking", "navigation.tabs", "navigation.sections", "navigation.expand", "navigation.top", "search.suggest", "search.highlight", "content.code.copy", "content.code.annotate", "content.action.edit"], "search": "../assets/javascripts/workers/search.7a47a382.min.js", "tags": null, "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}, "version": null}</script> <script src="../assets/javascripts/bundle.e71a0d61.min.js"></script> </body> </html>

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/prefrontalsys/mnemex'

If you have feedback or need assistance with the MCP directory API, please join our Discord server