Co-Located Memory Surfacing

Agentic AI Memory

When a user mentions a known entity, proactively surface the 1–2 most relevant past memories inline — so the agent brings context to the conversation without being asked.

Co-Located Memory Surfacing turns the agent into an active participant in continuity: on every user message, it extracts concrete entities, matches them against persistent memory (thoughts, notes, project files, prior transcripts), and surfaces up to 2 relevant fragments inline — bridging the gap between what the user mentioned and what the agent already knows about it.

Intent & Description

🎯 Intent

Surface relevant persistent memories proactively when the human mentions a concrete entity the agent has prior knowledge of — so the human doesn’t bear the burden of remembering to ask.

📋 Context

The agent has a searchable persistent memory store — thoughts, notes, insights, project files, prior session transcripts. The human’s memory of past sessions is fuzzy or absent. The agent can search its own memory in milliseconds; the human cannot search into it at all.

💡 Solution

On every user message, extract concrete proper nouns and significant named phrases. Match against persistent memory via grep or embedding similarity. If matches exist, surface ≤ 2 most relevant fragments inline in the reply — time-stamped, briefly framed — and let the human steer whether to pursue. Suppress surfacing if it would feel like a lecture or if the mention was clearly incidental.

Real-world Use Case

The agent has a persistent memory store keyed by entities (people, projects, places).
Users expect the agent to recognize and react to entities they’ve discussed before, without being prompted.
Memory recall can be made cheap enough to run on every user turn (lookup, not LLM call).

Source

View Original Source →

📌 TL;DR

Extract entities from every user message, match against persistent memory, and surface 1–2 relevant fragments inline — the agent connects the dots so the user doesn’t have to.

Advantages

Conversation continuity across sessions without the user needing to re-explain context.
The human doesn’t have to remember to ask — the agent brings relevant history to them.
Surfaces forgotten threads naturally, in context.

Disadvantages

Risk of surfacing irrelevant matches that derail the conversation.
Context window cost when many matches fire simultaneously.
Privacy risk if shared memory contains sensitive details from other contexts.

82 of 322