← back to notes

memory is the product surface

May 2026 · Prasith Govin

The memory plan I wrote opens with a flat claim: for this agent, memory is the product surface. I still think that's the most important sentence in the doc, and everything else follows from taking it literally.

A smart model that forgets everything is expensive autocomplete. The intelligence you pay for resets every session unless something outside the context window remembers for it. So memory can't be whatever the current plugin happens to do by default. It's the substrate the whole system stands on, and it deserves the same rigor I'd give any load-bearing part.

Taking it seriously meant turning it into something measured. Local-first, so the source of truth is files I own and can read, not a service I hope is up. Benchmarked recall, so I know retrieval works instead of assuming it. Bounded latency, so remembering doesn't cost more than it saves. Drift detection I can actually see. And explicit decision gates before anything gets swapped or disabled, so no backend change happens on a hunch.

The benchmark is where this got real. It has recall buckets, and it has negative controls: cases where the correct answer is to retrieve nothing. Ask what nineteen times twenty-three is, and the right move is to answer, not to search memory for it. Ask for a password, and it should refuse instead of inventing one. Ask whether we decided to move everything to the cloud, and the honest answer is no, with the reason why. A memory system that only passes direct keyword recall isn't good enough, because the worst failures are confident retrieval of things that were never true.

The discipline underneath all of it is one habit: write everything down. Context is temporary and files persist, so the job every session is to move what mattered out of the window and onto disk before it evaporates. The architecture is the grown-up version of that habit.

One line from that plan still runs everything I build: treat memory like the product, keep measuring whether it recalls, and stay suspicious of any system that can't correctly retrieve nothing but insists it can retrieve everything.