- A substantial share of a company’s daily reasoning now happens inside AI interactions (33.4% of Cowork sessions are business operations, across 600k+ organizations), and the organizational record of it is, in most companies, zero.
- MIT’s famous 95% is about zero measurable P&L return, and its ignored diagnosis is the learning gap: systems that do not retain feedback, adapt to context, or improve over time.
- The gap is structural: context is not memory (Lost in the Middle, Context Rot) and nothing persists across sessions by default. Vendor memory is scoped to one person and one product: personal memory is not organizational memory.
- Two clocks are ticking: the EU AI Act’s general applicability (2 August 2026) and a funded race after YC named the “Company Brain” a missing primitive.
- Any serious answer needs five properties: capture at birth, human approval, provenance, one source for agents and humans, and company ownership.
Every day, the people in your company have hundreds or thousands of conversations with AI. Real work happens in them: a pricing exception gets explained, a compliance rule gets clarified, a broken process gets debugged, a decision gets made and justified. Then the session ends.
And everything the organization just learned is gone. Nobody decided this: there was no meeting where someone proposed that the fastest-growing stream of operational knowledge in the company should be discarded by default. It is simply what happens when the tools that produce that knowledge were designed for conversations, not for institutions. We think this is quietly becoming one of the most expensive defaults in enterprise software. This piece is our attempt to name the problem precisely, with evidence. It is not a product pitch: we do not think anyone, including us, has fully solved it.
Someone opens a session
A real problem: a pricing exception, a compliance rule, a process that keeps breaking.
Knowledge is born
A rule clarified, a decision made and justified, a correction the model didn’t know.
The session ends
The work is done. The person closes the chat and moves on to the next thing.
The organization’s record
Nothing. Nobody decided this: it is simply the default.
The volume is no longer marginal
For a long time you could dismiss this as a curiosity: a few enthusiasts chatting with a bot. That framing is dead. Anthropic’s analysis of 1.2 million Claude Cowork sessions across more than 600,000 organizations found that software development accounts for just 8.7% of usage. Much of the rest is the operational core of companies: business process and operations alone is 33.4%, the single largest category, alongside content creation, DevOps, research, data analysis, document processing and sales operations[1]. Anthropic calls it “the work around the work”. We would call it something else: it is the exact layer of a company where tacit knowledge lives.
OpenAI, meanwhile, reports over one million business customers and ChatGPT Enterprise seats growing 9x year over year[2]. LLM traffic measured on a single leading model router grew by an order of magnitude in roughly a year, into the quadrillions of tokens[3].
organizations across 1.2M Cowork sessions analyzed
Anthropic, 2026
of sessions are business process & operations, the #1 category
Anthropic, 2026
of organizations: zero measurable P&L return from GenAI pilots
MIT NANDA, 2025
of AI users bring their own AI tools to work (BYOAI)
Microsoft & LinkedIn, 2024
of ChatGPT accounts used at work are non-corporate
Cyberhaven, 2024
average extra breach cost where shadow AI is high
IBM, 2025
Put plainly: a substantial share of your company’s daily reasoning now happens inside model interactions. The interactions grew by an order of magnitude in about a year. The organizational record of them is, in most companies, zero.
The failure everyone measured and almost nobody explained
In 2025, MIT’s NANDA project published the number every conference speaker has repeated since: 95%. It is usually misquoted. The report’s actual claim is that 95% of organizations surveyed were getting zero measurable P&L return from their GenAI investments within the observation window, and that just 5% of custom enterprise AI tools made it to production. The authors themselves flag the figures as “directionally accurate”, based on 52 interviews and 153 survey responses, with a six-month window that may understate success[4]. Treat the number with care.
What almost nobody repeats is the report’s diagnosis. It is worth quoting exactly:
“The core barrier to scaling is not infrastructure, regulation, or talent. It is learning. Most GenAI systems do not retain feedback, adapt to context, or improve over time.”[4]
The report’s interviewees say it in plainer words. A corporate lawyer: the tool “doesn’t retain knowledge of client preferences or learn from previous edits. It repeats the same mistakes and requires extensive context input for each session.” The most cited barriers among users: “it doesn’t learn from our feedback” and “too much manual context required each time”[4]. Read that against the adoption data above and the picture is uncomfortable. Companies are not failing at AI because the models are weak. The models got good faster than anyone expected. Companies are failing because every session starts from institutional amnesia, and every correction an employee makes is a gift the organization throws away at logout.
This is structural, not a missing feature
It is tempting to think the vendors will simply fix this with bigger context windows or a memory toggle. The technical evidence says otherwise. First, context does not behave like memory. The “Lost in the Middle” study showed that model performance degrades sharply when relevant information sits in the middle of a long context; in the worst cases, giving the model the right document buried among many others performed worse than giving it nothing at all[5]. Chroma’s evaluation of 18 frontier models reached the same conclusion from another angle: performance grows increasingly unreliable as input length grows, even on trivially simple tasks[6]. A longer window is a bigger desk, not a filing system.
Second, persistence across sessions does not exist by default. The entire research line on agent memory, from MemGPT onward, starts from the same premise: anything outside the window is gone unless an external system deliberately captures and re-injects it[7]. When researchers gave web agents the ability to store and reuse workflows they had already figured out, success rates improved by 24.6% and 51.1% in relative terms on standard benchmarks[8]. That delta is a measurement of exactly how much value evaporates when nothing is written down.
Third, even the people building frontier agents work around this, manually. Anthropic’s own engineering guidance recommends “structured note-taking”: the agent writes notes outside the context window, because critical context “would otherwise be lost” across long tasks[9]. Vendor memory features exist precisely because, as OpenAI put it when launching ChatGPT’s memory, remembering across chats “saves you from having to repeat information”[10]. These are real improvements, and they are scoped to a person and a product. Your account remembers you. The company remembers nothing. That distinction is the whole problem, so let us make it explicit.
Companies are not failing at AI because the models are weak. They are failing because every session starts from institutional amnesia.
Personal memory is not organizational memory
When a senior analyst spends twenty minutes teaching an AI assistant the company’s revenue recognition edge cases, three things are true in most organizations today. The correction improves that one conversation. It may improve that one person’s future conversations, if their memory feature caught it. It will never reach the colleague two desks away who will make the same mistake tomorrow, nor the agent that colleague runs, nor the auditor who in two years will ask why two systems answered the same question differently.
One correction, twenty minutes of work
A senior analyst teaches the AI assistant the company’s revenue recognition edge cases.
The answer improves immediately.
If the vendor’s personal memory feature caught it.
Tomorrow they make the same mistake, from scratch.
Still answers with the old rule, with the same confidence.
“Why did two systems answer the same question differently?”
It paid salary to produce that knowledge. It does not own it.
Organizations have always bled knowledge this way, before AI existed. McKinsey estimated interaction workers spend nearly 20% of their week looking for internal information or tracking down colleagues who hold it[11]. Panopto’s workplace study put a number on the departure side: 42% of institutional knowledge is unique to the individual holding it, and knowledge workers waste over five hours a week waiting for or recreating knowledge that already exists somewhere in the company[12]. Both studies have caveats, and both predate LLMs. That is precisely the point. AI did not create the organizational forgetting problem. It multiplied the volume of knowledge being created while leaving the retention rate at zero.
And there is a darker layer. Most of this is not even happening in accounts the company can see. Microsoft’s Work Trend Index found 78% of AI users bring their own tools to work[13]. Cyberhaven’s telemetry, based on actual usage rather than surveys, found that 73.8% of ChatGPT accounts used at work are non-corporate accounts, and that the share of sensitive corporate data pasted into AI tools more than doubled in a year, from 10.7% to 27.4%[14]. IBM’s 2025 breach report attaches a cost: organizations with high levels of shadow AI absorbed an average of $670,000 in additional breach costs[15]. The knowledge is not just unretained. It is accumulating, unmanaged, in places the organization cannot audit at all. We covered the governance side of this in AI governance for SMEs.
AI did not create organizational forgetting. It multiplied the volume of knowledge created while leaving retention at zero.
The two clocks ticking on this problem
The regulatory clock. The EU AI Act’s general applicability arrives on 2 August 2026, bringing transparency and high-risk obligations, with deployer duties phasing in from there[16]. The EDPB has already published a risk methodology specifically for LLM systems[17]. We will not pretend this regulation is about organizational memory; it is not. But it makes one question unavoidable for any European company running AI in real workflows: what did your systems know, where did that knowledge come from, and who approved it? A company whose operational knowledge lives in a million deleted sessions has no answer. On why data sovereignty matters here too, we wrote a dedicated piece.
The competitive clock is more interesting. Y Combinator’s Summer 2026 Request for Startups includes an entry called, literally, “Company Brain”. Tom Blomfield’s framing: “The biggest blocker to AI automation of companies is no longer the models... Now the blocker is the domain knowledge”, and companies need “a system that pulls knowledge out of all these fragmented sources, structures it, keeps it current”, because “AI agents can’t operate like that” on knowledge scattered across heads, threads and tickets[18]. When Y Combinator declares a missing primitive, funded teams follow. The MIT report found the same dynamic from the buyer side: executives’ top demands from vendors were systems that learn from feedback (66%) and retain context (63%), and one CIO put the endgame bluntly: “once we’ve invested time in training a system to understand our workflows, the switching costs become prohibitive”[4].
Memory, in other words, is becoming the moat. The only open question is whether it will be your moat or your vendor’s. It is the same underlying question as who owns the company brain.
Memory is becoming the moat. The only open question is whether it will be yours or your vendor’s.
What an answer would have to look like
We have spent months on this problem, first inside our own company, then with others. We do not have a finished answer. We have become confident about the properties any real answer must have, and we offer them here as a checklist, mostly because we would like to be challenged on them.
If it depends on someone remembering to document after the fact, it is dead on arrival. Nobody documents. Nobody ever has.
Automatic capture without governance is just a bigger landfill. A correction becomes organizational knowledge when someone accountable approves it.
Source, date, owner, status, version. Without it, people don’t trust, auditors can’t verify, and agents consume stale rules with full confidence.
If the version people read and the version agents consume can drift apart, they will.
Not export it: own it, in a format it can read, inside a perimeter it controls. Knowledge in a vendor’s memory feature is knowledge you rent back.
None of these properties is exotic. What is genuinely hard is that they pull against each other: capture wants volume, governance wants friction, agents want structure, humans want prose, auditors want provenance, and employees want zero extra work.
The tensions are the point: the teams that resolve them, in whatever form, will define how companies remember in the agent era. As for where to start measuring where you stand, we formalized it in the Company Brain Maturity Model: the L0-L4 scale of how a company’s operating knowledge lives.
The question we ask you
Here is the uncomfortable arithmetic to run on your own organization. Take the number of AI interactions your teams had last month, sanctioned or not. Estimate the fraction that contained a correction, a decision, a rule, an exception: knowledge your company paid salary to produce. Now ask what percentage of it your organization could retrieve today.
For almost every company we have talked to, the honest answer is a rounding error above zero. Your company is learning at machine speed. It is remembering at approximately zero. That gap compounds daily, it is invisible on any dashboard, and if the MIT diagnosis is right, it is what separates the few organizations extracting real value from AI from everyone else.
We are researching how organizations are dealing with this today: workarounds, internal tools, policies, resignation. If you run AI or agents in production and this problem sounds familiar, we would genuinely like to compare notes. Write to us. The worst outcome is a good conversation.
Do you run AI or agents in production? Let’s compare notes.
We are collecting real cases on where the knowledge born in AI interactions ends up: 30 minutes, no pitch, there is no product in this article. The worst outcome is a good conversation.
The problem, in practice
What does “knowledge dies where it is born” mean?
A growing share of a company’s operational knowledge (decisions, rules, corrections, exceptions) is now born inside AI interactions: chats, agent runs, assistants. When the session ends, that content is not preserved anywhere as shared organizational state: it improves that one conversation and, at best, the personal memory of the person who wrote it, but it never reaches colleagues, other agents, or a verifiable record.
Doesn’t a bigger context window solve this?
No. Research shows model performance degrades as context grows (“Lost in the Middle”, TACL 2024; “Context Rot”, Chroma 2025) and that nothing persists across sessions without an external system that deliberately captures and re-injects context. A longer window is a bigger desk, not a filing system.
Aren’t ChatGPT’s or Claude’s memory features enough?
They are real progress, but they are scoped to one person and one product: your account remembers you. The correction you teach your assistant never reaches your colleague, your colleague’s agent, or an audit. That is the difference between personal memory and organizational memory, and it is the second one that is missing.
What does the EU AI Act have to do with organizational memory?
The AI Act does not talk about organizational memory. But with general applicability from 2 August 2026 it makes one question unavoidable: what did your AI systems know, where did that knowledge come from, and who approved it? A company whose operational knowledge lives in millions of deleted sessions has no answer.
What can a company do today, in practice?
First: measure the phenomenon with the arithmetic in the article (how many AI interactions per month, how many contain knowledge, how much is retrievable). Second: treat the five properties as requirements for any solution, internal or off the shelf: capture at birth, human approval, provenance, one source for people and agents, ownership. Third: decide who owns the problem, because today in almost every organization it has no owner.
Is this article selling something?
No. It is a research piece: the problem, the evidence, and the requirements of an answer. We do work on production AI systems in this space, so we have a declared interest in the topic being taken seriously, and we are collecting notes from teams running AI and agents in production. If the problem sounds familiar, write to us.
Sources
- [1]Anthropic, “How people are using Claude Cowork”, July 2026. claude.com
- [2]OpenAI, “1 million business customers”, November 2025. openai.com
- [3]Menlo Ventures / OpenRouter, “OpenRouter now processes more than a quadrillion tokens a year”, 2026. menlovc.com
- [4]MIT NANDA, “The GenAI Divide: State of AI in Business 2025”, July 2025 (preliminary findings; 52 interviews, 153 surveys, 6-month ROI window). mlq.ai
- [5]Liu et al., “Lost in the Middle: How Language Models Use Long Contexts”, TACL 2024. aclanthology.org
- [6]Chroma Research, “Context Rot: How Increasing Input Tokens Impacts LLM Performance”, July 2025. research.trychroma.com
- [7]Packer et al., “MemGPT: Towards LLMs as Operating Systems”, 2023. arxiv.org
- [8]Wang et al., “Agent Workflow Memory”, 2024. arxiv.org
- [9]Anthropic, “Effective context engineering for AI agents”, September 2025. www.anthropic.com
- [10]OpenAI, “Memory and new controls for ChatGPT”, February 2024. openai.com
- [11]McKinsey Global Institute, “The social economy”, July 2012. www.mckinsey.com
- [12]Panopto, “Workplace Knowledge and Productivity Report”, 2018 (YouGov fieldwork; vendor-sponsored). www.panopto.com
- [13]Microsoft & LinkedIn, “2024 Work Trend Index Annual Report”, May 2024. news.microsoft.com
- [14]Cyberhaven Labs, “AI Adoption and Risk Report”, Q2 2024 (telemetry across 3M workers; vendor data). www.cyberhaven.com
- [15]IBM & Ponemon Institute, “Cost of a Data Breach Report 2025”, July 2025. www.ibm.com
- [16]European Commission, “AI Act implementation timeline”. ai-act-service-desk.ec.europa.eu
- [17]EDPB, “AI Privacy Risks & Mitigations: Large Language Models”, April 2025. www.edpb.europa.eu
- [18]Y Combinator, “Requests for Startups”, Summer 2026 (Tom Blomfield, “Company Brain”). www.ycombinator.com
This is a research piece by Raffaele Zarrelli and Simone Bova, founders of Yempik, with editing done with Claude. We work on production AI systems in this space too, so we have a declared interest in the topic being taken seriously. Every figure is cited to its original source, including the caveats the original authors attach; where a number is commonly misquoted, we quoted the original wording instead.