I Measured My Copilot Citation Drop Against Its Best Five Weeks
I called a 45% fall in my Copilot citations. Against June and July, the real fall was smaller and started a week later than I said. How I read the report now.
Every few months a new word shows up to tell you your AI setup is behind. Right now the word is memory. My feed is full of videos about building a “brain” for an AI agent: memory layers, knowledge graphs, context engineering. I build my own AI systems for client work, so I took the trend seriously and sent a team of research agents through all of it. The verdict came back about 60 percent noise and 40 percent real. The real part is something you can build out of plain text files. You don’t need to buy a memory product. You need better notes. Here is the full read.
Strip the jargon and agent memory means one thing. An AI tool that doesn’t start from zero every time you open it.
By default most AI agents are amnesiacs. You finish a session, close the window, and everything the tool learned about your brand and your last decision is gone. Next session you brief it from scratch. “Building a brain” is the catch-all for fixing that.
The trend splits the idea into two kinds of memory. Semantic memory is facts and rules: your brand voice and your margin floor. Episodic memory is what happened: which campaign you ran last month and what it returned. Most marketing teams using AI have written down neither in a place the tool can read.
Everything else is plumbing. Knowledge graphs and vector databases are storage formats for the two kinds of memory above. Useful to engineers. Mostly noise to an operator.
Once you see the layers, the hype sorts itself.
The loudest layer is the vendors. A wave of startups now sells “memory layers” as a product. Mem0, Letta, a dozen others. They publish “State of AI Agent Memory” reports that read like research and function like brochures. Behind them are the investors who funded the round and need the category to feel inevitable.
The next layer is the influencers. “Context engineer” gets called the hottest job title of the year by people who make videos for a living. That tells you nothing about whether you need one.
The thin layer underneath is the real signal. Anthropic, the lab behind the model I run every day, treats context engineering as a genuine engineering discipline with named failure modes. When the people building the technology write something careful, read it. When someone selling the technology writes something urgent, discount it.
The mix lands around 60 / 40. The trend is real. The volume around it is not.
Here is the detail almost no video mentions.
Giving an AI a memory is easy. Deciding what it should forget is hard, and it’s mostly unsolved.
Add memory to an agent and at first it works. Then stale facts pile up. Old decisions contradict new ones. The tool starts confidently citing something that stopped being true six weeks ago. Vendor benchmarks measure how well a system retrieves a fact. They don’t measure how well it drops one that went bad. On a real workload, accuracy can slide noticeably within weeks of use.
So the demo looks perfect and the production system slowly rots. Anyone selling you a memory layer is selling the easy half of the problem.
I had the same itch, because I do have a real memory gap in my own work.
I run AI pipelines that produce ad creative and content for clients. They generate the work, it ships, and nothing comes back. The pipeline never learns whether the ad it made performed. That’s the missing memory. Not a philosophical one. A specific, fixable one.
I didn’t buy a memory layer. I built a small tool that reads ad performance from Meta and Google and writes it into a plain text file. Winning angles. Creative that’s fading. Concepts that are dead. One file per client. The production pipeline reads that file before it generates the next batch.
The file is the brain. It’s a Markdown document. I can read the whole thing in ten seconds, and so can the client.
AI pipeline builds the ad creative.
Creative goes live on Meta and Google.
Performance read back from the ad platforms.
Outcome saved to a plain results.md file.
The return step: 04 is read before 01 runs again. That return is the loop. Remove it and the pipeline stops at 02 and never learns.
Memory is a discipline, not a product.
Your AI systems already have memory the moment you give them a file to read. A document with your brand rules is semantic memory. A running log of what each campaign returned is episodic memory. Plain files, kept current, under version control. That covers what almost every marketing operator needs.
A vector database answers a problem of scale that most operators will not have for years. Reaching for one now is buying a forklift to move a single box.
The rule I run on: build memory out of files a human can open and read. If you can’t read your agent’s memory, you can’t tell when it’s wrong. And it will be wrong. A memory you can audit beats a memory you have to trust.
The tool I built is real and it’s boring. Three files. Markdown and JSON. No database, no vendor account, no monthly fee. It runs at zero marginal cost and the whole thing is legible to anyone who opens the folder.
The trend will resurface next quarter in a louder form with a new word attached. The file will still be a file. Boring infrastructure you understand beats exciting infrastructure you rent.
If you want to know what your ad account is actually doing, automated features included, the free ads audit is the place to start. Send me read-only access and I write it up myself, 5 to 7 pages, back within 24 hours. No call.
If this hit, the next two pieces in the same universe:
Free PDF: The two-page Voice Audit Checklist. No email gate.
Questions about Google Ads, tracking or Shopify? Browse all 89 answers
I called a 45% fall in my Copilot citations. Against June and July, the real fall was smaller and started a week later than I said. How I read the report now.
A site can go live looking right while its search index is missing, generated files 404 and a build variable breaks a feature. The script that ended them.
Add me as a read-only user and I'll write the audit myself: 5 to 7 pages, back within 24 hours of access. A home or furniture store can send the store link instead. Rather talk first? A call is open too.