How to manage context effectively and prevent AI from making things up
How do you balance lots of lengthy context files while avoiding token limits? How do you prevent hallucinations?Hilary Gridley challenges this premise by pointing out the desire to load as much context as possible into these tools is a trap. Often there’s bad context in any large context set - outdated information, incorrect data, conflicting versions.Instead, synthesize layers of context. If you have a project with dozens of files, pull them into a conversation with ChatGPT and ask what’s most salient. Generate a focused markdown file from that conversation. Now you have one file instead of dozens.For file conversion, Sven-Erik Nielsen recommends the Markdown MCP server, which converts everything to markdown including PDFs. Where it doesn’t do a great job, iterate and distill before pulling insights back into your corpus.Tristan Rodman’s maintenance approach: Keep a running project log. Today’s date, what happened, conversations you had. It’s the easiest thing to pull from when writing status updates, and it prevents context from getting stale.On preventing hallucinations, the stakes are real. I learned this painfully when using AI to rearrange interview quotes. I texted the person about something interesting they said. “Dude, I didn’t say any of that.” The AI had completely fabricated quotes. I spent a whole day trying to stop hallucinations on content, then another half day on attribution.As Zev Arnovitz warns, if you show AI-generated work without verification and someone catches an error, you lose your team’s trust completely. And you’re ruining it for all of us because people aren’t sold on AI yet.The bottom line from Tristan: You’re accountable for the artifact you produce. There’s no world where you want to ship something you wouldn’t co-sign.➡️ Synthesize context into focused markdown files instead of dumping everything. Keep a running project log. And always verify: schedule calls with support ticket users, check quotes against transcripts, validate with your team. You own what you ship.