Last week’s Post-Transformer debate post raised one question: Can long term memory become part of the architecture?
It points to one promising mathematical idea behind Post Transformer AI: Linear attention in high dimension with persistent state.
In a standard Transformer,
Building AI architectures and models that autonomously and continually learn, evolve, and reason.
- Pathway (www.pathway.com) repostedExactly why I’m so bullish on @pathway_com. 🧠 Next-Gen AI ⚡️ Incredible performance 🔋 Ultra compute-efficientCitadel Securities just put institutional weight behind what the AI bulls won't say out loud. In a new macro note titled "Tokenomics," Citadel makes the argument plainly: even the most powerful technology on earth still has to pass through the boring discipline of cost curves,
- Pathway (www.pathway.com) repostedThere are co-founders. Then, there are friends. And then, there is @JChorowski. Jan Chorowski and his story. From working on attention at MILA, through speech to Google Brain, all the way to BDH.
00:00 - Pathway (www.pathway.com) repostedThis is probably the most entertaining way to understand one of AI’s hardest AI debates. Transformer vs Post-Transformer, argued by leading researchers, inside a real physical boxing ring. Both technically deep and genuinely entertaining. I was glued for the entire 1 hour 20
00:00 - Pathway (www.pathway.com) reposted200K+ views and counting! The Transformer vs Post-Transformer debate, convened by @pathway_com Ft @lukaszkaiser, @adrian_pathway, @YesThisIsLion, @mlech26l, @dexhorthy, and me. Watch on YouTube: youtube.com/watch?v=hCjoML… Follow along for the next one.
- Pathway (www.pathway.com) reposted“We have not yet had a PageRank moment for intelligence.” We’ve got so many comments and questions about this statement delivered by @adrian_pathway during our recent Transformer vs Post-Transformer debate with @lukaszkaiser @YesThisIsLion @mlech26l - thanks! Let’s dig into
- Here's a great starting point for you to understand the Transformer vs Post Transformer Debate convened by @zuzanna_pathway! Credits @rohanpaul_ai.This is probably the most entertaining way to understand one of AI’s hardest AI debates. Transformer vs Post-Transformer, argued by leading researchers, inside a real physical boxing ring. Both technically deep and genuinely entertaining. I was glued for the entire 1 hour 20
00:00 - Pathway (www.pathway.com) repostedThe full Transformer vs Post-Transformer debate is live. 80 minutes. Seven rounds. No slides. Real disagreement. @lukaszkaiser came to defend the Transformer. @adrian_pathway, @YesThisIsLion, and @mlech26l made the case for what comes next. 00:00 Contenders enter the ring 06:30
00:00 - Pathway (www.pathway.com) repostedOne deep learning debate every AI researcher should care about: Transformers vs Post Transformers. At the surface, it sounds like an architecture fight. Mathematically, it is about scaling laws, memory, online learning in frontier models, and hardware limits. That is what made










