BDH: The Missing Link between the Transformer and Models of the Brain
Join us on April 10, 2026 in Montreal, Canada for a talk by Jan Chorowski, CTO and Co-Founder of Pathway, on BDH: The Missing Link between the Transformer and Models of the Brain.
BDH: The Missing Link between the Transformer and Models of the Brain
Join us on April 10, 2026 in Montreal, Canada for a talk by Jan Chorowski, CTO and Co-Founder of Pathway, on BDH: The Missing Link between the Transformer and Models of the Brain. The session will introduce a new large language model architecture inspired by scale-free biological networks and designed to combine interpretability with Transformer-like performance.
BDH shows how attention can emerge from local, graph-based neuron interactions rather than centralized matrix multiplications, while remaining compatible with efficient GPU-based implementation. To learn more about BDH's architecture, interpretability, and behavior, you can find the BDH paper here.
See you in Montreal!
Team
