BDH: The Dragon Hatchling architecture, explained

BDH Explainer · Series overview

August 7, 20265 min read

Dragon Hatchling (BDH) is a Post-Transformer AI architecture built around one premise: intelligence should not have to choose between reasoning and memory. Rather than bolting memory onto a language model from the outside, BDH makes memory, adaptation, and inference part of the same computational fabric.

Current Transformer-based systems have achieved an incredible feat by mimicking language-based human artifacts. Large Language Models (LLMs) can reason with Chain-of-Thought (CoT), produce new code or counterexamples to mathematical conjectures.

The foundational approach to date has mostly relied on brute force: throwing more synthetic data, more weights, more compute during inference, and massive GPU clusters at identical dense structures. Dense Transformer architectures fail to systematically generalize CoT reasoning beyond their specific training bounds.

Transformer-based models have no continual learning, no persistent memory, and no latent reasoning. They lack formal foundations to understand and generalize their behavior at larger scales or under different training and inference regimes.

Scaling returns are diminishing, costs are rising, and the limitations are no longer theoretical; they’re showing up in production. The infrastructure needed to build and deploy fundamentally different architectures that deliver more intelligence per dollar now exists.

We introduce Dragon Hatchling (BDH), a new large language model architecture inspired by scale-free biological networks. The design is brain-inspired, but not brain-imitative. It draws on principles biology got right, namely local interaction, sparse activity, persistent state, and continual adjustment, and applies them to a modern sequence model. BDH shows how attention can emerge from local, graph-based neuron interactions rather than centralized matrix multiplications.

On the one hand, BDH behaves like a decentralized, brain-like system where computation lives on synapses adjusted through Hebbian learning. On the other, it offers a dual, GPU-friendly implementation that empirically matches the performance of GPT-style Transformers.

This duality makes BDH both performant and interpretable: mechanistic interpretability of attention emerges from the architecture itself rather than from post-hoc explanation. BDH supports more secure and safer AI systems by making internal representations and asymptotic behavior predictable, controllable, and robust over time.

The result is a different path forward for AI. BDH keeps the strengths of language models but pushes beyond token-by-token processing toward parallel latent reasoning, the kind of internal structure needed for models that do not just generate answers but work through problems.

This blog series provides broader context for The Dragon Hatchling: The Missing Link between the Transformer and Models of the Brain, published in September 2025 by the Pathway Research team. We begin with what Transformers do well and where they are structurally limited. We then return to the network view that deep learning gradually left behind, and to the graph properties of the brain.

From there we state the design requirements, explain why short-term memory belongs on synapses, and derive BDH from the attention equations in two stages. We close with what we observe in trained models: a recoverable graph, interpretable synapses, activity that tracks novelty, Transformer-like scaling, a uniform way to shard and grow the model, and a path toward reasoning in a persistent latent space.

How to read this series

Readers can follow the series in order for the complete argument, or enter directly through the architectural motivation, mathematical derivation, or empirical results. By clicking on a chapter’s title, you will be directed to that chapter.

Chapter 1: Why search for a brain-inspired network?

Chapter 1 explores why the limitations of the Transformer call for a new approach to language modeling. It traces how artificial neural networks evolved toward dense, globally coordinated computation, then shows how the brain’s sparse, locally organized, scale-free structure offers an alternative foundation for efficient intelligence and explains how these insights shaped BDH’s design principles.

Chapter 2: From attention to synapses: deriving BDH

Chapter 2 derives BDH from the attention equations, reframing retrieval as synaptic memory in a high-dimensional sparse neuron space and showing how Hebbian updates and low-rank factorization lead to the practical BDH-GPU architecture. It then highlights the key differences between BDH and the Transformer.

Chapter 3: What emerges in trained BDH models: graphs, synapses, scaling

Chapter 3 demonstrates BDH empirically, revealing its scale-free connectivity, interpretable synapses and neurons, Transformer-like scaling, and a uniform approach to model sharding and growth.

Series conclusion: What comes next for BDH and Post-Transformer AI?

The conclusion brings the three chapters together and considers the implications for persistent memory, latent reasoning, continual learning, and scalable inference.

Further reading

This series explains the BDH architecture and its motivation. For the underlying research, mathematical treatment, implementation, and benchmark evidence, continue with: