Posts
Browse all articles covering artificial intelligence, AGI development, machine learning, and technology insights with practical perspectives.
-
Navier-Stokes: Neither Human nor AI, but the System
Published: at 02:00 AMBehind the 10,000 agents working on Navier-Stokes was an organization, and a human role that became scarcer without disappearing.
-
How a Mixture of Experts Manages Its Experts
Published: at 11:00 AMA Mixture of Experts does not become efficient simply by replacing one large FFN with smaller experts. Everything depends on routing, load balancing, and the combinatorics that decouple capacity from cost.
-
World Models: A Building Block for AGI, Not a Sufficient Architecture
Published: at 11:00 AMWorld models provide a more robust understanding of physical dynamics, but their interventional validity remains expensive to generalize. Why AGI will probably need a hybrid architecture combining LLMs, causality, and interaction.
-
Synthetic data: from model collapse to epistemic risk
Published: at 10:47 PMModel collapse during training is documented. But when synthetic data is also used to test and validate a thesis, another risk emerges: AI research may become trapped inside its own assumptions.
AiBrain