Posts

Browse all articles covering artificial intelligence, AGI development, machine learning, and technology insights with practical perspectives.

• How a Mixture of Experts Manages Its Experts

  
  Published: 21 Jul, 2026 |  at  11:00 AM

  A Mixture of Experts does not become efficient simply by replacing one large FFN with smaller experts. Everything depends on routing, load balancing, and the combinatorics that decouple capacity from cost.

• World Models: A Building Block for AGI, Not a Sufficient Architecture

  
  Published: 15 Jul, 2026 |  at  11:00 AM

  World models provide a more robust understanding of physical dynamics, but their interventional validity remains expensive to generalize. Why AGI will probably need a hybrid architecture combining LLMs, causality, and interaction.

• Synthetic data: from model collapse to epistemic risk

  
  Published: 29 Jun, 2026 |  at  10:47 PM

  Model collapse during training is documented. But when synthetic data is also used to test and validate a thesis, another risk emerges: AI research may become trapped inside its own assumptions.

• AI: will we even have time to invent our own methods?

  
  Published: 15 Jun, 2026 |  at  09:00 AM

  AI platforms are arriving before companies have had time to understand their own needs. How can we preserve our ability to choose our methods rather than simply inherit them?