This post is an attempt to find answers to a question I had, using Claude and Gemini Argon. The write-up, the simulations and figures were produced with Claude and Gemini and then edited by me for the blog. The question (and the intuition behind it) are mine, obviously. This is...
[Read More]
A Riff on "The Slow Death of Scaling"
Sara Hooker’s essay “On the Slow Death of Scaling” (2026) is a thought-provoking piece that deserves a careful read.1 What follows is my interpretation (or perhaps more accurately, a riff) on her arguments, where I’ll both steelman her position and push back where I think the evidence points elsewhere. Hooker,...
[Read More]
Active Learning vs. Data Filtering:
Selection vs. Rejection
What is the difference between active learning (and active sampling)
and data filtering? And why do we treat data selection differently
during training versus before training?
[Read More]
The Paradox of Polarization: When More Facts Backfire
This note explores a seemingly simple yet surprisingly profound example of how rational agents can diverge in their beliefs even when exposed to identical evidence. While the mathematical model we’ll examine is highly simplified, its core mechanism offers a potential lens through which to understand the complex dynamics of real-world...
[Read More]
Why is the Bayesian Model Average the best choice?
Why is the Bayesian model average (BMA) often hailed as the optimal
choice for rational actors making predictions under uncertainty? Is this
claim justified, and if so, what’s the underlying logic?
[Read More]