Leon Chlon

Leon Chlon

AI Research Lead, PhysicsX. Founder, Hassana Labs.

I study when language models genuinely learn from their context and when they take shortcuts: why they hallucinate, and how structured inductive biases, symmetry-aware learning and a Bayesian perspective can make them more reliable and easier to interpret. I also work on world models, multimodal learning and physics-informed machine learning.

I’m AI Research Lead in the Fundamentals team at PhysicsX. Before that I was a Visiting Fellow in the Torr Vision Group at the University of Oxford. I founded Hassana Labs, an independent non-profit AI research lab that opens doors for researchers from marginalised communities, and wrote a free book, Information Geometry for Generative Models, with donations going to Lebanese refugees.

Selected papers

  1. Predictable Compression Failures: Order Sensitivity and Information Budgeting for Evidence-Grounded Binary Adjudication

    Leon Chlon, Ahmed Karim, Maggie Chlon, MarcAntonio Awada. ICML 2026.

    When the evidence doesn’t carry enough information to support an answer, a model fills the gap with something plausible; the paper turns this into a rule for when to answer and when to abstain. Code

  2. Exact Finite Attention Responses From RoPE Derivatives

    Julie Huang, Maggie Chlon, Gregory Gutin, Leon Chlon. arXiv preprint, September 2026.

    An exact formula for how a model’s attention responds when parts of its input are moved, removed or changed.

  3. Robot World Models Are Not Invariant to How the Actions Are Written

    Ahmed Karim, Leon Chlon. arXiv preprint, September 2026.

    A robot world model trained on one way of writing actions breaks when it’s handed the same actions written another, equivalent way.

  4. LLMs are Bayesian in Expectation, Not Realization

    Leon Chlon, Zein Khamis, Fatima Sheaib, Maggie Chlon, Mahdi El Zein, MarcAntonio M. Awada. arXiv preprint, 2025, revised 2026.

    Averaged over the order of their examples, language models come close to ideal Bayesian reasoning; any single ordering can drift from it.

  5. Information Geometry for Generative Models

    Leon Chlon. Free textbook, 2026. PDF

    Thirteen chapters, from compression and Bayesian prediction to transformers and diffusion. Originally bound for Oxford University Press and released free instead; donations support displaced Lebanese refugees.

Software

More research code: ITO, factuality-slice and aecf. I’ve also contributed to Google DeepMind’s Optax and to Hugging Face, including a 4× speed-up in SAM image processing.

News

Work

Talks and writing

Teaching and mentoring

Education