Writing

Writing & Essays

Essays on research, journalism, and academic life, from minds to machines.

The Papers

On my research

Short write-ups of individual papers, with references in the margins.

Paper · Award

Teacher Demonstrations in a BabyLM's Zone of Proximal Development

How a slightly-stronger "teacher" improves multi-turn learning in a small model. Outstanding Paper, EMNLP 2025.

Paper · Award

Looking to Learn: Token-wise Dynamic Gating for Vision-Language Modelling

Token-wise gating for low-resource vision-language models. Outstanding Paper, EMNLP 2025.

Paper

ByteSpan: Information-Driven Subword Tokenisation

Tokenisation that groups predictable bytes instead of pooling their representations.

Paper · EMNLP 2026

LangMAP: A Language-Adaptive Approach to Tokenization

Adapting tokenisation to the language rather than committing to one fixed scheme.

Paper

BabyBabelLM: A Multilingual Developmentally-Plausible Benchmark

A multilingual pretraining benchmark built to a child's scale of language input.

Paper · EMNLP 2026

Cross-Lingual Alignment Without Joint Training

Do monolingual models converge on universal representations with no joint training?

Paper · Framework

Pico: Hypothesis-Driven Small Language Model Research

A modular sandbox and baseline suite for controlled small-model experiments.

Paper

What's the Best Sequence Length for BabyLM?

How the training sequence length shapes what a human-scale model learns.

Paper

BLiSS: Bilingual Learner Competence in Small Models

Evaluating second-language learner competence in small language models.

Paper

Less is More: Cognitively-Plausible Curricula for Cross-Lingual Small Models

Curriculum-learning strategies for pre-training multilingual BabyLMs.

Paper

Measuring Grammatical Diversity from Small Corpora

Annotation-invariant measures of grammatical diversity from limited data.

Paper · BlackboxNLP 2026

Development of Linear Truth Encodings in Language Models

A replication study of how linear "truth" directions emerge during training.