PrefixMemory-Tuning: Modernizing Prefix-Tuning by Decoupling the Prefix from Attention
International Conference on Learning Representations, 2026
Independent Researcher
I’m an independent AI researcher with a background in mathematics and statistics. I work on model efficiency and reasoning, which I see as two sides of the same coin. Much of my research is about understanding how language models use the context they’re given, and whether we can make that process more efficient without losing their ability to reason.
During my PhD, I mainly worked on connections between in-context learning and model weights, as well as methods for adapting models more efficiently. Recently, I’ve been looking at how memory and attention limit what transformers can do. I’m also studying diffusion language models as a possible alternative, particularly how to make their decoding more efficient.
I enjoy bringing what I’ve learned from working with researchers in industry into my own research. That experience has given me a clearer sense of the problems that are most pressing in practice and helps guide the questions I choose to work on. I believe theory should guide experiments and help us understand what’s happening at the frontier, rather than serve as an excuse to ignore it.
I did my PhD in Computer Science at the National University of Singapore with Kenji Kawaguchi, after studying Mathematics and Statistics at Oxford. My work has appeared at ICML and ICLR.
Equal contribution
International Conference on Learning Representations, 2026
npj Biomedical Innovations, 2026
International Conference on Machine Learning, 2024
NeurIPS Workshop, 2024
Recent work on the limits of memory and attention, probing reasoning, and efficient language model inference.
Get in touch
For research discussions and collaboration, you can reach me by email.