Science of (Artificial) Intelligence
How meaning resolves from noise.
I seek to understand current artificial intelligence through empirical and theoretical investigation, especially aiming to explain interesting and puzzling deep learning phenomena.
I have investigated how diffusion models learn to factorize and compose concepts, revealing mechanisms of compositionality in deep generative models.
Currently, I'm exploring evolution strategies for finetuning large language models, examining how evolutionary approaches can complement traditional gradient-based methods for model adaptation and alignment.