News

More news

Publications

We do research in both theoretical machine learning, as well as applications of machine learning in various domains, including medical, astronomy, autonomous driving, and more.

Recent publications:
07/2024: "AI models collapse when trained on recursively generated data" (Ilia Shumailov, Zakhar Shumaylov, Yiren Zhao, Nicolas Papernot, Ross Anderson, Yarin Gal).
07/2024: "Variational Inference Failures Under Model Symmetries: Permutation Invariant Posteriors for Bayesian Neural Networks" (Yoav Gelberg, Tycho F.A. van der Ouderaa, Mark van der Wilk, Yarin Gal).
06/2024: "Detecting hallucinations in large language models using semantic entropy" (Sebastian Farquhar, Jannik Kossen, Lorenz Kuhn, Yarin Gal).

Reproducibility and Code

One of our lab's missions is to contribute to the reproducibility effort. Here we provide code for our own research, as well as reproductions of works by others (e.g. ones we implemented as baselines as part of our own research).

Recent code release:
07/2024: AI models collapse when trained on recursively generated data (Ilia Shumailov, Zakhar Shumaylov, Yiren Zhao, Nicolas Papernot, Ross Anderson, Yarin Gal).
06/2024: Detecting hallucinations in large language models using semantic entropy (Sebastian Farquhar, Jannik Kossen, Lorenz Kuhn, Yarin Gal).
04/2023: Bayesian active learning with EPIG data acquisition (Freddie Bickford Smith).
05/2022: Tranception: protein fitness prediction with autoregressive transformers and inference-time retrieval (Pascal Notin).
12/2021: Improving black-box optimization in VAE latent space using decoder uncertainty (Pascal Notin).

Group Members

We are researchers coming from varied backgrounds, including Computer Science, Maths & Stats, Engineering, and Physics.

We come from academia (Oxford, Cambridge, MILA, Manchester, U of Amsterdam, U of Toronto, U of Cape Town, Yale, and others) and industry (Google, DeepMind, Twitter, Qualcomm, and startups).

Current and former members include Rhodes Scholars, Clarendon Scholars, DeepMind Scholars, one cancer research UK Scholar, with our students funded by many additional sources (AIMS CDT, Cyber CDT, industry, and more). If you'd like to join us take a look here.

Current group members: Yarin Gal (Associate Professor) ● Freddie Kalaitzis (Senior Research Fellow, 2020) ● Tiarnan Doherty (Postdoc, 2022) ● Daniella (Zihuiwen) Ye (PhD, 2024) ● Hazel Kim (PhD, 2023) ● Luckeciano Carvalho Melo (PhD, 2023) ● Matthew Kearney (PhD, 2023) ● Yonatan Gideoni (PhD, 2023) ● Katrina Dickson (Associate Member (Program Manager), 2023) ● Kunal Handa (MSc by Research, 2023) ● Ilia Shumailov (Associate Member (Senior Research Fellow), 2022) ● Gunshi Gupta (PhD, 2021) ● Kelsey Doerksen (PhD, 2021) ● Ruben Weitzman (PhD, 2021) ● Shreshth Malik (PhD, 2021) ● Jannik Kossen (PhD, 2020) ● Lisa Schut (PhD, 2020) ● Muhammed Razzak (PhD, 2020) ● Gabriel Jones (Associate Member (PhD), 2020) ● Freddie Bickford Smith (Associate Member (PhD), 2020) ● Angus Nicolson (Associate Member (PhD), 2020) ● Atılım Güneş Baydin (Associate Member (Faculty), 2020) ● Pascal Notin (Associate Member (Senior Research Fellow), 2019) ● Tom Rainforth (Associate Member (Faculty), 2019) ● Tim G. J. Rudner (PhD, 2017) ● Sebastian Farquhar (Associate Member (Senior Research Fellow), 2017)


Group Invited Talks

Recent invited talks:
11 Jun 2024, 12:00, Room 051 Marco Sertoli (Tokamak Energy). ML for Fusion Research
14 May 2024, 12:00, Lecture Theatre A Albert Jiang (Cambridge/Mistral). Trustworthy Automation in Mathematics with Language Models
03 May 2024, 13:00, Lecture Theatre A Jonathan Frankle (Databricks). Training Modern LLMs from Scratch
05 Mar 2024, 16:00, Lecture Theatre A Nicolas Papernot (University of Toronto). Characterizing Machine Unlearning through Definitions and Implementations

Group Collaborators and Affiliates

Our group collaborators include:



And our group affiliates include:

Are you looking to do a PhD in machine learning? Did you do a PhD in another field and want to do a postdoc in machine learning? Would you like to visit the group?

How to apply


Contact

We are located at
Department of Computer Science, University of Oxford
Wolfson Building
Parks Road
OXFORD
OX1 3QD
UK
Twitter: @OATML_Oxford
Github: OATML
Email: oatml@cs.ox.ac.uk