More Publications

(2020). Pretrained Language Models for Biomedical and Clinical Tasks:Understanding and Extending the State-of-the-Art. In ClinicalNLP 2020 @ EMNLP 2020.

PDF Code Project

(2020). Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval. Arxiv Preprint.

Preprint PDF

(2020). KILT: a Benchmark for Knowledge Intensive Language Tasks. Arxiv Preprint.

Preprint PDF Code

Recent Posts

More Posts

Earlier this year I led a collaboration between Cray Supercomputers, Digital Catapult and Bloomsbury AI (my previous employer). This …

I just got back from EMNLP in Brussels. We were presenting our dataset paper ShARC (a blog post about ShARC will be coming soon). The …


Here are some great projects I’m involved with:


LAMA ia a probe for analyzing factual and commonsense knowledge in language models.


Code, Data and Models to run Unsupervised Question Answering data generation on your own documents


Cape is a software solution allowing for SUPER easy integration of Machine Reading into software.