About
Founding engineer at Contextual AI, working on agentic RAG, evaluation, and alignment mentored by Douwe Kiela. Previously researcher at Center for Brains Mind and Machines - MIT and Electronic visualization Lab - UIUC
Selected Publications
View All →Jon Saad-Falcon†, Rajan Vivek†, William Berrios†, Nandita Shankar Naik, Matija Franklin, Bertie Vidgen, Amanpreet Singh, Douwe Kiela, Shikib Mehri
Findings of the Association for Computational Linguistics: EMNLP 2024
A natural language unit testing paradigm for fine-grained LLM evaluation, achieving state-of-the-art on FLASK and BigGenBench benchmarks.
Nicholas Lui, Bryan Chia, William Berrios, Candace Ross, Douwe Kiela
Proceedings of the AAAI Conference on Artificial Intelligence
Using diffusion model perturbations to create demographically balanced datasets for measuring racial bias in vision-language models.
William Berrios, Gautam Mittal, Tristan Thrush, Douwe Kiela, Amanpreet Singh
A modular approach enabling LLMs to solve computer vision tasks by reasoning over descriptive vision module outputs, achieving competitive performance without multimodal training.