Javier Alvarez-Valle

MAIRA-Seg: Enhancing Radiology Report Generation with Segmentation-Aware Multimodal Large Language Models

Harshita Sharma, Valentina Salvatelli, Shaury Srivastav, Kenza Bouzid, Shruthi Bannur, Daniel Coelho de Castro, Maximilian Ilse, Sam Bond-Taylor, Mercy Ranjit, Fabian Falck, Fernando Pérez-García, Anton Schwaighofer, Hannah Richardson (nee Murfet), Maria Teodora Wetscherek, Stephanie Hyland, Javier Alvarez-Valle

NeurIPS 2024 | December 2024

Preprint DOI Project

OSAIRIS: Lessons Learned from the Hospital-Based Implementation and Evaluation of an Open-Source Deep-Learning Model for Radiotherapy Image Segmentation

Alexandra Constantinou, Andrew Hoole, David C. Wong, G. S. Sagoo, Javier Alvarez-Valle, Kenji Takeda, Tom Griffiths, Amy Edwards, Andrew Robinson, Liam Stubbington, Niall Bolger, Yvonne Rimmer, Thiraviyam Elumalai, K. T. Jayaprakash, Richard Benson, Ian Gleeson, Rebecca Sen, Louisa Stockton, Tian Wang, Stephanie Brown, E. Gatfield, C. Sanghera, Alexandros Mourounas, Barry Evans, Anita Anthony, Renteng Hou, Marian Toomey, K. Wildschut, Aviva Grisby, Gill Barnett, Rose McMullen, Raj Jena

Clinical Oncology | October 2024

DOI Github Github Github Github Project Project

MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging

Noel Codella, Yu Gu, Shrey Jain, Ho Hin Lee, Asma Ben Abacha, Alberto Santamaria-Pang, Will Guyman, Natieek Sangani, Sheng Zhang, Hoifung Poon, Stephanie Hyland, Shruthi Bannur, Javier Alvarez-Valle, Xue Li, John Garett, Alan McMillan, Gaurav Rajguru, Madhu Maddi, Nilesh Vijayrania, Reehan Bhimai, Nick Mecklenburg, Rupal Jain, Daniel Holstein, Naveen Gaur, Vijay Aski, Jenq-Neng Hwang, Thomas Lin, Ivan Tarapov, Matthew P Lungren, Mu Wei

October 2024

Publication

MAIRA-2: Grounded Radiology Report Generation

Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Anton Schwaighofer, Sam Bond-Taylor, Maximilian Ilse, Fernando Pérez-García, Valentina Salvatelli, Harshita Sharma, Felix Meissen, Mercy Ranjit, Shaury Srivastav, Julia Gong, Fabian Flack, Ozan Oktay, Anja Thieme, Matthew P Lungren, Maria Teodora Wetscherek, Javier Alvarez-Valle, Stephanie Hyland

MSR-TR-2024-18 | June 2024

Published by Microsoft

Preprint PDF Github Github Download Project

Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology

Nur Yildirim, Hannah Richardson (nee Murfet), Maria T Wetscherek, Junaid Bajwa, Joseph Jacob, Mark A Pinnock, Stephen Harris, Daniel Coelho de Castro, Shruthi Bannur, Stephanie Hyland, Pratik Ghosh, Mercy Ranjit, Kenza Bouzid, Anton Schwaighofer, Fernando Pérez-García, Harshita Sharma, Ozan Oktay, Matthew P Lungren, Javier Alvarez-Valle, Aditya Nori, Anja Thieme

CHI 2024 | May 2024

Preprint Publication Project

Challenges for Responsible AI Design and Workflow Integration in Healthcare: A Case Study of Automatic Feeding Tube Qualification in Radiology

Anja Thieme, Abhijith Rajamohan, Benjamin Cooper, Heather Groombridge, Robert Simister, Barney Wong, Nicholas Woznitza, Mark Ames Pinnock, Maria Teodora Wetscherek, Cecily Morrison, Hannah Richardson (nee Murfet), Fernando Pérez-García, Stephanie Hyland, Shruthi Bannur, Daniel Coelho de Castro, Kenza Bouzid, Anton Schwaighofer, Mercy Ranjit, Harshita Sharma, Matthew P Lungren, Ozan Oktay, Javier Alvarez-Valle, Aditya Nori, Stephen Harris, Joseph Jacob

2405.05299 | May 2024

Published by arXiv

Preprint PDF Project

Enabling large-scale screening of Barrett’s esophagus using weakly supervised deep learning in histopathology

Kenza Bouzid, Harshita Sharma, Sarah Killcoyne, Daniel Coelho de Castro, Anton Schwaighofer, Maximilian Ilse, Valentina Salvatelli, Ozan Oktay, Sumanth Murthy, Lucas Bordeaux, Luiza Moore, Maria O'Donovan, Anja Thieme, Aditya Nori, Marcel Gehrung, Javier Alvarez-Valle

Nature Communications | March 2024, Vol 15

DOI Publication PDF

RAD-DINO: Exploring Scalable Medical Image Encoders Beyond Text Supervision

Fernando Pérez-García, Harshita Sharma, Sam Bond-Taylor, Kenza Bouzid, Valentina Salvatelli, Maximilian Ilse, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Matthew P Lungren, Noel Codella, Stephanie Hyland, Javier Alvarez-Valle, Ozan Oktay

MSR-TR-2024-5 | January 2024

Published by Microsoft

Preprint Download Project

RadEdit: stress-testing biomedical vision models via diffusion image editing

Fernando Pérez-García, Sam Bond-Taylor, Pedro P. Sanchez, Boris van Breugel, Daniel Coelho de Castro, Harshita Sharma, Valentina Salvatelli, Maria T. A. Wetscherek, Hannah Richardson (nee Murfet), Matthew P Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay, Maximilian Ilse

December 2023

Preprint Project

MAIRA-1: A specialised large multimodal model for radiology report generation

Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Mercy Ranjit, Anton Schwaighofer, Fernando Pérez-García, Valentina Salvatelli, Shaury Srivastav, Anja Thieme, Noel Codella, Matthew P Lungren, Maria Teodora Wetscherek, Ozan Oktay, Javier Alvarez-Valle

MSR-TR-2023-47 | November 2023

Published by Microsoft

Publication Project

Exploring the Boundaries of GPT-4 in Radiology

Qianchu Liu, Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Maria Teodora Wetscherek, Robert Tinn, Harshita Sharma, Fernando Pérez-García, Anton Schwaighofer, Pranav Rajpurkar, Sameer Tajdin Khanna, Hoifung Poon, Naoto Usuyama, Anja Thieme, Aditya Nori, Matthew P Lungren, Ozan Oktay, Javier Alvarez-Valle

EMNLP 2023 | October 2023

PDF Publication Project

Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing

Shruthi Bannur, Stephanie Hyland, Flora Liu, Fernando Pérez-García, Maximilian Ilse, Daniel Coelho de Castro, Benedikt Boecking, Harshita Sharma, Kenza Bouzid, Anja Thieme, Anton Schwaighofer, Maria Teodora Wetscherek, Matthew Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) | June 2023

Preprint Download Project

Making the Most of Text Semantics to Improve Biomedical Vision-Language Processing

Benedikt Boecking, Naoto Usuyama, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Stephanie Hyland, Maria Teodora Wetscherek, Tristan Naumann, Aditya Nori, Javier Alvarez-Valle, Hoifung Poon, Ozan Oktay

The European Conference on Computer Vision (ECCV) | October 2022

Preprint Video Download Download Project

Active label cleaning for improved dataset quality under resource constraints

Melanie Bernhardt, Daniel Coelho de Castro, Ryutaro Tanno, Anton Schwaighofer, Kerem C. Tezcan, Miguel Monteiro, Shruthi Bannur, Matthew P. Lungren, Aditya Nori, Ben Glocker, Javier Alvarez-Valle, Ozan Oktay

Nature Communications | March 2022, Vol 13(1161): pp. 1-11

Publication Github Project Project

Machine Learning for Auto-Segmentation in Radiotherapy Planning

K Harrison, H Pullen, C Welsh, Ozan Oktay, Javier Alvarez-Valle, R Jena

The Royal College of Radiologists - Clinical Oncology | January 2022, Vol 34(2): pp. 74-88

Publication Project Project

Multi-institution encrypted medical imaging AI validation without data sharing

Arjun Soin, Pratik Bhatu, Rohit Takhar, Nishanth Chandran, Divya Gupta, Javier Alvarez-Valle, Rahul Sharma, Vidur Mahajan, Matthew P Lungren

August 2021

Publication Project

Hierarchical Analysis of Visual COVID-19 Features from Chest Radiographs

Shruthi Bannur, Ozan Oktay, Melanie Bernhardt, Anton Schwaighofer, Rajesh Jena, Besmira Nushi, Sharan Wadhwani, Aditya Nori, Kal Natarajan, Shazad Ashraf, Javier Alvarez-Valle, Daniel Coelho de Castro

ICML 2021 Workshop on Interpretable Machine Learning in Healthcare | July 2021

PDF Preprint Project Project Project Project

Addressing the Exorbitant Cost of Labeling Medical Images with Active Learning

Saba Rahimi, Ozan Oktay, Javier Alvarez-Valle, Sujeeth Bharadwaj

International Conference on Machine Learning in Medical Imaging and Analysis | June 2021

Best Presentation Award

Publication Project

Secure Medical Image Analysis with CrypTFlow

Javier Alvarez-Valle, Pratik Bhatu, Nishanth Chandran, Divya Gupta, Aditya Nori, Aseem Rastogi, Mayank Rathee, Rahul Sharma, Shubham Ugare

NeurIPS PPML Workshop | December 2020

Publication Project Project

Evaluation of Deep Learning to Augment Image Guided Radiotherapy for Head and Neck and Prostate Cancers

Ozan Oktay, Jay Nanavati, Anton Schwaighofer, David Carter, Melissa Bristow, Ryutaro Tanno, Gill Barnett, David Noble, Yvonne Rimmer, Rajesh Jena, Ben Glocker, Kenton O'Hara, Christopher Bishop, Javier Alvarez-Valle, Aditya Nori

JAMA | November 2020

Publication Video Github Project

MAIRA-Seg: Enhancing Radiology Report Generation with Segmentation-Aware Multimodal Large Language Models

Harshita Sharma, Valentina Salvatelli, Shaury Srivastav, Kenza Bouzid, Shruthi Bannur, Daniel Coelho de Castro, Maximilian Ilse, Sam Bond-Taylor, Mercy Ranjit, Fabian Falck, Fernando Pérez-García, Anton Schwaighofer, Hannah Richardson (nee Murfet), Maria Teodora Wetscherek, Stephanie Hyland, Javier Alvarez-Valle

NeurIPS 2024 | December 2024

Preprint DOI Project

MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging

Noel Codella, Yu Gu, Shrey Jain, Ho Hin Lee, Asma Ben Abacha, Alberto Santamaria-Pang, Will Guyman, Natieek Sangani, Sheng Zhang, Hoifung Poon, Stephanie Hyland, Shruthi Bannur, Javier Alvarez-Valle, Xue Li, John Garett, Alan McMillan, Gaurav Rajguru, Madhu Maddi, Nilesh Vijayrania, Reehan Bhimai, Nick Mecklenburg, Rupal Jain, Daniel Holstein, Naveen Gaur, Vijay Aski, Jenq-Neng Hwang, Thomas Lin, Ivan Tarapov, Matthew P Lungren, Mu Wei

October 2024

Publication

MAIRA-2: Grounded Radiology Report Generation

Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Anton Schwaighofer, Sam Bond-Taylor, Maximilian Ilse, Fernando Pérez-García, Valentina Salvatelli, Harshita Sharma, Felix Meissen, Mercy Ranjit, Shaury Srivastav, Julia Gong, Fabian Flack, Ozan Oktay, Anja Thieme, Matthew P Lungren, Maria Teodora Wetscherek, Javier Alvarez-Valle, Stephanie Hyland

MSR-TR-2024-18 | June 2024

Published by Microsoft

Preprint PDF Github Github Download Project

Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology

Nur Yildirim, Hannah Richardson (nee Murfet), Maria T Wetscherek, Junaid Bajwa, Joseph Jacob, Mark A Pinnock, Stephen Harris, Daniel Coelho de Castro, Shruthi Bannur, Stephanie Hyland, Pratik Ghosh, Mercy Ranjit, Kenza Bouzid, Anton Schwaighofer, Fernando Pérez-García, Harshita Sharma, Ozan Oktay, Matthew P Lungren, Javier Alvarez-Valle, Aditya Nori, Anja Thieme

CHI 2024 | May 2024

Preprint Publication Project

Challenges for Responsible AI Design and Workflow Integration in Healthcare: A Case Study of Automatic Feeding Tube Qualification in Radiology

Anja Thieme, Abhijith Rajamohan, Benjamin Cooper, Heather Groombridge, Robert Simister, Barney Wong, Nicholas Woznitza, Mark Ames Pinnock, Maria Teodora Wetscherek, Cecily Morrison, Hannah Richardson (nee Murfet), Fernando Pérez-García, Stephanie Hyland, Shruthi Bannur, Daniel Coelho de Castro, Kenza Bouzid, Anton Schwaighofer, Mercy Ranjit, Harshita Sharma, Matthew P Lungren, Ozan Oktay, Javier Alvarez-Valle, Aditya Nori, Stephen Harris, Joseph Jacob

2405.05299 | May 2024

Published by arXiv

Preprint PDF Project

Enabling large-scale screening of Barrett’s esophagus using weakly supervised deep learning in histopathology

Kenza Bouzid, Harshita Sharma, Sarah Killcoyne, Daniel Coelho de Castro, Anton Schwaighofer, Maximilian Ilse, Valentina Salvatelli, Ozan Oktay, Sumanth Murthy, Lucas Bordeaux, Luiza Moore, Maria O'Donovan, Anja Thieme, Aditya Nori, Marcel Gehrung, Javier Alvarez-Valle

Nature Communications | March 2024, Vol 15

DOI Publication PDF

RAD-DINO: Exploring Scalable Medical Image Encoders Beyond Text Supervision

Fernando Pérez-García, Harshita Sharma, Sam Bond-Taylor, Kenza Bouzid, Valentina Salvatelli, Maximilian Ilse, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Matthew P Lungren, Noel Codella, Stephanie Hyland, Javier Alvarez-Valle, Ozan Oktay

MSR-TR-2024-5 | January 2024

Published by Microsoft

Preprint Download Project

RadEdit: stress-testing biomedical vision models via diffusion image editing

Fernando Pérez-García, Sam Bond-Taylor, Pedro P. Sanchez, Boris van Breugel, Daniel Coelho de Castro, Harshita Sharma, Valentina Salvatelli, Maria T. A. Wetscherek, Hannah Richardson (nee Murfet), Matthew P Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay, Maximilian Ilse

December 2023

Preprint Project

MAIRA-1: A specialised large multimodal model for radiology report generation

Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Mercy Ranjit, Anton Schwaighofer, Fernando Pérez-García, Valentina Salvatelli, Shaury Srivastav, Anja Thieme, Noel Codella, Matthew P Lungren, Maria Teodora Wetscherek, Ozan Oktay, Javier Alvarez-Valle

MSR-TR-2023-47 | November 2023

Published by Microsoft

Publication Project

Exploring the Boundaries of GPT-4 in Radiology

Qianchu Liu, Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Maria Teodora Wetscherek, Robert Tinn, Harshita Sharma, Fernando Pérez-García, Anton Schwaighofer, Pranav Rajpurkar, Sameer Tajdin Khanna, Hoifung Poon, Naoto Usuyama, Anja Thieme, Aditya Nori, Matthew P Lungren, Ozan Oktay, Javier Alvarez-Valle

EMNLP 2023 | October 2023

PDF Publication Project

Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing

Shruthi Bannur, Stephanie Hyland, Flora Liu, Fernando Pérez-García, Maximilian Ilse, Daniel Coelho de Castro, Benedikt Boecking, Harshita Sharma, Kenza Bouzid, Anja Thieme, Anton Schwaighofer, Maria Teodora Wetscherek, Matthew Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) | June 2023

Preprint Download Project

Making the Most of Text Semantics to Improve Biomedical Vision-Language Processing

Benedikt Boecking, Naoto Usuyama, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Stephanie Hyland, Maria Teodora Wetscherek, Tristan Naumann, Aditya Nori, Javier Alvarez-Valle, Hoifung Poon, Ozan Oktay

The European Conference on Computer Vision (ECCV) | October 2022

Preprint Video Download Download Project

Active label cleaning for improved dataset quality under resource constraints

Melanie Bernhardt, Daniel Coelho de Castro, Ryutaro Tanno, Anton Schwaighofer, Kerem C. Tezcan, Miguel Monteiro, Shruthi Bannur, Matthew P. Lungren, Aditya Nori, Ben Glocker, Javier Alvarez-Valle, Ozan Oktay

Nature Communications | March 2022, Vol 13(1161): pp. 1-11

Publication Github Project Project

Hierarchical Analysis of Visual COVID-19 Features from Chest Radiographs

Shruthi Bannur, Ozan Oktay, Melanie Bernhardt, Anton Schwaighofer, Rajesh Jena, Besmira Nushi, Sharan Wadhwani, Aditya Nori, Kal Natarajan, Shazad Ashraf, Javier Alvarez-Valle, Daniel Coelho de Castro

ICML 2021 Workshop on Interpretable Machine Learning in Healthcare | July 2021

PDF Preprint Project Project Project Project

Addressing the Exorbitant Cost of Labeling Medical Images with Active Learning

Saba Rahimi, Ozan Oktay, Javier Alvarez-Valle, Sujeeth Bharadwaj

International Conference on Machine Learning in Medical Imaging and Analysis | June 2021

Best Presentation Award

Publication Project

Secure Medical Image Analysis with CrypTFlow

Javier Alvarez-Valle, Pratik Bhatu, Nishanth Chandran, Divya Gupta, Aditya Nori, Aseem Rastogi, Mayank Rathee, Rahul Sharma, Shubham Ugare

NeurIPS PPML Workshop | December 2020

Publication Project Project

Evaluation of Deep Learning to Augment Image Guided Radiotherapy for Head and Neck and Prostate Cancers

Ozan Oktay, Jay Nanavati, Anton Schwaighofer, David Carter, Melissa Bristow, Ryutaro Tanno, Gill Barnett, David Noble, Yvonne Rimmer, Rajesh Jena, Ben Glocker, Kenton O'Hara, Christopher Bishop, Javier Alvarez-Valle, Aditya Nori

JAMA | November 2020

Publication Video Github Project

MAIRA-Seg: Enhancing Radiology Report Generation with Segmentation-Aware Multimodal Large Language Models

Harshita Sharma, Valentina Salvatelli, Shaury Srivastav, Kenza Bouzid, Shruthi Bannur, Daniel Coelho de Castro, Maximilian Ilse, Sam Bond-Taylor, Mercy Ranjit, Fabian Falck, Fernando Pérez-García, Anton Schwaighofer, Hannah Richardson (nee Murfet), Maria Teodora Wetscherek, Stephanie Hyland, Javier Alvarez-Valle

NeurIPS 2024 | December 2024

Preprint DOI Project

OSAIRIS: Lessons Learned from the Hospital-Based Implementation and Evaluation of an Open-Source Deep-Learning Model for Radiotherapy Image Segmentation

Alexandra Constantinou, Andrew Hoole, David C. Wong, G. S. Sagoo, Javier Alvarez-Valle, Kenji Takeda, Tom Griffiths, Amy Edwards, Andrew Robinson, Liam Stubbington, Niall Bolger, Yvonne Rimmer, Thiraviyam Elumalai, K. T. Jayaprakash, Richard Benson, Ian Gleeson, Rebecca Sen, Louisa Stockton, Tian Wang, Stephanie Brown, E. Gatfield, C. Sanghera, Alexandros Mourounas, Barry Evans, Anita Anthony, Renteng Hou, Marian Toomey, K. Wildschut, Aviva Grisby, Gill Barnett, Rose McMullen, Raj Jena

Clinical Oncology | October 2024

DOI Github Github Github Github Project Project

MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging

Noel Codella, Yu Gu, Shrey Jain, Ho Hin Lee, Asma Ben Abacha, Alberto Santamaria-Pang, Will Guyman, Natieek Sangani, Sheng Zhang, Hoifung Poon, Stephanie Hyland, Shruthi Bannur, Javier Alvarez-Valle, Xue Li, John Garett, Alan McMillan, Gaurav Rajguru, Madhu Maddi, Nilesh Vijayrania, Reehan Bhimai, Nick Mecklenburg, Rupal Jain, Daniel Holstein, Naveen Gaur, Vijay Aski, Jenq-Neng Hwang, Thomas Lin, Ivan Tarapov, Matthew P Lungren, Mu Wei

October 2024

Publication

MAIRA-2: Grounded Radiology Report Generation

Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Anton Schwaighofer, Sam Bond-Taylor, Maximilian Ilse, Fernando Pérez-García, Valentina Salvatelli, Harshita Sharma, Felix Meissen, Mercy Ranjit, Shaury Srivastav, Julia Gong, Fabian Flack, Ozan Oktay, Anja Thieme, Matthew P Lungren, Maria Teodora Wetscherek, Javier Alvarez-Valle, Stephanie Hyland

MSR-TR-2024-18 | June 2024

Published by Microsoft

Preprint PDF Github Github Download Project

Challenges for Responsible AI Design and Workflow Integration in Healthcare: A Case Study of Automatic Feeding Tube Qualification in Radiology

Anja Thieme, Abhijith Rajamohan, Benjamin Cooper, Heather Groombridge, Robert Simister, Barney Wong, Nicholas Woznitza, Mark Ames Pinnock, Maria Teodora Wetscherek, Cecily Morrison, Hannah Richardson (nee Murfet), Fernando Pérez-García, Stephanie Hyland, Shruthi Bannur, Daniel Coelho de Castro, Kenza Bouzid, Anton Schwaighofer, Mercy Ranjit, Harshita Sharma, Matthew P Lungren, Ozan Oktay, Javier Alvarez-Valle, Aditya Nori, Stephen Harris, Joseph Jacob

2405.05299 | May 2024

Published by arXiv

Preprint PDF Project

Enabling large-scale screening of Barrett’s esophagus using weakly supervised deep learning in histopathology

Kenza Bouzid, Harshita Sharma, Sarah Killcoyne, Daniel Coelho de Castro, Anton Schwaighofer, Maximilian Ilse, Valentina Salvatelli, Ozan Oktay, Sumanth Murthy, Lucas Bordeaux, Luiza Moore, Maria O'Donovan, Anja Thieme, Aditya Nori, Marcel Gehrung, Javier Alvarez-Valle

Nature Communications | March 2024, Vol 15

DOI Publication PDF

RAD-DINO: Exploring Scalable Medical Image Encoders Beyond Text Supervision

Fernando Pérez-García, Harshita Sharma, Sam Bond-Taylor, Kenza Bouzid, Valentina Salvatelli, Maximilian Ilse, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Matthew P Lungren, Noel Codella, Stephanie Hyland, Javier Alvarez-Valle, Ozan Oktay

MSR-TR-2024-5 | January 2024

Published by Microsoft

Preprint Download Project

RadEdit: stress-testing biomedical vision models via diffusion image editing

Fernando Pérez-García, Sam Bond-Taylor, Pedro P. Sanchez, Boris van Breugel, Daniel Coelho de Castro, Harshita Sharma, Valentina Salvatelli, Maria T. A. Wetscherek, Hannah Richardson (nee Murfet), Matthew P Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay, Maximilian Ilse

December 2023

Preprint Project

Exploring the Boundaries of GPT-4 in Radiology

Qianchu Liu, Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Maria Teodora Wetscherek, Robert Tinn, Harshita Sharma, Fernando Pérez-García, Anton Schwaighofer, Pranav Rajpurkar, Sameer Tajdin Khanna, Hoifung Poon, Naoto Usuyama, Anja Thieme, Aditya Nori, Matthew P Lungren, Ozan Oktay, Javier Alvarez-Valle

EMNLP 2023 | October 2023

PDF Publication Project

Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing

Shruthi Bannur, Stephanie Hyland, Flora Liu, Fernando Pérez-García, Maximilian Ilse, Daniel Coelho de Castro, Benedikt Boecking, Harshita Sharma, Kenza Bouzid, Anja Thieme, Anton Schwaighofer, Maria Teodora Wetscherek, Matthew Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) | June 2023

Preprint Download Project

Making the Most of Text Semantics to Improve Biomedical Vision-Language Processing

Benedikt Boecking, Naoto Usuyama, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Stephanie Hyland, Maria Teodora Wetscherek, Tristan Naumann, Aditya Nori, Javier Alvarez-Valle, Hoifung Poon, Ozan Oktay

The European Conference on Computer Vision (ECCV) | October 2022

Preprint Video Download Download Project

Active label cleaning for improved dataset quality under resource constraints

Melanie Bernhardt, Daniel Coelho de Castro, Ryutaro Tanno, Anton Schwaighofer, Kerem C. Tezcan, Miguel Monteiro, Shruthi Bannur, Matthew P. Lungren, Aditya Nori, Ben Glocker, Javier Alvarez-Valle, Ozan Oktay

Nature Communications | March 2022, Vol 13(1161): pp. 1-11

Publication Github Project Project

Machine Learning for Auto-Segmentation in Radiotherapy Planning

K Harrison, H Pullen, C Welsh, Ozan Oktay, Javier Alvarez-Valle, R Jena

The Royal College of Radiologists - Clinical Oncology | January 2022, Vol 34(2): pp. 74-88

Publication Project Project

Hierarchical Analysis of Visual COVID-19 Features from Chest Radiographs

Shruthi Bannur, Ozan Oktay, Melanie Bernhardt, Anton Schwaighofer, Rajesh Jena, Besmira Nushi, Sharan Wadhwani, Aditya Nori, Kal Natarajan, Shazad Ashraf, Javier Alvarez-Valle, Daniel Coelho de Castro

ICML 2021 Workshop on Interpretable Machine Learning in Healthcare | July 2021

PDF Preprint Project Project Project Project

Addressing the Exorbitant Cost of Labeling Medical Images with Active Learning

Saba Rahimi, Ozan Oktay, Javier Alvarez-Valle, Sujeeth Bharadwaj

International Conference on Machine Learning in Medical Imaging and Analysis | June 2021

Best Presentation Award

Publication Project

Secure Medical Image Analysis with CrypTFlow

Javier Alvarez-Valle, Pratik Bhatu, Nishanth Chandran, Divya Gupta, Aditya Nori, Aseem Rastogi, Mayank Rathee, Rahul Sharma, Shubham Ugare

NeurIPS PPML Workshop | December 2020

Publication Project Project

Evaluation of Deep Learning to Augment Image Guided Radiotherapy for Head and Neck and Prostate Cancers

Ozan Oktay, Jay Nanavati, Anton Schwaighofer, David Carter, Melissa Bristow, Ryutaro Tanno, Gill Barnett, David Noble, Yvonne Rimmer, Rajesh Jena, Ben Glocker, Kenton O'Hara, Christopher Bishop, Javier Alvarez-Valle, Aditya Nori

JAMA | November 2020

Publication Video Github Project

MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging

Noel Codella, Yu Gu, Shrey Jain, Ho Hin Lee, Asma Ben Abacha, Alberto Santamaria-Pang, Will Guyman, Natieek Sangani, Sheng Zhang, Hoifung Poon, Stephanie Hyland, Shruthi Bannur, Javier Alvarez-Valle, Xue Li, John Garett, Alan McMillan, Gaurav Rajguru, Madhu Maddi, Nilesh Vijayrania, Reehan Bhimai, Nick Mecklenburg, Rupal Jain, Daniel Holstein, Naveen Gaur, Vijay Aski, Jenq-Neng Hwang, Thomas Lin, Ivan Tarapov, Matthew P Lungren, Mu Wei

October 2024

Publication

RAD-DINO: Exploring Scalable Medical Image Encoders Beyond Text Supervision

Fernando Pérez-García, Harshita Sharma, Sam Bond-Taylor, Kenza Bouzid, Valentina Salvatelli, Maximilian Ilse, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Matthew P Lungren, Noel Codella, Stephanie Hyland, Javier Alvarez-Valle, Ozan Oktay

MSR-TR-2024-5 | January 2024

Published by Microsoft

Preprint Download Project

RadEdit: stress-testing biomedical vision models via diffusion image editing

Fernando Pérez-García, Sam Bond-Taylor, Pedro P. Sanchez, Boris van Breugel, Daniel Coelho de Castro, Harshita Sharma, Valentina Salvatelli, Maria T. A. Wetscherek, Hannah Richardson (nee Murfet), Matthew P Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay, Maximilian Ilse

December 2023

Preprint Project

MAIRA-1: A specialised large multimodal model for radiology report generation

Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Mercy Ranjit, Anton Schwaighofer, Fernando Pérez-García, Valentina Salvatelli, Shaury Srivastav, Anja Thieme, Noel Codella, Matthew P Lungren, Maria Teodora Wetscherek, Ozan Oktay, Javier Alvarez-Valle

MSR-TR-2023-47 | November 2023

Published by Microsoft

Publication Project

Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing

Shruthi Bannur, Stephanie Hyland, Flora Liu, Fernando Pérez-García, Maximilian Ilse, Daniel Coelho de Castro, Benedikt Boecking, Harshita Sharma, Kenza Bouzid, Anja Thieme, Anton Schwaighofer, Maria Teodora Wetscherek, Matthew Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) | June 2023

Preprint Download Project

Making the Most of Text Semantics to Improve Biomedical Vision-Language Processing

Benedikt Boecking, Naoto Usuyama, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Stephanie Hyland, Maria Teodora Wetscherek, Tristan Naumann, Aditya Nori, Javier Alvarez-Valle, Hoifung Poon, Ozan Oktay

The European Conference on Computer Vision (ECCV) | October 2022

Preprint Video Download Download Project

Active label cleaning for improved dataset quality under resource constraints

Melanie Bernhardt, Daniel Coelho de Castro, Ryutaro Tanno, Anton Schwaighofer, Kerem C. Tezcan, Miguel Monteiro, Shruthi Bannur, Matthew P. Lungren, Aditya Nori, Ben Glocker, Javier Alvarez-Valle, Ozan Oktay

Nature Communications | March 2022, Vol 13(1161): pp. 1-11

Publication Github Project Project

Hierarchical Analysis of Visual COVID-19 Features from Chest Radiographs

Shruthi Bannur, Ozan Oktay, Melanie Bernhardt, Anton Schwaighofer, Rajesh Jena, Besmira Nushi, Sharan Wadhwani, Aditya Nori, Kal Natarajan, Shazad Ashraf, Javier Alvarez-Valle, Daniel Coelho de Castro

ICML 2021 Workshop on Interpretable Machine Learning in Healthcare | July 2021

PDF Preprint Project Project Project Project

Addressing the Exorbitant Cost of Labeling Medical Images with Active Learning

Saba Rahimi, Ozan Oktay, Javier Alvarez-Valle, Sujeeth Bharadwaj

International Conference on Machine Learning in Medical Imaging and Analysis | June 2021

Best Presentation Award

Publication Project

Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology

Nur Yildirim, Hannah Richardson (nee Murfet), Maria T Wetscherek, Junaid Bajwa, Joseph Jacob, Mark A Pinnock, Stephen Harris, Daniel Coelho de Castro, Shruthi Bannur, Stephanie Hyland, Pratik Ghosh, Mercy Ranjit, Kenza Bouzid, Anton Schwaighofer, Fernando Pérez-García, Harshita Sharma, Ozan Oktay, Matthew P Lungren, Javier Alvarez-Valle, Aditya Nori, Anja Thieme

CHI 2024 | May 2024

Preprint Publication Project

Challenges for Responsible AI Design and Workflow Integration in Healthcare: A Case Study of Automatic Feeding Tube Qualification in Radiology

Anja Thieme, Abhijith Rajamohan, Benjamin Cooper, Heather Groombridge, Robert Simister, Barney Wong, Nicholas Woznitza, Mark Ames Pinnock, Maria Teodora Wetscherek, Cecily Morrison, Hannah Richardson (nee Murfet), Fernando Pérez-García, Stephanie Hyland, Shruthi Bannur, Daniel Coelho de Castro, Kenza Bouzid, Anton Schwaighofer, Mercy Ranjit, Harshita Sharma, Matthew P Lungren, Ozan Oktay, Javier Alvarez-Valle, Aditya Nori, Stephen Harris, Joseph Jacob

2405.05299 | May 2024

Published by arXiv

Preprint PDF Project

Multi-institution encrypted medical imaging AI validation without data sharing

Arjun Soin, Pratik Bhatu, Rohit Takhar, Nishanth Chandran, Divya Gupta, Javier Alvarez-Valle, Rahul Sharma, Vidur Mahajan, Matthew P Lungren

August 2021

Publication Project

Secure Medical Image Analysis with CrypTFlow

Javier Alvarez-Valle, Pratik Bhatu, Nishanth Chandran, Divya Gupta, Aditya Nori, Aseem Rastogi, Mayank Rathee, Rahul Sharma, Shubham Ugare

NeurIPS PPML Workshop | December 2020

Publication Project Project

Secure Medical Image Analysis with CrypTFlow

Javier Alvarez-Valle, Pratik Bhatu, Nishanth Chandran, Divya Gupta, Aditya Nori, Aseem Rastogi, Mayank Rathee, Rahul Sharma, Shubham Ugare

NeurIPS PPML Workshop | December 2020

Publication Project Project

MAIRA-Seg: Enhancing Radiology Report Generation with Segmentation-Aware Multimodal Large Language Models

Harshita Sharma, Valentina Salvatelli, Shaury Srivastav, Kenza Bouzid, Shruthi Bannur, Daniel Coelho de Castro, Maximilian Ilse, Sam Bond-Taylor, Mercy Ranjit, Fabian Falck, Fernando Pérez-García, Anton Schwaighofer, Hannah Richardson (nee Murfet), Maria Teodora Wetscherek, Stephanie Hyland, Javier Alvarez-Valle

NeurIPS 2024 | December 2024

Preprint DOI Project

Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology

Nur Yildirim, Hannah Richardson (nee Murfet), Maria T Wetscherek, Junaid Bajwa, Joseph Jacob, Mark A Pinnock, Stephen Harris, Daniel Coelho de Castro, Shruthi Bannur, Stephanie Hyland, Pratik Ghosh, Mercy Ranjit, Kenza Bouzid, Anton Schwaighofer, Fernando Pérez-García, Harshita Sharma, Ozan Oktay, Matthew P Lungren, Javier Alvarez-Valle, Aditya Nori, Anja Thieme

CHI 2024 | May 2024

Preprint Publication Project

Exploring the Boundaries of GPT-4 in Radiology

Qianchu Liu, Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Maria Teodora Wetscherek, Robert Tinn, Harshita Sharma, Fernando Pérez-García, Anton Schwaighofer, Pranav Rajpurkar, Sameer Tajdin Khanna, Hoifung Poon, Naoto Usuyama, Anja Thieme, Aditya Nori, Matthew P Lungren, Ozan Oktay, Javier Alvarez-Valle

EMNLP 2023 | October 2023

PDF Publication Project

Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing

Shruthi Bannur, Stephanie Hyland, Flora Liu, Fernando Pérez-García, Maximilian Ilse, Daniel Coelho de Castro, Benedikt Boecking, Harshita Sharma, Kenza Bouzid, Anja Thieme, Anton Schwaighofer, Maria Teodora Wetscherek, Matthew Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) | June 2023

Preprint Download Project

Making the Most of Text Semantics to Improve Biomedical Vision-Language Processing

Benedikt Boecking, Naoto Usuyama, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Stephanie Hyland, Maria Teodora Wetscherek, Tristan Naumann, Aditya Nori, Javier Alvarez-Valle, Hoifung Poon, Ozan Oktay

The European Conference on Computer Vision (ECCV) | October 2022

Preprint Video Download Download Project

Hierarchical Analysis of Visual COVID-19 Features from Chest Radiographs

Shruthi Bannur, Ozan Oktay, Melanie Bernhardt, Anton Schwaighofer, Rajesh Jena, Besmira Nushi, Sharan Wadhwani, Aditya Nori, Kal Natarajan, Shazad Ashraf, Javier Alvarez-Valle, Daniel Coelho de Castro

ICML 2021 Workshop on Interpretable Machine Learning in Healthcare | July 2021

PDF Preprint Project Project Project Project

Addressing the Exorbitant Cost of Labeling Medical Images with Active Learning

Saba Rahimi, Ozan Oktay, Javier Alvarez-Valle, Sujeeth Bharadwaj

International Conference on Machine Learning in Medical Imaging and Analysis | June 2021

Best Presentation Award

Publication Project

Secure Medical Image Analysis with CrypTFlow

Javier Alvarez-Valle, Pratik Bhatu, Nishanth Chandran, Divya Gupta, Aditya Nori, Aseem Rastogi, Mayank Rathee, Rahul Sharma, Shubham Ugare

NeurIPS PPML Workshop | December 2020

Publication Project Project

OSAIRIS: Lessons Learned from the Hospital-Based Implementation and Evaluation of an Open-Source Deep-Learning Model for Radiotherapy Image Segmentation

Alexandra Constantinou, Andrew Hoole, David C. Wong, G. S. Sagoo, Javier Alvarez-Valle, Kenji Takeda, Tom Griffiths, Amy Edwards, Andrew Robinson, Liam Stubbington, Niall Bolger, Yvonne Rimmer, Thiraviyam Elumalai, K. T. Jayaprakash, Richard Benson, Ian Gleeson, Rebecca Sen, Louisa Stockton, Tian Wang, Stephanie Brown, E. Gatfield, C. Sanghera, Alexandros Mourounas, Barry Evans, Anita Anthony, Renteng Hou, Marian Toomey, K. Wildschut, Aviva Grisby, Gill Barnett, Rose McMullen, Raj Jena

Clinical Oncology | October 2024

DOI Github Github Github Github Project Project

Enabling large-scale screening of Barrett’s esophagus using weakly supervised deep learning in histopathology

Kenza Bouzid, Harshita Sharma, Sarah Killcoyne, Daniel Coelho de Castro, Anton Schwaighofer, Maximilian Ilse, Valentina Salvatelli, Ozan Oktay, Sumanth Murthy, Lucas Bordeaux, Luiza Moore, Maria O'Donovan, Anja Thieme, Aditya Nori, Marcel Gehrung, Javier Alvarez-Valle

Nature Communications | March 2024, Vol 15

DOI Publication PDF

Active label cleaning for improved dataset quality under resource constraints

Melanie Bernhardt, Daniel Coelho de Castro, Ryutaro Tanno, Anton Schwaighofer, Kerem C. Tezcan, Miguel Monteiro, Shruthi Bannur, Matthew P. Lungren, Aditya Nori, Ben Glocker, Javier Alvarez-Valle, Ozan Oktay

Nature Communications | March 2022, Vol 13(1161): pp. 1-11

Publication Github Project Project

Machine Learning for Auto-Segmentation in Radiotherapy Planning

K Harrison, H Pullen, C Welsh, Ozan Oktay, Javier Alvarez-Valle, R Jena

The Royal College of Radiologists - Clinical Oncology | January 2022, Vol 34(2): pp. 74-88

Publication Project Project

Evaluation of Deep Learning to Augment Image Guided Radiotherapy for Head and Neck and Prostate Cancers

Ozan Oktay, Jay Nanavati, Anton Schwaighofer, David Carter, Melissa Bristow, Ryutaro Tanno, Gill Barnett, David Noble, Yvonne Rimmer, Rajesh Jena, Ben Glocker, Kenton O'Hara, Christopher Bishop, Javier Alvarez-Valle, Aditya Nori

JAMA | November 2020

Publication Video Github Project

MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging

Noel Codella, Yu Gu, Shrey Jain, Ho Hin Lee, Asma Ben Abacha, Alberto Santamaria-Pang, Will Guyman, Natieek Sangani, Sheng Zhang, Hoifung Poon, Stephanie Hyland, Shruthi Bannur, Javier Alvarez-Valle, Xue Li, John Garett, Alan McMillan, Gaurav Rajguru, Madhu Maddi, Nilesh Vijayrania, Reehan Bhimai, Nick Mecklenburg, Rupal Jain, Daniel Holstein, Naveen Gaur, Vijay Aski, Jenq-Neng Hwang, Thomas Lin, Ivan Tarapov, Matthew P Lungren, Mu Wei

October 2024

Publication

RadEdit: stress-testing biomedical vision models via diffusion image editing

Fernando Pérez-García, Sam Bond-Taylor, Pedro P. Sanchez, Boris van Breugel, Daniel Coelho de Castro, Harshita Sharma, Valentina Salvatelli, Maria T. A. Wetscherek, Hannah Richardson (nee Murfet), Matthew P Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay, Maximilian Ilse

December 2023

Preprint Project

MAIRA-2: Grounded Radiology Report Generation

Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Anton Schwaighofer, Sam Bond-Taylor, Maximilian Ilse, Fernando Pérez-García, Valentina Salvatelli, Harshita Sharma, Felix Meissen, Mercy Ranjit, Shaury Srivastav, Julia Gong, Fabian Flack, Ozan Oktay, Anja Thieme, Matthew P Lungren, Maria Teodora Wetscherek, Javier Alvarez-Valle, Stephanie Hyland

MSR-TR-2024-18 | June 2024

Published by Microsoft

Preprint PDF Github Github Download Project

Challenges for Responsible AI Design and Workflow Integration in Healthcare: A Case Study of Automatic Feeding Tube Qualification in Radiology

Anja Thieme, Abhijith Rajamohan, Benjamin Cooper, Heather Groombridge, Robert Simister, Barney Wong, Nicholas Woznitza, Mark Ames Pinnock, Maria Teodora Wetscherek, Cecily Morrison, Hannah Richardson (nee Murfet), Fernando Pérez-García, Stephanie Hyland, Shruthi Bannur, Daniel Coelho de Castro, Kenza Bouzid, Anton Schwaighofer, Mercy Ranjit, Harshita Sharma, Matthew P Lungren, Ozan Oktay, Javier Alvarez-Valle, Aditya Nori, Stephen Harris, Joseph Jacob

2405.05299 | May 2024

Published by arXiv

Preprint PDF Project

RAD-DINO: Exploring Scalable Medical Image Encoders Beyond Text Supervision

Fernando Pérez-García, Harshita Sharma, Sam Bond-Taylor, Kenza Bouzid, Valentina Salvatelli, Maximilian Ilse, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Matthew P Lungren, Noel Codella, Stephanie Hyland, Javier Alvarez-Valle, Ozan Oktay

MSR-TR-2024-5 | January 2024

Published by Microsoft

Preprint Download Project

MAIRA-1: A specialised large multimodal model for radiology report generation

Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Mercy Ranjit, Anton Schwaighofer, Fernando Pérez-García, Valentina Salvatelli, Shaury Srivastav, Anja Thieme, Noel Codella, Matthew P Lungren, Maria Teodora Wetscherek, Ozan Oktay, Javier Alvarez-Valle

MSR-TR-2023-47 | November 2023

Published by Microsoft

Publication Project

Multi-institution encrypted medical imaging AI validation without data sharing

Arjun Soin, Pratik Bhatu, Rohit Takhar, Nishanth Chandran, Divya Gupta, Javier Alvarez-Valle, Rahul Sharma, Vidur Mahajan, Matthew P Lungren

August 2021

Publication Project