Vibhav Vineet

Inference-Time Scaling for Complex Tasks: Where We Stand and What Lies Ahead

Vidhisha Balachandran, Jingya Chen, Lingjiao Chen, Shivam Garg, Neel Joshi, Yash Lara, John Langford, Besmira Nushi, Vibhav Vineet, Yue Wu, Safoora Yousefi

MSR-TR-2025-16 | March 2025

Published by Microsoft

Publication Github

Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models

Vibhav Vineet, Xin Wang, Neel Joshi

2024 Neural Information Processing Systems | December 2024

Publication

EUREKA: Evaluating and Understanding Large Foundation Models

Vidhisha Balachandran, Jingya Chen, Neel Joshi, Besmira Nushi, Hamid Palangi, Eduardo Salinas, Vibhav Vineet, James Woffinden-Luey, Safoora Yousefi

MSR-TR-2024-33 | September 2024

Published by Microsoft

Preprint Github

Exposing the Achilles’ Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning

Joykirat Singh, Akshay Nambi, Vibhav Vineet

June 2024

Preprint

Peekaboo: Interactive video generation via masked-diffusion

Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl

2024 Computer Vision and Pattern Recognition | June 2024

Invited Talk at Holistic Video Understanding Workshop, CVPR 2024

DOI Publication PDF

PEEKABOO: Interactive Video Generation via Masked-Diffusion

Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl

CVPR 2024 | December 2023

Invited Talk at Holistic Video Understanding Workshop, CVPR 2024

DOI Publication Publication

DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets

Yash Jain, Harkirat Behl, Zsolt Kira, Vibhav Vineet

2023 Neural Information Processing Systems | December 2023

DOI Publication Publication

DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets

Yash Jain, Harkirat Behl, Zsolt Kira, Vibhav Vineet

NeurIPS 2023 | October 2023

Publication

PLEX: Making the Most of the Available Data for Robotic Manipulation Pretraining

Garrett Thomas, Ching-An Cheng, Ricky Loynd, Felipe Vieira Frujeri, Vibhav Vineet, Mihai Jalobeanu, Andrey Kolobov

CoRL 2023 | June 2023

Publication

Benchmarking Spatial Relationships in Text-to-Image Generation

Tejas Gokhale, Hamid Palangi, Besmira Nushi, Vibhav Vineet, Eric Horvitz, Ece Kamar, Chitta Baral, Yezhou Yang

MSR-TR-2023-44 | May 2023

Published by Microsoft

Publication Github

A Large-scale Robustness Analysis of Video Action Recognition Models

Madeline Chantry Schiappa, Naman Biyani, Prudvi Kamtam, Shruti Vyas, Hamid Palangi, Vibhav Vineet, Yogesh Rawat

April 2023

Publication

Robustness Analysis of Video-Language Models Against Visual and Language Perturbations

Madeline C. Schiappa, Shruti Vyas, Hamid Palangi, Yogesh S. Rawat, Vibhav Vineet

2022 Neural Information Processing Systems | October 2022

Publication

Image Retrieval from Contextual Descriptions

Benno Krojer, Vaibhav Adlakha, Vibhav Vineet, Yash Goyal, Edoardo Ponti, Siva Reddy

ACL 2022 | May 2022

Publication

Missingness Bias in Model Debugging

Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry

ICLR 2022 | April 2022

Publication

CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoning

Daniel McDuff, Yale Song, Jiyoung Lee, Vibhav Vineet, Sai Vemprala, Nicholas Gyde, Hadi Salman, Shuang Ma, Kwanghoon Sohn, Ashish Kapoor

June 2021

Preprint under review

Publication Github

Depth Completion Using a View-constrained Deep Prior

Pallabi Ghosh, Vibhav Vineet, Larry S. Davis, Abhinav Shrivastava, Sudipta Sinha, Neel Joshi

2020 International Conference on 3D Vision | October 2020

DOI

RANP: Resource Aware Neuron Pruning at Initialization for 3D CNNs

Zhiwei Xu, Thalaiyasingam Ajanthan, Vibhav Vineet, Richard I. Hartley

3DV | October 2020

Publication

FAST Depth Completion using a view Constrained Deep Prior

3DV | October 2020

Publication

AutoSimulate: (Quickly) Learning Synthetic Data Generation

Harkirat Singh Behl, Atılım Güneş Baydin, Ran Gal, Philip H.S. Torr, Vibhav Vineet

16th European Conference Computer Vision (ECCV 2020) | August 2020

Publication

Fast acoustic scattering using convolutional neural networks

Ziqi Fan, Vibhav Vineet, Hannes Gamper, Nikunj Raghuvanshi

ICASSP 2020 - IEEE International Conference on Acoustics, Speech and Signal Processing | May 2020

PDF Project

Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations

Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor

In submission | March 2020

Publication PDF Video Github Project

Photorealistic Image Synthesis For Object Instance Detection

Tomas Hodan, Vibhav Vineet, Ran Gal, Emanuel Shalev, Jon Hanzelka, Treb Connell, Pedro Urbina, Sudipta Sinha, Brian Guenter

IEEE International Conference on Image Processing | September 2019

Publication

Privacy Preserving Action Recognition using Coded Aperture Videos

Zihao W. Wang, Vibhav Vineet, Francesco Pittaluga, Sudipta Sinha, Oliver Cossairt, Sing Bing Kang

The Bright and Dark Sides of Computer Vision: Challenges and Opportunities for Privacy and Security (CV-COPS 2019) | June 2019

Publication

Feature Space Optimization for Semantic Video Segmentation

Abhijit Kundu, Vibhav Vineet, Vladlen Koltun

July 2016

Publication

Playing for Data: Ground Truth from Computer Games

Stephan R. Richter, Vibhav Vineet, Stefan Roth, Vladlen Koltun

July 2016

Publication

Dense Monocular Depth Estimation in Complex Dynamic Scenes

Vladlen Koltun, Qifeng Chen, Vibhav Vineet, Rene Ranftl

April 2016

Publication

Incremental Dense Multi-modal 3D Scene Reconstruction

Philip H. S. Torr, Vibhav Vineet, Yousef Amar, Ondrej Miksik

July 2015

Publication

Inference-Time Scaling for Complex Tasks: Where We Stand and What Lies Ahead

Vidhisha Balachandran, Jingya Chen, Lingjiao Chen, Shivam Garg, Neel Joshi, Yash Lara, John Langford, Besmira Nushi, Vibhav Vineet, Yue Wu, Safoora Yousefi

MSR-TR-2025-16 | March 2025

Published by Microsoft

Publication Github

Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models

Vibhav Vineet, Xin Wang, Neel Joshi

2024 Neural Information Processing Systems | December 2024

Publication

EUREKA: Evaluating and Understanding Large Foundation Models

Vidhisha Balachandran, Jingya Chen, Neel Joshi, Besmira Nushi, Hamid Palangi, Eduardo Salinas, Vibhav Vineet, James Woffinden-Luey, Safoora Yousefi

MSR-TR-2024-33 | September 2024

Published by Microsoft

Preprint Github

Exposing the Achilles’ Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning

Joykirat Singh, Akshay Nambi, Vibhav Vineet

June 2024

Preprint

DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets

Yash Jain, Harkirat Behl, Zsolt Kira, Vibhav Vineet

2023 Neural Information Processing Systems | December 2023

DOI Publication Publication

DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets

Yash Jain, Harkirat Behl, Zsolt Kira, Vibhav Vineet

NeurIPS 2023 | October 2023

Publication

PLEX: Making the Most of the Available Data for Robotic Manipulation Pretraining

Garrett Thomas, Ching-An Cheng, Ricky Loynd, Felipe Vieira Frujeri, Vibhav Vineet, Mihai Jalobeanu, Andrey Kolobov

CoRL 2023 | June 2023

Publication

Benchmarking Spatial Relationships in Text-to-Image Generation

Tejas Gokhale, Hamid Palangi, Besmira Nushi, Vibhav Vineet, Eric Horvitz, Ece Kamar, Chitta Baral, Yezhou Yang

MSR-TR-2023-44 | May 2023

Published by Microsoft

Publication Github

Robustness Analysis of Video-Language Models Against Visual and Language Perturbations

Madeline C. Schiappa, Shruti Vyas, Hamid Palangi, Yogesh S. Rawat, Vibhav Vineet

2022 Neural Information Processing Systems | October 2022

Publication

Missingness Bias in Model Debugging

Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry

ICLR 2022 | April 2022

Publication

CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoning

Daniel McDuff, Yale Song, Jiyoung Lee, Vibhav Vineet, Sai Vemprala, Nicholas Gyde, Hadi Salman, Shuang Ma, Kwanghoon Sohn, Ashish Kapoor

June 2021

Preprint under review

Publication Github

Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations

Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor

In submission | March 2020

Publication PDF Video Github Project

EUREKA: Evaluating and Understanding Large Foundation Models

Vidhisha Balachandran, Jingya Chen, Neel Joshi, Besmira Nushi, Hamid Palangi, Eduardo Salinas, Vibhav Vineet, James Woffinden-Luey, Safoora Yousefi

MSR-TR-2024-33 | September 2024

Published by Microsoft

Preprint Github

Peekaboo: Interactive video generation via masked-diffusion

Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl

2024 Computer Vision and Pattern Recognition | June 2024

Invited Talk at Holistic Video Understanding Workshop, CVPR 2024

DOI Publication PDF

PEEKABOO: Interactive Video Generation via Masked-Diffusion

Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl

CVPR 2024 | December 2023

Invited Talk at Holistic Video Understanding Workshop, CVPR 2024

DOI Publication Publication

DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets

Yash Jain, Harkirat Behl, Zsolt Kira, Vibhav Vineet

2023 Neural Information Processing Systems | December 2023

DOI Publication Publication

A Large-scale Robustness Analysis of Video Action Recognition Models

Madeline Chantry Schiappa, Naman Biyani, Prudvi Kamtam, Shruti Vyas, Hamid Palangi, Vibhav Vineet, Yogesh Rawat

April 2023

Publication

Robustness Analysis of Video-Language Models Against Visual and Language Perturbations

Madeline C. Schiappa, Shruti Vyas, Hamid Palangi, Yogesh S. Rawat, Vibhav Vineet

2022 Neural Information Processing Systems | October 2022

Publication

CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoning

Daniel McDuff, Yale Song, Jiyoung Lee, Vibhav Vineet, Sai Vemprala, Nicholas Gyde, Hadi Salman, Shuang Ma, Kwanghoon Sohn, Ashish Kapoor

June 2021

Preprint under review

Publication Github

Depth Completion Using a View-constrained Deep Prior

Pallabi Ghosh, Vibhav Vineet, Larry S. Davis, Abhinav Shrivastava, Sudipta Sinha, Neel Joshi

2020 International Conference on 3D Vision | October 2020

DOI

RANP: Resource Aware Neuron Pruning at Initialization for 3D CNNs

Zhiwei Xu, Thalaiyasingam Ajanthan, Vibhav Vineet, Richard I. Hartley

3DV | October 2020

Publication

FAST Depth Completion using a view Constrained Deep Prior

3DV | October 2020

Publication

AutoSimulate: (Quickly) Learning Synthetic Data Generation

Harkirat Singh Behl, Atılım Güneş Baydin, Ran Gal, Philip H.S. Torr, Vibhav Vineet

16th European Conference Computer Vision (ECCV 2020) | August 2020

Publication

Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations

Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor

In submission | March 2020

Publication PDF Video Github Project

Photorealistic Image Synthesis For Object Instance Detection

Tomas Hodan, Vibhav Vineet, Ran Gal, Emanuel Shalev, Jon Hanzelka, Treb Connell, Pedro Urbina, Sudipta Sinha, Brian Guenter

IEEE International Conference on Image Processing | September 2019

Publication

Privacy Preserving Action Recognition using Coded Aperture Videos

Zihao W. Wang, Vibhav Vineet, Francesco Pittaluga, Sudipta Sinha, Oliver Cossairt, Sing Bing Kang

The Bright and Dark Sides of Computer Vision: Challenges and Opportunities for Privacy and Security (CV-COPS 2019) | June 2019

Publication

EUREKA: Evaluating and Understanding Large Foundation Models

Vidhisha Balachandran, Jingya Chen, Neel Joshi, Besmira Nushi, Hamid Palangi, Eduardo Salinas, Vibhav Vineet, James Woffinden-Luey, Safoora Yousefi

MSR-TR-2024-33 | September 2024

Published by Microsoft

Preprint Github

Image Retrieval from Contextual Descriptions

Benno Krojer, Vaibhav Adlakha, Vibhav Vineet, Yash Goyal, Edoardo Ponti, Siva Reddy

ACL 2022 | May 2022

Publication

Robustness Analysis of Video-Language Models Against Visual and Language Perturbations

Madeline C. Schiappa, Shruti Vyas, Hamid Palangi, Yogesh S. Rawat, Vibhav Vineet

2022 Neural Information Processing Systems | October 2022

Publication

Feature Space Optimization for Semantic Video Segmentation

Abhijit Kundu, Vibhav Vineet, Vladlen Koltun

July 2016

Publication

Dense Monocular Depth Estimation in Complex Dynamic Scenes

Vladlen Koltun, Qifeng Chen, Vibhav Vineet, Rene Ranftl

April 2016

Publication

Incremental Dense Multi-modal 3D Scene Reconstruction

Philip H. S. Torr, Vibhav Vineet, Yousef Amar, Ondrej Miksik

July 2015

Publication

Fast acoustic scattering using convolutional neural networks

Ziqi Fan, Vibhav Vineet, Hannes Gamper, Nikunj Raghuvanshi

ICASSP 2020 - IEEE International Conference on Acoustics, Speech and Signal Processing | May 2020

PDF Project

Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations

Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor

In submission | March 2020

Publication PDF Video Github Project

Playing for Data: Ground Truth from Computer Games

Stephan R. Richter, Vibhav Vineet, Stefan Roth, Vladlen Koltun

July 2016

Publication

Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations

Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor

In submission | March 2020

Publication PDF Video Github Project

Dense Monocular Depth Estimation in Complex Dynamic Scenes

Vladlen Koltun, Qifeng Chen, Vibhav Vineet, Rene Ranftl

April 2016

Publication

Playing for Data: Ground Truth from Computer Games

Stephan R. Richter, Vibhav Vineet, Stefan Roth, Vladlen Koltun

July 2016

Publication

Inference-Time Scaling for Complex Tasks: Where We Stand and What Lies Ahead

Vidhisha Balachandran, Jingya Chen, Lingjiao Chen, Shivam Garg, Neel Joshi, Yash Lara, John Langford, Besmira Nushi, Vibhav Vineet, Yue Wu, Safoora Yousefi

MSR-TR-2025-16 | March 2025

Published by Microsoft

Publication Github

EUREKA: Evaluating and Understanding Large Foundation Models

Vidhisha Balachandran, Jingya Chen, Neel Joshi, Besmira Nushi, Hamid Palangi, Eduardo Salinas, Vibhav Vineet, James Woffinden-Luey, Safoora Yousefi

MSR-TR-2024-33 | September 2024

Published by Microsoft

Preprint Github

Benchmarking Spatial Relationships in Text-to-Image Generation

Tejas Gokhale, Hamid Palangi, Besmira Nushi, Vibhav Vineet, Eric Horvitz, Ece Kamar, Chitta Baral, Yezhou Yang

MSR-TR-2023-44 | May 2023

Published by Microsoft

Publication Github

Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models

Vibhav Vineet, Xin Wang, Neel Joshi

2024 Neural Information Processing Systems | December 2024

Publication

Peekaboo: Interactive video generation via masked-diffusion

Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl

2024 Computer Vision and Pattern Recognition | June 2024

Invited Talk at Holistic Video Understanding Workshop, CVPR 2024

DOI Publication PDF

PEEKABOO: Interactive Video Generation via Masked-Diffusion

Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl

CVPR 2024 | December 2023

Invited Talk at Holistic Video Understanding Workshop, CVPR 2024

DOI Publication Publication

DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets

Yash Jain, Harkirat Behl, Zsolt Kira, Vibhav Vineet

2023 Neural Information Processing Systems | December 2023

DOI Publication Publication

DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets

Yash Jain, Harkirat Behl, Zsolt Kira, Vibhav Vineet

NeurIPS 2023 | October 2023

Publication

PLEX: Making the Most of the Available Data for Robotic Manipulation Pretraining

Garrett Thomas, Ching-An Cheng, Ricky Loynd, Felipe Vieira Frujeri, Vibhav Vineet, Mihai Jalobeanu, Andrey Kolobov

CoRL 2023 | June 2023

Publication

Robustness Analysis of Video-Language Models Against Visual and Language Perturbations

Madeline C. Schiappa, Shruti Vyas, Hamid Palangi, Yogesh S. Rawat, Vibhav Vineet

2022 Neural Information Processing Systems | October 2022

Publication

Image Retrieval from Contextual Descriptions

Benno Krojer, Vaibhav Adlakha, Vibhav Vineet, Yash Goyal, Edoardo Ponti, Siva Reddy

ACL 2022 | May 2022

Publication

Missingness Bias in Model Debugging

Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry

ICLR 2022 | April 2022

Publication

Depth Completion Using a View-constrained Deep Prior

Pallabi Ghosh, Vibhav Vineet, Larry S. Davis, Abhinav Shrivastava, Sudipta Sinha, Neel Joshi

2020 International Conference on 3D Vision | October 2020

DOI

RANP: Resource Aware Neuron Pruning at Initialization for 3D CNNs

Zhiwei Xu, Thalaiyasingam Ajanthan, Vibhav Vineet, Richard I. Hartley

3DV | October 2020

Publication

FAST Depth Completion using a view Constrained Deep Prior

3DV | October 2020

Publication

AutoSimulate: (Quickly) Learning Synthetic Data Generation

Harkirat Singh Behl, Atılım Güneş Baydin, Ran Gal, Philip H.S. Torr, Vibhav Vineet

16th European Conference Computer Vision (ECCV 2020) | August 2020

Publication

Fast acoustic scattering using convolutional neural networks

Ziqi Fan, Vibhav Vineet, Hannes Gamper, Nikunj Raghuvanshi

ICASSP 2020 - IEEE International Conference on Acoustics, Speech and Signal Processing | May 2020

PDF Project

Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations

Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor

In submission | March 2020

Publication PDF Video Github Project

Photorealistic Image Synthesis For Object Instance Detection

Tomas Hodan, Vibhav Vineet, Ran Gal, Emanuel Shalev, Jon Hanzelka, Treb Connell, Pedro Urbina, Sudipta Sinha, Brian Guenter

IEEE International Conference on Image Processing | September 2019

Publication

Privacy Preserving Action Recognition using Coded Aperture Videos

Zihao W. Wang, Vibhav Vineet, Francesco Pittaluga, Sudipta Sinha, Oliver Cossairt, Sing Bing Kang

The Bright and Dark Sides of Computer Vision: Challenges and Opportunities for Privacy and Security (CV-COPS 2019) | June 2019

Publication

Feature Space Optimization for Semantic Video Segmentation

Abhijit Kundu, Vibhav Vineet, Vladlen Koltun

July 2016

Publication

Playing for Data: Ground Truth from Computer Games

Stephan R. Richter, Vibhav Vineet, Stefan Roth, Vladlen Koltun

July 2016

Publication

Dense Monocular Depth Estimation in Complex Dynamic Scenes

Vladlen Koltun, Qifeng Chen, Vibhav Vineet, Rene Ranftl

April 2016

Publication

Incremental Dense Multi-modal 3D Scene Reconstruction

Philip H. S. Torr, Vibhav Vineet, Yousef Amar, Ondrej Miksik

July 2015

Publication

Exposing the Achilles’ Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning

Joykirat Singh, Akshay Nambi, Vibhav Vineet

June 2024

Preprint

A Large-scale Robustness Analysis of Video Action Recognition Models

Madeline Chantry Schiappa, Naman Biyani, Prudvi Kamtam, Shruti Vyas, Hamid Palangi, Vibhav Vineet, Yogesh Rawat

April 2023

Publication

CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoning

Daniel McDuff, Yale Song, Jiyoung Lee, Vibhav Vineet, Sai Vemprala, Nicholas Gyde, Hadi Salman, Shuang Ma, Kwanghoon Sohn, Ashish Kapoor

June 2021

Preprint under review

Publication Github