UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
ECCV | October 2022
Publications
Publications by Year
-
An Empirical Study of Training End-to-End Vision-and-Language Transformers
Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
CVPR | June 2022
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
Scaling Up Vision-Language Pre-training for Image Captioning
Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
CVPR 2022 | March 2022
An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
AAAI 2022 | February 2022
OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning
Sheng Liu, Kevin Lin, Lijuan Wang, Junsong Yuan, Zicheng Liu
AAAI 2022 | February 2022
Playing Lottery Tickets with Vision and Language
Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu
AAAI 2022 | February 2022
-
VIOLET: End-to-End Video-Language Transformers with Masked Visual-token Modeling
Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu
arXiv preprint arXiv:2111.12681 | November 2021
Florence: A New Foundation Model for Computer Vision
Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
arXiv preprint arXiv:2111.11432 | November 2021
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang
arXiv preprint arXiv:2111.10023 | November 2021
Compressing Visual-Linguistic Model via Knowledge Distillation
Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu
ICCV 2021 | October 2021
Mesh Graphormer
Kevin Lin, Lijuan Wang, Zicheng Liu
ICCV 2021 | October 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
End-to-End Human Pose and Mesh Reconstruction with Transformers
Kevin Lin, Lijuan Wang, Zicheng Liu
CVPR 2021 | June 2021
TAP: Text-Aware Pre-training for Text-VQA and Text-Caption
Zhengyuan Yang, Yijuan Lu, Jianfeng Wang, Xi Yin, Dinei Florencio, Lijuan Wang, Cha Zhang, Lei Zhang, Jiebo Luo
CVPR 2021 | June 2021
VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
AAAI | February 2021
-
MiniVLM: A Smaller and Faster Vision-Language Model
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
arXiv preprint arXiv:2012.06946 | December 2020
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Rethinking Classification and Localization for Object Detection
Pengyue Wu, Yinpeng Chen, Lu Yuan, Zicheng Liu, Lijuan Wang, Hongzhi Li, Yun Fu
CVPR 2020 | June 2020
-
Photo-Real Talking Head with Deep Bidirectional LSTM
Bo Fan, Lijuan Wang, Frank Soong, Lei Xie
April 2015
-
A New Language Independent, Photo-realistic Talking Head Driven by Voice Only
Xinjian Zhang, Lijuan Wang, Gang Li, Frank Seide, Frank Soong
September 2013
Binocular Photometric Stereo Acquisition and Reconstruction for 3D Talking Head Applications
Lijuan Wang, Yasuyuki Matsushita, Bojun Huang, Frank Soong
August 2013
-
Computer-Assisted Audiovisual Language Learning
Lijuan Wang, Yao Qian, Matt Scott, Gang Chen, Frank Soong
COMPUTER | June 2012
High Quality Lip-Sync Animation for 3D Photo-Realistic Talking Head
Lijuan Wang, Wei Han, Frank Soong
April 2012
Improved Minimum Converted Trajectory Error Training for Real-Time Speech-to-lips Conversion
Wei Han, Lijuan Wang, Frank Soong, Bo Yuan
April 2012
-
Text-driven 3D Photo-Realistic Talking Head
Lijuan Wang, Wei Han, Frank Soong, Qiang Huo
INTERSPEECH 2011 | September 2011
A Sparse and Low-Rank Approach to Efficient Face Alignment for Photo-Real Talking Head Synthesis
Lijuan Wang, Frank Soong
ICASSP 2011 | May 2011
Synthesizing Visual Speech Trajectory with Minimum Generation Error
Lijuan Wang, Yi-Jian Wu, Xiaodan Zhuang, Frank Soong
ICASSP 2011 | May 2011
-
Photo-Real Lips Synthesis with Trajectory-Guided Sample Selection
Lijuan Wang, Xiaojun Qian, Wei Han, Frank Soong
Speech Synthesis Workshop (SSW7) | September 2010
A Minimum Converted Trajectory Error (MCTE) Approach to High Quality Speech-to-Lips Conversion
Lijuan Wang, Frank Soong
INTERSPEECH 2010 | September 2010
Synthesizing Photo-Real Talking Head via Trajectory-Guided Sample Selection
Lijuan Wang, Xiaojun Qian, Wei Han, Frank Soong
INTERSPEECH 2010 | September 2010
-
Auto-Checking Speech Transcriptions by Multiple Template Constrained
Lijuan Wang, Shenghao Qin, Frank Soong
INTERSPEECH 2009 | September 2009
-
Efficient Handwriting Correction of Speech Recognition Errors with Template Constrained Posterior (TCP)
Lijuan Wang, Tao Hu, Peng Liu, Frank Soong
INTERSPEECH 2008 | September 2008
Template Constrained Posterior for Verifying Phone Transcriptions
Lijuan Wang, Tao Hu, Frank Soong
ICASSP 2008 | April 2008
-
Context Constrained-Generalized Posterior Probability for Verifying Phone Transcriptions
Lijuan Wang, Frank Soong
September 2007
-
Constructing Stylistic Synthesis Databases from Audio Books
Yong Zhao, Di Peng, Lijuan Wang, Min Chu, Yining Chen, Roger (Peng) Yu, Jun Guo
INTERSPEECH 2006 | September 2006
-
Phonetic Transcription Verification with Generalized Posterior Probability
Lijuan Wang, Yong Zhao, Min Chu, Frank Soong, Zhigang Cao
INTERSPEECH 2005 | September 2005
INTERSPEECH 2005
Refining Phoneme Segmentations Using Speaker-Adaptive Context Dependent Boundary Models
Yong Zhao, Lijuan Wang, Min Chu, Frank Soong, Zhigang Cao
INTERSPEECH 2005 | September 2005
Phonetic Transcription Verification with Generalized Posterior Probability
Lijuan Wang, Yong Zhao, Min Chu, Frank Soong, Zhigang Cao
April 2005
-
Refining Segmental Boundaries for TTS database Using Fine Contextual-Dependent Boundary Models
Lijuan Wang, Yong Zhao, Min Chu, Jianlai Zhou, Zhigang Cao
May 2004
Publications by Research Area
-
UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
ECCV | October 2022
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
Scaling Up Vision-Language Pre-training for Image Captioning
Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
CVPR 2022 | March 2022
OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning
Sheng Liu, Kevin Lin, Lijuan Wang, Junsong Yuan, Zicheng Liu
AAAI 2022 | February 2022
An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
AAAI 2022 | February 2022
Playing Lottery Tickets with Vision and Language
Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu
AAAI 2022 | February 2022
VIOLET: End-to-End Video-Language Transformers with Masked Visual-token Modeling
Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu
arXiv preprint arXiv:2111.12681 | November 2021
Florence: A New Foundation Model for Computer Vision
Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
arXiv preprint arXiv:2111.11432 | November 2021
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang
arXiv preprint arXiv:2111.10023 | November 2021
Compressing Visual-Linguistic Model via Knowledge Distillation
Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu
ICCV 2021 | October 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
AAAI | February 2021
MiniVLM: A Smaller and Faster Vision-Language Model
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
arXiv preprint arXiv:2012.06946 | December 2020
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Photo-Real Talking Head with Deep Bidirectional LSTM
Bo Fan, Lijuan Wang, Frank Soong, Lei Xie
April 2015
A New Language Independent, Photo-realistic Talking Head Driven by Voice Only
Xinjian Zhang, Lijuan Wang, Gang Li, Frank Seide, Frank Soong
September 2013
Text-driven 3D Photo-Realistic Talking Head
Lijuan Wang, Wei Han, Frank Soong, Qiang Huo
INTERSPEECH 2011 | September 2011
-
UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
ECCV | October 2022
An Empirical Study of Training End-to-End Vision-and-Language Transformers
Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
CVPR | June 2022
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
Scaling Up Vision-Language Pre-training for Image Captioning
Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
CVPR 2022 | March 2022
OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning
Sheng Liu, Kevin Lin, Lijuan Wang, Junsong Yuan, Zicheng Liu
AAAI 2022 | February 2022
An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
AAAI 2022 | February 2022
Playing Lottery Tickets with Vision and Language
Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu
AAAI 2022 | February 2022
VIOLET: End-to-End Video-Language Transformers with Masked Visual-token Modeling
Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu
arXiv preprint arXiv:2111.12681 | November 2021
Florence: A New Foundation Model for Computer Vision
Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
arXiv preprint arXiv:2111.11432 | November 2021
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang
arXiv preprint arXiv:2111.10023 | November 2021
Mesh Graphormer
Kevin Lin, Lijuan Wang, Zicheng Liu
ICCV 2021 | October 2021
Compressing Visual-Linguistic Model via Knowledge Distillation
Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu
ICCV 2021 | October 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
End-to-End Human Pose and Mesh Reconstruction with Transformers
Kevin Lin, Lijuan Wang, Zicheng Liu
CVPR 2021 | June 2021
TAP: Text-Aware Pre-training for Text-VQA and Text-Caption
Zhengyuan Yang, Yijuan Lu, Jianfeng Wang, Xi Yin, Dinei Florencio, Lijuan Wang, Cha Zhang, Lei Zhang, Jiebo Luo
CVPR 2021 | June 2021
VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
AAAI | February 2021
MiniVLM: A Smaller and Faster Vision-Language Model
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
arXiv preprint arXiv:2012.06946 | December 2020
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Rethinking Classification and Localization for Object Detection
Pengyue Wu, Yinpeng Chen, Lu Yuan, Zicheng Liu, Lijuan Wang, Hongzhi Li, Yun Fu
CVPR 2020 | June 2020
-
UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
ECCV | October 2022
An Empirical Study of Training End-to-End Vision-and-Language Transformers
Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
CVPR | June 2022
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
Scaling Up Vision-Language Pre-training for Image Captioning
Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
CVPR 2022 | March 2022
OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning
Sheng Liu, Kevin Lin, Lijuan Wang, Junsong Yuan, Zicheng Liu
AAAI 2022 | February 2022
An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
AAAI 2022 | February 2022
Playing Lottery Tickets with Vision and Language
Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu
AAAI 2022 | February 2022
VIOLET: End-to-End Video-Language Transformers with Masked Visual-token Modeling
Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu
arXiv preprint arXiv:2111.12681 | November 2021
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang
arXiv preprint arXiv:2111.10023 | November 2021
MiniVLM: A Smaller and Faster Vision-Language Model
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
arXiv preprint arXiv:2012.06946 | December 2020
A New Language Independent, Photo-realistic Talking Head Driven by Voice Only
Xinjian Zhang, Lijuan Wang, Gang Li, Frank Seide, Frank Soong
September 2013
Improved Minimum Converted Trajectory Error Training for Real-Time Speech-to-lips Conversion
Wei Han, Lijuan Wang, Frank Soong, Bo Yuan
April 2012
Photo-Real Lips Synthesis with Trajectory-Guided Sample Selection
Lijuan Wang, Xiaojun Qian, Wei Han, Frank Soong
Speech Synthesis Workshop (SSW7) | September 2010
Synthesizing Photo-Real Talking Head via Trajectory-Guided Sample Selection
Lijuan Wang, Xiaojun Qian, Wei Han, Frank Soong
INTERSPEECH 2010 | September 2010
Auto-Checking Speech Transcriptions by Multiple Template Constrained
Lijuan Wang, Shenghao Qin, Frank Soong
INTERSPEECH 2009 | September 2009
Template Constrained Posterior for Verifying Phone Transcriptions
Lijuan Wang, Tao Hu, Frank Soong
ICASSP 2008 | April 2008
Phonetic Transcription Verification with Generalized Posterior Probability
Lijuan Wang, Yong Zhao, Min Chu, Frank Soong, Zhigang Cao
INTERSPEECH 2005 | September 2005
INTERSPEECH 2005
Refining Phoneme Segmentations Using Speaker-Adaptive Context Dependent Boundary Models
Yong Zhao, Lijuan Wang, Min Chu, Frank Soong, Zhigang Cao
INTERSPEECH 2005 | September 2005
Refining Segmental Boundaries for TTS database Using Fine Contextual-Dependent Boundary Models
Lijuan Wang, Yong Zhao, Min Chu, Jianlai Zhou, Zhigang Cao
May 2004
-
Binocular Photometric Stereo Acquisition and Reconstruction for 3D Talking Head Applications
Lijuan Wang, Yasuyuki Matsushita, Bojun Huang, Frank Soong
August 2013
High Quality Lip-Sync Animation for 3D Photo-Realistic Talking Head
Lijuan Wang, Wei Han, Frank Soong
April 2012
Text-driven 3D Photo-Realistic Talking Head
Lijuan Wang, Wei Han, Frank Soong, Qiang Huo
INTERSPEECH 2011 | September 2011
-
Computer-Assisted Audiovisual Language Learning
Lijuan Wang, Yao Qian, Matt Scott, Gang Chen, Frank Soong
COMPUTER | June 2012
A Sparse and Low-Rank Approach to Efficient Face Alignment for Photo-Real Talking Head Synthesis
Lijuan Wang, Frank Soong
ICASSP 2011 | May 2011
Synthesizing Visual Speech Trajectory with Minimum Generation Error
Lijuan Wang, Yi-Jian Wu, Xiaodan Zhuang, Frank Soong
ICASSP 2011 | May 2011
A Minimum Converted Trajectory Error (MCTE) Approach to High Quality Speech-to-Lips Conversion
Lijuan Wang, Frank Soong
INTERSPEECH 2010 | September 2010
-
Efficient Handwriting Correction of Speech Recognition Errors with Template Constrained Posterior (TCP)
Lijuan Wang, Tao Hu, Peng Liu, Frank Soong
INTERSPEECH 2008 | September 2008
-
Context Constrained-Generalized Posterior Probability for Verifying Phone Transcriptions
Lijuan Wang, Frank Soong
September 2007
-
Context Constrained-Generalized Posterior Probability for Verifying Phone Transcriptions
Lijuan Wang, Frank Soong
September 2007
-
Constructing Stylistic Synthesis Databases from Audio Books
Yong Zhao, Di Peng, Lijuan Wang, Min Chu, Yining Chen, Roger (Peng) Yu, Jun Guo
INTERSPEECH 2006 | September 2006
-
Phonetic Transcription Verification with Generalized Posterior Probability
Lijuan Wang, Yong Zhao, Min Chu, Frank Soong, Zhigang Cao
April 2005
Publications by Type
-
UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
ECCV | October 2022
An Empirical Study of Training End-to-End Vision-and-Language Transformers
Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
CVPR | June 2022
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
Scaling Up Vision-Language Pre-training for Image Captioning
Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
CVPR 2022 | March 2022
OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning
Sheng Liu, Kevin Lin, Lijuan Wang, Junsong Yuan, Zicheng Liu
AAAI 2022 | February 2022
An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
AAAI 2022 | February 2022
Playing Lottery Tickets with Vision and Language
Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu
AAAI 2022 | February 2022
Mesh Graphormer
Kevin Lin, Lijuan Wang, Zicheng Liu
ICCV 2021 | October 2021
Compressing Visual-Linguistic Model via Knowledge Distillation
Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu
ICCV 2021 | October 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
End-to-End Human Pose and Mesh Reconstruction with Transformers
Kevin Lin, Lijuan Wang, Zicheng Liu
CVPR 2021 | June 2021
TAP: Text-Aware Pre-training for Text-VQA and Text-Caption
Zhengyuan Yang, Yijuan Lu, Jianfeng Wang, Xi Yin, Dinei Florencio, Lijuan Wang, Cha Zhang, Lei Zhang, Jiebo Luo
CVPR 2021 | June 2021
VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
AAAI | February 2021
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Rethinking Classification and Localization for Object Detection
Pengyue Wu, Yinpeng Chen, Lu Yuan, Zicheng Liu, Lijuan Wang, Hongzhi Li, Yun Fu
CVPR 2020 | June 2020
Photo-Real Talking Head with Deep Bidirectional LSTM
Bo Fan, Lijuan Wang, Frank Soong, Lei Xie
April 2015
A New Language Independent, Photo-realistic Talking Head Driven by Voice Only
Xinjian Zhang, Lijuan Wang, Gang Li, Frank Seide, Frank Soong
September 2013
Binocular Photometric Stereo Acquisition and Reconstruction for 3D Talking Head Applications
Lijuan Wang, Yasuyuki Matsushita, Bojun Huang, Frank Soong
August 2013
High Quality Lip-Sync Animation for 3D Photo-Realistic Talking Head
Lijuan Wang, Wei Han, Frank Soong
April 2012
Improved Minimum Converted Trajectory Error Training for Real-Time Speech-to-lips Conversion
Wei Han, Lijuan Wang, Frank Soong, Bo Yuan
April 2012
Text-driven 3D Photo-Realistic Talking Head
Lijuan Wang, Wei Han, Frank Soong, Qiang Huo
INTERSPEECH 2011 | September 2011
A Sparse and Low-Rank Approach to Efficient Face Alignment for Photo-Real Talking Head Synthesis
Lijuan Wang, Frank Soong
ICASSP 2011 | May 2011
Synthesizing Visual Speech Trajectory with Minimum Generation Error
Lijuan Wang, Yi-Jian Wu, Xiaodan Zhuang, Frank Soong
ICASSP 2011 | May 2011
Photo-Real Lips Synthesis with Trajectory-Guided Sample Selection
Lijuan Wang, Xiaojun Qian, Wei Han, Frank Soong
Speech Synthesis Workshop (SSW7) | September 2010
A Minimum Converted Trajectory Error (MCTE) Approach to High Quality Speech-to-Lips Conversion
Lijuan Wang, Frank Soong
INTERSPEECH 2010 | September 2010
Synthesizing Photo-Real Talking Head via Trajectory-Guided Sample Selection
Lijuan Wang, Xiaojun Qian, Wei Han, Frank Soong
INTERSPEECH 2010 | September 2010
Auto-Checking Speech Transcriptions by Multiple Template Constrained
Lijuan Wang, Shenghao Qin, Frank Soong
INTERSPEECH 2009 | September 2009
Efficient Handwriting Correction of Speech Recognition Errors with Template Constrained Posterior (TCP)
Lijuan Wang, Tao Hu, Peng Liu, Frank Soong
INTERSPEECH 2008 | September 2008
Template Constrained Posterior for Verifying Phone Transcriptions
Lijuan Wang, Tao Hu, Frank Soong
ICASSP 2008 | April 2008
Context Constrained-Generalized Posterior Probability for Verifying Phone Transcriptions
Lijuan Wang, Frank Soong
September 2007
Constructing Stylistic Synthesis Databases from Audio Books
Yong Zhao, Di Peng, Lijuan Wang, Min Chu, Yining Chen, Roger (Peng) Yu, Jun Guo
INTERSPEECH 2006 | September 2006
Phonetic Transcription Verification with Generalized Posterior Probability
Lijuan Wang, Yong Zhao, Min Chu, Frank Soong, Zhigang Cao
INTERSPEECH 2005 | September 2005
INTERSPEECH 2005
Refining Phoneme Segmentations Using Speaker-Adaptive Context Dependent Boundary Models
Yong Zhao, Lijuan Wang, Min Chu, Frank Soong, Zhigang Cao
INTERSPEECH 2005 | September 2005
Phonetic Transcription Verification with Generalized Posterior Probability
Lijuan Wang, Yong Zhao, Min Chu, Frank Soong, Zhigang Cao
April 2005
Refining Segmental Boundaries for TTS database Using Fine Contextual-Dependent Boundary Models
Lijuan Wang, Yong Zhao, Min Chu, Jianlai Zhou, Zhigang Cao
May 2004
-
VIOLET: End-to-End Video-Language Transformers with Masked Visual-token Modeling
Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu
arXiv preprint arXiv:2111.12681 | November 2021
Florence: A New Foundation Model for Computer Vision
Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
arXiv preprint arXiv:2111.11432 | November 2021
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang
arXiv preprint arXiv:2111.10023 | November 2021
MiniVLM: A Smaller and Faster Vision-Language Model
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
arXiv preprint arXiv:2012.06946 | December 2020
Computer-Assisted Audiovisual Language Learning
Lijuan Wang, Yao Qian, Matt Scott, Gang Chen, Frank Soong
COMPUTER | June 2012