Document AI (Intelligent Document Processing)

Kosmos-2.5: A Multimodal Literate Model

Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei

September 2023

Preprint

TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models

Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei

AAAI 2023 | February 2023

Publication

XDoc: Unified Pre-training for Cross-Format Document Understanding

Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei

EMNLP 2022 | December 2022

Publication

DiT: Self-supervised Pre-training for Document Image Transformer

Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei

ACM Multimedia 2022 | October 2022

Publication

LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking

Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei

ACM Multimedia 2022 | October 2022

Publication

MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding

Junlong Li, Yiheng Xu, Lei Cui, Furu Wei

ACL 2022 | May 2022

Publication

XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding

Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei

ACL 2022 | May 2022

Publication

Document AI: Benchmarks, Models and Applications

Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei

November 2021

Publication

LayoutReader: Pre-training of Text and Layout for Reading Order Detection

Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei

EMNLP 2021 | November 2021

Publication

Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)

Lei Cui

September 2021

September 2021

DIL workshop in ICDAR 2021

Document AI: Benchmarks, Models and Applications (In Chinese)

Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei

CCL 2021 | August 2021

Publication

LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding

Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei

April 2021

Publication

LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding

Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou

ACL-IJCNLP 2021 | January 2021

Preprint Publication Github

DocBank: A Benchmark Dataset for Document Layout Analysis

Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou

COLING 2020 | December 2020

Publication

LayoutLM: Pre-training of Text and Layout for Document Image Understanding

Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou

KDD 2020 | August 2020

PDF Publication Github

TableBank: Table Benchmark for Image-based Table Detection and Recognition

Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li

LREC 2020 | May 2020

Publication

Kosmos-2.5: A Multimodal Literate Model

Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei

September 2023

Preprint

TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models

Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei

AAAI 2023 | February 2023

Publication

XDoc: Unified Pre-training for Cross-Format Document Understanding

Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei

EMNLP 2022 | December 2022

Publication

LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking

Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei

ACM Multimedia 2022 | October 2022

Publication

DiT: Self-supervised Pre-training for Document Image Transformer

Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei

ACM Multimedia 2022 | October 2022

Publication

MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding

Junlong Li, Yiheng Xu, Lei Cui, Furu Wei

ACL 2022 | May 2022

Publication

Document AI: Benchmarks, Models and Applications

Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei

November 2021

Publication

LayoutReader: Pre-training of Text and Layout for Reading Order Detection

Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei

EMNLP 2021 | November 2021

Publication

Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)

Lei Cui

September 2021

September 2021

DIL workshop in ICDAR 2021

Document AI: Benchmarks, Models and Applications (In Chinese)

Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei

CCL 2021 | August 2021

Publication

LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding

Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei

April 2021

Publication

DocBank: A Benchmark Dataset for Document Layout Analysis

Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou

COLING 2020 | December 2020

Publication

LayoutLM: Pre-training of Text and Layout for Document Image Understanding

Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou

KDD 2020 | August 2020

PDF Publication Github

TableBank: Table Benchmark for Image-based Table Detection and Recognition

Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li

LREC 2020 | May 2020

Publication

Kosmos-2.5: A Multimodal Literate Model

Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei

September 2023

Preprint

TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models

Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei

AAAI 2023 | February 2023

Publication

LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking

Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei

ACM Multimedia 2022 | October 2022

Publication

DiT: Self-supervised Pre-training for Document Image Transformer

Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei

ACM Multimedia 2022 | October 2022

Publication

Document AI: Benchmarks, Models and Applications

Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei

November 2021

Publication

TableBank: Table Benchmark for Image-based Table Detection and Recognition

Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li

LREC 2020 | May 2020

Publication

Kosmos-2.5: A Multimodal Literate Model

Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei

September 2023

Preprint

TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models

Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei

AAAI 2023 | February 2023

Publication

XDoc: Unified Pre-training for Cross-Format Document Understanding

Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei

EMNLP 2022 | December 2022

Publication

LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking

Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei

ACM Multimedia 2022 | October 2022

Publication

XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding

Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei

ACL 2022 | May 2022

Publication

MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding

Junlong Li, Yiheng Xu, Lei Cui, Furu Wei

ACL 2022 | May 2022

Publication

Document AI: Benchmarks, Models and Applications

Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei

November 2021

Publication

LayoutReader: Pre-training of Text and Layout for Reading Order Detection

Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei

EMNLP 2021 | November 2021

Publication

Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)

Lei Cui

September 2021

September 2021

DIL workshop in ICDAR 2021

Document AI: Benchmarks, Models and Applications (In Chinese)

Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei

CCL 2021 | August 2021

Publication

LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding

Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei

April 2021

Publication

LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding

Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou

ACL-IJCNLP 2021 | January 2021

Preprint Publication Github

DocBank: A Benchmark Dataset for Document Layout Analysis

Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou

COLING 2020 | December 2020

Publication

LayoutLM: Pre-training of Text and Layout for Document Image Understanding

Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou

KDD 2020 | August 2020

PDF Publication Github

TableBank: Table Benchmark for Image-based Table Detection and Recognition

Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li

LREC 2020 | May 2020

Publication

Kosmos-2.5: A Multimodal Literate Model

Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei

September 2023

Preprint

Document AI: Benchmarks, Models and Applications

Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei

November 2021

Publication

LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding

Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei

April 2021

Publication

TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models

Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei

AAAI 2023 | February 2023

Publication

XDoc: Unified Pre-training for Cross-Format Document Understanding

Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei

EMNLP 2022 | December 2022

Publication

LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking

Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei

ACM Multimedia 2022 | October 2022

Publication

DiT: Self-supervised Pre-training for Document Image Transformer

Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei

ACM Multimedia 2022 | October 2022

Publication

XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding

Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei

ACL 2022 | May 2022

Publication

MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding

Junlong Li, Yiheng Xu, Lei Cui, Furu Wei

ACL 2022 | May 2022

Publication

LayoutReader: Pre-training of Text and Layout for Reading Order Detection

Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei

EMNLP 2021 | November 2021

Publication

Document AI: Benchmarks, Models and Applications (In Chinese)

Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei

CCL 2021 | August 2021

Publication

LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding

Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou

ACL-IJCNLP 2021 | January 2021

Preprint Publication Github

DocBank: A Benchmark Dataset for Document Layout Analysis

Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou

COLING 2020 | December 2020

Publication

LayoutLM: Pre-training of Text and Layout for Document Image Understanding

Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou

KDD 2020 | August 2020

PDF Publication Github

TableBank: Table Benchmark for Image-based Table Detection and Recognition

Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li

LREC 2020 | May 2020

Publication

Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)

Lei Cui

September 2021

September 2021

DIL workshop in ICDAR 2021