Bei Liu

CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo

November 2024

DOI Publication Publication

MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo

arXiv | December 2022

Publication Projet

Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning

Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu

NeurIPS 2022 | November 2022

Publication

Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions

Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo

CVPR 2022 | June 2022

Publication Projet

Debiasing Event Understanding for Visual Commonsense Tasks

Minji Seo, YeonJoon Jung, Seungtaek Choi, seung-won hwang, Bei Liu

May 2022

Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training

Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo

NeurIPS 2021 | December 2021

Publication

Searching the Search Space of Vision Transformer

Minghao Chen, Kan Wu, Bolin Ni, Houwen Peng, Bei Liu, Jianlong Fu, Hongyang Chao, Haibin Ling

NeurIPS 2021 | December 2021

Publication

Learning Fine-Grained Motion Embedding for Landscape Animation

Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo

ACM Multimedia 2021 | October 2021

Oral

Publication Projet

A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation

Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu

ACM Multimedia 2021 | October 2021

Publication Projet

Unifying multimodal transformer for bi-directional image and text generation

Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu

ACM Multimedia 2021 | October 2021

Publication Projet

MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding

Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui

ICMR 2021 | August 2021

DOI Projet

Reference-Based Defect Detection Network

Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao

IEEE Transactions on Image Processing | July 2021, Vol 30: pp. 6637-6647

Publication

Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning

Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu

CVPR 2021 | June 2021

Oral

Publication Projet

Aesthetic-Aware Image Style Transfer

Bei Liu, Jianlong Fu

ACM Multimedia | October 2020

Publication Projet

Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers

Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu

MSR-TR-2020-51 | April 2020

Publié par Microsoft

Publication Projet

Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences

Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou

ACM Multimedia | October 2019

Publication Projet

SMP Challenge: An Overview of Social Media Prediction Challenge 2019

Bo Wu, Wen-Huang Cheng, Peiye Liu, Bei Liu, Zhaoyang Zeng, Jiebo Luo

ACM Multimedia | October 2019

Publication

WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection

Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao, Lei Zhang

ICCV | October 2019

Publication Projet

Emotion Reinforced Visual Storytelling

Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu

ICMR | June 2019

Publication Projet

Learning Rich Image Region Representation for Visual Question Answering

Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu

MSR-TR-2020-1 | June 2019

Publié par Microsoft

CVPR 2019, VQA Workshop

Publication Projet

Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training

Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa

2018 ACM Multimedia | October 2018

Best Paper Award

DOI Publication PDF Projet

CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo

November 2024

DOI Publication Publication

Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning

Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu

NeurIPS 2022 | November 2022

Publication

Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning

Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu

CVPR 2021 | June 2021

Oral

Publication Projet

Aesthetic-Aware Image Style Transfer

Bei Liu, Jianlong Fu

ACM Multimedia | October 2020

Publication Projet

Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers

Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu

MSR-TR-2020-51 | April 2020

Publié par Microsoft

Publication Projet

Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences

Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou

ACM Multimedia | October 2019

Publication Projet

Learning Rich Image Region Representation for Visual Question Answering

Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu

MSR-TR-2020-1 | June 2019

Publié par Microsoft

CVPR 2019, VQA Workshop

Publication Projet

Emotion Reinforced Visual Storytelling

Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu

ICMR | June 2019

Publication Projet

Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training

Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa

2018 ACM Multimedia | October 2018

Best Paper Award

DOI Publication PDF Projet

CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo

November 2024

DOI Publication Publication

MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo

arXiv | December 2022

Publication Projet

Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions

Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo

CVPR 2022 | June 2022

Publication Projet

Searching the Search Space of Vision Transformer

Minghao Chen, Kan Wu, Bolin Ni, Houwen Peng, Bei Liu, Jianlong Fu, Hongyang Chao, Haibin Ling

NeurIPS 2021 | December 2021

Publication

Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training

Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo

NeurIPS 2021 | December 2021

Publication

Learning Fine-Grained Motion Embedding for Landscape Animation

Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo

ACM Multimedia 2021 | October 2021

Oral

Publication Projet

Unifying multimodal transformer for bi-directional image and text generation

Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu

ACM Multimedia 2021 | October 2021

Publication Projet

A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation

Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu

ACM Multimedia 2021 | October 2021

Publication Projet

MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding

Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui

ICMR 2021 | August 2021

DOI Projet

Reference-Based Defect Detection Network

Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao

IEEE Transactions on Image Processing | July 2021, Vol 30: pp. 6637-6647

Publication

Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning

Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu

CVPR 2021 | June 2021

Oral

Publication Projet

Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers

Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu

MSR-TR-2020-51 | April 2020

Publié par Microsoft

Publication Projet

WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection

Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao, Lei Zhang

ICCV | October 2019

Publication Projet

Learning Rich Image Region Representation for Visual Question Answering

Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu

MSR-TR-2020-1 | June 2019

Publié par Microsoft

CVPR 2019, VQA Workshop

Publication Projet

CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo

November 2024

DOI Publication Publication

Debiasing Event Understanding for Visual Commonsense Tasks

Minji Seo, YeonJoon Jung, Seungtaek Choi, seung-won hwang, Bei Liu

May 2022

Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training

Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa

2018 ACM Multimedia | October 2018

Best Paper Award

DOI Publication PDF Projet

Learning Fine-Grained Motion Embedding for Landscape Animation

Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo

ACM Multimedia 2021 | October 2021

Oral

Publication Projet

Unifying multimodal transformer for bi-directional image and text generation

Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu

ACM Multimedia 2021 | October 2021

Publication Projet

A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation

Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu

ACM Multimedia 2021 | October 2021

Publication Projet

MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding

Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui

ICMR 2021 | August 2021

DOI Projet

SMP Challenge: An Overview of Social Media Prediction Challenge 2019

Bo Wu, Wen-Huang Cheng, Peiye Liu, Bei Liu, Zhaoyang Zeng, Jiebo Luo

ACM Multimedia | October 2019

Publication

Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences

Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou

ACM Multimedia | October 2019

Publication Projet

Emotion Reinforced Visual Storytelling

Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu

ICMR | June 2019

Publication Projet

Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training

Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa

2018 ACM Multimedia | October 2018

Best Paper Award

DOI Publication PDF Projet

CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo

November 2024

DOI Publication Publication

MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo

arXiv | December 2022

Publication Projet

Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning

Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu

NeurIPS 2022 | November 2022

Publication

Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions

Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo

CVPR 2022 | June 2022

Publication Projet

Searching the Search Space of Vision Transformer

Minghao Chen, Kan Wu, Bolin Ni, Houwen Peng, Bei Liu, Jianlong Fu, Hongyang Chao, Haibin Ling

NeurIPS 2021 | December 2021

Publication

Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training

Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo

NeurIPS 2021 | December 2021

Publication

Learning Fine-Grained Motion Embedding for Landscape Animation

Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo

ACM Multimedia 2021 | October 2021

Oral

Publication Projet

Unifying multimodal transformer for bi-directional image and text generation

Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu

ACM Multimedia 2021 | October 2021

Publication Projet

A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation

Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu

ACM Multimedia 2021 | October 2021

Publication Projet

MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding

Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui

ICMR 2021 | August 2021

DOI Projet

Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning

Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu

CVPR 2021 | June 2021

Oral

Publication Projet

Aesthetic-Aware Image Style Transfer

Bei Liu, Jianlong Fu

ACM Multimedia | October 2020

Publication Projet

SMP Challenge: An Overview of Social Media Prediction Challenge 2019

Bo Wu, Wen-Huang Cheng, Peiye Liu, Bei Liu, Zhaoyang Zeng, Jiebo Luo

ACM Multimedia | October 2019

Publication

Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences

Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou

ACM Multimedia | October 2019

Publication Projet

WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection

Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao, Lei Zhang

ICCV | October 2019

Publication Projet

Emotion Reinforced Visual Storytelling

Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu

ICMR | June 2019

Publication Projet

Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training

Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa

2018 ACM Multimedia | October 2018

Best Paper Award

DOI Publication PDF Projet

Debiasing Event Understanding for Visual Commonsense Tasks

Minji Seo, YeonJoon Jung, Seungtaek Choi, seung-won hwang, Bei Liu

May 2022

Reference-Based Defect Detection Network

Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao

IEEE Transactions on Image Processing | July 2021, Vol 30: pp. 6637-6647

Publication

Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers

Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu

MSR-TR-2020-51 | April 2020

Publié par Microsoft

Publication Projet

Learning Rich Image Region Representation for Visual Question Answering

Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu

MSR-TR-2020-1 | June 2019

Publié par Microsoft

CVPR 2019, VQA Workshop

Publication Projet