Microsoft at CVPR 2024

BIOCLIP: A Vision Foundation Model for the Tree of Life

Samuel Stevens, Jiaman Wu, Matthew J Thompson, Elizabeth G. Campolongo, Chan Hee Song, David Carlyn, Li Dong, W. Dahdul, Charles Stewart, Tanya Y. Berger-Wolf, Wei-Lun Chao, Yu Su

CVPR 2024 | June 2024

CVPR 2024 Best Student Paper Award

DOI Publication

BlockGCN: Redefine Topology Awareness for Skeleton-Based Action Recognition

Yuxuan Zhou, Xudong Yan, Zhi-Qi Cheng, Yan Yan, Qi Dai, Xian-Sheng Hua

The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) | May 2024

Publication

Boosting Neural Representations for Videos with a Conditional Decoder

Xinjie Zhang, Ren Yang, Dailan He, Xingtong Ge, Tongda Xu, Yan Wang, Hongwei Qin, Jun Zhang

CVPR 2024 | February 2024

DOI Publication Publication

CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation

Zineng Tang, Ziyi Yang, Mahmoud Khademi, Yang Liu, Chenguang Zhu, Mohit Bansal

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024 | March 2024

Publication PDF

Desigen: A Pipeline for Controllable Design Template Generation

Haohan Weng, Danqing Huang, Yu Qiao, Zheng Hu, Chin-Yew Lin, Tong Zhang, C. L. P. Chen

CVPR 2024 | March 2024

DOI Publication Publication

DREAM: Diffusion Rectification and Estimation-Adaptive Models

Jinxin Zhou, Tianyu Ding, Tianyi Chen, Jiachen Jiang, Ilya Zharkov, Zhihui Zhu, Luming Liang

2024 Computer Vision and Pattern Recognition | March 2024

DOI Publication Publication

Efficient Solution of Point-Line Absolute Pose

Petr Hruby, Timothy Duff, Marc Pollefeys

CVPR 2024 | April 2024

Publication

EgoGen: An Egocentric Synthetic Data Generator

Gen Li, Kaifeng Zhao, Siwei Zhang, Xiaozhong Lyu, Mihai Dusmanu, Yan Zhang, Marc Pollefeys

CVPR 2024 | January 2024

Publication

Explaining CLIP’s performance disparities on data from blind/low vision users

Daniela Massiceti, Camilla Longden, Agnieszka Slowik, Samuel Wills, Martin Grayson, Cecily Morrison

2024 Computer Vision and Pattern Recognition | June 2024

Publication 동영상 동영상 프로젝트

Exploiting Inter-sample and Inter-feature Relations in Dataset Distillation

Wenxiao Deng, Wenbin Li, Tianyu Ding, Lei Wang, Hongguang Zhang, Kuihua Huang, Jing Huo, Yang Gao

CVPR 2024 | March 2024

DOI Publication Publication

F3Loc: Fusion and Filtering for Floorplan Localization

Changan Chen, Rui Wang, Christoph Vogel, Marc Pollefeys

CVPR 2024 | March 2024

Publication

FlashEval: Towards Fast and Accurate Evaluation of Text-to-image Diffusion Generative Models

Lin Zhao, Tianchen Zhao, Zinan Lin, Xuefei Ning, Guohao Dai, Huazhong Yang, Yu Wang

CVPR 2024 | June 2024

Publication

Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks

Bin Xiao, Haiping Wu, Weijian Xu, Xiyang Dai, Houdong Hu, Yumao Lu, Michael Zeng, Ce Liu, Lu Yuan

CVPR 2024 | June 2024

Preprint Publication

GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image

Chong Bao, Yinda Zhang, Yuan Li, Xiyu Zhang, Bangbang Yang, Hujun Bao, Marc Pollefeys, Guofeng Zhang, Zhaopeng Cui

CVPR 2024 | April 2024

DOI Publication Publication

Generative Latent Coding for Ultra-Low Bitrate Image Compression

Zhaoyang Jia, Jiahao Li, Bin Li, Houqiang Li, Yan Lu

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | May 2024

Publication

GeoGen: Geometry-Aware Generative Modeling via Signed Distance Functions

Salvatore Esposito, Qingshan Xu, Kacper Kania, Charlie Hewitt, Octave Mariotti, Lohit Petikam, Julien Valentin, Arno Onken, Oisin Mac Aodha

Computer Vision and Pattern Recognition 2024 Workshops | June 2024

Publication

GLACE: Global Local Accelerated Coordinate Encoding

Fangjinhua Wang, Xudong Jiang, Silvano Galliani, Christoph Vogel, Marc Pollefeys

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | June 2024

Publication Publication Publication Publication

Hierarchical Intra-modal Correlation Learning for Label-free 3D Semantic Segmentation

Xin Kang, Lei Chu, Jiahao Li, Xuejin Chen, Yan Lu

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | June 2024

Publication

Implicit Motion Function

Yue Gao, Jiahao Li, Lei Chu, Yan Lu

May 2024

Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?

Hanxin Zhu, Tianyu He, Xin Li, Bingchen Li, Zhibo Chen

CVPR 2024 | June 2024

Publication

Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning

Rui Li, Tobias Fischer, Mattia Segu, Marc Pollefeys, L. V. Gool, Federico Tombari

CVPR 2024 | April 2024

DOI Publication Publication

LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry

Weirong Chen, Le Chen, Rui Wang, Marc Pollefeys

CVPR | January 2024

Publication

LOTUS: Evasive and Resilient Backdoor Attacks through Sub-Partitioning

Siyuan Cheng, Guanhong Tao, Yingqi Liu, Guangyu Shen, Shengwei An, Shiwei Feng, Xiangzhe Xu, Kaiyuan Zhang, Shiqing Ma, Xiangyu Zhang

CVPR 2024 | March 2024

DOI Publication Publication

MultiPly: Reconstruction of Multiple People from Monocular Video in the Wild

Zeren Jiang, Chen Guo, Manuel Kaufmann, Tianjian Jiang, Julien Valentin, Otmar Hilliges, Jie Song

CVPR 2024 | May 2024

Publication

Multiway Point Cloud Mosaicking with Diffusion and Global Optimization

Shengze Jin, Iro Armeni, Marc Pollefeys, Daniel Barath

CVPR 2024 | March 2024

Publication

NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild

Zihan Zhu, Boyang Sun, Jiaqi Chen, Marc Pollefeys, Songyou Peng

CVPR 2024 | May 2024

Publication

Neural Video Compression with Feature Modulation

Jiahao Li, Bin Li, Yan Lu

CVPR 2024 | February 2024

DOI Publication Publication

ODIN: A Single Model for 2D and 3D Segmentation

Ayush Jain, Pushkal Katara, N. Gkanatsios, Adam W. Harley, Gabriel H. Sarch, Kriti Aggarwal, Vishrav Chaudhary, Katerina Fragkiadaki

CVPR 2024 | January 2024

Publication

OmniVid: A Generative Framework for Universal Video Understanding

Junke Wang, Dongdong Chen, Chong Luo, Bo He, Lu Yuan, Zuxuan Wu, Yu-Gang Jiang

CVPR 2024 | March 2024

DOI Publication Publication

Rewrite the Stars

Xu Ma, Xiyang Dai, Yue Bai, Yizhou Wang, Yun Fu

CVPR 2024 | March 2024

DOI Publication Publication

Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusion

Zuoyue Li, Zhenqiang Li, Zhaopeng Cui, Marc Pollefeys, Martin R. Oswald

CVPR 2024 | April 2024

Publication

SceneFun3D: Fine-Grained Functionality and Affordance Understanding in 3D Scenes

Alexandros Delitzas, Ayc¸a Takmaz, Federico Tombari, Robert Sumner, Marc Pollefeys, Francis Engelmann

CVPR 2024 | January 2024

Publication

SeD: Semantic-Aware Discriminator for Image Super-Resolution

Bingchen Li, Xin Li, Hanxin Zhu, Yeying Jin, Ruoyu Feng, Zhizheng Zhang, Zhibo Chen

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | June 2024

Publication

Structure-from-Motion from Pixel-wise Correspondences

Philipp Lindenberger, Paul-Edouard Sarlin, Marc Pollefeys

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | May 2024

Publication

Text Grouping Adapter: Adapting Pre-trained Text Detector for Layout Analysis

Tianci Bi, Xiaoyi Zhang, Zhizheng Zhang, Wenxuan Xie, Cuiling Lan, Yan Lu, Nanning Zheng

CVPR 2024 | May 2024

Publication

Training Diffusion Models Towards Diverse Image Generation with Reinforcement Learning

Zichen Miao, Jiang Wang, Zhengyuan Yang, Lijuan Wang, Qiang Qiu, Zicheng Liu

CVPR 2024 | May 2024

Publication

XFeat: Accelerated Features for Lightweight Image Matching

Guilherme A. Potje, Felipe Cadar, Andre Araujo, Renato Martins, Erickson R. Nascimento

CVPR 2024 | April 2024

Publication

You Only Need Less Attention Each Stage in Vision Transformers

Shuoxi Zhang, Hanpeng Liu, Stephen Lin, Kun He

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | May 2024

Publication

Zero-Reference Low-Light Enhancement via Physical Quadruple Priors

Wenjing Wang, Huan Yang, Jianlong Fu, Jiaying Liu

CVPR 2024 | March 2024

DOI Publication Publication

ASSISTGUI: Task-Oriented Desktop Graphical User Interface Automation

Difei Gao, Lei Ji, Zechen Bai, Mingyu Ouyang, Peiran Li, Dongxing Mao, Qinchen Wu, Weichen Zhang, Peiyi Wang, Xiangwu Guo, Hengxu Wang, Luowei Zhou, Mike Zheng Shou

CVPR 2024 | December 2023

DOI Publication Publication

CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programs

Haocheng Yuan, Jing Xu, Hao Pan, A. Bousseau, Niloy Mitra, Changjian Li

CVPR 2024 | November 2023

DOI Publication Publication

CCEdit: Creative and Controllable Video Editing via Diffusion Models

Ruoyu Feng, Wenming Weng, Yuhui Yuan, Yuhui Yuan, Jianmin Bao, Chong Luo, Zhibo Chen, Baining Guo

CVPR 2024 | September 2023

DOI Publication Publication Publication

DisCo: Disentangled Control for Realistic Human Dance Generation

Tan Wang, Linjie Li, Kevin Lin, Chung-Ching Lin, Zhengyuan Yang, Hanwang Zhang, Zicheng Liu, Lijuan Wang

CVPR 2024 | June 2023

Publication

InstructDiffusion: A Generalist Modeling Interface for Vision Tasks

Zigang Geng, Binxin Yang, Tiankai Hang, Chen Li, Shuyang Gu, Ting Zhang, Jianmin Bao, Zheng Zhang, Han Hu, Dongdong Chen, Baining Guo

CVPR 2024 | September 2023

DOI Publication Publication Publication

LISA: Reasoning Segmentation via Large Language Model

Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, Jiaya Jia

CVPR 2024 | July 2023

DOI Publication PDF Publication

MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generation

Yanhui Wang, Jianmin Bao, Wenming Weng, Ruoyu Feng, Dacheng Yin, Tao Yang, Jingxu Zhang, Qi Dai, Chunyu Wang, Kai Qiu, Yuhui Yuan, Xiaoyan Sun, Chong Luo, Baining Guo

CVPR 2024 | November 2023

DOI Publication Publication

MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning

Chaoyi Zhang, Kevin Lin, Zhengyuan Yang, Jianfeng Wang, Linjie Li, Chung-Ching Lin, Zicheng Liu, Lijuan Wang

CVPR 2024 | November 2023

DOI Publication Publication

MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos

Jielin Qiu, Jiacheng Zhu, William Jongwon Han, Aditesh Kumar, Karthik Mittal, Claire Jin, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Ding Zhao, Bo Li, Lijuan Wang

CVPR 2024 | June 2023

Publication

MotionEditor: Editing Video Motion via Content-Aware Diffusion

Shuyuan Tu, Qi Dai, Zhi-Qi Cheng, Hang-Rui Hu, Xintong Han, Zuxuan Wu, Yu-Gang Jiang

CVPR 2024 | November 2023

DOI Publication Publication

MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

Enxin Song, Wenhao Chai, Guanhong Wang, Yucheng Zhang, Haoyang Zhou, Feiyang Wu, Xun Guo, Tianbo Ye, Yang Lu, Jenq-Neng Hwang, Gaoang Wang

CVPR 2024 | July 2023

DOI Publication Publication Publication

Multiple View Geometry Transformers for 3D Human Pose Estimation

Ziwei Liao, Jialiang Zhu, Chunyu Wang, Han Hu, Steven L. Waslander, Han Hu

CVPR 2024 | November 2023

DOI Publication Publication

MuRF: Multi-Baseline Radiance Fields

Haofei Xu, Anpei Chen, Yuedong Chen, Christos Sakaridis, Yulun Zhang, Marc Pollefeys, Andreas Geiger, Fisher Yu

CVPR 2024 | December 2023

Publication

OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation

Qidong Huang, Xiaoyi Dong, Pan Zhang, Bin Wang, Conghui He, Jiaqi Wang, Dahua Lin, Weiming Zhang, Neng H. Yu

CVPR 2024 | November 2023

DOI Publication Publication

Osprey: Pixel Understanding with Visual Instruction Tuning

Yuqian Yuan, Wentong Li, Jian Liu, Dongqi Tang, Xinjie Luo, Chi Qin, Lei Zhang, Jianke Zhu

CVPR 2024 | December 2023

DOI Publication Publication

Panacea: Panoramic and Controllable Video Generation for Autonomous Driving

Yuqing Wen, Yucheng Zhao, Yingfei Liu, Fan Jia, Yanhui Wang, Chong Luo, Chi Zhang, Tiancai Wang, Xiaoyan Sun, Xiangyu Zhang

CVPR 2024 | November 2023

DOI Publication Publication

PEEKABOO: Interactive Video Generation via Masked-Diffusion

Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl

CVPR 2024 | December 2023

Invited Talk at Holistic Video Understanding Workshop, CVPR 2024

DOI Publication Publication

QDFormer: Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition

Xiang Li, Jinglu Wang, Xiaohao Xu, Xiulian Peng, Rita Singh, Yan Lu, Bhiksha Raj

CVPR 2024 | September 2023

Publication

Segment and Caption Anything

Xiaoke Huang, Jianfeng Wang, Yansong Tang, Zheng Zhang, Han Hu, Jiwen Lu, Lijuan Wang, Lijuan Wang, Zicheng Liu

CVPR 2024 | November 2023

DOI Publication Publication

SimDA: Simple Diffusion Adapter for Efficient Video Generation

Zhen Xing, Qi Dai, Han Hu, Zuxuan Wu, Yu-Gang Jiang

CVPR 2024 | August 2023

DOI Publication Publication Publication

SNI-SLAM: Semantic Neural Implicit SLAM

Siting Zhu, Guangming Wang, Hermann Blum, Jiuming Liu, Liang Song, Marc Pollefeys, Hesheng Wang

CVPR 2024 | November 2023

DOI Publication Publication

Towards More Unified In-context Visual Understanding

Dianmo Sheng, Dongdong Chen, Zhentao Tan, Qiankun Liu, Qi Chu, Jianmin Bao, Tao Gong, Bin Liu, Shengwei Xu, Nenghai Yu

CVPR 2024 | December 2023

DOI Publication Publication

Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs

Sung‐Jin Hong, Jaewoo Jung, Heeseong Shin, Jiaolong Yang, Seungryong Kim, Chong Luo

CVPR 2024 | December 2023

DOI Publication Publication

VCoder: Versatile Vision Encoders for Multimodal Large Language Models

Jitesh Jain, Jianwei Yang, Humphrey Shi

CVPR 2024 | December 2023

DOI Publication Publication

Visual In-Context Prompting

Feng Li, Qing Jiang, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Hu-Sheng Xu, Hongyang Li, Chunyuan Li, Jianwei Yang, Lei Zhang, Jianfeng Gao

CVPR 2024 | November 2023

DOI Publication Publication

L2B: Learning to Bootstrap Robust Models for Combating Label Noise

Yuyin Zhou, Xianhang Li, Fengze Liu, Xuxi Chen, Lequan Yu, Cihang Xie, Matthew P Lungren, Lei Xing

CVPR 2024 | February 2022

Publication

CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation

Zineng Tang, Ziyi Yang, Mahmoud Khademi, Yang Liu, Chenguang Zhu, Mohit Bansal

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024 | March 2024

Publication PDF

EgoGen: An Egocentric Synthetic Data Generator

Gen Li, Kaifeng Zhao, Siwei Zhang, Xiaozhong Lyu, Mihai Dusmanu, Yan Zhang, Marc Pollefeys

CVPR 2024 | January 2024

Publication

Explaining CLIP’s performance disparities on data from blind/low vision users

Daniela Massiceti, Camilla Longden, Agnieszka Slowik, Samuel Wills, Martin Grayson, Cecily Morrison

2024 Computer Vision and Pattern Recognition | June 2024

Publication 동영상 동영상 프로젝트

F3Loc: Fusion and Filtering for Floorplan Localization

Changan Chen, Rui Wang, Christoph Vogel, Marc Pollefeys

CVPR 2024 | March 2024

Publication

FlashEval: Towards Fast and Accurate Evaluation of Text-to-image Diffusion Generative Models

Lin Zhao, Tianchen Zhao, Zinan Lin, Xuefei Ning, Guohao Dai, Huazhong Yang, Yu Wang

CVPR 2024 | June 2024

Publication

Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks

Bin Xiao, Haiping Wu, Weijian Xu, Xiyang Dai, Houdong Hu, Yumao Lu, Michael Zeng, Ce Liu, Lu Yuan

CVPR 2024 | June 2024

Preprint Publication

GLACE: Global Local Accelerated Coordinate Encoding

Fangjinhua Wang, Xudong Jiang, Silvano Galliani, Christoph Vogel, Marc Pollefeys

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | June 2024

Publication Publication Publication Publication

Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?

Hanxin Zhu, Tianyu He, Xin Li, Bingchen Li, Zhibo Chen

CVPR 2024 | June 2024

Publication

LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry

Weirong Chen, Le Chen, Rui Wang, Marc Pollefeys

CVPR | January 2024

Publication

Multiway Point Cloud Mosaicking with Diffusion and Global Optimization

Shengze Jin, Iro Armeni, Marc Pollefeys, Daniel Barath

CVPR 2024 | March 2024

Publication

MuRF: Multi-Baseline Radiance Fields

Haofei Xu, Anpei Chen, Yuedong Chen, Christos Sakaridis, Yulun Zhang, Marc Pollefeys, Andreas Geiger, Fisher Yu

CVPR 2024 | December 2023

Publication

Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusion

Zuoyue Li, Zhenqiang Li, Zhaopeng Cui, Marc Pollefeys, Martin R. Oswald

CVPR 2024 | April 2024

Publication

SceneFun3D: Fine-Grained Functionality and Affordance Understanding in 3D Scenes

Alexandros Delitzas, Ayc¸a Takmaz, Federico Tombari, Robert Sumner, Marc Pollefeys, Francis Engelmann

CVPR 2024 | January 2024

Publication

ASSISTGUI: Task-Oriented Desktop Graphical User Interface Automation

Difei Gao, Lei Ji, Zechen Bai, Mingyu Ouyang, Peiran Li, Dongxing Mao, Qinchen Wu, Weichen Zhang, Peiyi Wang, Xiangwu Guo, Hengxu Wang, Luowei Zhou, Mike Zheng Shou

CVPR 2024 | December 2023

DOI Publication Publication

BIOCLIP: A Vision Foundation Model for the Tree of Life

Samuel Stevens, Jiaman Wu, Matthew J Thompson, Elizabeth G. Campolongo, Chan Hee Song, David Carlyn, Li Dong, W. Dahdul, Charles Stewart, Tanya Y. Berger-Wolf, Wei-Lun Chao, Yu Su

CVPR 2024 | June 2024

CVPR 2024 Best Student Paper Award

DOI Publication

BlockGCN: Redefine Topology Awareness for Skeleton-Based Action Recognition

Yuxuan Zhou, Xudong Yan, Zhi-Qi Cheng, Yan Yan, Qi Dai, Xian-Sheng Hua

The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) | May 2024

Publication

Boosting Neural Representations for Videos with a Conditional Decoder

Xinjie Zhang, Ren Yang, Dailan He, Xingtong Ge, Tongda Xu, Yan Wang, Hongwei Qin, Jun Zhang

CVPR 2024 | February 2024

DOI Publication Publication

CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programs

Haocheng Yuan, Jing Xu, Hao Pan, A. Bousseau, Niloy Mitra, Changjian Li

CVPR 2024 | November 2023

DOI Publication Publication

CCEdit: Creative and Controllable Video Editing via Diffusion Models

Ruoyu Feng, Wenming Weng, Yuhui Yuan, Yuhui Yuan, Jianmin Bao, Chong Luo, Zhibo Chen, Baining Guo

CVPR 2024 | September 2023

DOI Publication Publication Publication

CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation

Zineng Tang, Ziyi Yang, Mahmoud Khademi, Yang Liu, Chenguang Zhu, Mohit Bansal

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024 | March 2024

Publication PDF

Desigen: A Pipeline for Controllable Design Template Generation

Haohan Weng, Danqing Huang, Yu Qiao, Zheng Hu, Chin-Yew Lin, Tong Zhang, C. L. P. Chen

CVPR 2024 | March 2024

DOI Publication Publication

DisCo: Disentangled Control for Realistic Human Dance Generation

Tan Wang, Linjie Li, Kevin Lin, Chung-Ching Lin, Zhengyuan Yang, Hanwang Zhang, Zicheng Liu, Lijuan Wang

CVPR 2024 | June 2023

Publication

DREAM: Diffusion Rectification and Estimation-Adaptive Models

Jinxin Zhou, Tianyu Ding, Tianyi Chen, Jiachen Jiang, Ilya Zharkov, Zhihui Zhu, Luming Liang

2024 Computer Vision and Pattern Recognition | March 2024

DOI Publication Publication

Efficient Solution of Point-Line Absolute Pose

Petr Hruby, Timothy Duff, Marc Pollefeys

CVPR 2024 | April 2024

Publication

EgoGen: An Egocentric Synthetic Data Generator

Gen Li, Kaifeng Zhao, Siwei Zhang, Xiaozhong Lyu, Mihai Dusmanu, Yan Zhang, Marc Pollefeys

CVPR 2024 | January 2024

Publication

Explaining CLIP’s performance disparities on data from blind/low vision users

Daniela Massiceti, Camilla Longden, Agnieszka Slowik, Samuel Wills, Martin Grayson, Cecily Morrison

2024 Computer Vision and Pattern Recognition | June 2024

Publication 동영상 동영상 프로젝트

Exploiting Inter-sample and Inter-feature Relations in Dataset Distillation

Wenxiao Deng, Wenbin Li, Tianyu Ding, Lei Wang, Hongguang Zhang, Kuihua Huang, Jing Huo, Yang Gao

CVPR 2024 | March 2024

DOI Publication Publication

F3Loc: Fusion and Filtering for Floorplan Localization

Changan Chen, Rui Wang, Christoph Vogel, Marc Pollefeys

CVPR 2024 | March 2024

Publication

FlashEval: Towards Fast and Accurate Evaluation of Text-to-image Diffusion Generative Models

Lin Zhao, Tianchen Zhao, Zinan Lin, Xuefei Ning, Guohao Dai, Huazhong Yang, Yu Wang

CVPR 2024 | June 2024

Publication

Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks

Bin Xiao, Haiping Wu, Weijian Xu, Xiyang Dai, Houdong Hu, Yumao Lu, Michael Zeng, Ce Liu, Lu Yuan

CVPR 2024 | June 2024

Preprint Publication

GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image

Chong Bao, Yinda Zhang, Yuan Li, Xiyu Zhang, Bangbang Yang, Hujun Bao, Marc Pollefeys, Guofeng Zhang, Zhaopeng Cui

CVPR 2024 | April 2024

DOI Publication Publication

Generative Latent Coding for Ultra-Low Bitrate Image Compression

Zhaoyang Jia, Jiahao Li, Bin Li, Houqiang Li, Yan Lu

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | May 2024

Publication

GLACE: Global Local Accelerated Coordinate Encoding

Fangjinhua Wang, Xudong Jiang, Silvano Galliani, Christoph Vogel, Marc Pollefeys

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | June 2024

Publication Publication Publication Publication

Hierarchical Intra-modal Correlation Learning for Label-free 3D Semantic Segmentation

Xin Kang, Lei Chu, Jiahao Li, Xuejin Chen, Yan Lu

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | June 2024

Publication

Implicit Motion Function

Yue Gao, Jiahao Li, Lei Chu, Yan Lu

May 2024

InstructDiffusion: A Generalist Modeling Interface for Vision Tasks

Zigang Geng, Binxin Yang, Tiankai Hang, Chen Li, Shuyang Gu, Ting Zhang, Jianmin Bao, Zheng Zhang, Han Hu, Dongdong Chen, Baining Guo

CVPR 2024 | September 2023

DOI Publication Publication Publication

Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?

Hanxin Zhu, Tianyu He, Xin Li, Bingchen Li, Zhibo Chen

CVPR 2024 | June 2024

Publication

Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning

Rui Li, Tobias Fischer, Mattia Segu, Marc Pollefeys, L. V. Gool, Federico Tombari

CVPR 2024 | April 2024

DOI Publication Publication

L2B: Learning to Bootstrap Robust Models for Combating Label Noise

Yuyin Zhou, Xianhang Li, Fengze Liu, Xuxi Chen, Lequan Yu, Cihang Xie, Matthew P Lungren, Lei Xing

CVPR 2024 | February 2022

Publication

LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry

Weirong Chen, Le Chen, Rui Wang, Marc Pollefeys

CVPR | January 2024

Publication

LISA: Reasoning Segmentation via Large Language Model

Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, Jiaya Jia

CVPR 2024 | July 2023

DOI Publication PDF Publication

LOTUS: Evasive and Resilient Backdoor Attacks through Sub-Partitioning

Siyuan Cheng, Guanhong Tao, Yingqi Liu, Guangyu Shen, Shengwei An, Shiwei Feng, Xiangzhe Xu, Kaiyuan Zhang, Shiqing Ma, Xiangyu Zhang

CVPR 2024 | March 2024

DOI Publication Publication

MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generation

Yanhui Wang, Jianmin Bao, Wenming Weng, Ruoyu Feng, Dacheng Yin, Tao Yang, Jingxu Zhang, Qi Dai, Chunyu Wang, Kai Qiu, Yuhui Yuan, Xiaoyan Sun, Chong Luo, Baining Guo

CVPR 2024 | November 2023

DOI Publication Publication

MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning

Chaoyi Zhang, Kevin Lin, Zhengyuan Yang, Jianfeng Wang, Linjie Li, Chung-Ching Lin, Zicheng Liu, Lijuan Wang

CVPR 2024 | November 2023

DOI Publication Publication

MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos

Jielin Qiu, Jiacheng Zhu, William Jongwon Han, Aditesh Kumar, Karthik Mittal, Claire Jin, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Ding Zhao, Bo Li, Lijuan Wang

CVPR 2024 | June 2023

Publication

MotionEditor: Editing Video Motion via Content-Aware Diffusion

Shuyuan Tu, Qi Dai, Zhi-Qi Cheng, Hang-Rui Hu, Xintong Han, Zuxuan Wu, Yu-Gang Jiang

CVPR 2024 | November 2023

DOI Publication Publication

MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

Enxin Song, Wenhao Chai, Guanhong Wang, Yucheng Zhang, Haoyang Zhou, Feiyang Wu, Xun Guo, Tianbo Ye, Yang Lu, Jenq-Neng Hwang, Gaoang Wang

CVPR 2024 | July 2023

DOI Publication Publication Publication

Multiple View Geometry Transformers for 3D Human Pose Estimation

Ziwei Liao, Jialiang Zhu, Chunyu Wang, Han Hu, Steven L. Waslander, Han Hu

CVPR 2024 | November 2023

DOI Publication Publication

MultiPly: Reconstruction of Multiple People from Monocular Video in the Wild

Zeren Jiang, Chen Guo, Manuel Kaufmann, Tianjian Jiang, Julien Valentin, Otmar Hilliges, Jie Song

CVPR 2024 | May 2024

Publication

Multiway Point Cloud Mosaicking with Diffusion and Global Optimization

Shengze Jin, Iro Armeni, Marc Pollefeys, Daniel Barath

CVPR 2024 | March 2024

Publication

MuRF: Multi-Baseline Radiance Fields

Haofei Xu, Anpei Chen, Yuedong Chen, Christos Sakaridis, Yulun Zhang, Marc Pollefeys, Andreas Geiger, Fisher Yu

CVPR 2024 | December 2023

Publication

NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild

Zihan Zhu, Boyang Sun, Jiaqi Chen, Marc Pollefeys, Songyou Peng

CVPR 2024 | May 2024

Publication

Neural Video Compression with Feature Modulation

Jiahao Li, Bin Li, Yan Lu

CVPR 2024 | February 2024

DOI Publication Publication

ODIN: A Single Model for 2D and 3D Segmentation

Ayush Jain, Pushkal Katara, N. Gkanatsios, Adam W. Harley, Gabriel H. Sarch, Kriti Aggarwal, Vishrav Chaudhary, Katerina Fragkiadaki

CVPR 2024 | January 2024

Publication

OmniVid: A Generative Framework for Universal Video Understanding

Junke Wang, Dongdong Chen, Chong Luo, Bo He, Lu Yuan, Zuxuan Wu, Yu-Gang Jiang

CVPR 2024 | March 2024

DOI Publication Publication

OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation

Qidong Huang, Xiaoyi Dong, Pan Zhang, Bin Wang, Conghui He, Jiaqi Wang, Dahua Lin, Weiming Zhang, Neng H. Yu

CVPR 2024 | November 2023

DOI Publication Publication

Osprey: Pixel Understanding with Visual Instruction Tuning

Yuqian Yuan, Wentong Li, Jian Liu, Dongqi Tang, Xinjie Luo, Chi Qin, Lei Zhang, Jianke Zhu

CVPR 2024 | December 2023

DOI Publication Publication

Panacea: Panoramic and Controllable Video Generation for Autonomous Driving

Yuqing Wen, Yucheng Zhao, Yingfei Liu, Fan Jia, Yanhui Wang, Chong Luo, Chi Zhang, Tiancai Wang, Xiaoyan Sun, Xiangyu Zhang

CVPR 2024 | November 2023

DOI Publication Publication

PEEKABOO: Interactive Video Generation via Masked-Diffusion

Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl

CVPR 2024 | December 2023

Invited Talk at Holistic Video Understanding Workshop, CVPR 2024

DOI Publication Publication

QDFormer: Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition

Xiang Li, Jinglu Wang, Xiaohao Xu, Xiulian Peng, Rita Singh, Yan Lu, Bhiksha Raj

CVPR 2024 | September 2023

Publication

Rewrite the Stars

Xu Ma, Xiyang Dai, Yue Bai, Yizhou Wang, Yun Fu

CVPR 2024 | March 2024

DOI Publication Publication

Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusion

Zuoyue Li, Zhenqiang Li, Zhaopeng Cui, Marc Pollefeys, Martin R. Oswald

CVPR 2024 | April 2024

Publication

SceneFun3D: Fine-Grained Functionality and Affordance Understanding in 3D Scenes

Alexandros Delitzas, Ayc¸a Takmaz, Federico Tombari, Robert Sumner, Marc Pollefeys, Francis Engelmann

CVPR 2024 | January 2024

Publication

SeD: Semantic-Aware Discriminator for Image Super-Resolution

Bingchen Li, Xin Li, Hanxin Zhu, Yeying Jin, Ruoyu Feng, Zhizheng Zhang, Zhibo Chen

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | June 2024

Publication

Segment and Caption Anything

Xiaoke Huang, Jianfeng Wang, Yansong Tang, Zheng Zhang, Han Hu, Jiwen Lu, Lijuan Wang, Lijuan Wang, Zicheng Liu

CVPR 2024 | November 2023

DOI Publication Publication

SimDA: Simple Diffusion Adapter for Efficient Video Generation

Zhen Xing, Qi Dai, Han Hu, Zuxuan Wu, Yu-Gang Jiang

CVPR 2024 | August 2023

DOI Publication Publication Publication

SNI-SLAM: Semantic Neural Implicit SLAM

Siting Zhu, Guangming Wang, Hermann Blum, Jiuming Liu, Liang Song, Marc Pollefeys, Hesheng Wang

CVPR 2024 | November 2023

DOI Publication Publication

Structure-from-Motion from Pixel-wise Correspondences

Philipp Lindenberger, Paul-Edouard Sarlin, Marc Pollefeys

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | May 2024

Publication

Text Grouping Adapter: Adapting Pre-trained Text Detector for Layout Analysis

Tianci Bi, Xiaoyi Zhang, Zhizheng Zhang, Wenxuan Xie, Cuiling Lan, Yan Lu, Nanning Zheng

CVPR 2024 | May 2024

Publication

Towards More Unified In-context Visual Understanding

Dianmo Sheng, Dongdong Chen, Zhentao Tan, Qiankun Liu, Qi Chu, Jianmin Bao, Tao Gong, Bin Liu, Shengwei Xu, Nenghai Yu

CVPR 2024 | December 2023

DOI Publication Publication

Training Diffusion Models Towards Diverse Image Generation with Reinforcement Learning

Zichen Miao, Jiang Wang, Zhengyuan Yang, Lijuan Wang, Qiang Qiu, Zicheng Liu

CVPR 2024 | May 2024

Publication

Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs

Sung‐Jin Hong, Jaewoo Jung, Heeseong Shin, Jiaolong Yang, Seungryong Kim, Chong Luo

CVPR 2024 | December 2023

DOI Publication Publication

VCoder: Versatile Vision Encoders for Multimodal Large Language Models

Jitesh Jain, Jianwei Yang, Humphrey Shi

CVPR 2024 | December 2023

DOI Publication Publication

Visual In-Context Prompting

Feng Li, Qing Jiang, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Hu-Sheng Xu, Hongyang Li, Chunyuan Li, Jianwei Yang, Lei Zhang, Jianfeng Gao

CVPR 2024 | November 2023

DOI Publication Publication

XFeat: Accelerated Features for Lightweight Image Matching

Guilherme A. Potje, Felipe Cadar, Andre Araujo, Renato Martins, Erickson R. Nascimento

CVPR 2024 | April 2024

Publication

You Only Need Less Attention Each Stage in Vision Transformers

Shuoxi Zhang, Hanpeng Liu, Stephen Lin, Kun He

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | May 2024

Publication

Zero-Reference Low-Light Enhancement via Physical Quadruple Priors

Wenjing Wang, Huan Yang, Jianlong Fu, Jiaying Liu

CVPR 2024 | March 2024

DOI Publication Publication

GeoGen: Geometry-Aware Generative Modeling via Signed Distance Functions

Salvatore Esposito, Qingshan Xu, Kacper Kania, Charlie Hewitt, Octave Mariotti, Lohit Petikam, Julien Valentin, Arno Onken, Oisin Mac Aodha

Computer Vision and Pattern Recognition 2024 Workshops | June 2024

Publication

Explaining CLIP’s performance disparities on data from blind/low vision users

Daniela Massiceti, Camilla Longden, Agnieszka Slowik, Samuel Wills, Martin Grayson, Cecily Morrison

2024 Computer Vision and Pattern Recognition | June 2024

Publication 동영상 동영상 프로젝트

ASSISTGUI: Task-Oriented Desktop Graphical User Interface Automation

Difei Gao, Lei Ji, Zechen Bai, Mingyu Ouyang, Peiran Li, Dongxing Mao, Qinchen Wu, Weichen Zhang, Peiyi Wang, Xiangwu Guo, Hengxu Wang, Luowei Zhou, Mike Zheng Shou

CVPR 2024 | December 2023

DOI Publication Publication

BIOCLIP: A Vision Foundation Model for the Tree of Life

Samuel Stevens, Jiaman Wu, Matthew J Thompson, Elizabeth G. Campolongo, Chan Hee Song, David Carlyn, Li Dong, W. Dahdul, Charles Stewart, Tanya Y. Berger-Wolf, Wei-Lun Chao, Yu Su

CVPR 2024 | June 2024

CVPR 2024 Best Student Paper Award

DOI Publication

BlockGCN: Redefine Topology Awareness for Skeleton-Based Action Recognition

Yuxuan Zhou, Xudong Yan, Zhi-Qi Cheng, Yan Yan, Qi Dai, Xian-Sheng Hua

The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) | May 2024

Publication

Boosting Neural Representations for Videos with a Conditional Decoder

Xinjie Zhang, Ren Yang, Dailan He, Xingtong Ge, Tongda Xu, Yan Wang, Hongwei Qin, Jun Zhang

CVPR 2024 | February 2024

DOI Publication Publication

CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programs

Haocheng Yuan, Jing Xu, Hao Pan, A. Bousseau, Niloy Mitra, Changjian Li

CVPR 2024 | November 2023

DOI Publication Publication

CCEdit: Creative and Controllable Video Editing via Diffusion Models

Ruoyu Feng, Wenming Weng, Yuhui Yuan, Yuhui Yuan, Jianmin Bao, Chong Luo, Zhibo Chen, Baining Guo

CVPR 2024 | September 2023

DOI Publication Publication Publication

CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation

Zineng Tang, Ziyi Yang, Mahmoud Khademi, Yang Liu, Chenguang Zhu, Mohit Bansal

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024 | March 2024

Publication PDF

Desigen: A Pipeline for Controllable Design Template Generation

Haohan Weng, Danqing Huang, Yu Qiao, Zheng Hu, Chin-Yew Lin, Tong Zhang, C. L. P. Chen

CVPR 2024 | March 2024

DOI Publication Publication

DisCo: Disentangled Control for Realistic Human Dance Generation

Tan Wang, Linjie Li, Kevin Lin, Chung-Ching Lin, Zhengyuan Yang, Hanwang Zhang, Zicheng Liu, Lijuan Wang

CVPR 2024 | June 2023

Publication

DREAM: Diffusion Rectification and Estimation-Adaptive Models

Jinxin Zhou, Tianyu Ding, Tianyi Chen, Jiachen Jiang, Ilya Zharkov, Zhihui Zhu, Luming Liang

2024 Computer Vision and Pattern Recognition | March 2024

DOI Publication Publication

Efficient Solution of Point-Line Absolute Pose

Petr Hruby, Timothy Duff, Marc Pollefeys

CVPR 2024 | April 2024

Publication

EgoGen: An Egocentric Synthetic Data Generator

Gen Li, Kaifeng Zhao, Siwei Zhang, Xiaozhong Lyu, Mihai Dusmanu, Yan Zhang, Marc Pollefeys

CVPR 2024 | January 2024

Publication

Explaining CLIP’s performance disparities on data from blind/low vision users

Daniela Massiceti, Camilla Longden, Agnieszka Slowik, Samuel Wills, Martin Grayson, Cecily Morrison

2024 Computer Vision and Pattern Recognition | June 2024

Publication 동영상 동영상 프로젝트

Exploiting Inter-sample and Inter-feature Relations in Dataset Distillation

Wenxiao Deng, Wenbin Li, Tianyu Ding, Lei Wang, Hongguang Zhang, Kuihua Huang, Jing Huo, Yang Gao

CVPR 2024 | March 2024

DOI Publication Publication

F3Loc: Fusion and Filtering for Floorplan Localization

Changan Chen, Rui Wang, Christoph Vogel, Marc Pollefeys

CVPR 2024 | March 2024

Publication

FlashEval: Towards Fast and Accurate Evaluation of Text-to-image Diffusion Generative Models

Lin Zhao, Tianchen Zhao, Zinan Lin, Xuefei Ning, Guohao Dai, Huazhong Yang, Yu Wang

CVPR 2024 | June 2024

Publication

Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks

Bin Xiao, Haiping Wu, Weijian Xu, Xiyang Dai, Houdong Hu, Yumao Lu, Michael Zeng, Ce Liu, Lu Yuan

CVPR 2024 | June 2024

Preprint Publication

GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image

Chong Bao, Yinda Zhang, Yuan Li, Xiyu Zhang, Bangbang Yang, Hujun Bao, Marc Pollefeys, Guofeng Zhang, Zhaopeng Cui

CVPR 2024 | April 2024

DOI Publication Publication

Generative Latent Coding for Ultra-Low Bitrate Image Compression

Zhaoyang Jia, Jiahao Li, Bin Li, Houqiang Li, Yan Lu

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | May 2024

Publication

GeoGen: Geometry-Aware Generative Modeling via Signed Distance Functions

Salvatore Esposito, Qingshan Xu, Kacper Kania, Charlie Hewitt, Octave Mariotti, Lohit Petikam, Julien Valentin, Arno Onken, Oisin Mac Aodha

Computer Vision and Pattern Recognition 2024 Workshops | June 2024

Publication

GLACE: Global Local Accelerated Coordinate Encoding

Fangjinhua Wang, Xudong Jiang, Silvano Galliani, Christoph Vogel, Marc Pollefeys

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | June 2024

Publication Publication Publication Publication

Hierarchical Intra-modal Correlation Learning for Label-free 3D Semantic Segmentation

Xin Kang, Lei Chu, Jiahao Li, Xuejin Chen, Yan Lu

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | June 2024

Publication

InstructDiffusion: A Generalist Modeling Interface for Vision Tasks

Zigang Geng, Binxin Yang, Tiankai Hang, Chen Li, Shuyang Gu, Ting Zhang, Jianmin Bao, Zheng Zhang, Han Hu, Dongdong Chen, Baining Guo

CVPR 2024 | September 2023

DOI Publication Publication Publication

Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?

Hanxin Zhu, Tianyu He, Xin Li, Bingchen Li, Zhibo Chen

CVPR 2024 | June 2024

Publication

Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning

Rui Li, Tobias Fischer, Mattia Segu, Marc Pollefeys, L. V. Gool, Federico Tombari

CVPR 2024 | April 2024

DOI Publication Publication

L2B: Learning to Bootstrap Robust Models for Combating Label Noise

Yuyin Zhou, Xianhang Li, Fengze Liu, Xuxi Chen, Lequan Yu, Cihang Xie, Matthew P Lungren, Lei Xing

CVPR 2024 | February 2022

Publication

LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry

Weirong Chen, Le Chen, Rui Wang, Marc Pollefeys

CVPR | January 2024

Publication

LISA: Reasoning Segmentation via Large Language Model

Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, Jiaya Jia

CVPR 2024 | July 2023

DOI Publication PDF Publication

LOTUS: Evasive and Resilient Backdoor Attacks through Sub-Partitioning

Siyuan Cheng, Guanhong Tao, Yingqi Liu, Guangyu Shen, Shengwei An, Shiwei Feng, Xiangzhe Xu, Kaiyuan Zhang, Shiqing Ma, Xiangyu Zhang

CVPR 2024 | March 2024

DOI Publication Publication

MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generation

Yanhui Wang, Jianmin Bao, Wenming Weng, Ruoyu Feng, Dacheng Yin, Tao Yang, Jingxu Zhang, Qi Dai, Chunyu Wang, Kai Qiu, Yuhui Yuan, Xiaoyan Sun, Chong Luo, Baining Guo

CVPR 2024 | November 2023

DOI Publication Publication

MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning

Chaoyi Zhang, Kevin Lin, Zhengyuan Yang, Jianfeng Wang, Linjie Li, Chung-Ching Lin, Zicheng Liu, Lijuan Wang

CVPR 2024 | November 2023

DOI Publication Publication

MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos

Jielin Qiu, Jiacheng Zhu, William Jongwon Han, Aditesh Kumar, Karthik Mittal, Claire Jin, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Ding Zhao, Bo Li, Lijuan Wang

CVPR 2024 | June 2023

Publication

MotionEditor: Editing Video Motion via Content-Aware Diffusion

Shuyuan Tu, Qi Dai, Zhi-Qi Cheng, Hang-Rui Hu, Xintong Han, Zuxuan Wu, Yu-Gang Jiang

CVPR 2024 | November 2023

DOI Publication Publication

MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

Enxin Song, Wenhao Chai, Guanhong Wang, Yucheng Zhang, Haoyang Zhou, Feiyang Wu, Xun Guo, Tianbo Ye, Yang Lu, Jenq-Neng Hwang, Gaoang Wang

CVPR 2024 | July 2023

DOI Publication Publication Publication

Multiple View Geometry Transformers for 3D Human Pose Estimation

Ziwei Liao, Jialiang Zhu, Chunyu Wang, Han Hu, Steven L. Waslander, Han Hu

CVPR 2024 | November 2023

DOI Publication Publication

MultiPly: Reconstruction of Multiple People from Monocular Video in the Wild

Zeren Jiang, Chen Guo, Manuel Kaufmann, Tianjian Jiang, Julien Valentin, Otmar Hilliges, Jie Song

CVPR 2024 | May 2024

Publication

Multiway Point Cloud Mosaicking with Diffusion and Global Optimization

Shengze Jin, Iro Armeni, Marc Pollefeys, Daniel Barath

CVPR 2024 | March 2024

Publication

MuRF: Multi-Baseline Radiance Fields

Haofei Xu, Anpei Chen, Yuedong Chen, Christos Sakaridis, Yulun Zhang, Marc Pollefeys, Andreas Geiger, Fisher Yu

CVPR 2024 | December 2023

Publication

NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild

Zihan Zhu, Boyang Sun, Jiaqi Chen, Marc Pollefeys, Songyou Peng

CVPR 2024 | May 2024

Publication

Neural Video Compression with Feature Modulation

Jiahao Li, Bin Li, Yan Lu

CVPR 2024 | February 2024

DOI Publication Publication

ODIN: A Single Model for 2D and 3D Segmentation

Ayush Jain, Pushkal Katara, N. Gkanatsios, Adam W. Harley, Gabriel H. Sarch, Kriti Aggarwal, Vishrav Chaudhary, Katerina Fragkiadaki

CVPR 2024 | January 2024

Publication

OmniVid: A Generative Framework for Universal Video Understanding

Junke Wang, Dongdong Chen, Chong Luo, Bo He, Lu Yuan, Zuxuan Wu, Yu-Gang Jiang

CVPR 2024 | March 2024

DOI Publication Publication

OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation

Qidong Huang, Xiaoyi Dong, Pan Zhang, Bin Wang, Conghui He, Jiaqi Wang, Dahua Lin, Weiming Zhang, Neng H. Yu

CVPR 2024 | November 2023

DOI Publication Publication

Osprey: Pixel Understanding with Visual Instruction Tuning

Yuqian Yuan, Wentong Li, Jian Liu, Dongqi Tang, Xinjie Luo, Chi Qin, Lei Zhang, Jianke Zhu

CVPR 2024 | December 2023

DOI Publication Publication

Panacea: Panoramic and Controllable Video Generation for Autonomous Driving

Yuqing Wen, Yucheng Zhao, Yingfei Liu, Fan Jia, Yanhui Wang, Chong Luo, Chi Zhang, Tiancai Wang, Xiaoyan Sun, Xiangyu Zhang

CVPR 2024 | November 2023

DOI Publication Publication

PEEKABOO: Interactive Video Generation via Masked-Diffusion

Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl

CVPR 2024 | December 2023

Invited Talk at Holistic Video Understanding Workshop, CVPR 2024

DOI Publication Publication

QDFormer: Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition

Xiang Li, Jinglu Wang, Xiaohao Xu, Xiulian Peng, Rita Singh, Yan Lu, Bhiksha Raj

CVPR 2024 | September 2023

Publication

Rewrite the Stars

Xu Ma, Xiyang Dai, Yue Bai, Yizhou Wang, Yun Fu

CVPR 2024 | March 2024

DOI Publication Publication

Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusion

Zuoyue Li, Zhenqiang Li, Zhaopeng Cui, Marc Pollefeys, Martin R. Oswald

CVPR 2024 | April 2024

Publication

SceneFun3D: Fine-Grained Functionality and Affordance Understanding in 3D Scenes

Alexandros Delitzas, Ayc¸a Takmaz, Federico Tombari, Robert Sumner, Marc Pollefeys, Francis Engelmann

CVPR 2024 | January 2024

Publication

SeD: Semantic-Aware Discriminator for Image Super-Resolution

Bingchen Li, Xin Li, Hanxin Zhu, Yeying Jin, Ruoyu Feng, Zhizheng Zhang, Zhibo Chen

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | June 2024

Publication

Segment and Caption Anything

Xiaoke Huang, Jianfeng Wang, Yansong Tang, Zheng Zhang, Han Hu, Jiwen Lu, Lijuan Wang, Lijuan Wang, Zicheng Liu

CVPR 2024 | November 2023

DOI Publication Publication

SimDA: Simple Diffusion Adapter for Efficient Video Generation

Zhen Xing, Qi Dai, Han Hu, Zuxuan Wu, Yu-Gang Jiang

CVPR 2024 | August 2023

DOI Publication Publication Publication

SNI-SLAM: Semantic Neural Implicit SLAM

Siting Zhu, Guangming Wang, Hermann Blum, Jiuming Liu, Liang Song, Marc Pollefeys, Hesheng Wang

CVPR 2024 | November 2023

DOI Publication Publication

Structure-from-Motion from Pixel-wise Correspondences

Philipp Lindenberger, Paul-Edouard Sarlin, Marc Pollefeys

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | May 2024

Publication

Text Grouping Adapter: Adapting Pre-trained Text Detector for Layout Analysis

Tianci Bi, Xiaoyi Zhang, Zhizheng Zhang, Wenxuan Xie, Cuiling Lan, Yan Lu, Nanning Zheng

CVPR 2024 | May 2024

Publication

Towards More Unified In-context Visual Understanding

Dianmo Sheng, Dongdong Chen, Zhentao Tan, Qiankun Liu, Qi Chu, Jianmin Bao, Tao Gong, Bin Liu, Shengwei Xu, Nenghai Yu

CVPR 2024 | December 2023

DOI Publication Publication

Training Diffusion Models Towards Diverse Image Generation with Reinforcement Learning

Zichen Miao, Jiang Wang, Zhengyuan Yang, Lijuan Wang, Qiang Qiu, Zicheng Liu

CVPR 2024 | May 2024

Publication

Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs

Sung‐Jin Hong, Jaewoo Jung, Heeseong Shin, Jiaolong Yang, Seungryong Kim, Chong Luo

CVPR 2024 | December 2023

DOI Publication Publication

VCoder: Versatile Vision Encoders for Multimodal Large Language Models

Jitesh Jain, Jianwei Yang, Humphrey Shi

CVPR 2024 | December 2023

DOI Publication Publication

Visual In-Context Prompting

Feng Li, Qing Jiang, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Hu-Sheng Xu, Hongyang Li, Chunyuan Li, Jianwei Yang, Lei Zhang, Jianfeng Gao

CVPR 2024 | November 2023

DOI Publication Publication

XFeat: Accelerated Features for Lightweight Image Matching

Guilherme A. Potje, Felipe Cadar, Andre Araujo, Renato Martins, Erickson R. Nascimento

CVPR 2024 | April 2024

Publication

You Only Need Less Attention Each Stage in Vision Transformers

Shuoxi Zhang, Hanpeng Liu, Stephen Lin, Kun He

The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 | May 2024

Publication

Zero-Reference Low-Light Enhancement via Physical Quadruple Priors

Wenjing Wang, Huan Yang, Jianlong Fu, Jiaying Liu

CVPR 2024 | March 2024

DOI Publication Publication

Implicit Motion Function

Yue Gao, Jiahao Li, Lei Chu, Yan Lu

May 2024