Knowledge and Language Team

i-Code Studio: A Configurable and Composable Framework for Integrative AI

Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang

The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024

PDF Publication

Global Selection of Contrastive Batches via Optimization on Sample Permutations

Vin Sachidananda, Ziyi Yang, Chenguang Zhu

ICML 2023 | July 2023

PDF Publication

Unifying Vision, Text, and Layout for Universal Document Processing

Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal

The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023

Publication 다운로드

Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles

Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao

The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023

Publication

Fine-Tuning Language Models with Advantage-Induced Policy Alignment

Banghua Zhu, Hiteshi Sharma, Felipe Vieira Frujeri, Shi Dong, Chenguang Zhu, Michael I. Jordan, Jiantao Jiao

June 2023

Publication

In-Context Demonstration Selection with Cross Entropy Difference

Dan Iter, Reid Pryzant, Ruochen Xu, Shuohang Wang, Yang Liu, Chenguang Zhu

May 2023

Arxiv

Publication

PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents

Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer

May 2023

Publication

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

Small Models are Valuable Plug-ins for Large Language Models

Canwen Xu, Yichong Xu, Shuohang Wang, Yang Liu, Chenguang Zhu, Julian McAuley

May 2023

Publication

Automatic Prompt Optimization with “Gradient Descent” and Beam Search

Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng

May 2023

Publication

Generate rather than Retrieve: Large Language Models are Strong Context Generators

Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang

ICLR 2023 | May 2023

Publication

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT

Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng

May 2023

PDF

LMGQS: A Large-scale Dataset for Query-focused Summarization

Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng

May 2023

PDF

Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences

Chaojun Wang, Yang Liu, Wai Lam

ACL 2023 Findings | May 2023

Publication Publication

Prompting GPT-3 To Be Reliable

Silei Cheng, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang

International Conference on Learning Representations (ICLR 23) | May 2023

PDF

UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization

Yulong Chen, Yang Liu, Ruochen Xu, Ziyi Yang, Chenguang Zhu, Michael Zeng, Yue Zhang

ACL 2023 | May 2023

Publication Publication

G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment

Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, Chenguang Zhu

arXiv 2303.16634 | March 2023

Publication

MACSum: Controllable Summarization with Mixed Attributes

Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang

Transactions of the Association for Computational Linguistics | March 2023

Publication

How Does In-Context Learning Help Prompt Tuning?

Simeng Sun, Yang Liu, Dan Iter, Chenguang Zhu, Mohit Iyyer

February 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

Narrate Dialogues for Better Summarization

Ruochen Xu, Chenguang Zhu, Michael Zeng

2022 Empirical Methods in Natural Language Processing | December 2022

Publication

A Unified Encoder-Decoder Framework with Entity Memory

Zhihan Zhang, Wenhao Yu, Chenguang Zhu, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022

Publication

AdaPrompt: Adaptive Model Training for Prompt-based NLP

Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

Automatic Rule Induction for Efficient Semi-Supervised Learning

Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022

Publication

Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering

Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun

2022 Empirical Methods in Natural Language Processing | December 2022

Best Paper Award at SoCal NLP Symposium 2022

PDF Publication

FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training

Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu

December 2022

Publication

Leveraging Locality in Abstractive Text Summarization

Yixin Liu, Ansong Ni, Linyong Nan, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev

EMNLP 2022 | December 2022

Publication Publication

ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation

Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022

PDF

Retrieval Augmentation for Commonsense Reasoning: A Unified Approach

Wenhao Yu, Chenguang Zhu, Zhihan Zhang, Shuohang Wang, Zhuosheng Zhang, Yuwei Fang, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022

Publication

Task Compass: Scaling Multi-task Pre-training with Task Prefix

Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng

EMNLP 2022 | December 2022

Publication

Towards A Unified Multi-Dimensional Evaluator For Text Generation

Ming Zhong, Yang Liu, Da Yin, Yuning Mao, Yizhu Jiao, Pengfei Liu, Chenguang Zhu, Heng Ji, Jiawei Han

Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022

Publication

Unsupervised Summarization with Customized Granularities

Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners

Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji

Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022

PDF

REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering

Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan

Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022

Publication Publication 프로젝트

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

IJCAI 2022 | July 2022

human parity result on CommonsenseQA

Publication

An Empirical Study of Training End-to-End Vision-and-Language Transformers

Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng

CVPR | June 2022

Publication Publication 프로젝트

CLIP-Event: Connecting Text and Images with Event Structures

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022

Publication

Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts

Wenhao Yu, Chenguang Zhu, Lianhui Qin, Zhihan Zhang, Tong Zhao, Meng Jiang

ACL 2022 | May 2022

Publication

End-to-End Segmentation-based News Summarization

Yang Liu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

DICT-BERT: Enhancing Language Model Pre-Training with Dictionary

Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang

ACL 2022 | May 2022

Preprint

DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarization

Ziming Mao, Chen Henry Wu, Ansong Ni, Yushen Zhang, Rui Zhang, Tao Yu, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev

ACL 2022 | May 2022

Publication

KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering

Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng

ACL 2022 | May 2022

Publication

Leveraging Knowledge in Multilingual Commonsense Reasoning

Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer

Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren

ACL 2022 | May 2022

Publication

Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents

Yusen Zhang, Ansong Ni, Ziming Mao, Chen Henry Wu, Chenguang Zhu, Budhaditya Deb, Ahmed Awadallah, Dragomir Radev, Rui Zhang

ACL 2022 | May 2022

Publication

Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data

Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization

Ming Zhong, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

AAAI 2022 | February 2022

Publication

JAKET: Joint Pre-training of Knowledge Graph and Language Understanding

Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng

AAAI 2022 | February 2022

Publication

MLP Architectures for Vision-and-Language Modeling: An Empirical Study

Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang

December 2021

Preprint 프로젝트

The Elastic Lottery Ticket Hypothesis

Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang

35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021

Publication 프로젝트

An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next

Yusen Zhang, Ansong Ni, Tao Yu, Rui Zhang, Chenguang Zhu, Budhaditya Deb, Asli Celikyilmaz, Ahmed Awadallah, Dragomir Radev

Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021

Publication

Injecting Entity Types into Entity-Guided Text Generation

Xiangyu Dong, Wenhao Yu, Chenguang Zhu, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021

Publication

Accelerating Real-Time Question Answering via Question Generation

Yuwei Fang, Shuohang Wang, Zhe Gan, Siqi Sun, Jingjing Liu, Chenguang Zhu

arXiv: Computation and Language | September 2021

Data Augmentation for Spoken Language Understanding via Pretrained Models

Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao

INTERSPEECH | September 2021

Publication

Does Knowledge Help General NLU? An Empirical Study

Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng

arXiv: Computation and Language | September 2021

Universal Sentence Representations Learning with Conditional Masked Language Model

Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve

EMNLP 2021 | August 2021

Publication

DialSumm: A Real-Life Scenario Dialogue Summarization Dataset

Yulong Chen, Yang Liu, Liang Chen, Yue Zhang

The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021

Publication

Fusing Context Into Knowledge Graph for Commonsense Reasoning

Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang

The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021

Publication

RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems

Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Publication

Retrieval Enhanced Model for Commonsense Generation

Han Wang, Yang Liu, Chenguang Zhu, Linjun Shou (寿林钧), Ming Gong (YIMING), Yichong Xu, Michael Zeng

ACL-IJCNLP 2021 | August 2021

Publication

Want To Reduce Labeling Cost? GPT-3 Can Help

Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

Conference on Empirical Methods in Natural Language Processing | August 2021

Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021

PDF Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021

Publication

Enhancing Factual Consistency of Abstractive Summarization

Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng, Xuedong Huang, Meng Jiang

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding

Yu-An Chung, Chenguang Zhu, Michael Zeng

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

Noisy Self-Knowledge Distillation for Text Summarization

Yang Liu, Sheng Shen, Mirella Lapata

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication Publication

Filtered Inner Product Projection for Crosslingual Embedding Alignment

Vin Sachidananda, Ziyi Yang, Chenguang Zhu

International Conference on Learning Representations (ICLR) | May 2021

Publication

Sentence-Permuted Paragraph Generation

Wenhao Yu, Chenguang Zhu, Tong Zhao, Zhichun Guo, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP) 2021 | April 2021

Publication

MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization

Chenguang Zhu, Yang Liu, Jie Mei, Michael Zeng

NAACL | March 2021

PDF Publication

A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining

Chenguang Zhu, Ruochen Xu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication 프로젝트

Few-shot Natural Language Generation for Task-Oriented Dialog

Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication 프로젝트

TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication

A Survey of Knowledge-Enhanced Text Generation

Wenhao Yu, Chenguang Zhu, Zaitang Li, Zhiting Hu, Qingyun Wang, Heng Ji, Meng Jiang

arXiv 2010.04389 | October 2020

Publication

Mixed-Lingual Pre-training for Cross-lingual Summarization

Ruochen Xu, Chenguang Zhu, Yu Shi, Michael Zeng, Xuedong Huang

The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL 2020) | September 2020

Publication

Meta Dialogue Policy Learning

Yumo Xu, Chenguang Zhu, Baolin Peng, Michael Zeng

arxiv 2006.02588 | June 2020

Publication

Boosting Naturalness of Language in Task-oriented Dialogues via Adversarial Training

Chenguang Zhu

SIGDial 2020 | May 2020

Publication

Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue

Chenguang Zhu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2019

Publication

SIM: A Slot-Independent Neural Model for Dialogue State Tracking

Chenguang Zhu, Michael Zeng, Xuedong Huang

The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019

Publication

Embedding Imputation with Grounded Language Information

Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve

The 57th Annual Meeting of the Association for Computational Linguistics (ACL) | July 2019

Publication

Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering

Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley

North American Chapter of the Association for Computational Linguistics (NAACL) 2019 | May 2019

Publication 프로젝트

SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering

Chenguang Zhu, Michael Zeng, Xuedong Huang

arXiv | December 2018

Publication

FusionNet: Fusing via Fully-Aware Attention with Application to Machine Comprehension

Hsin-Yuan Huang, Chenguang Zhu, Yelong Shen, Weizhu Chen

Sixth International Conference on Learning Representations, ICLR 2018 | January 2018

출판

i-Code Studio: A Configurable and Composable Framework for Integrative AI

Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang

The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024

PDF Publication

Unifying Vision, Text, and Layout for Universal Document Processing

Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal

The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023

Publication 다운로드

Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles

Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao

The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023

Publication

Fine-Tuning Language Models with Advantage-Induced Policy Alignment

Banghua Zhu, Hiteshi Sharma, Felipe Vieira Frujeri, Shi Dong, Chenguang Zhu, Michael I. Jordan, Jiantao Jiao

June 2023

Publication

In-Context Demonstration Selection with Cross Entropy Difference

Dan Iter, Reid Pryzant, Ruochen Xu, Shuohang Wang, Yang Liu, Chenguang Zhu

May 2023

Arxiv

Publication

PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents

Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer

May 2023

Publication

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

Automatic Prompt Optimization with “Gradient Descent” and Beam Search

Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng

May 2023

Publication

UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization

Yulong Chen, Yang Liu, Ruochen Xu, Ziyi Yang, Chenguang Zhu, Michael Zeng, Yue Zhang

ACL 2023 | May 2023

Publication Publication

LMGQS: A Large-scale Dataset for Query-focused Summarization

Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng

May 2023

PDF

InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT

Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng

May 2023

PDF

Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences

Chaojun Wang, Yang Liu, Wai Lam

ACL 2023 Findings | May 2023

Publication Publication

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

Prompting GPT-3 To Be Reliable

Silei Cheng, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang

International Conference on Learning Representations (ICLR 23) | May 2023

PDF

How Does In-Context Learning Help Prompt Tuning?

Simeng Sun, Yang Liu, Dan Iter, Chenguang Zhu, Mohit Iyyer

February 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

Narrate Dialogues for Better Summarization

Ruochen Xu, Chenguang Zhu, Michael Zeng

2022 Empirical Methods in Natural Language Processing | December 2022

Publication

ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation

Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022

PDF

Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering

Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun

2022 Empirical Methods in Natural Language Processing | December 2022

Best Paper Award at SoCal NLP Symposium 2022

PDF Publication

FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training

Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu

December 2022

Publication

Task Compass: Scaling Multi-task Pre-training with Task Prefix

Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng

EMNLP 2022 | December 2022

Publication

Automatic Rule Induction for Efficient Semi-Supervised Learning

Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022

Publication

Unsupervised Summarization with Customized Granularities

Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering

Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan

Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022

Publication Publication 프로젝트

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

IJCAI 2022 | July 2022

human parity result on CommonsenseQA

Publication

CLIP-Event: Connecting Text and Images with Event Structures

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022

Publication

End-to-End Segmentation-based News Summarization

Yang Liu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data

Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

DICT-BERT: Enhancing Language Model Pre-Training with Dictionary

Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang

ACL 2022 | May 2022

Preprint

MLP Architectures for Vision-and-Language Modeling: An Empirical Study

Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang

December 2021

Preprint 프로젝트

The Elastic Lottery Ticket Hypothesis

Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang

35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021

Publication 프로젝트

Universal Sentence Representations Learning with Conditional Masked Language Model

Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve

EMNLP 2021 | August 2021

Publication

Want To Reduce Labeling Cost? GPT-3 Can Help

Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

Conference on Empirical Methods in Natural Language Processing | August 2021

Publication

RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems

Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021

PDF Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021

Publication

Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue

Chenguang Zhu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2019

Publication

SIM: A Slot-Independent Neural Model for Dialogue State Tracking

Chenguang Zhu, Michael Zeng, Xuedong Huang

The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019

Publication

Embedding Imputation with Grounded Language Information

Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve

The 57th Annual Meeting of the Association for Computational Linguistics (ACL) | July 2019

Publication

Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering

Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley

North American Chapter of the Association for Computational Linguistics (NAACL) 2019 | May 2019

Publication 프로젝트

SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering

Chenguang Zhu, Michael Zeng, Xuedong Huang

arXiv | December 2018

Publication

FusionNet: Fusing via Fully-Aware Attention with Application to Machine Comprehension

Hsin-Yuan Huang, Chenguang Zhu, Yelong Shen, Weizhu Chen

Sixth International Conference on Learning Representations, ICLR 2018 | January 2018

출판

i-Code Studio: A Configurable and Composable Framework for Integrative AI

Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang

The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024

PDF Publication

Global Selection of Contrastive Batches via Optimization on Sample Permutations

Vin Sachidananda, Ziyi Yang, Chenguang Zhu

ICML 2023 | July 2023

PDF Publication

Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles

Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao

The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023

Publication

PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents

Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer

May 2023

Publication

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

Small Models are Valuable Plug-ins for Large Language Models

Canwen Xu, Yichong Xu, Shuohang Wang, Yang Liu, Chenguang Zhu, Julian McAuley

May 2023

Publication

LMGQS: A Large-scale Dataset for Query-focused Summarization

Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng

May 2023

PDF

Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences

Chaojun Wang, Yang Liu, Wai Lam

ACL 2023 Findings | May 2023

Publication Publication

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

Prompting GPT-3 To Be Reliable

Silei Cheng, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang

International Conference on Learning Representations (ICLR 23) | May 2023

PDF

Generate rather than Retrieve: Large Language Models are Strong Context Generators

Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang

ICLR 2023 | May 2023

Publication

G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment

Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, Chenguang Zhu

arXiv 2303.16634 | March 2023

Publication

MACSum: Controllable Summarization with Mixed Attributes

Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang

Transactions of the Association for Computational Linguistics | March 2023

Publication

How Does In-Context Learning Help Prompt Tuning?

Simeng Sun, Yang Liu, Dan Iter, Chenguang Zhu, Mohit Iyyer

February 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation

Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022

PDF

Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering

Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun

2022 Empirical Methods in Natural Language Processing | December 2022

Best Paper Award at SoCal NLP Symposium 2022

PDF Publication

Retrieval Augmentation for Commonsense Reasoning: A Unified Approach

Wenhao Yu, Chenguang Zhu, Zhihan Zhang, Shuohang Wang, Zhuosheng Zhang, Yuwei Fang, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022

Publication

FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training

Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu

December 2022

Publication

Task Compass: Scaling Multi-task Pre-training with Task Prefix

Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng

EMNLP 2022 | December 2022

Publication

Towards A Unified Multi-Dimensional Evaluator For Text Generation

Ming Zhong, Yang Liu, Da Yin, Yuning Mao, Yizhu Jiao, Pengfei Liu, Chenguang Zhu, Heng Ji, Jiawei Han

Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022

Publication

A Unified Encoder-Decoder Framework with Entity Memory

Zhihan Zhang, Wenhao Yu, Chenguang Zhu, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022

Publication

Leveraging Locality in Abstractive Text Summarization

Yixin Liu, Ansong Ni, Linyong Nan, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev

EMNLP 2022 | December 2022

Publication Publication

Automatic Rule Induction for Efficient Semi-Supervised Learning

Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022

Publication

AdaPrompt: Adaptive Model Training for Prompt-based NLP

Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

Unsupervised Summarization with Customized Granularities

Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering

Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan

Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022

Publication Publication 프로젝트

Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners

Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji

Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022

PDF

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

IJCAI 2022 | July 2022

human parity result on CommonsenseQA

Publication

CLIP-Event: Connecting Text and Images with Event Structures

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022

Publication

An Empirical Study of Training End-to-End Vision-and-Language Transformers

Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng

CVPR | June 2022

Publication Publication 프로젝트

Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts

Wenhao Yu, Chenguang Zhu, Lianhui Qin, Zhihan Zhang, Tong Zhao, Meng Jiang

ACL 2022 | May 2022

Publication

End-to-End Segmentation-based News Summarization

Yang Liu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer

Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren

ACL 2022 | May 2022

Publication

Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data

Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents

Yusen Zhang, Ansong Ni, Ziming Mao, Chen Henry Wu, Chenguang Zhu, Budhaditya Deb, Ahmed Awadallah, Dragomir Radev, Rui Zhang

ACL 2022 | May 2022

Publication

DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarization

Ziming Mao, Chen Henry Wu, Ansong Ni, Yushen Zhang, Rui Zhang, Tao Yu, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev

ACL 2022 | May 2022

Publication

Leveraging Knowledge in Multilingual Commonsense Reasoning

Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

DICT-BERT: Enhancing Language Model Pre-Training with Dictionary

Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang

ACL 2022 | May 2022

Preprint

KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering

Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng

ACL 2022 | May 2022

Publication

DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization

Ming Zhong, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

AAAI 2022 | February 2022

Publication

JAKET: Joint Pre-training of Knowledge Graph and Language Understanding

Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng

AAAI 2022 | February 2022

Publication

MLP Architectures for Vision-and-Language Modeling: An Empirical Study

Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang

December 2021

Preprint 프로젝트

An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next

Yusen Zhang, Ansong Ni, Tao Yu, Rui Zhang, Chenguang Zhu, Budhaditya Deb, Asli Celikyilmaz, Ahmed Awadallah, Dragomir Radev

Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021

Publication

Injecting Entity Types into Entity-Guided Text Generation

Xiangyu Dong, Wenhao Yu, Chenguang Zhu, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021

Publication

Does Knowledge Help General NLU? An Empirical Study

Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng

arXiv: Computation and Language | September 2021

Accelerating Real-Time Question Answering via Question Generation

Yuwei Fang, Shuohang Wang, Zhe Gan, Siqi Sun, Jingjing Liu, Chenguang Zhu

arXiv: Computation and Language | September 2021

Data Augmentation for Spoken Language Understanding via Pretrained Models

Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao

INTERSPEECH | September 2021

Publication

Universal Sentence Representations Learning with Conditional Masked Language Model

Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve

EMNLP 2021 | August 2021

Publication

Want To Reduce Labeling Cost? GPT-3 Can Help

Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

Conference on Empirical Methods in Natural Language Processing | August 2021

Publication

DialSumm: A Real-Life Scenario Dialogue Summarization Dataset

Yulong Chen, Yang Liu, Liang Chen, Yue Zhang

The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021

Publication

Retrieval Enhanced Model for Commonsense Generation

Han Wang, Yang Liu, Chenguang Zhu, Linjun Shou (寿林钧), Ming Gong (YIMING), Yichong Xu, Michael Zeng

ACL-IJCNLP 2021 | August 2021

Publication

Fusing Context Into Knowledge Graph for Commonsense Reasoning

Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang

The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021

Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021

PDF Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021

Publication

SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding

Yu-An Chung, Chenguang Zhu, Michael Zeng

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

Enhancing Factual Consistency of Abstractive Summarization

Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng, Xuedong Huang, Meng Jiang

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

Noisy Self-Knowledge Distillation for Text Summarization

Yang Liu, Sheng Shen, Mirella Lapata

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication Publication

Filtered Inner Product Projection for Crosslingual Embedding Alignment

Vin Sachidananda, Ziyi Yang, Chenguang Zhu

International Conference on Learning Representations (ICLR) | May 2021

Publication

Sentence-Permuted Paragraph Generation

Wenhao Yu, Chenguang Zhu, Tong Zhao, Zhichun Guo, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP) 2021 | April 2021

Publication

MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization

Chenguang Zhu, Yang Liu, Jie Mei, Michael Zeng

NAACL | March 2021

PDF Publication

A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining

Chenguang Zhu, Ruochen Xu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication 프로젝트

TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication

Few-shot Natural Language Generation for Task-Oriented Dialog

Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication 프로젝트

A Survey of Knowledge-Enhanced Text Generation

Wenhao Yu, Chenguang Zhu, Zaitang Li, Zhiting Hu, Qingyun Wang, Heng Ji, Meng Jiang

arXiv 2010.04389 | October 2020

Publication

Mixed-Lingual Pre-training for Cross-lingual Summarization

Ruochen Xu, Chenguang Zhu, Yu Shi, Michael Zeng, Xuedong Huang

The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL 2020) | September 2020

Publication

Meta Dialogue Policy Learning

Yumo Xu, Chenguang Zhu, Baolin Peng, Michael Zeng

arxiv 2006.02588 | June 2020

Publication

Boosting Naturalness of Language in Task-oriented Dialogues via Adversarial Training

Chenguang Zhu

SIGDial 2020 | May 2020

Publication

Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue

Chenguang Zhu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2019

Publication

SIM: A Slot-Independent Neural Model for Dialogue State Tracking

Chenguang Zhu, Michael Zeng, Xuedong Huang

The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019

Publication

Embedding Imputation with Grounded Language Information

Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve

The 57th Annual Meeting of the Association for Computational Linguistics (ACL) | July 2019

Publication

Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering

Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley

North American Chapter of the Association for Computational Linguistics (NAACL) 2019 | May 2019

Publication 프로젝트

i-Code Studio: A Configurable and Composable Framework for Integrative AI

Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang

The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024

PDF Publication

Unifying Vision, Text, and Layout for Universal Document Processing

Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal

The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023

Publication 다운로드

Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles

Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao

The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023

Publication

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering

Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan

Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022

Publication Publication 프로젝트

Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners

Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji

Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022

PDF

CLIP-Event: Connecting Text and Images with Event Structures

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022

Publication

An Empirical Study of Training End-to-End Vision-and-Language Transformers

Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng

CVPR | June 2022

Publication Publication 프로젝트

MLP Architectures for Vision-and-Language Modeling: An Empirical Study

Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang

December 2021

Preprint 프로젝트

The Elastic Lottery Ticket Hypothesis

Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang

35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021

Publication 프로젝트

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

Automatic Prompt Optimization with “Gradient Descent” and Beam Search

Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng

May 2023

Publication

Fine-Tuning Language Models with Advantage-Induced Policy Alignment

Banghua Zhu, Hiteshi Sharma, Felipe Vieira Frujeri, Shi Dong, Chenguang Zhu, Michael I. Jordan, Jiantao Jiao

June 2023

Publication

In-Context Demonstration Selection with Cross Entropy Difference

Dan Iter, Reid Pryzant, Ruochen Xu, Shuohang Wang, Yang Liu, Chenguang Zhu

May 2023

Arxiv

Publication

PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents

Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer

May 2023

Publication

LMGQS: A Large-scale Dataset for Query-focused Summarization

Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng

May 2023

PDF

InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT

Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng

May 2023

PDF

FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training

Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu

December 2022

Publication

MLP Architectures for Vision-and-Language Modeling: An Empirical Study

Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang

December 2021

Preprint 프로젝트

i-Code Studio: A Configurable and Composable Framework for Integrative AI

Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang

The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024

PDF Publication

Global Selection of Contrastive Batches via Optimization on Sample Permutations

Vin Sachidananda, Ziyi Yang, Chenguang Zhu

ICML 2023 | July 2023

PDF Publication

Unifying Vision, Text, and Layout for Universal Document Processing

Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal

The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023

Publication 다운로드

Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles

Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao

The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023

Publication

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

Small Models are Valuable Plug-ins for Large Language Models

Canwen Xu, Yichong Xu, Shuohang Wang, Yang Liu, Chenguang Zhu, Julian McAuley

May 2023

Publication

Automatic Prompt Optimization with “Gradient Descent” and Beam Search

Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng

May 2023

Publication

UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization

Yulong Chen, Yang Liu, Ruochen Xu, Ziyi Yang, Chenguang Zhu, Michael Zeng, Yue Zhang

ACL 2023 | May 2023

Publication Publication

Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences

Chaojun Wang, Yang Liu, Wai Lam

ACL 2023 Findings | May 2023

Publication Publication

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

Prompting GPT-3 To Be Reliable

Silei Cheng, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang

International Conference on Learning Representations (ICLR 23) | May 2023

PDF

Generate rather than Retrieve: Large Language Models are Strong Context Generators

Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang

ICLR 2023 | May 2023

Publication

How Does In-Context Learning Help Prompt Tuning?

Simeng Sun, Yang Liu, Dan Iter, Chenguang Zhu, Mohit Iyyer

February 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

Narrate Dialogues for Better Summarization

Ruochen Xu, Chenguang Zhu, Michael Zeng

2022 Empirical Methods in Natural Language Processing | December 2022

Publication

ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation

Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022

PDF

Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering

Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun

2022 Empirical Methods in Natural Language Processing | December 2022

Best Paper Award at SoCal NLP Symposium 2022

PDF Publication

Retrieval Augmentation for Commonsense Reasoning: A Unified Approach

Wenhao Yu, Chenguang Zhu, Zhihan Zhang, Shuohang Wang, Zhuosheng Zhang, Yuwei Fang, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022

Publication

Task Compass: Scaling Multi-task Pre-training with Task Prefix

Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng

EMNLP 2022 | December 2022

Publication

Towards A Unified Multi-Dimensional Evaluator For Text Generation

Ming Zhong, Yang Liu, Da Yin, Yuning Mao, Yizhu Jiao, Pengfei Liu, Chenguang Zhu, Heng Ji, Jiawei Han

Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022

Publication

A Unified Encoder-Decoder Framework with Entity Memory

Zhihan Zhang, Wenhao Yu, Chenguang Zhu, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022

Publication

Leveraging Locality in Abstractive Text Summarization

Yixin Liu, Ansong Ni, Linyong Nan, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev

EMNLP 2022 | December 2022

Publication Publication

Automatic Rule Induction for Efficient Semi-Supervised Learning

Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022

Publication

AdaPrompt: Adaptive Model Training for Prompt-based NLP

Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

Unsupervised Summarization with Customized Granularities

Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering

Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan

Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022

Publication Publication 프로젝트

Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners

Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji

Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022

PDF

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

IJCAI 2022 | July 2022

human parity result on CommonsenseQA

Publication

CLIP-Event: Connecting Text and Images with Event Structures

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022

Publication

An Empirical Study of Training End-to-End Vision-and-Language Transformers

Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng

CVPR | June 2022

Publication Publication 프로젝트

Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts

Wenhao Yu, Chenguang Zhu, Lianhui Qin, Zhihan Zhang, Tong Zhao, Meng Jiang

ACL 2022 | May 2022

Publication

End-to-End Segmentation-based News Summarization

Yang Liu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer

Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren

ACL 2022 | May 2022

Publication

Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data

Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents

Yusen Zhang, Ansong Ni, Ziming Mao, Chen Henry Wu, Chenguang Zhu, Budhaditya Deb, Ahmed Awadallah, Dragomir Radev, Rui Zhang

ACL 2022 | May 2022

Publication

DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarization

Ziming Mao, Chen Henry Wu, Ansong Ni, Yushen Zhang, Rui Zhang, Tao Yu, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev

ACL 2022 | May 2022

Publication

Leveraging Knowledge in Multilingual Commonsense Reasoning

Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

DICT-BERT: Enhancing Language Model Pre-Training with Dictionary

Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang

ACL 2022 | May 2022

Preprint

KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering

Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng

ACL 2022 | May 2022

Publication

DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization

Ming Zhong, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

AAAI 2022 | February 2022

Publication

JAKET: Joint Pre-training of Knowledge Graph and Language Understanding

Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng

AAAI 2022 | February 2022

Publication

The Elastic Lottery Ticket Hypothesis

Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang

35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021

Publication 프로젝트

An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next

Yusen Zhang, Ansong Ni, Tao Yu, Rui Zhang, Chenguang Zhu, Budhaditya Deb, Asli Celikyilmaz, Ahmed Awadallah, Dragomir Radev

Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021

Publication

Universal Sentence Representations Learning with Conditional Masked Language Model

Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve

EMNLP 2021 | August 2021

Publication

Want To Reduce Labeling Cost? GPT-3 Can Help

Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

Conference on Empirical Methods in Natural Language Processing | August 2021

Publication

DialSumm: A Real-Life Scenario Dialogue Summarization Dataset

Yulong Chen, Yang Liu, Liang Chen, Yue Zhang

The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021

Publication

Retrieval Enhanced Model for Commonsense Generation

Han Wang, Yang Liu, Chenguang Zhu, Linjun Shou (寿林钧), Ming Gong (YIMING), Yichong Xu, Michael Zeng

ACL-IJCNLP 2021 | August 2021

Publication

RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems

Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Publication

Fusing Context Into Knowledge Graph for Commonsense Reasoning

Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang

The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021

Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021

PDF Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021

Publication

Noisy Self-Knowledge Distillation for Text Summarization

Yang Liu, Sheng Shen, Mirella Lapata

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication Publication

MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization

Chenguang Zhu, Yang Liu, Jie Mei, Michael Zeng

NAACL | March 2021

PDF Publication

Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue

Chenguang Zhu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2019

Publication

SIM: A Slot-Independent Neural Model for Dialogue State Tracking

Chenguang Zhu, Michael Zeng, Xuedong Huang

The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019

Publication

Embedding Imputation with Grounded Language Information

Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve

The 57th Annual Meeting of the Association for Computational Linguistics (ACL) | July 2019

Publication

Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering

Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley

North American Chapter of the Association for Computational Linguistics (NAACL) 2019 | May 2019

Publication 프로젝트

FusionNet: Fusing via Fully-Aware Attention with Application to Machine Comprehension

Hsin-Yuan Huang, Chenguang Zhu, Yelong Shen, Weizhu Chen

Sixth International Conference on Learning Representations, ICLR 2018 | January 2018

출판

G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment

Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, Chenguang Zhu

arXiv 2303.16634 | March 2023

Publication

MACSum: Controllable Summarization with Mixed Attributes

Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang

Transactions of the Association for Computational Linguistics | March 2023

Publication

Injecting Entity Types into Entity-Guided Text Generation

Xiangyu Dong, Wenhao Yu, Chenguang Zhu, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021

Publication

Does Knowledge Help General NLU? An Empirical Study

Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng

arXiv: Computation and Language | September 2021

Accelerating Real-Time Question Answering via Question Generation

Yuwei Fang, Shuohang Wang, Zhe Gan, Siqi Sun, Jingjing Liu, Chenguang Zhu

arXiv: Computation and Language | September 2021

Data Augmentation for Spoken Language Understanding via Pretrained Models

Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao

INTERSPEECH | September 2021

Publication

SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding

Yu-An Chung, Chenguang Zhu, Michael Zeng

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

Enhancing Factual Consistency of Abstractive Summarization

Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng, Xuedong Huang, Meng Jiang

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

Filtered Inner Product Projection for Crosslingual Embedding Alignment

Vin Sachidananda, Ziyi Yang, Chenguang Zhu

International Conference on Learning Representations (ICLR) | May 2021

Publication

Sentence-Permuted Paragraph Generation

Wenhao Yu, Chenguang Zhu, Tong Zhao, Zhichun Guo, Meng Jiang

Empirical Methods in Natural Language Processing (EMNLP) 2021 | April 2021

Publication

A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining

Chenguang Zhu, Ruochen Xu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication 프로젝트

TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication

Few-shot Natural Language Generation for Task-Oriented Dialog

Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication 프로젝트

A Survey of Knowledge-Enhanced Text Generation

Wenhao Yu, Chenguang Zhu, Zaitang Li, Zhiting Hu, Qingyun Wang, Heng Ji, Meng Jiang

arXiv 2010.04389 | October 2020

Publication

Mixed-Lingual Pre-training for Cross-lingual Summarization

Ruochen Xu, Chenguang Zhu, Yu Shi, Michael Zeng, Xuedong Huang

The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL 2020) | September 2020

Publication

Meta Dialogue Policy Learning

Yumo Xu, Chenguang Zhu, Baolin Peng, Michael Zeng

arxiv 2006.02588 | June 2020

Publication

Boosting Naturalness of Language in Task-oriented Dialogues via Adversarial Training

Chenguang Zhu

SIGDial 2020 | May 2020

Publication

SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering

Chenguang Zhu, Michael Zeng, Xuedong Huang

arXiv | December 2018

Publication