Microsoft at ICML 2024

Provable Risk-Sensitive Distributional Reinforcement Learning with General Function Approximation

Yu Chen, Xiangcheng Zhang, Siwei Wang, Longbo Huang

ICML 2024 | July 2024

DOI Publication Publication

DéjàVu: KV-cache Streaming for Fast, Fault-tolerant Generative LLM Serving

Foteini Strati, Sara Mcallister, Amar Phanishayee, Jakub Tarnawski, Ana Klimovic

ICML 2024 | July 2024

DOI PDF Publication PDF プロジェクト

Integrated Hardware Architecture and Device Placement Search

Irene Wang, Jakub Tarnawski, Amar Phanishayee, Divya Mahajan

2024 International Conference on Machine Learning | July 2024

Publication PDF プロジェクト

Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and Beyond

Xutong Liu, Siwei Wang, Jinhang Zuo, Han Zhong, Xuchuang Wang, Zhiyong Wang, Shuai Li, Mohammad Hajiesmaili, John C.S. Lui, Wei Chen

Proceedings of the 41st International Conference on Machine Learning (ICML) | July 2024

PDF

Intersecting-Boundary-Sensitive Fingerprinting for Tampering Detection of DNN Models

Bin Benjamin Zhu

2024 International Conference on Machine Learning | July 2024

Publication

Stealing Part of a Production Language Model

Nicholas Carlini, Daniel Paleka, Krishnamurthy Dj Dvijotham, Thomas Steinke, Jonathan Hayase, A. Feder Cooper, Katherine Lee, Matthew Jagielski, Milad Nasr, Arthur Conmy, Itay Yona, Eric Wallace, David Rolnick, Florian Tramèr

ICML 2024 | July 2024

Best Paper

Publication

Differentially Private Synthetic Data via Foundation Model APIs 2: Text

Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin

ICML 2024 | July 2024

Spotlight

Publication プロジェクト

How Far Can Fairness Constraints Help Recover From Biased Data?

Mohit Sharma, Amit Deshpande

ICML 2024 | July 2024

DOI Publication Publication

Language-guided Skill Learning with Temporal Variational Inference

Haotian Fu, Pratyusha Sharma, Elias Stengel-Eskin, George Konidaris, Nicolas Le Roux, Marc-Alexandre Côté, Xingdi Yuan

ICML 2024 | July 2024

DOI Publication Publication

OAK: Enriching Document Representations using Auxiliary Knowledge for Extreme Classification

Shikhar Mohan, Deepak Saini, Anshul Mittal, Sayak Roy Chowdhury, Bhawna Paliwal, Jian Jiao, Manish Gupta, Manik Varma

2024 International Conference on Machine Learning | July 2024

Publication

Submodular Framework for Structured-Sparse Optimal Transport

Piyushi Manupriya, Pratik Jawanpuria, Karthik S. Gurumoorthy, S. Jagarlapudi, Bamdev Mishra

ICML 2024 | June 2024

Publication

PRISE: LLM-Style Sequence Compression for Learning Temporal Action Abstractions in Control

Ruijie Zheng, Ching-An Cheng, Hal Daumé III, Furong Huang, Andrey Kolobov

ICML 2024 | June 2024

ORAL

Publication

Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective

Fabian Falck, Ziyu Wang, Chris Holmes

ICML 2024 | June 2024

Publication

NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models

Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao

ICML | June 2024

Publication

Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problems

Yifan Xia, Xianliang Yang, Zichuan Liu, Zhihao Liu, Lei Song, Jiang Bian

2024 International Conference on Machine Learning | June 2024

PDF

Riemannian coordinate descent algorithms on matrix manifolds

Andi Han, Pratik Jawanpuria, Bamdev Mishra

ICML 2024 | June 2024

Publication

Safe and Robust Subgame Exploitation in Imperfect Information Games

Zhenxing Ge, Zheng Xu, Tianyu Ding, Linjian Meng, Bo An, Wenbin Li, Yang Gao

ICML 2024 | June 2024

Publication

Think Before You Act: Decision Transformers with Internal Working Memory

Jikun Kang, Romain Laroche, Xingdi Yuan, Adam Trischler, Xuefei Liu, Jie Fu

ICML 2024 | May 2024

DOI Publication Publication

Towards Modular LLMs by Building and Reusing a Library of LoRAs

O. Ostapenko, Zhan Su, E. Ponti, Laurent Charlin, Nicolas Le Roux, Matheus Pereira, Lucas Caccia, Alessandro Sordoni

ICML 2024 | May 2024

Publication

TimeX++: Learning Time-Series Explanations with Information Bottleneck

Zichuan Liu, Tianchun Wang, Jimeng Shi, Xu Zheng, Zhuomin Chen, Lei Song, Wenqian Dong, J. Obeysekera, Farhad Shirani, Dongsheng Luo

ICML 2024 | May 2024

Publication

Generalizing Knowledge Graph Embedding with Universal Orthogonal Parameterization

Rui Li, Chaozhuo Li, Yanming Shen, Zeyu Zhang, Xu Chen

ICML 2024 | May 2024

Publication

A Fixed-Point Approach for Causal Generative Modeling

Meyer Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma

ICML 2024 | May 2024

DOI Publication Publication

Precise Accuracy / Robustness Tradeoffs in Regression: Case of General Norms

Elvis Dohmatob, Meyer Scetbon

ICML 2024 | May 2024

DOI Publication Publication PDF

Provably Robust DPO: Aligning Language Models with Noisy Feedback

Sayak Ray Chowdhury, Anush Kini, Nagarajan Natarajan

ICML 2024 | May 2024

Publication

Debiased Distribution Compression

Lingxiao Li, Raaz Dwivedi, Lester Mackey

ICML 2024 | April 2024

Publication

Token-level Direct Preference Optimization

Yongcheng Zeng, Guoqing Liu, Weiyu Ma, Ning Yang, Haifeng Zhang, Jun Wang

ICML 2024 | April 2024

DOI Publication Publication

Provable Interactive Learning with Hindsight Instruction Feedback

Dipendra Misra, Aldo Pacchiano, Robert E. Schapire

ICML 2024 | April 2024

DOI Publication Publication

FiP: A Fixed-Point Approach for Causal Generative Modeling

M. Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma

ICML 2024 | April 2024

DOI Publication Publication

Out-of-Distribution Detection via Deep Multi-Comprehension Ensemble

Chenhui Xu, Fuxun Yu, Zirui Xu, Nathan Inkawhich, Xiang Chen

ICML 2024 | March 2024

DOI Publication Publication

Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction

He Zhang, Chang Liu, Zun Wang, Xinran wei, Siyuan Liu, Nanning Zheng, Bin Shao, Tie-Yan Liu

ICML 2024 | March 2024

DOI Publication Publication

Rethinking Generative Large Language Model Evaluation for Semantic Comprehension

Fangyun Wei, Xi Chen, Linzi Luo

ICML 2024 | March 2024

DOI Publication Publication

Scalable Online Exploration via Coverability

P. Amortila, Dylan Foster, Akshay Krishnamurthy

ICML 2024 | March 2024

DOI Publication Publication

MathScale: Scaling Instruction Tuning for Mathematical Reasoning

Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei

ICML 2024 | March 2024

DOI Publication Publication

Clifford-Steerable Convolutional Neural Networks

Maksim Zhdanov, David Ruhe, Maurice Weiler, Ana Lucic, Johannes Brandstetter, Patrick Forr'e

ICML 2024 | February 2024

DOI Publication Publication

DyVal 2: Dynamic Evaluation of Large Language Models by Meta Probing Agents

Kaijie Zhu, Jindong Wang, Qinlin Zhao, Ruochen Xu, Xing Xie

ICML 2024 | February 2024

DOI Publication Publication

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang

ICML 2024 | February 2024

Publication DOI Github

Using Left and Right Brains Together: Towards Vision and Language Planning

Jun Cen, Chenfei Wu, Xiao Liu, Sheng-Siang Yin, Yixuan Pei, Jinglong Yang, Qifeng Chen, Nan Duan, Jianguo Zhang

ICML 2024 | February 2024

DOI Publication Publication

ChemReasoner: Heuristic Search over a Large Language Model’s Knowledge Space using Quantum-Chemical Feedback

Henry W Sprueill, Carl N. Edwards, Khushbu Agarwal, Mariefel V. Olarte, Udishnu Sanyal, Conrad Johnston, Hongbin Liu, Heng Ji, Sutanay Choudhury

ICML 2024 | February 2024

DOI Publication Publication

DoRA: Weight-Decomposed Low-Rank Adaptation

Shih-yang Liu, Chien-Yi Wang, Hongxu Yin, Pavlo Molchanov, Yu-Chiang Frank Wang, Kwang-Ting Cheng, Min-Hung Chen

ICML 2024 | February 2024

DOI Publication Publication

Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models

Francesca-Zhoufan Li, Ava P. Amini, Yisong Yue, Kevin Yang, Alex Lu

ICML 2024 | February 2024

DOI Publication

Efficient Contextual Bandits with Uninformed Feedback Graphs

Mengxiao Zhang, Yuheng Zhang, Haipeng Luo, Paul Mineiro

ICML 2024 | February 2024

DOI Publication Publication

Understanding the Training Speedup from Sampling with Approximate Losses

Rudrajit Das, Xi Chen, Bertram Ieong, Parikshit Bansal, Sujay Sanghavi

ICML 2024 | February 2024

DOI Publication Publication

Premier-TACO is a Few-Shot Policy Learner: Pretraining Multitask Representation via Temporal Action-Driven Contrastive Loss

Ruijie Zheng, Yongyuan Liang, Xiyao Wang, Shuang Ma, Hal Daumé III, Huazhe Xu, John Langford, Praveen Palanisamy, Kalyan Shankar Basu, Furong Huang

ICML 2024 | February 2024

DOI Publication Publication

Open-Vocabulary Calibration for Vision-Language Models

Shuoyuan Wang, Jindong Wang, Guoqing Wang, Bob Zhang, Kaiyang Zhou, Hongxin Wei

ICML 2024 | February 2024

DOI Publication Publication

AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Calls

Yu Du, Fangyun Wei, Hongyang Zhang

ICML 2024 | February 2024

DOI Publication Publication

DistiLLM: Towards Streamlined Distillation for Large Language Models

Jongwoo Ko, Sungnyun Kim, Tianyi Chen, Se-Young Yun

ICML 2024 | February 2024

DOI Publication Publication

HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal

Mantas Mazeika, Long Phan, Xuwang Yin, Andy Zou, Zifan Wang, Norman Mu, Elham Sakhaee, Nathaniel Li, Steven Basart, Bo Li, David Forsyth, Dan Hendrycks

ICML 2024 | February 2024

DOI Publication Publication

Tag-LLM: Repurposing General-Purpose LLMs for Specialized Domains

Junhong Shen, Neil Tenenholtz, James Hall, David Alvarez-Melis, Nicolo Fusi

ICML 2024 | February 2024

DOI Publication Publication

A General Framework for Learning from Weak Supervision

Hao Chen, Jindong Wang, Lei Feng, Xiang Li, Yidong Wang, Xing Xie, Masashi Sugiyama, Rita Singh, Bhiksha Raj

ICML 2024 | February 2024

DOI Publication Publication

Efficient and Effective Time-Series Forecasting with Spiking Neural Networks

Changze Lv, Yansen Wang, Dongqi Han, Xiaoqing Zheng, Xuanjing Huang, Dongsheng Li

ICML 2024 | February 2024

DOI Publication Github

Mission Critical – Satellite Data is a Distinct Modality in Machine Learning

Esther Rolf, Konstantin Klemmer, Caleb Robinson, Hannah Kerner

ICML 2024 | February 2024

DOI Publication Publication

StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis

Zecheng Tang, Chenfei Wu, Zekai Zhang, Mingheng Ni, Sheng-Siang Yin, Yu Liu, Zhengyuan Yang, Lijuan Wang, Zicheng Liu, Juntao Li, Nan Duan

ICML 2024 | January 2024

DOI Publication Publication

EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty

Yuhui Li, Fangyun Wei, Chao Zhang, Hongyang Zhang, Fangyun Wei

ICML 2024 | January 2024

DOI Publication Publication

Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation

Haoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan, Lingfeng Shen, Benjamin Van Durme, Kenton Murray, Young Jin Kim

ICML 2024 | January 2024

DOI Publication Publication

TrustLLM: Trustworthiness in Large Language Models

Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao

ICML 2024 | January 2024

DOI Publication Publication

Principled Gradient-based Markov Chain Monte Carlo for Text Generation

Li Du, Afra Amini, Lucas Torroba Hennigen, Xinyan Velocity Yu, Jason Eisner, Holden Lee, Ryan Cotterell

ICML 2024 | December 2023

DOI Publication Publication

The Good, The Bad, and Why: Unveiling Emotions in Generative AI

Cheng Li, Jindong Wang, Yixuan Zhang, Kaijie Zhu, Xinyi Wang, Wenxin Hou, Jianxun Lian, Fang Luo, Qiang Yang, Xing Xie

ICML 2024 | December 2023

DOI Publication Publication

Improved Differentially Private and Lazy Online Convex Optimization

Naman Agarwal, Satyen Kale, Karan Singh, Abhradeep Thakurta

ICML 2024 | December 2023

DOI Publication Publication

PcLast: Discovering Plannable Continuous Latent States

Anurag Koul, Shivakanth Sujit, Shaoru Chen, Ben Evans, Lili Wu, Byron Xu, Rajan Chari, Riashat Islam, Raihan Seraj, Yonathan Efroni, Lekan Molu, Miro Dudík, John Langford, Alex Lamb

ICML 2024 | November 2023

DOI Publication Publication

CompeteAI: Understanding the Competition Behaviors in Large Language Model-based Agents

Qinlin Zhao, Jindong Wang, Yixuan Zhang, Yiqiao Jin, Kaijie Zhu, Hao Chen, Xing Xie

ICML 2024 | October 2023

DOI Publication Publication

HumanTOMATO: Text-aligned Whole-body Motion Generation

Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing-de Lin, Ruimao Zhang, Lei Zhang, Heung-Yeung Shum

ICML 2024 | October 2023

DOI Publication Publication

Completing Visual Objects via Bridging Generation and Segmentation

Xiang Li, Yinpeng Chen, Chung-Ching Lin, Rita Singh, Bhiksha Raj, Lijuan Wang, Zicheng Liu

IMCL 2024 | September 2023

DOI Publication PDF Publication

Towards Causal Foundation Model: on Duality between Causal Inference and Attention

Jiaqi Zhang, Joel Jennings, Cheng Zhang, Chao Ma

ICML 2024 | September 2023

DOI Publication Publication Publication

UniAudio: An Audio Foundation Model Toward Universal Audio Generation

Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Xixin Wu, Zhou Zhao, Helen Meng

ICML 2024 | September 2023

DOI Publication Publication PDF

Breaking through the learning plateaus of in-context learning in Transformer

Jingwen Fu, T. Yang, Yuwang Wang, Yan Lu, Nanning Zheng

ICML 2024 | September 2023

Publication

MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities

Weihao Yu, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Zicheng Liu, Xinchao Wang, Lijuan Wang

ICML 2024 | August 2023

DOI Publication PDF Publication

Safe Exploration in Dose Finding Clinical Trials with Heterogeneous Participants

Isabel Chien, Richard Turner, Javier González

ICML 2024 | July 2023

DOI Publication

MGit: A Model Versioning and Management System

Wei Hao, Daniel Mendoza, Rafael da Silva, Deepak Narayanan, Amar Phanishayee

ICML 2024 | July 2023

DOI Publication PDF Publication

Selective Mixup Helps with Distribution Shifts, But Not (Only) because of Mixup

Damien Teney, Jindong Wang, Ehsan Abbasnejad

ICML 2024 | May 2023

DOI Publication Publication PDF

Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling

Weijia Xu, Andrzej Banburski-Fahey, Nebojsa Jojic

ICML 2024 | May 2023

DOI Publication Publication PDF

Provable Risk-Sensitive Distributional Reinforcement Learning with General Function Approximation

Yu Chen, Xiangcheng Zhang, Siwei Wang, Longbo Huang

ICML 2024 | July 2024

DOI Publication Publication

Integrated Hardware Architecture and Device Placement Search

Irene Wang, Jakub Tarnawski, Amar Phanishayee, Divya Mahajan

2024 International Conference on Machine Learning | July 2024

Publication PDF プロジェクト

DéjàVu: KV-cache Streaming for Fast, Fault-tolerant Generative LLM Serving

Foteini Strati, Sara Mcallister, Amar Phanishayee, Jakub Tarnawski, Ana Klimovic

ICML 2024 | July 2024

DOI PDF Publication PDF プロジェクト

Stealing Part of a Production Language Model

Nicholas Carlini, Daniel Paleka, Krishnamurthy Dj Dvijotham, Thomas Steinke, Jonathan Hayase, A. Feder Cooper, Katherine Lee, Matthew Jagielski, Milad Nasr, Arthur Conmy, Itay Yona, Eric Wallace, David Rolnick, Florian Tramèr

ICML 2024 | July 2024

Best Paper

Publication

Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and Beyond

Xutong Liu, Siwei Wang, Jinhang Zuo, Han Zhong, Xuchuang Wang, Zhiyong Wang, Shuai Li, Mohammad Hajiesmaili, John C.S. Lui, Wei Chen

Proceedings of the 41st International Conference on Machine Learning (ICML) | July 2024

PDF

Language-guided Skill Learning with Temporal Variational Inference

Haotian Fu, Pratyusha Sharma, Elias Stengel-Eskin, George Konidaris, Nicolas Le Roux, Marc-Alexandre Côté, Xingdi Yuan

ICML 2024 | July 2024

DOI Publication Publication

OAK: Enriching Document Representations using Auxiliary Knowledge for Extreme Classification

Shikhar Mohan, Deepak Saini, Anshul Mittal, Sayak Roy Chowdhury, Bhawna Paliwal, Jian Jiao, Manish Gupta, Manik Varma

2024 International Conference on Machine Learning | July 2024

Publication

How Far Can Fairness Constraints Help Recover From Biased Data?

Mohit Sharma, Amit Deshpande

ICML 2024 | July 2024

DOI Publication Publication

Differentially Private Synthetic Data via Foundation Model APIs 2: Text

Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin

ICML 2024 | July 2024

Spotlight

Publication プロジェクト

Submodular Framework for Structured-Sparse Optimal Transport

Piyushi Manupriya, Pratik Jawanpuria, Karthik S. Gurumoorthy, S. Jagarlapudi, Bamdev Mishra

ICML 2024 | June 2024

Publication

PRISE: LLM-Style Sequence Compression for Learning Temporal Action Abstractions in Control

Ruijie Zheng, Ching-An Cheng, Hal Daumé III, Furong Huang, Andrey Kolobov

ICML 2024 | June 2024

ORAL

Publication

Safe and Robust Subgame Exploitation in Imperfect Information Games

Zhenxing Ge, Zheng Xu, Tianyu Ding, Linjian Meng, Bo An, Wenbin Li, Yang Gao

ICML 2024 | June 2024

Publication

Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective

Fabian Falck, Ziyu Wang, Chris Holmes

ICML 2024 | June 2024

Publication

Riemannian coordinate descent algorithms on matrix manifolds

Andi Han, Pratik Jawanpuria, Bamdev Mishra

ICML 2024 | June 2024

Publication

NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models

Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao

ICML | June 2024

Publication

Think Before You Act: Decision Transformers with Internal Working Memory

Jikun Kang, Romain Laroche, Xingdi Yuan, Adam Trischler, Xuefei Liu, Jie Fu

ICML 2024 | May 2024

DOI Publication Publication

Towards Modular LLMs by Building and Reusing a Library of LoRAs

O. Ostapenko, Zhan Su, E. Ponti, Laurent Charlin, Nicolas Le Roux, Matheus Pereira, Lucas Caccia, Alessandro Sordoni

ICML 2024 | May 2024

Publication

TimeX++: Learning Time-Series Explanations with Information Bottleneck

Zichuan Liu, Tianchun Wang, Jimeng Shi, Xu Zheng, Zhuomin Chen, Lei Song, Wenqian Dong, J. Obeysekera, Farhad Shirani, Dongsheng Luo

ICML 2024 | May 2024

Publication

Generalizing Knowledge Graph Embedding with Universal Orthogonal Parameterization

Rui Li, Chaozhuo Li, Yanming Shen, Zeyu Zhang, Xu Chen

ICML 2024 | May 2024

Publication

Precise Accuracy / Robustness Tradeoffs in Regression: Case of General Norms

Elvis Dohmatob, Meyer Scetbon

ICML 2024 | May 2024

DOI Publication Publication PDF

A Fixed-Point Approach for Causal Generative Modeling

Meyer Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma

ICML 2024 | May 2024

DOI Publication Publication

Provably Robust DPO: Aligning Language Models with Noisy Feedback

Sayak Ray Chowdhury, Anush Kini, Nagarajan Natarajan

ICML 2024 | May 2024

Publication

Token-level Direct Preference Optimization

Yongcheng Zeng, Guoqing Liu, Weiyu Ma, Ning Yang, Haifeng Zhang, Jun Wang

ICML 2024 | April 2024

DOI Publication Publication

Debiased Distribution Compression

Lingxiao Li, Raaz Dwivedi, Lester Mackey

ICML 2024 | April 2024

Publication

Provable Interactive Learning with Hindsight Instruction Feedback

Dipendra Misra, Aldo Pacchiano, Robert E. Schapire

ICML 2024 | April 2024

DOI Publication Publication

FiP: A Fixed-Point Approach for Causal Generative Modeling

M. Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma

ICML 2024 | April 2024

DOI Publication Publication

Out-of-Distribution Detection via Deep Multi-Comprehension Ensemble

Chenhui Xu, Fuxun Yu, Zirui Xu, Nathan Inkawhich, Xiang Chen

ICML 2024 | March 2024

DOI Publication Publication

Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction

He Zhang, Chang Liu, Zun Wang, Xinran wei, Siyuan Liu, Nanning Zheng, Bin Shao, Tie-Yan Liu

ICML 2024 | March 2024

DOI Publication Publication

Rethinking Generative Large Language Model Evaluation for Semantic Comprehension

Fangyun Wei, Xi Chen, Linzi Luo

ICML 2024 | March 2024

DOI Publication Publication

Scalable Online Exploration via Coverability

P. Amortila, Dylan Foster, Akshay Krishnamurthy

ICML 2024 | March 2024

DOI Publication Publication

MathScale: Scaling Instruction Tuning for Mathematical Reasoning

Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei

ICML 2024 | March 2024

DOI Publication Publication

Clifford-Steerable Convolutional Neural Networks

Maksim Zhdanov, David Ruhe, Maurice Weiler, Ana Lucic, Johannes Brandstetter, Patrick Forr'e

ICML 2024 | February 2024

DOI Publication Publication

DyVal 2: Dynamic Evaluation of Large Language Models by Meta Probing Agents

Kaijie Zhu, Jindong Wang, Qinlin Zhao, Ruochen Xu, Xing Xie

ICML 2024 | February 2024

DOI Publication Publication

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang

ICML 2024 | February 2024

Publication DOI Github

Using Left and Right Brains Together: Towards Vision and Language Planning

Jun Cen, Chenfei Wu, Xiao Liu, Sheng-Siang Yin, Yixuan Pei, Jinglong Yang, Qifeng Chen, Nan Duan, Jianguo Zhang

ICML 2024 | February 2024

DOI Publication Publication

ChemReasoner: Heuristic Search over a Large Language Model’s Knowledge Space using Quantum-Chemical Feedback

Henry W Sprueill, Carl N. Edwards, Khushbu Agarwal, Mariefel V. Olarte, Udishnu Sanyal, Conrad Johnston, Hongbin Liu, Heng Ji, Sutanay Choudhury

ICML 2024 | February 2024

DOI Publication Publication

Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models

Francesca-Zhoufan Li, Ava P. Amini, Yisong Yue, Kevin Yang, Alex Lu

ICML 2024 | February 2024

DOI Publication

DoRA: Weight-Decomposed Low-Rank Adaptation

Shih-yang Liu, Chien-Yi Wang, Hongxu Yin, Pavlo Molchanov, Yu-Chiang Frank Wang, Kwang-Ting Cheng, Min-Hung Chen

ICML 2024 | February 2024

DOI Publication Publication

Efficient Contextual Bandits with Uninformed Feedback Graphs

Mengxiao Zhang, Yuheng Zhang, Haipeng Luo, Paul Mineiro

ICML 2024 | February 2024

DOI Publication Publication

Understanding the Training Speedup from Sampling with Approximate Losses

Rudrajit Das, Xi Chen, Bertram Ieong, Parikshit Bansal, Sujay Sanghavi

ICML 2024 | February 2024

DOI Publication Publication

Premier-TACO is a Few-Shot Policy Learner: Pretraining Multitask Representation via Temporal Action-Driven Contrastive Loss

Ruijie Zheng, Yongyuan Liang, Xiyao Wang, Shuang Ma, Hal Daumé III, Huazhe Xu, John Langford, Praveen Palanisamy, Kalyan Shankar Basu, Furong Huang

ICML 2024 | February 2024

DOI Publication Publication

Open-Vocabulary Calibration for Vision-Language Models

Shuoyuan Wang, Jindong Wang, Guoqing Wang, Bob Zhang, Kaiyang Zhou, Hongxin Wei

ICML 2024 | February 2024

DOI Publication Publication

Tag-LLM: Repurposing General-Purpose LLMs for Specialized Domains

Junhong Shen, Neil Tenenholtz, James Hall, David Alvarez-Melis, Nicolo Fusi

ICML 2024 | February 2024

DOI Publication Publication

HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal

Mantas Mazeika, Long Phan, Xuwang Yin, Andy Zou, Zifan Wang, Norman Mu, Elham Sakhaee, Nathaniel Li, Steven Basart, Bo Li, David Forsyth, Dan Hendrycks

ICML 2024 | February 2024

DOI Publication Publication

DistiLLM: Towards Streamlined Distillation for Large Language Models

Jongwoo Ko, Sungnyun Kim, Tianyi Chen, Se-Young Yun

ICML 2024 | February 2024

DOI Publication Publication

AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Calls

Yu Du, Fangyun Wei, Hongyang Zhang

ICML 2024 | February 2024

DOI Publication Publication

Mission Critical – Satellite Data is a Distinct Modality in Machine Learning

Esther Rolf, Konstantin Klemmer, Caleb Robinson, Hannah Kerner

ICML 2024 | February 2024

DOI Publication Publication

Efficient and Effective Time-Series Forecasting with Spiking Neural Networks

Changze Lv, Yansen Wang, Dongqi Han, Xiaoqing Zheng, Xuanjing Huang, Dongsheng Li

ICML 2024 | February 2024

DOI Publication Github

A General Framework for Learning from Weak Supervision

Hao Chen, Jindong Wang, Lei Feng, Xiang Li, Yidong Wang, Xing Xie, Masashi Sugiyama, Rita Singh, Bhiksha Raj

ICML 2024 | February 2024

DOI Publication Publication

StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis

Zecheng Tang, Chenfei Wu, Zekai Zhang, Mingheng Ni, Sheng-Siang Yin, Yu Liu, Zhengyuan Yang, Lijuan Wang, Zicheng Liu, Juntao Li, Nan Duan

ICML 2024 | January 2024

DOI Publication Publication

EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty

Yuhui Li, Fangyun Wei, Chao Zhang, Hongyang Zhang, Fangyun Wei

ICML 2024 | January 2024

DOI Publication Publication

Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation

Haoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan, Lingfeng Shen, Benjamin Van Durme, Kenton Murray, Young Jin Kim

ICML 2024 | January 2024

DOI Publication Publication

TrustLLM: Trustworthiness in Large Language Models

Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao

ICML 2024 | January 2024

DOI Publication Publication

Principled Gradient-based Markov Chain Monte Carlo for Text Generation

Li Du, Afra Amini, Lucas Torroba Hennigen, Xinyan Velocity Yu, Jason Eisner, Holden Lee, Ryan Cotterell

ICML 2024 | December 2023

DOI Publication Publication

The Good, The Bad, and Why: Unveiling Emotions in Generative AI

Cheng Li, Jindong Wang, Yixuan Zhang, Kaijie Zhu, Xinyi Wang, Wenxin Hou, Jianxun Lian, Fang Luo, Qiang Yang, Xing Xie

ICML 2024 | December 2023

DOI Publication Publication

Improved Differentially Private and Lazy Online Convex Optimization

Naman Agarwal, Satyen Kale, Karan Singh, Abhradeep Thakurta

ICML 2024 | December 2023

DOI Publication Publication

PcLast: Discovering Plannable Continuous Latent States

Anurag Koul, Shivakanth Sujit, Shaoru Chen, Ben Evans, Lili Wu, Byron Xu, Rajan Chari, Riashat Islam, Raihan Seraj, Yonathan Efroni, Lekan Molu, Miro Dudík, John Langford, Alex Lamb

ICML 2024 | November 2023

DOI Publication Publication

CompeteAI: Understanding the Competition Behaviors in Large Language Model-based Agents

Qinlin Zhao, Jindong Wang, Yixuan Zhang, Yiqiao Jin, Kaijie Zhu, Hao Chen, Xing Xie

ICML 2024 | October 2023

DOI Publication Publication

HumanTOMATO: Text-aligned Whole-body Motion Generation

Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing-de Lin, Ruimao Zhang, Lei Zhang, Heung-Yeung Shum

ICML 2024 | October 2023

DOI Publication Publication

UniAudio: An Audio Foundation Model Toward Universal Audio Generation

Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Xixin Wu, Zhou Zhao, Helen Meng

ICML 2024 | September 2023

DOI Publication Publication PDF

Towards Causal Foundation Model: on Duality between Causal Inference and Attention

Jiaqi Zhang, Joel Jennings, Cheng Zhang, Chao Ma

ICML 2024 | September 2023

DOI Publication Publication Publication

Completing Visual Objects via Bridging Generation and Segmentation

Xiang Li, Yinpeng Chen, Chung-Ching Lin, Rita Singh, Bhiksha Raj, Lijuan Wang, Zicheng Liu

IMCL 2024 | September 2023

DOI Publication PDF Publication

Breaking through the learning plateaus of in-context learning in Transformer

Jingwen Fu, T. Yang, Yuwang Wang, Yan Lu, Nanning Zheng

ICML 2024 | September 2023

Publication

MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities

Weihao Yu, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Zicheng Liu, Xinchao Wang, Lijuan Wang

ICML 2024 | August 2023

DOI Publication PDF Publication

Safe Exploration in Dose Finding Clinical Trials with Heterogeneous Participants

Isabel Chien, Richard Turner, Javier González

ICML 2024 | July 2023

DOI Publication

MGit: A Model Versioning and Management System

Wei Hao, Daniel Mendoza, Rafael da Silva, Deepak Narayanan, Amar Phanishayee

ICML 2024 | July 2023

DOI Publication PDF Publication

Selective Mixup Helps with Distribution Shifts, But Not (Only) because of Mixup

Damien Teney, Jindong Wang, Ehsan Abbasnejad

ICML 2024 | May 2023

DOI Publication Publication PDF

Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling

Weijia Xu, Andrzej Banburski-Fahey, Nebojsa Jojic

ICML 2024 | May 2023

DOI Publication Publication PDF

Stealing Part of a Production Language Model

Nicholas Carlini, Daniel Paleka, Krishnamurthy Dj Dvijotham, Thomas Steinke, Jonathan Hayase, A. Feder Cooper, Katherine Lee, Matthew Jagielski, Milad Nasr, Arthur Conmy, Itay Yona, Eric Wallace, David Rolnick, Florian Tramèr

ICML 2024 | July 2024

Best Paper

Publication

Intersecting-Boundary-Sensitive Fingerprinting for Tampering Detection of DNN Models

Bin Benjamin Zhu

2024 International Conference on Machine Learning | July 2024

Publication

Differentially Private Synthetic Data via Foundation Model APIs 2: Text

Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin

ICML 2024 | July 2024

Spotlight

Publication プロジェクト

Intersecting-Boundary-Sensitive Fingerprinting for Tampering Detection of DNN Models

Bin Benjamin Zhu

2024 International Conference on Machine Learning | July 2024

Publication

OAK: Enriching Document Representations using Auxiliary Knowledge for Extreme Classification

Shikhar Mohan, Deepak Saini, Anshul Mittal, Sayak Roy Chowdhury, Bhawna Paliwal, Jian Jiao, Manish Gupta, Manik Varma

2024 International Conference on Machine Learning | July 2024

Publication

Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and Beyond

Xutong Liu, Siwei Wang, Jinhang Zuo, Han Zhong, Xuchuang Wang, Zhiyong Wang, Shuai Li, Mohammad Hajiesmaili, John C.S. Lui, Wei Chen

Proceedings of the 41st International Conference on Machine Learning (ICML) | July 2024

PDF

Differentially Private Synthetic Data via Foundation Model APIs 2: Text

Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin

ICML 2024 | July 2024

Spotlight

Publication プロジェクト

Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problems

Yifan Xia, Xianliang Yang, Zichuan Liu, Zhihao Liu, Lei Song, Jiang Bian

2024 International Conference on Machine Learning | June 2024

PDF

NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models

Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao

ICML | June 2024

Publication

Integrated Hardware Architecture and Device Placement Search

Irene Wang, Jakub Tarnawski, Amar Phanishayee, Divya Mahajan

2024 International Conference on Machine Learning | July 2024

Publication PDF プロジェクト

DéjàVu: KV-cache Streaming for Fast, Fault-tolerant Generative LLM Serving

Foteini Strati, Sara Mcallister, Amar Phanishayee, Jakub Tarnawski, Ana Klimovic

ICML 2024 | July 2024

DOI PDF Publication PDF プロジェクト

Safe Exploration in Dose Finding Clinical Trials with Heterogeneous Participants

Isabel Chien, Richard Turner, Javier González

ICML 2024 | July 2023

DOI Publication

Differentially Private Synthetic Data via Foundation Model APIs 2: Text

Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin

ICML 2024 | July 2024

Spotlight

Publication プロジェクト

MathScale: Scaling Instruction Tuning for Mathematical Reasoning

Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei

ICML 2024 | March 2024

DOI Publication Publication

HumanTOMATO: Text-aligned Whole-body Motion Generation

Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing-de Lin, Ruimao Zhang, Lei Zhang, Heung-Yeung Shum

ICML 2024 | October 2023

DOI Publication Publication

Provable Risk-Sensitive Distributional Reinforcement Learning with General Function Approximation

Yu Chen, Xiangcheng Zhang, Siwei Wang, Longbo Huang

ICML 2024 | July 2024

DOI Publication Publication

Integrated Hardware Architecture and Device Placement Search

Irene Wang, Jakub Tarnawski, Amar Phanishayee, Divya Mahajan

2024 International Conference on Machine Learning | July 2024

Publication PDF プロジェクト

DéjàVu: KV-cache Streaming for Fast, Fault-tolerant Generative LLM Serving

Foteini Strati, Sara Mcallister, Amar Phanishayee, Jakub Tarnawski, Ana Klimovic

ICML 2024 | July 2024

DOI PDF Publication PDF プロジェクト

Stealing Part of a Production Language Model

Nicholas Carlini, Daniel Paleka, Krishnamurthy Dj Dvijotham, Thomas Steinke, Jonathan Hayase, A. Feder Cooper, Katherine Lee, Matthew Jagielski, Milad Nasr, Arthur Conmy, Itay Yona, Eric Wallace, David Rolnick, Florian Tramèr

ICML 2024 | July 2024

Best Paper

Publication

Intersecting-Boundary-Sensitive Fingerprinting for Tampering Detection of DNN Models

Bin Benjamin Zhu

2024 International Conference on Machine Learning | July 2024

Publication

Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and Beyond

Xutong Liu, Siwei Wang, Jinhang Zuo, Han Zhong, Xuchuang Wang, Zhiyong Wang, Shuai Li, Mohammad Hajiesmaili, John C.S. Lui, Wei Chen

Proceedings of the 41st International Conference on Machine Learning (ICML) | July 2024

PDF

Language-guided Skill Learning with Temporal Variational Inference

Haotian Fu, Pratyusha Sharma, Elias Stengel-Eskin, George Konidaris, Nicolas Le Roux, Marc-Alexandre Côté, Xingdi Yuan

ICML 2024 | July 2024

DOI Publication Publication

OAK: Enriching Document Representations using Auxiliary Knowledge for Extreme Classification

Shikhar Mohan, Deepak Saini, Anshul Mittal, Sayak Roy Chowdhury, Bhawna Paliwal, Jian Jiao, Manish Gupta, Manik Varma

2024 International Conference on Machine Learning | July 2024

Publication

How Far Can Fairness Constraints Help Recover From Biased Data?

Mohit Sharma, Amit Deshpande

ICML 2024 | July 2024

DOI Publication Publication

Differentially Private Synthetic Data via Foundation Model APIs 2: Text

Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin

ICML 2024 | July 2024

Spotlight

Publication プロジェクト

Submodular Framework for Structured-Sparse Optimal Transport

Piyushi Manupriya, Pratik Jawanpuria, Karthik S. Gurumoorthy, S. Jagarlapudi, Bamdev Mishra

ICML 2024 | June 2024

Publication

PRISE: LLM-Style Sequence Compression for Learning Temporal Action Abstractions in Control

Ruijie Zheng, Ching-An Cheng, Hal Daumé III, Furong Huang, Andrey Kolobov

ICML 2024 | June 2024

ORAL

Publication

Safe and Robust Subgame Exploitation in Imperfect Information Games

Zhenxing Ge, Zheng Xu, Tianyu Ding, Linjian Meng, Bo An, Wenbin Li, Yang Gao

ICML 2024 | June 2024

Publication

Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective

Fabian Falck, Ziyu Wang, Chris Holmes

ICML 2024 | June 2024

Publication

Riemannian coordinate descent algorithms on matrix manifolds

Andi Han, Pratik Jawanpuria, Bamdev Mishra

ICML 2024 | June 2024

Publication

Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problems

Yifan Xia, Xianliang Yang, Zichuan Liu, Zhihao Liu, Lei Song, Jiang Bian

2024 International Conference on Machine Learning | June 2024

PDF

NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models

Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao

ICML | June 2024

Publication

Think Before You Act: Decision Transformers with Internal Working Memory

Jikun Kang, Romain Laroche, Xingdi Yuan, Adam Trischler, Xuefei Liu, Jie Fu

ICML 2024 | May 2024

DOI Publication Publication

Towards Modular LLMs by Building and Reusing a Library of LoRAs

O. Ostapenko, Zhan Su, E. Ponti, Laurent Charlin, Nicolas Le Roux, Matheus Pereira, Lucas Caccia, Alessandro Sordoni

ICML 2024 | May 2024

Publication

TimeX++: Learning Time-Series Explanations with Information Bottleneck

Zichuan Liu, Tianchun Wang, Jimeng Shi, Xu Zheng, Zhuomin Chen, Lei Song, Wenqian Dong, J. Obeysekera, Farhad Shirani, Dongsheng Luo

ICML 2024 | May 2024

Publication

Generalizing Knowledge Graph Embedding with Universal Orthogonal Parameterization

Rui Li, Chaozhuo Li, Yanming Shen, Zeyu Zhang, Xu Chen

ICML 2024 | May 2024

Publication

Precise Accuracy / Robustness Tradeoffs in Regression: Case of General Norms

Elvis Dohmatob, Meyer Scetbon

ICML 2024 | May 2024

DOI Publication Publication PDF

A Fixed-Point Approach for Causal Generative Modeling

Meyer Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma

ICML 2024 | May 2024

DOI Publication Publication

Provably Robust DPO: Aligning Language Models with Noisy Feedback

Sayak Ray Chowdhury, Anush Kini, Nagarajan Natarajan

ICML 2024 | May 2024

Publication

Token-level Direct Preference Optimization

Yongcheng Zeng, Guoqing Liu, Weiyu Ma, Ning Yang, Haifeng Zhang, Jun Wang

ICML 2024 | April 2024

DOI Publication Publication

Debiased Distribution Compression

Lingxiao Li, Raaz Dwivedi, Lester Mackey

ICML 2024 | April 2024

Publication

Provable Interactive Learning with Hindsight Instruction Feedback

Dipendra Misra, Aldo Pacchiano, Robert E. Schapire

ICML 2024 | April 2024

DOI Publication Publication

FiP: A Fixed-Point Approach for Causal Generative Modeling

M. Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma

ICML 2024 | April 2024

DOI Publication Publication

Out-of-Distribution Detection via Deep Multi-Comprehension Ensemble

Chenhui Xu, Fuxun Yu, Zirui Xu, Nathan Inkawhich, Xiang Chen

ICML 2024 | March 2024

DOI Publication Publication

Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction

He Zhang, Chang Liu, Zun Wang, Xinran wei, Siyuan Liu, Nanning Zheng, Bin Shao, Tie-Yan Liu

ICML 2024 | March 2024

DOI Publication Publication

Rethinking Generative Large Language Model Evaluation for Semantic Comprehension

Fangyun Wei, Xi Chen, Linzi Luo

ICML 2024 | March 2024

DOI Publication Publication

Scalable Online Exploration via Coverability

P. Amortila, Dylan Foster, Akshay Krishnamurthy

ICML 2024 | March 2024

DOI Publication Publication

MathScale: Scaling Instruction Tuning for Mathematical Reasoning

Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei

ICML 2024 | March 2024

DOI Publication Publication

Clifford-Steerable Convolutional Neural Networks

Maksim Zhdanov, David Ruhe, Maurice Weiler, Ana Lucic, Johannes Brandstetter, Patrick Forr'e

ICML 2024 | February 2024

DOI Publication Publication

DyVal 2: Dynamic Evaluation of Large Language Models by Meta Probing Agents

Kaijie Zhu, Jindong Wang, Qinlin Zhao, Ruochen Xu, Xing Xie

ICML 2024 | February 2024

DOI Publication Publication

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang

ICML 2024 | February 2024

Publication DOI Github

Using Left and Right Brains Together: Towards Vision and Language Planning

Jun Cen, Chenfei Wu, Xiao Liu, Sheng-Siang Yin, Yixuan Pei, Jinglong Yang, Qifeng Chen, Nan Duan, Jianguo Zhang

ICML 2024 | February 2024

DOI Publication Publication

ChemReasoner: Heuristic Search over a Large Language Model’s Knowledge Space using Quantum-Chemical Feedback

Henry W Sprueill, Carl N. Edwards, Khushbu Agarwal, Mariefel V. Olarte, Udishnu Sanyal, Conrad Johnston, Hongbin Liu, Heng Ji, Sutanay Choudhury

ICML 2024 | February 2024

DOI Publication Publication

Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models

Francesca-Zhoufan Li, Ava P. Amini, Yisong Yue, Kevin Yang, Alex Lu

ICML 2024 | February 2024

DOI Publication

DoRA: Weight-Decomposed Low-Rank Adaptation

Shih-yang Liu, Chien-Yi Wang, Hongxu Yin, Pavlo Molchanov, Yu-Chiang Frank Wang, Kwang-Ting Cheng, Min-Hung Chen

ICML 2024 | February 2024

DOI Publication Publication

Efficient Contextual Bandits with Uninformed Feedback Graphs

Mengxiao Zhang, Yuheng Zhang, Haipeng Luo, Paul Mineiro

ICML 2024 | February 2024

DOI Publication Publication

Understanding the Training Speedup from Sampling with Approximate Losses

Rudrajit Das, Xi Chen, Bertram Ieong, Parikshit Bansal, Sujay Sanghavi

ICML 2024 | February 2024

DOI Publication Publication

Premier-TACO is a Few-Shot Policy Learner: Pretraining Multitask Representation via Temporal Action-Driven Contrastive Loss

Ruijie Zheng, Yongyuan Liang, Xiyao Wang, Shuang Ma, Hal Daumé III, Huazhe Xu, John Langford, Praveen Palanisamy, Kalyan Shankar Basu, Furong Huang

ICML 2024 | February 2024

DOI Publication Publication

Open-Vocabulary Calibration for Vision-Language Models

Shuoyuan Wang, Jindong Wang, Guoqing Wang, Bob Zhang, Kaiyang Zhou, Hongxin Wei

ICML 2024 | February 2024

DOI Publication Publication

Tag-LLM: Repurposing General-Purpose LLMs for Specialized Domains

Junhong Shen, Neil Tenenholtz, James Hall, David Alvarez-Melis, Nicolo Fusi

ICML 2024 | February 2024

DOI Publication Publication

HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal

Mantas Mazeika, Long Phan, Xuwang Yin, Andy Zou, Zifan Wang, Norman Mu, Elham Sakhaee, Nathaniel Li, Steven Basart, Bo Li, David Forsyth, Dan Hendrycks

ICML 2024 | February 2024

DOI Publication Publication

DistiLLM: Towards Streamlined Distillation for Large Language Models

Jongwoo Ko, Sungnyun Kim, Tianyi Chen, Se-Young Yun

ICML 2024 | February 2024

DOI Publication Publication

AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Calls

Yu Du, Fangyun Wei, Hongyang Zhang

ICML 2024 | February 2024

DOI Publication Publication

Mission Critical – Satellite Data is a Distinct Modality in Machine Learning

Esther Rolf, Konstantin Klemmer, Caleb Robinson, Hannah Kerner

ICML 2024 | February 2024

DOI Publication Publication

Efficient and Effective Time-Series Forecasting with Spiking Neural Networks

Changze Lv, Yansen Wang, Dongqi Han, Xiaoqing Zheng, Xuanjing Huang, Dongsheng Li

ICML 2024 | February 2024

DOI Publication Github

A General Framework for Learning from Weak Supervision

Hao Chen, Jindong Wang, Lei Feng, Xiang Li, Yidong Wang, Xing Xie, Masashi Sugiyama, Rita Singh, Bhiksha Raj

ICML 2024 | February 2024

DOI Publication Publication

StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis

Zecheng Tang, Chenfei Wu, Zekai Zhang, Mingheng Ni, Sheng-Siang Yin, Yu Liu, Zhengyuan Yang, Lijuan Wang, Zicheng Liu, Juntao Li, Nan Duan

ICML 2024 | January 2024

DOI Publication Publication

EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty

Yuhui Li, Fangyun Wei, Chao Zhang, Hongyang Zhang, Fangyun Wei

ICML 2024 | January 2024

DOI Publication Publication

Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation

Haoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan, Lingfeng Shen, Benjamin Van Durme, Kenton Murray, Young Jin Kim

ICML 2024 | January 2024

DOI Publication Publication

TrustLLM: Trustworthiness in Large Language Models

Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao

ICML 2024 | January 2024

DOI Publication Publication

Principled Gradient-based Markov Chain Monte Carlo for Text Generation

Li Du, Afra Amini, Lucas Torroba Hennigen, Xinyan Velocity Yu, Jason Eisner, Holden Lee, Ryan Cotterell

ICML 2024 | December 2023

DOI Publication Publication

The Good, The Bad, and Why: Unveiling Emotions in Generative AI

Cheng Li, Jindong Wang, Yixuan Zhang, Kaijie Zhu, Xinyi Wang, Wenxin Hou, Jianxun Lian, Fang Luo, Qiang Yang, Xing Xie

ICML 2024 | December 2023

DOI Publication Publication

Improved Differentially Private and Lazy Online Convex Optimization

Naman Agarwal, Satyen Kale, Karan Singh, Abhradeep Thakurta

ICML 2024 | December 2023

DOI Publication Publication

PcLast: Discovering Plannable Continuous Latent States

Anurag Koul, Shivakanth Sujit, Shaoru Chen, Ben Evans, Lili Wu, Byron Xu, Rajan Chari, Riashat Islam, Raihan Seraj, Yonathan Efroni, Lekan Molu, Miro Dudík, John Langford, Alex Lamb

ICML 2024 | November 2023

DOI Publication Publication

CompeteAI: Understanding the Competition Behaviors in Large Language Model-based Agents

Qinlin Zhao, Jindong Wang, Yixuan Zhang, Yiqiao Jin, Kaijie Zhu, Hao Chen, Xing Xie

ICML 2024 | October 2023

DOI Publication Publication

HumanTOMATO: Text-aligned Whole-body Motion Generation

Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing-de Lin, Ruimao Zhang, Lei Zhang, Heung-Yeung Shum

ICML 2024 | October 2023

DOI Publication Publication

UniAudio: An Audio Foundation Model Toward Universal Audio Generation

Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Xixin Wu, Zhou Zhao, Helen Meng

ICML 2024 | September 2023

DOI Publication Publication PDF

Towards Causal Foundation Model: on Duality between Causal Inference and Attention

Jiaqi Zhang, Joel Jennings, Cheng Zhang, Chao Ma

ICML 2024 | September 2023

DOI Publication Publication Publication

Completing Visual Objects via Bridging Generation and Segmentation

Xiang Li, Yinpeng Chen, Chung-Ching Lin, Rita Singh, Bhiksha Raj, Lijuan Wang, Zicheng Liu

IMCL 2024 | September 2023

DOI Publication PDF Publication

Breaking through the learning plateaus of in-context learning in Transformer

Jingwen Fu, T. Yang, Yuwang Wang, Yan Lu, Nanning Zheng

ICML 2024 | September 2023

Publication

MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities

Weihao Yu, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Zicheng Liu, Xinchao Wang, Lijuan Wang

ICML 2024 | August 2023

DOI Publication PDF Publication

Safe Exploration in Dose Finding Clinical Trials with Heterogeneous Participants

Isabel Chien, Richard Turner, Javier González

ICML 2024 | July 2023

DOI Publication

MGit: A Model Versioning and Management System

Wei Hao, Daniel Mendoza, Rafael da Silva, Deepak Narayanan, Amar Phanishayee

ICML 2024 | July 2023

DOI Publication PDF Publication

Selective Mixup Helps with Distribution Shifts, But Not (Only) because of Mixup

Damien Teney, Jindong Wang, Ehsan Abbasnejad

ICML 2024 | May 2023

DOI Publication Publication PDF

Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling

Weijia Xu, Andrzej Banburski-Fahey, Nebojsa Jojic

ICML 2024 | May 2023

DOI Publication Publication PDF