2023
SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks
Bill Yuchen Lin, Yicheng Fu, Karina Yang, Prithviraj Ammanabrolu, Faeze Brahman, Shiyu Huang, Chandra Bhagavatula, Yejin Choi, Xiang Ren
NeurIPS 2023 (Spotlight)
Faith and Fate: Limits of Transformers on Compositionality
Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jian, Bill Yuchen Lin, Peter West, Chandra Bhagavatula, Ronan Le Bras, Jena D Hwang, Soumya Sanyal, Sean Welleck, Xiang Ren, Allyson Ettinger, Zaid Harchaoui, Yejin Choi
NeurIPS 2023 (Spotlight)
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning
Ximing Lu, Faeze Brahman, Peter West, Jaehun Jang, Khyathi Chandu, Abhilasha Ravichander, Lianhui Qin, Prithviraj Ammanabrolu, Liwei Jiang, Sahana Ramnath, Nouha Dziri, Jillian Fisher, Bill Yuchen Lin, Skyler Hallinan, Xiang Ren, Sean Welleck, Yejin Choi
EMNLP 2023
How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench
Qinyuan Ye, Harvey Yiyun Fu, Xiang Ren, Robin Jia
Findings of EMNLP 2023
Estimating Large Language Model Capabilities without Labeled Test Data
Harvey Yiyun Fu, Qinyuan Ye, Albert Xu, Xiang Ren, Robin Jia
Findings of EMNLP 2023
Exploring Distributional Shifts in Large Language Models for Code Analysis
Shushan Arakelyan, Rocktim Jyoti Das, Yi Mao, Xiang Ren
EMNLP 2023
Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidance
Jesse Zhang, Jiahui Zhang, Karl Pertsch, Ziyi Liu, Xiang Ren, Minsuk Chang, Shao-Hua Sun, Joseph J Lim
CORL 2023
KNIFE: Knowledge Distillation with Free-Text Rationales
Aaron Chan, Zhiyuan Zeng, Wyatt Lake, Brihi Joshi, Hanjie Chen, Xiang Ren
TrustML Workshop at ICLR 2023
How New Ideas Diffuse in Science
Mengjie Cheng, Daniel Scott Smith, Xiang Ren, Hancheng Cao, Sanne Smith, Daniel McFarland
American Sociological Review 2023
Self-Consistent Chain-of-Thought Distillation
Peifeng Wang, Zhengyang Wang, Zheng Li, Yifan Gao, Bing Yin, Xiang Ren
ACL 2023
ACL 2023 Outstanding Paper Award
Github
Are Machine Rationales (Not) Useful to Humans? Measuring and Improving Human Utility of Free-text Rationales
Brihi Joshi, Ziyi Liu, Sahana Ramnath, Aaron Chan, Zhewei Tong, Shaoliang Nie, Qifan Wang, Yejin Choi, Xiang Ren
ACL 2023
FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning
Qinyuan Ye, Iz Beltagy, Matthew E. Peters, Xiang Ren, Hannaneh Hajishirzi
ACL 2023
Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Step
Liunian Harold Li, Jack Hessel, Youngjae Yu, Xiang Ren, Kai-Wei Chang and Yejin Choi
ACL 2023
CoNAL: Anticipating Outliers with Large Language Models
Albert Xu, Xiang Ren, Robin Jia
ACL 2023
LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusion
Dongfu Jiang, Xiang Ren, Bill Yuchen Lin
ACL 2023
Website
APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning
Soumya Sanyal, Yichong Xu, Shuohang Wang, Ziyi Yang, Reid Pryzant, Wenhao Yu, Chenguang Zhu, Xiang Ren
ACL 2023
REV: Information-Theoretic Evaluation of Free-Text Rationales
Hanjie Chen, Faeze Brahman, Xiang Ren, Yangfeng Ji, Yejin Choi, Swabha Swayamdipta
ACL 2023
Textual Backdoor Attacks with Iterative Trigger Injection
Jun Yan, Vansh Gupta, Xiang Ren
ACL 2023
Cross-lingual Lifelong Learning
Meryem M'hamdi, Xiang Ren, Jonathan May
ACL 2023
An AI Dungeon Master's Guide: Learning to Converse and Guide with Intents and Theory-of-Mind in Dungeons and Dragons
Pei Zhou, Andrew Zhu, Jennifer Hu, Jay Pujara, Xiang Ren, Chris Callison-Burch, Yejin Choi, Prithviraj Ammanabrolu
ACL 2023
Dataless Knowledge Fusion by Merging Weights of Language Models
Xisen Jin, Xiang Ren, Daniel Preotiuc-Pietro, Pengxiang Cheng
ICLR 2023
PINTO: Faithful Language Reasoning Using Prompt-Generated Rationales
Peifeng Wang, Aaron Chan, Filip Ilievski, Muhao Chen, Xiang Ren
ICLR 2023
On Grounded Planning for Embodied Tasks with Language Models
Bill Yuchen Lin, Chengsong Huang, Qian Liu, Wenda Gu, Sam Sommerer, Xiang Ren
AAAI 2023
2022
Unsupervised Cross-Task Generalization via Retrieval Augmentation
Bill Yuchen Lin, Kangmin Tan, Chris Miller, Beiwen Tian, Xiang Ren
Conference on Neural Information Processing Systems (NeurIPS) 2022
Project
NS3: Neuro-Symbolic Semantic Code Search
Shushan Arakelyan, Anna Hakhverdyan, Miltiadis Allamanis, Christophe Hauser, Luis Antonio Garcia, Xiang Ren
Conference on Neural Information Processing Systems (NeurIPS) 2022
(Also a Spotlight at ICLR 2022 Deep Learning for Code Workshop)
Github
UniREx: A Unified Learning Framework for Language Model Rationale Extraction
Aaron Chan, Maziar Sanjabi, Lambert Mathias, Liang Tan, Shaoliang Nie, Xiaochang Peng, Xiang Ren, Hamed Firooz
ICML 2022
(Also at ICLR Workshop on Socially Responsible Machine Learning & ACL Workshop on BigScience)
Github (coming soon)
Eliciting Transferability in Multi-task Learning with Task-level Mixture-of-Experts
Qinyuan Ye, Juan Zha, Xiang Ren
Findings of EMNLP 2022
RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning
Soumya Sanyal, Zeyi Liao, Xiang Ren
EMNLP 2022
Github
ER-Test: Evaluating Explanation Regularization Methods for NLP Models
Brihi Joshi, Aaron Chan, Ziyi Liu, Shaoliang Nie, Maziar Sanjabi, Hamed Firooz, Xiang Ren
Findings of EMNLP 2022
Github
Reflect, Not Reflex: Inference-Based Common Ground Improves Dialogue Response Quality
Pei Zhou, Hyundong J. Cho, Pegah Jandaghi, Dong-Ho Lee, Bill Yuchen Lin, Jay Pujara, Xiang Ren
EMNLP 2022
Project
Machine Translation Robustness to Natural Asemantic Variation
Jacob Bremerman, Xiang Ren, Jonathan May
EMNLP 2022
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora
Xisen Jin, Dejiao Zhang, Henghui Zhu, Wei Xiao, Shang-Wen Li, Xiaokai Wei, Andrew Arnold, Xiang Ren
NAACL 2022
(also at ACL 2022 Workshop BigScience)
Github (coming soon)
Retweet-BERT: Characterizing Echo Chambers by Leveraging Language Features and Information Diffusion in Social Media
Julie Jiang, Xiang Ren, and Emilio Ferrara
ICWSM 2022
Sparse Distillation: Speeding Up Text Classification by Using Bigger Models
Qinyuan Ye, Madian Khabsa, Mike Lewis, Sinong Wang, Xiang Ren, Aaron Jaech
NAACL 2022
FedNLP: A Research Platform for Federated Learning in Natural Language Processing
Bill Yuchen Lin, Chaoyang He, Zihang Zeng, Hulin Wang, Yufen Huang, Mahdi Soltanolkotabi, Xiang Ren, Salman Avestimehr
Findings of NAACL 2022
Github
On the Robustness of Reading Comprehension Models to Entity Renaming
Jun Yan, Yang Xiao, Sagnik Mukherjee, Bill Yuchen Lin, Robin Jia, Xiang Ren
NAACL 2022
Github
NewsEdits: A Dataset of News Article Revision Histories and a Novel Document-Level Reasoning Challenge
Alexander Spangher, Xiang Ren, Jonathan May, Nanyun Peng
NAACL 2022
Outstanding Paper Award
Github
FaiRR: Faithful and Robust Deductive Reasoning over Natural Language
Soumya Sanyal, Harman Singh, Xiang Ren
ACL 2022
Github
A Good Prompt Is Worth Millions of Parameters?: Low-resource Prompt-based Learning for Vision-Language Models
Woojeong Jin, Yu Cheng, Yelong Shen, Weizhu Chen, Xiang Ren
ACL 2022
Github
Fixing Errors in the Wild: On Continual Model Refinement in Out-of-Distribution Data Streams
Bill Yuchen Lin, Sida Wang, Xi Victoria Lin, Robin Jia, Lin Xiao, Xiang Ren, Scott Yih
ACL 2022
Github (coming soon)
Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER
Dong-Ho Lee, Mahak Agarwal, Akshen Kadakia, Jay Pujara, Xiang Ren
ACL 2022
Github
Think Before You Speak: Using Self-talk to Generate Implicit Commonsense Knowledge for Response Generation
Pei Zhou, Karthik Gopalakrishnan, Behnam Hedayatnia, Seokhwan Kim, Jay Pujara, Xiang Ren, Yang Liu, Dilek Hakkani-Tur
ACL 2022
Github (coming soon)
Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-Modal Knowledge Transfer
Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren
ACL 2022
Github
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng
ACL 2022
Contextualized Scene Imagination for Generative Commonsense Reasoning
Peifeng Wang, Jonathan Zamora, Junfeng Liu, Filip Ilievski, Muhao Chen, Xiang Ren
ICLR 2022
Github
2021
Refining Language Models with Compositional Explanations
Huihan Yao, Ying Chen, Qinyuan Ye, Xisen Jin, Xiang Ren
Conference on Neural Information Processing Systems (NeurIPS) 2021
spotlight presentation
(previously at RAI @ICLR 2021)
Github
SalKG: Learning From Knowledge Graph Explanations for Commonsense Reasoning
Aaron Chan, Boyuan Long, Jiashu Xu, Soumya Sanyal, Tanishq Gupta, Xiang Ren
Conference on Neural Information Processing Systems (NeurIPS) 2021
(previously at XAI @ICML 2021)
Github
Gradient Based Memory Editing for Task-Free Continual Learning
Xisen Jin, Arka Sadhu, Junyi Du, Xiang Ren
Conference on Neural Information Processing Systems (NeurIPS) 2021
(Previously a contributed talk to LifelongML@ICML
2020)
Github
AutoTriggER: Named Entity Recognition with Auxiliary Trigger Extraction
Dong-Ho Lee*, Ravi Kiran Selvam*, Sheikh Muhammad Sarwar, Bill Yuchen Lin, Fred Morstatter,
Jay Pujara, Elizabeth Boschee, James Allan, Xiang Ren
Github (coming soon)
Best paper award at TrustNLP@ NAACL 2021
ICLR Workshop on Weakly Supervised Learning (WeaSuL @ICLR) 2021
CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP
Qinyuan Ye, Yuchen Lin, Xiang Ren
EMNLP 2021
Github
Tweet
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms
Pei Zhou, Rahul Khanna, Bill Yuchen Lin, Daniel Ho, Jay Pujara, Xiang Ren
EMNLP 2021
Project Data
Github
Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning
Xisen Jin, Bill Yuchen Lin, Mohammad Rostami, Xiang Ren
Findings of EMNLP 2021
Github
Tweet
Discretized Integrated Gradients for Explaining Language Models
Soumya Sanyal, Xiang Ren
EMNLP 2021
Github
On the Influence of Masking Policies in Intermediate Pre-training
Qinyuan Ye, Belinda Z. Li, Sinong Wang, Benjamin Bolte, Hao Ma, Wen-tau Yih, Xiang Ren, Madian Khabsa
EMNLP 2021
Lawyers are Dishonest? : Quantifying Representational Harms in Commonsense Knowledge Resources
Ninareh Mehrabi, Pei Zhou, Fred Morstatter, Jay Pujara, Xiang Ren, Aram Galstyan
EMNLP 2021
Probing Commonsense Explanation in Dialogue Response Generation
Pei Zhou, Pegah Jandaghi, Hyundong Cho, Bill Yuchen Lin, Jay Pujara, Xiang Ren
Findings of EMNLP 2021
Project
ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning
Rujun Han, Xiang Ren, Nanyun Peng
EMNLP 2021
Github
Extract, Denoise and Enforce: Evaluating and Improving Concept Preservation for Text-to-Text Generation
Yuning Mao, Wenchang Ma, Deren Lei, Jiawei Han, Xiang Ren
EMNLP 2021
Github
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation
Mozhdeh Gheini, Xiang Ren, Jonathan May
EMNLP 2021
Github
MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding
Woojeong Jin, Maziar Sanjabi, Shaoliang Nie, Liang Tan, Xiang Ren, Hamed Firooz
Findings of EMNLP 2021
RockNER: Evaluating the Robustness of Named Entity Recognition with Natural Adversarial Attacks
Bill Yuchen Lin, Wenyang Gao, Jun Yan, Ryan Moreno, Xiang Ren
EMNLP 2021 (short paper)
Project
Github
Data
Leaderboard
ForecastQA: A Question Answering Challenge for Event Forecasting
Woojeong Jin, Rahul Khanna, Suji Kim, Dong-Ho Lee, Fred Morstatter, Aram Galstyan, Xiang Ren
ACL 2021
Project
Data Explorer
Leaderboard
Tweet
Learning to Generate Task-specific Adapters from Task Description
Qinyuan Ye, Xiang Ren.
ACL 2021, short paper
Github
Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Common Sense Reasoning
Bill Yuchen Lin, Seyeon Lee, Xiaoyang Qiao, Xiang Ren.
ACL 2021
Project X-CSR
Github
Leaderboard
AdaTag: Multi-Attribute Value Extraction from Product Profiles with Adaptive Decoding
Jun Yan, Nasser Zalmout, Yan Liang, Christan Grant, Xiang Ren, Xin Luna Dong.
ACL 2021
Tweet
Learning Contextualized Knowledge Structures for Commonsense Reasoning
Jun Yan, Mrigank Raman, Aaron Chan, Tianyu Zhang, Ryan Rossi, Handong Zhao, Sungchul Kim, Nedim Lipka, Xiang Ren
Findings of ACL 2021 (An earlier version accepted to KR2ML@ NeurIPS 2020)
Github
Poster
Tweet
RiddleSense: A Challenge Dataset for Answering Riddle-Style Commonsense Questions
Bill Yuchen Lin, Ziyi Wu, Yichi Yang, Dong-Ho Lee, Xiang Ren.
Findings of ACL 2021
Project
Do Language Models Perform Generalizable Commonsense Inference?
Peifeng Wang, Filip Ilievski, Muhao Chen, Xiang Ren.
Findings of ACL 2021
Github
Semi-Automated Protocol Disambiguation and Code Generation
Jane Yen, Tamás Lévai, Qinyuan Ye, Xiang Ren, Ramesh Govindan, Barath Raghavan
Annual conference of ACM SIGCOMM (SIGCOMM) 2021
Pre-training Text-to-Text Transformers for Concept-centric Common Sense
Wangchunshu Zhou*, Dong-Ho Lee*, Ravi Kiran Selvam, Seyeon Lee, Bill Yuchen Lin, Xiang Ren
ICLR 2021
(Previous version in SSL@ NeurIPS 2020)
Project
Github
Models
Slides
Tweet
Learning to Deceive Knowledge Graph Augmented Models via Targeted Perturbation
Mrigank Raman, Aaron Chan*, Siddhant Agarwal*, Peifeng Wang, Hansen Wang, Sungchul Kim, Ryan
Rossi, Handong Zhao, Nedim Lipka, Xiang Ren
ICLR 2021
Best paper runner-up at KR2ML@ NeurIPS 2020
Github
OpenReview
Tweet
On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning
Xisen Jin, Francesco Barbieri, Brendan Kennedy, Aida Mostafazadeh Davani, Leonardo Neves, Xiang Ren
NAACL 2021
Github
Differentiable
Open-Ended Commonsense Reasoning
Bill Yuchen Lin, Haitian Sun, Bhuwan Dhingra, Manzil Zaheer, Xiang Ren, William W. Cohen
Project
Github
Slides
NAACL 2021
X-METRA-ADA: Cross-lingual Meta-Transfer learning Adaptation to Natural Language Understanding
Meryem M'hamdi, Doo Soon Kim, Franck Dernoncourt, Trung Bui, Xiang Ren, Jonathan May
NAACL 2021
Github
Video
TaxoClass: Hierarchical Multi-Label Text Classification Using Only Class Names
Jiaming Shen, Wenda Qiu, Yu Meng, Jingbo Shang, Xiang Ren, Jiawei Han
NAACL 2021
Improving Counterfactual Generation for Fair Hate Speech Detection
Aida Mostafazadeh Davani, Ali Omrani, Brendan Kennedy, Mohammad Atari, Xiang Ren, Morteza Dehghani
WOAH@NAACL 2021
IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization
Wenxuan Zhou, Bill Yuchen Lin, Xiang Ren
AAAI 2021
Github
Time-Series Event
Prediction with Evolutionary State Graph
Wenjie Hu, Yang Yang, Ziqiang Cheng, Carl Yang, Xiang Ren
WSDM 2021