Publications

This section contains publications published by ISI over the past several decades.

2022

NewsEdits: A News Article Revision Dataset and a Document-Level Reasoning Challenge

Alexander Spangher, Xiang Ren, Jonathan May, Nanyun Peng
arXiv preprint arXiv:2206.07106,  2022

Beyond the imitation game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang, Alicia Parrish, Allen Nie, Aman Hussain, Amanda Askell, Amanda Dsouza, Ambrose Slone, Ameet Rahane, Anantharaman S Iyer, Anders Andreassen, Andrea Madotto, Andrea Santilli, Andreas Stuhlmüller, Andrew Dai, Andrew La, Andrew Lampinen, Andy Zou, Angela Jiang, Angelica Chen, Anh Vuong, Animesh Gupta, Anna Gottardi, Antonio Norelli, Anu Venkatesh, Arash Gholamidavoodi, Arfa Tabassum, Arul Menezes, Arun Kirubarajan, Asher Mullokandov, Ashish Sabharwal, Austin Herrick, Avia Efrat, Aykut Erdem, Ayla Karakaş, B Ryan Roberts, Bao Sheng Loe, Barret Zoph, Bartłomiej Bojanowski, Batuhan Özyurt, Behnam Hedayatnia, Behnam Neyshabur, Benjamin Inden, Benno Stein, Berk Ekmekci, Bill Yuchen Lin, Blake Howald, Bryan Orinion, Cameron Diao, Cameron Dour, Catherine Stinson, Cedrick Argueta, César Ferri Ramírez, Chandan Singh, Charles Rathkopf, Chenlin Meng, Chitta Baral, Chiyu Wu, Chris Callison-Burch, Chris Waites, Christian Voigt, Christopher D Manning, Christopher Potts, Cindy Ramirez, Clara E Rivera, Clemencia Siro, Colin Raffel, Courtney Ashcraft, Cristina Garbacea, Damien Sileo, Dan Garrette, Dan Hendrycks, Dan Kilman, Dan Roth, Daniel Freeman, Daniel Khashabi, Daniel Levy, Daniel Moseguí González, Danielle Perszyk, Danny Hernandez, Danqi Chen, Daphne Ippolito, Dar Gilboa, David Dohan, David Drakard, David Jurgens, Debajyoti Datta, Deep Ganguli, Denis Emelin, Denis Kleyko, Deniz Yuret, Derek Chen, Derek Tam, Dieuwke Hupkes, Diganta Misra, Dilyar Buzan, Dimitri Coelho Mollo, Diyi Yang, Dong-Ho Lee, Dylan Schrader, Ekaterina Shutova, Ekin Dogus Cubuk, Elad Segal, Eleanor Hagerman, Elizabeth Barnes, Elizabeth Donoway, Ellie Pavlick, Emanuele Rodola, Emma Lam, Eric Chu, Eric Tang, Erkut Erdem, Ernie Chang, Ethan A Chi, Ethan Dyer, Ethan Jerzak, Ethan Kim, Eunice Engefu Manyasi, Evgenii Zheltonozhskii, Fanyue Xia, Fatemeh Siar, Fernando Martínez-Plumed, Francesca Happé, Francois Chollet, Frieda Rong, Gaurav Mishra, Genta Indra Winata, Gerard de Melo, Germán Kruszewski, Giambattista Parascandolo, Giorgio Mariani, Gloria Wang
arXiv preprint arXiv:2206.04615,  2022

Eliciting and understanding cross-task skills with task-level mixture-of-experts

Qinyuan Ye, Juan Zha, Xiang Ren
arXiv preprint arXiv:2205.12701,  2022

Robustlr: Evaluating robustness to logical perturbation in deductive reasoning

Soumya Sanyal, Zeyi Liao, Xiang Ren
arXiv preprint arXiv:2205.12598,  2022

Machine Translation Robustness to Natural Asemantic Variation

Jacob Bremerman, Xiang Ren, Jonathan May
arXiv preprint arXiv:2205.12514,  2022

Cross-lingual lifelong learning

Meryem M'hamdi, Xiang Ren, Jonathan May
arXiv preprint arXiv:2205.11152,  2022

L-BGNN: Layerwise trained bipartite graph neural networks

Tian Xie, Chaoyang He, Xiang Ren, Cyrus Shahabi, C-C Jay Kuo
IEEE Transactions on Neural Networks and Learning Systems 34 (12), 10711-10723,  2022

Proceedings of the First Workshop on Commonsense Representation and Reasoning (CSRR 2022)

Antoine Bosselut, Xiang Li, Bill Yuchen Lin, Vered Shwartz, Bodhisattwa Prasad Majumder, Yash Kumar Lal, Rachel Rudinger, Xiang Ren, Niket Tandon, Vilém Zouhar
Proceedings of the First Workshop on Commonsense Representation and …,  2022

UniREx: A Unified Learning Framework for Language Model Rationale Extraction

Aaron Chan, Maziar Sanjabi, Lambert Mathias, Liang Tan, Shaoliang Nie, Xiaochang Peng, Xiang Ren, Hamed Firooz
arXiv preprint arXiv:2112.08802,  2022

Unsupervised Cross-Task Generalization via Retrieval Augmentation

Bill Yuchen Lin, Kangmin Tan, Chris Miller, Beiwen Tian, Xiang Ren
arXiv e-prints, arXiv: 2204.07937,  2022

Lifelong pretraining: Continually adapting language models to emerging corpora

Xisen Jin, Dejiao Zhang, Henghui Zhu, Wei Xiao, Shang-Wen Li, Xiaokai Wei, Andrew Arnold, Xiang Ren
NAACL 2022,  2022

Contextualized Scene Imagination for Generative Commonsense Reasoning

PeiFeng Wang, Jonathan Zamora, Junfeng Liu, Filip Ilievski, Muhao Chen, Xiang Ren
ICLR 2022,  2022

On the Robustness of Reading Comprehension Models to Entity Renaming

Jun Yan, Yang Xiao, Sagnik Mukherjee, Bill Yuchen Lin, Robin Jia, Xiang Ren
NAACL 2022,  2022

Sparse Distillation: Speeding Up Text Classification by Using Bigger Models

Qinyuan Ye, Madian Khabsa, Mike Lewis, Sinong Wang, Xiang Ren, Aaron Jaech
NAACL 2022,  2022

FaiRR: Faithful and Robust Deductive Reasoning over Natural Language

Soumya Sanyal, Harman Singh, Xiang Ren
ACL 2022,  2022

A Good Prompt Is Worth Millions of Parameters? Low-resource Prompt-based Learning for Vision-Language Models

Woojeong Jin, Yu Cheng, Yelong Shen, Weizhu Chen, Xiang Ren
ACL 2022,  2022

Cardiac Muscle-Cell-Based Coupled Oscillator Network for Collective Computing and Related Methods

P Zorlutuna, S Datta, JG Mir, X Ren, NS Shukla, J Ji, MK Bashar
US Patent App. 17/407,604,  2022

Electrically conductive 3D printed Ti3C2Tx MXene-PEG composite constructs for cardiac tissue engineering

Gozde Basara, Mortaza Saeidi-Javash, Xiang Ren, Gokhan Bahcecioglu, Brian C Wyatt, Babak Anasori, Yanliang Zhang, Pinar Zorlutuna
Acta biomaterialia 139, 179-189,  2022

On Continual Model Refinement in Out-of-Distribution Data Streams

Bill Yuchen Lin, Sida Wang, Xi Victoria Lin, Robin Jia, Lin Xiao, Xiang Ren, Wen-tau Yih
arXiv e-prints, arXiv: 2205.02014,  2022

FedNLP: Benchmarking federated learning models for natural language processing tasks

Bill Yuchen Lin, Chaoyang He, Zihang Zeng, Hulin Wang, Yufeng Huang, Christophe Dupuy, Rahul Gupta, Mahdi Soltanolkotab, Xiang Ren, Salman Avestimehr
2022