1

$O(n)$ Connections are Expressive Enough: Universal Approximability of Sparse Transformers
Chulhee Yun, Yin-Wen Chang, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar
Low-Rank Bottleneck in Multi-head Attention Models
Srinadh Bhojanapalli, Chulhee Yun, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar
Are Transformers universal approximators of sequence-to-sequence functions?
Chulhee Yun, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar
Are deep ResNets provably better than linear predictors?
Chulhee Yun, Suvrit Sra, Ali Jadbabaie
Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity
Chulhee Yun, Suvrit Sra, Ali Jadbabaie
Efficiently testing local optimality and escaping saddles for ReLU networks
Chulhee Yun, Suvrit Sra, Ali Jadbabaie
Small nonlinearities in activation functions create bad local minima in neural networks
Chulhee Yun, Suvrit Sra, Ali Jadbabaie
Minimax Bounds on Stochastic Batched Convex Optimization
John Duchi, Feng Ruan, Chulhee Yun
Global optimality conditions for deep neural networks
Chulhee Yun, Suvrit Sra, Ali Jadbabaie
Face detection using Local Hybrid Patterns
Chulhee Yun, Donghoon Lee, Chang D. Yoo