Publications

Prin Phunyaphibarn, Junghyun Lee, Bohan Wang, Huishuai Zhang, Chulhee Yun. Large Catapults in Momentum Gradient Descent with Warmup: An Empirical Study. arXiv preprint, early version at NeurIPS 2023 Workshop on Mathematics of Modern Machine Learning (Oral), 2024.
arXiv
Jaewook Lee, Hanseul Cho, Chulhee Yun. Fundamental Benefit of Alternating Updates in Minimax Optimization. ICML 2024, early version at ICLR 2024 Workshop on Bridging the Gap Between Practice and Theory in Deep Learning, 2024.
arXiv
Kwangjun Ahn, Xiang Cheng, Minhak Song, Chulhee Yun, Suvrit Sra, Ali Jadbabaie. Linear attention is (maybe) all you need (to understand transformer optimization). ICLR 2024, short version at NeurIPS 2023 Workshop on Mathematics of Modern Machine Learning (Oral), 2023.
Paper arXiv
Junghyun Lee, Hanseul Cho, Se-Young Yun, Chulhee Yun. Fair Streaming Principal Component Analysis: Statistical and Algorithmic Viewpoint. NeurIPS 2023, 2023.
Paper arXiv
Minhak Song, Chulhee Yun. Trajectory Alignment: Understanding the Edge of Stability Phenomenon via Bifurcation Theory. NeurIPS 2023, 2023.
Paper arXiv
Hojoon Lee, Hanseul Cho, Hyunseung Kim, Daehoon Gwak, Joonkee Kim, Jaegul Choo, Se-Young Yun, Chulhee Yun. PLASTIC: Improving Input and Label Plasticity for Sample Efficient Reinforcement Learning. NeurIPS 2023, 2023.
Paper arXiv
Dongkuk Si, Chulhee Yun. Practical Sharpness-Aware Minimization Cannot Converge All the Way to Optima. NeurIPS 2023 (Spotlight), 2023.
Paper arXiv
Junsoo Oh, Chulhee Yun. Provable Benefit of Mixup for Finding Optimal Decision Boundaries. ICML 2023, 2023.
Paper arXiv
Jaeyoung Cha, Jaewook Lee, Chulhee Yun. Tighter Lower Bounds for Shuffling SGD: Random Permutations and Beyond. ICML 2023 (Oral), 2023.
Paper arXiv
David X. Wu, Chulhee Yun, Suvrit Sra. On the Training Instability of Shuffling SGD with Batch Normalization. ICML 2023, 2023.
Paper arXiv
Hanseul Cho, Chulhee Yun. SGDA with shuffling: faster convergence for nonconvex-PŁ minimax optimization. ICLR 2023, 2022.
Paper arXiv
Chulhee Yun, Shashank Rajput, Suvrit Sra. Minibatch vs Local SGD with Shuffling: Tight Convergence Bounds and Beyond. ICLR 2022 (Oral), 2022.
Paper arXiv
Chulhee Yun, Suvrit Sra, Ali Jadbabaie. Open Problem: Can Single-Shuffle SGD be Better than Reshuffling SGD and GD?. COLT 2021, 2021.
Paper Long version
Sejun Park, Jaeho Lee, Chulhee Yun, Jinwoo Shin. Provable Memorization via Deep Neural Networks using Sub-linear Parameters. COLT 2021, 2021.
Paper arXiv
Chulhee Yun, Shankar Krishnan, Hossein Mobahi. A Unifying View on Implicit Bias in Training Linear Neural Networks. ICLR 2021, short version at NeurIPS 2020 Workshop on Optimization for Machine Learning (OPT 2020), 2021.
Paper arXiv
Sejun Park, Chulhee Yun, Jaeho Lee, Jinwoo Shin. Minimum Width for Universal Approximation. ICLR 2021 (Spotlight), 2021.
Paper arXiv
Kwangjun Ahn, Chulhee Yun, Suvrit Sra. SGD with shuffling: optimal rates without component convexity and large epoch requirements. NeurIPS 2020 (Spotlight), 2020.
Paper arXiv
Chulhee Yun, Yin-Wen Chang, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar. $O(n)$ Connections are Expressive Enough: Universal Approximability of Sparse Transformers. NeurIPS 2020, 2020.
Paper arXiv
Srinadh Bhojanapalli, Chulhee Yun, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar. Low-Rank Bottleneck in Multi-head Attention Models. ICML 2020, 2020.
Paper arXiv
Chulhee Yun, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar. Are Transformers universal approximators of sequence-to-sequence functions?. ICLR 2020, short version at NeurIPS 2019 Workshop on Machine Learning with Guarantees, 2020.
Paper arXiv
Chulhee Yun, Suvrit Sra, Ali Jadbabaie. Are deep ResNets provably better than linear predictors?. NeurIPS 2019, 2019.
Paper arXiv
Chulhee Yun, Suvrit Sra, Ali Jadbabaie. Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity. NeurIPS 2019 (Spotlight), 2019.
Paper arXiv
Chulhee Yun, Suvrit Sra, Ali Jadbabaie. Efficiently testing local optimality and escaping saddles for ReLU networks. ICLR 2019, 2019.
Paper arXiv
Chulhee Yun, Suvrit Sra, Ali Jadbabaie. Small nonlinearities in activation functions create bad local minima in neural networks. ICLR 2019, 2019.
Paper arXiv
John Duchi, Feng Ruan, Chulhee Yun. Minimax Bounds on Stochastic Batched Convex Optimization. COLT 2018, 2018.
Paper
Chulhee Yun, Suvrit Sra, Ali Jadbabaie. Global optimality conditions for deep neural networks. ICLR 2018, short version at NIPS 2017 Workshop on Deep Learning: Bridging Theory and Practice, 2018.
Paper arXiv
Chulhee Yun, Donghoon Lee, Chang D. Yoo. Face detection using Local Hybrid Patterns. ICASSP 2015, 2015.
Paper