Publications
Dynamic Loss-Based Sample Reweighting For Improved Large Language Model Pretraining
Daouda Sow, Herbert Woisetschläger, Saikiran Bulusu, Shiqiang Wang, Hans Arno Jacobsen, Yingbin Liang. Dynamic Loss-Based Sample Reweighting For Improved Large Language Model Pretraining. Submitted for publication, 2024.
Take the Bull by the Horns: Hard Sample-Reweighted Continual Training Improves LLM Generalization
Xuxi Chen, Zhendong Wang, Daouda Sow, Junjie Yang, Tianlong Chen, Yingbin Liang, Mingyuan Zhou, Zhangyang Wang. “Take the Bull by the Horns: Hard Sample-Reweighted Continual Training Improves LLM Generalization”, submitted for publication, 2024.
A Novel Blackbox Instruction Optimization Approach in Low Query Regime
Daouda Sow, Atlas Wang, Yingbin Liang. A Novel Blackbox Instruction Optimization Approach in Low Query Regime, submitted for publication, 2023.
Doubly Robust Instance-Reweighted Adversarial Training
Daouda Sow, Sen Lin, Zhangyang Wang, Yingbin Liang. “Doubly Robust Instance-Reweighted Adversarial Training”, ICLR 2024.
Algorithm Design for Online Meta-Learning with Task Boundary Detection
Daouda Sow, Sen Lin, Yingbin Liang, Junshan Zhang. “Algorithm Design for Online Meta-Learning with Task Boundary Detection”, CPAL 2024.
Online Bilevel Optimization: A Single-Loop Method with Window Averaging
Sen Lin, Daouda Sow, Yingbin Liang, Ness Shroff. “Online Bilevel Optimization: A Single-Loop Method with Window Averaging”, NeurIPS 2023.
On the convergence theory for Hessian-free bilevel algorithms
Daouda Sow, Kaiyi Ji, Yingbin Liang. “On the convergence theory for Hessian-free bilevel algorithms”, Advances in Neural Information Processing Systems (NeurIPS), 2022.
A primal-dual approach to bilevel optimization with multiple inner minima
Daouda Sow, Kaiyi Ji, Ziwei Guan, Yingbin Liang. “A primal-dual approach to bilevel optimization with multiple inner minima”, submitted for publication, 2022.
A Sequential Guiding Network With Attention for Image Captioning
Daouda Sow, Zengchang Qin, Mouhamed Niasse, Tao Wan. “A Sequential Guiding Network With Attention for Image Captioning”, IEEE ICASSP 2019.