Zhengyang Patrick Wang

👋 Hi

My name is Zhengyang (Patrick) Wang (王正阳). I’m a fourth-year PhD candidate in Computer Science at the University of California, Santa Barbara (UCSB), advised by Zheng Zhang. I also worked with Yuan Xie and Yufei Ding. I received my B.S. degree in Computer Science from the University of Science and Technology of China (USTC).

🔬 Research Interest

My research focuses on improving the efficiency of large-scale pre-training. I am particularly interested in distributed training performance optimization, memory management, and algorithm-system co-design.

News

Jun 29, 2026	I have started my internship at NVIDIA at End-to-End Training Team, working with Dingqing Yang 🎉🎉🎉.
Jan 26, 2026	🎉 BOOST is accepted to MLSys 2026!
Aug 20, 2025	🎉 CoLA is accepted to EMNLP 2025 as an oral!
Feb 01, 2025	I am visiting Argonne National Laboratory as a technical research aid, working with Bogdan Nicolae, Franck Cappello, and Paul Hovland 🎉🎉🎉.
Jun 24, 2024	I have started my research scientist internship at Meta AI-System Codesign Team, working with Sarunya Pumma 🎉🎉🎉.

Selected Publications

MICRO

Rm-stc: Row-merge dataflow inspired gpu sparse tensor core for energy-efficient sparse acceleration

Guyue Huang, Zhengyang Wang, Po-An Tsai, and 3 more authors

In MICRO 2023. Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, Oct 2023

Bib HTML

@inproceedings{huang2023rmstc,
  author = {Huang, Guyue and Wang, Zhengyang and Tsai, Po-An and Zhang, Chen and Ding, Yufei and Xie, Yuan},
  booktitle = {MICRO 2023. Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture},
  title = {Rm-stc: Row-merge dataflow inspired gpu sparse tensor core for energy-efficient sparse acceleration},
  year = {2023},
  month = oct,
  pages = {338--352},
}

EMNLP

Cola: Compute-efficient pre-training of llms via low-rank activation

Ziyue Liu^*, Ruijie Zhang^*, Zhengyang Wang^*, and 5 more authors

In EMNLP 2025 (oral), 2025

Bib HTML

@inproceedings{liu2025cola,
  author = {Liu, Ziyue and Zhang, Ruijie and Wang, Zhengyang and Yang, Zi and Hovland, Paul and Nicolae, Bogdan and Cappello, Franck and Zhang, Zheng},
  booktitle = {EMNLP 2025 (oral)},
  title = {Cola: Compute-efficient pre-training of llms via low-rank activation},
  year = {2025},
}

MLSys

BOOST: BOttleneck-Optimized Scalable Training Framework for Low-Rank Large Language Models

Zhengyang Wang^*, Ziyue Liu^*, Ruijie Zhang, and 5 more authors

In MLSys 2026, 2025

Bib HTML

@inproceedings{wang2025boost,
  author = {Wang, Zhengyang and Liu, Ziyue and Zhang, Ruijie and Maurya, Avinash and Hovland, Paul and Nicolae, Bogdan and Cappello, Franck and Zhang, Zheng},
  booktitle = {MLSys 2026},
  title = {BOOST: BOttleneck-Optimized Scalable Training Framework for Low-Rank Large Language Models},
  year = {2025},
}