Welcome! I am currently a first-year Ph.D. student of computer science at UNC-Chapel Hill, advised by Prof. Tianlong Chen. I received my B.Eng. from USTC.

My current research interests span efficient machine learning & the interaction between ML and sciences. Recently, I am particularly interested in the Sparse Mixture-of-Experts. I also enjoy building systems and putting thoughts into reality.

To find out more, you can check out my Twitter, Last.fm, or Instagram.

Selected Publications

* = equal contribution
^ = equal supervision

Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild
Xinyu Zhao*, Guoheng Sun*, Ruisi Cai*, Yukun Zhou*, Pingzhi Li*, Peihao Wang*, Bowen Tan, Yexiao He, Li Chen, Yi Liang, Beidi Chen, Binhang Yuan, Hongyi Wang^, Ang Li^, Zhangyang Wang^, Tianlong Chen^
Conference on Neural Information Processing Systems (NeurIPS), 2024
[ PDF | Code ]

Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
Yihua Zhang*, Pingzhi Li*, Junyuan Hong*, Jiaxiang Li*, Yimeng Zhang, Wenqing Zheng, Pin-Yu Chen, Jason D. Lee, Wotao Yin, Mingyi Hong, Zhangyang Wang, Sijia Liu, Tianlong Chen
International Conference on Machine Learning (ICML), 2024
[ PDF | Code | Tutorial ]

Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy
Pingzhi Li, Zhenyu Zhang, Prateek Yadav, Yi-Lin Sung, Yu Cheng, Mohit Bansal, Tianlong Chen
International Conference on Learning Representations (ICLR), 2024 (Spotlight)
[ PDF | Code ]

Awards

Bio

I primarily grew up on east China. From 2017-2018, I studied Chinese Physics Olympiad. From 2019-2020 I studied Geophysics at USTC, until I became interested in Computer Science and changed my major to it in July 2020.

During my junior undergrad period, I had been an intern in the BDAA lab, supervised by Prof. Qi Liu and Prof. Enhong Chen. I was deeply involved in developing an opensource NLP library towards multi-modal educational items. During 2023-2024, I worked closely with Dr. Tianlong Chen as research intern at CSAIL@MIT, focusing on machine learning efficiency.

I have passions for a wide variety of fields, and I am constantly exploring new areas and possibilities. Some of my major interests include classical music (especially thanks to Ludwig van Beethoven who provides me with immense power when I'm feeling down), photography (some are on my Instagram), and swimming. Feel free to ping me if you are interested as well!

I was a member of USTC Omni Media Center, executing official social media.

CV

Here is my CV (last updated Sep 2024).