Publications

Cauchy: A Cost-Efficient LLM Serving System through Adaptive Heterogeneous Deployment

Published in ACM Symposium on Cloud Computing (SoCC), 2025

Recommended citation: @inproceedings{zhang2025cauchy, title={Cauchy: A Cost-Efficient LLM Serving System through Adaptive Heterogeneous Deployment}, author={Zhang, Yihui and Shen, Han and Yang, Renyu and Tian, Di and Luo, Yuxi and Zhang, Menghao and Li, Li and Hu, Chunming and Wo, Tianyu and Song, Chengru and others}, booktitle={Proceedings of the 2025 ACM Symposium on Cloud Computing}, pages={881--893}, year={2025} } https://doi.org/10.1145/3772052.3772264