Comet: Accelerating Private Inference for Large Language Model by Predicting Activation Sparsity

Guang Yan , Yuhui Zhang , Zimu Guo , Lutan Zhao , Xiaojun Chen , Chen Wang , Wenhao Wang , Dan Meng , Rui Hou