MPCache: MPC-Friendly KV Cache Eviction for Efficient Private LLM Inference
Type
Publication
In Conference on Neural Information Processing Systems
Meng Li
Assistant Professor
I develop efficient and privacy-preserving AI systems through algorithm–hardware co-design, with applications in large language models, embodied AI, and multimodal intelligence.