ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction
Type
Publication
In Conference on Neural Information Processing Systems
Meng Li
Assistant Professor
I develop efficient and privacy-preserving AI systems through algorithm–hardware co-design, with applications in large language models, embodied AI, and multimodal intelligence.