FastQuery: Communication-efficient Embedding Table Query for Private LLMs inference

Publication
In Design Automation Conference (DAC)
Chenqi Lin
PhD Student (2024)
Tianshi Xu
PhD Student (2023)
Zebin Yang
PhD Student (2024)
Meng Li
Meng Li
Assistant Professor

I develop efficient and privacy-preserving AI systems through algorithm–hardware co-design, with applications in large language models, embodied AI, and multimodal intelligence.