Private AI

FastQuery: Communication-efficient Embedding Table Query for Private LLMs inference
Chenqi Lin, Tianshi Xu, Zebin Yang, 李萌, Runsheng Wang, Ru Huang