Algorithm/Software

PrivQuant: Communication-Efficient Private Inference with Quantized Network/Protocol Co-Optimization
Tianshi Xu, Shuzhang Zhong, Wenxuan Zeng, Runsheng Wang, 李萌
论文
ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding
Shuzhang Zhong, Zebin Yang, Ruihao Gong, Runsheng Wang, Ru Huang, 李萌
论文
FastQuery: Communication-efficient Embedding Table Query for Private LLMs inference
面向私有大语言模型推理的通信高效嵌入表查询方案。
Chenqi Lin, Tianshi Xu, Zebin Yang, 李萌, Runsheng Wang, Ru Huang
论文
CoPriv: Network/Protocol Co-Optimization for Communication-Efficient Private Inference
通过网络—协议协同优化降低安全私有推理的通信开销。
Wenxuan Zeng, 李萌, Haichuan Yang, Wen-Jie Lu, Runsheng Wang, Ru Huang
论文
Falcon: Accelerating Homomorphically Encrypted Convolutions for Efficient Private Mobile Network Inference
Tianshi Xu, 李萌, Runsheng Wang, Ru Huang
论文
Memory-aware Scheduling for Complex Wired Networks with Iterative Graph Optimization
Shuzhang Zhong, 李萌, Yun (Eric) Liang, Runsheng Wang, Ru Huang
论文
MPCViT: Searching for Accurate and Efficient MPC-Friendly Vision Transformer with Heterogeneous Attention
Wenxuan Zeng, 李萌, Wenjie Xiong, Tong Tong, Wen-Jie Lu, Jin Tan, Runsheng Wang, Ru Huang
论文
AVATAR: An Aging- and Variation-Aware Dynamic Timing Analyzer for Error-Efficient Computing
Zuodong Zhang, Zizheng Guo, Yibo Lin, 李萌, Runsheng Wang, Ru Huang
论文
BiT: Robustly Binarized Multi-distilled Transformer
Zechun Liu, Barlas Oguz, Aasish Pappu, Lin Xiao, Scott Yih, 李萌, Raghuraman Krishnamoorthi, Yashar Mehdad
论文
Depth Shrink: Empowering Hardware-Friendly Shallow Neural Networks
Yonggan Fu, Haichuan Yang, Jiayi Yuan, 李萌, Raghuraman Krishnamoorthi, Vikas Chandra, Yingyan Lin