1

MCUBERT: Memory-Efficient BERT Inference on Commodity Microcontrollers
Zebin Yang, Renze Chen, Taiqiang Wu, Ngai Wong, Yun (Eric) Liang, Runsheng Wang, Ru Huang, 李萌
论文
OSCA: End-to-end Serial Stochastic Computing Neural Acceleration with Fine-grained Scaling and Piecewise Activation
Yixuan Hu, Yikang Jia, 李萌, Yuan Wang, Runsheng Wang, Ru Huang
论文
PrivQuant: Communication-Efficient Private Inference with Quantized Network/Protocol Co-Optimization
Tianshi Xu, Shuzhang Zhong, Wenxuan Zeng, Runsheng Wang, 李萌
论文
ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding
Shuzhang Zhong, Zebin Yang, Ruihao Gong, Runsheng Wang, Ru Huang, 李萌
论文
FastQuery: Communication-efficient Embedding Table Query for Private LLMs inference
Chenqi Lin, Tianshi Xu, Zebin Yang, 李萌, Runsheng Wang, Ru Huang
论文
ASCEND: Accurate yet Efficient End-to-End Stochastic Computing Acceleration of Vision Transformer
Tong Xie, Yixuan Hu, Renjie Wei, 李萌, Runsheng Wang, Yuan Wang, Ru Huang
论文
MixCIM: A Hybrid-Cell-Based Computing-in-Memory Macro with Less-Data-Movement and Activation-Memory-Reuse for Depthwise Separable Neural Networks
Xin Qiao, Jiahao Song, Youming Yang, Renjie Wei, Xiyuan Tang, 李萌, Runsheng Wang, Yuan Wang
论文
CoPriv: Network/Protocol Co-Optimization for Communication-Efficient Private Inference
A network–protocol co-optimization framework for reducing the communication overhead of secure private inference.
Wenxuan Zeng, 李萌, Haichuan Yang, Wen-Jie Lu, Runsheng Wang, Ru Huang
论文
Falcon: Accelerating Homomorphically Encrypted Convolutions for Efficient Private Mobile Network Inference
Tianshi Xu, 李萌, Runsheng Wang, Ru Huang
论文
Memory-aware Scheduling for Complex Wired Networks with Iterative Graph Optimization
Shuzhang Zhong, 李萌, Yun (Eric) Liang, Runsheng Wang, Ru Huang
论文