Algorithm/Software

FastQuery: Communication-efficient Embedding Table Query for Private LLMs inference
Chenqi Lin, Tianshi Xu, Zebin Yang, Meng Li, Runsheng Wang, Ru Huang
Paper
CoPriv: Network/Protocol Co-Optimization for Communication-Efficient Private Inference
A network–protocol co-optimization framework for reducing the communication overhead of secure private inference.
Wenxuan Zeng, Meng Li, Haichuan Yang, Wen-Jie Lu, Runsheng Wang, Ru Huang
Paper
Falcon: Accelerating Homomorphically Encrypted Convolutions for Efficient Private Mobile Network Inference
Tianshi Xu, Meng Li, Runsheng Wang, Ru Huang
Paper
Memory-aware Scheduling for Complex Wired Networks with Iterative Graph Optimization
Shuzhang Zhong, Meng Li, Yun (Eric) Liang, Runsheng Wang, Ru Huang
Paper
MPCViT: Searching for Accurate and Efficient MPC-Friendly Vision Transformer with Heterogeneous Attention
Wenxuan Zeng, Meng Li, Wenjie Xiong, Tong Tong, Wen-Jie Lu, Jin Tan, Runsheng Wang, Ru Huang
Paper
AVATAR: An Aging- and Variation-Aware Dynamic Timing Analyzer for Error-Efficient Computing
Zuodong Zhang, Zizheng Guo, Yibo Lin, Meng Li, Runsheng Wang, Ru Huang
Paper
BiT: Robustly Binarized Multi-distilled Transformer
Zechun Liu, Barlas Oguz, Aasish Pappu, Lin Xiao, Scott Yih, Meng Li, Raghuraman Krishnamoorthi, Yashar Mehdad
Paper
Depth Shrink: Empowering Hardware-Friendly Shallow Neural Networks
Yonggan Fu, Haichuan Yang, Jiayi Yuan, Meng Li, Raghuraman Krishnamoorthi, Vikas Chandra, Yingyan Lin
Omni-sparsity DNN: Fast Sparsity Optimization for On-Device Streaming E2E ASR via Supernet
From wearables to powerful smart devices, modern automatic speech recognition (ASR) models run on a variety of edge devices with …
Haichuan Yang, Yuan Shangguan, Dilin Wang, Meng Li, Pierce Chuang, Xiaohui Zhang, Ganesh Venkatesh, Ozlem Kalinli, Vikas Chandra
Paper
Multi-Scale High-Resolution Vision Transformer for Semantic Segmentation
Vision Transformers (ViTs) have emerged with superior performance on computer vision tasks compared to convolutional neural network …
Jiaqi Gu, Hyoukjun Kwon, Dilin Wang, Wei Ye, Meng Li, Yu-Hsin Chen, Liangzhen Lai, Vikas Chandra, David Pan
Paper