Efficient AI

Efficient Non-Linear Adder for Stochastic Computing with Approximate Spatial-Temporal Sorting Network
Yixuan Hu, Tengyu Zhang, 李萌, Renjie Wei, Liangzhen Lai, Yuan Wang, Runsheng Wang, Ru Huang
Accurate yet Efficient Stochastic Computing Neural Acceleration with High Precision Residual Fusion
Yixuan Hu, Tengyu Zhang, Renjie Wei, 李萌, Runsheng Wang, Yuan Wang, Ru Huang
READ: Reliability-Enhanced Accelerator Dataflow Optimization using Critical Input Pattern Reduction
Zuodong Zhang, 李萌, Yibo Lin, Runsheng Wang, Ru Huang
BiT: Robustly Binarized Multi-distilled Transformer
Zechun Liu, Barlas Oguz, Aasish Pappu, Lin Xiao, Scott Yih, 李萌, Raghuraman Krishnamoorthi, Yashar Mehdad
Depth Shrink: Empowering Hardware-Friendly Shallow Neural Networks
Yonggan Fu, Haichuan Yang, Jiayi Yuan, 李萌, Raghuraman Krishnamoorthi, Vikas Chandra, Yingyan Lin
Omni-sparsity DNN: Fast Sparsity Optimization for On-Device Streaming E2E ASR via Supernet
From wearables to powerful smart devices, modern automatic speech recognition (ASR) models run on a variety of edge devices with …
Haichuan Yang, Yuan Shangguan, Dilin Wang, 李萌, Pierce Chuang, Xiaohui Zhang, Ganesh Venkatesh, Ozlem Kalinli, Vikas Chandra
SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems
We design deep neural networks (DNNs) and corresponding networks’ splittings to distribute DNNs’ workload to camera sensors …
Xin Dong, Ziyun Li, 李萌, Zhongnan Qu, Barbara De Salvo, Chiao Liu, Hsiang-Tsung Kung
NASViT: Neural Architecture Search for Efficient Vision Transformers with Gradient Conflict aware Supernet Training
Designing accurate and efficient vision transformers (ViTs) is a highly important but challenging task. Supernet-based one-shot neural …
Chengyue Gong, Dilin Wang, 李萌, Xinlei Chen, Zhicheng Yan, Yuandong Tian, Qiang Liu, Vikas Chandra
DNA: Differentiable Network-Accelerator Co-Search
Powerful yet complex deep neural networks (DNNs) have fueled a booming demand for efficient DNN solutions to bring DNN-powered …
Yongan Zhang, Yonggan Fu, Weiwen Jiang, Chaojian Li, Haoran You, 李萌, Vikas Chandra, Yingyan Lin
AlphaNet: Improved Training of Supernets with Alpha-Divergence
Weight-sharing neural architecture search (NAS) is an effective technique for automating efficient neural architecture design. …
Dilin Wang, Chengyue Gong, 李萌, Qiang Liu, Vikas Chandra