Efficient AI

SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems
We design deep neural networks (DNNs) and corresponding networks’ splittings to distribute DNNs’ workload to camera sensors …
Xin Dong, Ziyun Li, Meng Li, Zhongnan Qu, Barbara De Salvo, Chiao Liu, Hsiang-Tsung Kung
NASViT: Neural Architecture Search for Efficient Vision Transformers with Gradient Conflict aware Supernet Training
Designing accurate and efficient vision transformers (ViTs) is a highly important but challenging task. Supernet-based one-shot neural …
Chengyue Gong, Dilin Wang, Meng Li, Xinlei Chen, Zhicheng Yan, Yuandong Tian, Qiang Liu, Vikas Chandra
DNA: Differentiable Network-Accelerator Co-Search
Powerful yet complex deep neural networks (DNNs) have fueled a booming demand for efficient DNN solutions to bring DNN-powered …
Yongan Zhang, Yonggan Fu, Weiwen Jiang, Chaojian Li, Haoran You, Meng Li, Vikas Chandra, Yingyan Lin
AlphaNet: Improved Training of Supernets with Alpha-Divergence
Weight-sharing neural architecture search (NAS) is an effective technique for automating efficient neural architecture design. …
Dilin Wang, Chengyue Gong, Meng Li, Qiang Liu, Vikas Chandra
AttentiveNAS: Improving Neural Architecture Search via Attentive Sampling
Neural architecture search (NAS) has shown great promise in designing state-of-the-art (SOTA) models that are both accurate and …
Dilin Wang, Meng Li, Chengyue Gong, Vikas Chandra
Improving efficiency in neural network accelerator using operands hamming distance optimization
Neural network accelerator is a key enabler for the on-device AI inference, for which energy efficiency is an important metric. The …
Meng Li, Yilei Li, Vikas Chandra
Co-exploration of neural architectures and heterogeneous asic accelerator designs targeting multiple tasks
Neural architecture search (NAS) has shown great promise in designing state-of-the-art (SOTA) models that are both accurate and …
Lei Yang, Zheyu Yan, Meng Li, Hyoukjun Kwon, Liangzhen Lai, Tushar Krishna, Vikas Chandra, Weiwen Jiang, Yiyu Shi