1

HE-Guard: Efficient Fault Recovery for Reliable Homomorphic Encryption Accelerators
Tengyu Zhang, Tong Xie, Mingxuan Li, Yi Chen, Zishen Wan, Jianan Mu, Xiaowei Li, Tianyu Jia, Runsheng Wang, Meng Li
OCEAN: A 3D-Integrated OptiCal-Electro Accelerator with Heterogeneous NoC for LLMs
Zelun Pan, Yiyun Li, Yihang Zhu, Zhe Zhan, Yuqi Li, Bowen Wang, Teng Zhang, Jinshan Yue, Meng Li, Onur Mutlu, Yaoyu Tao, Yuchao Yang
Tetris: Accelerating Composable Test-Time Scaling on GPU-PIM Systems via Adaptive Mapping, Control, and Memory Management
Cachemir: Fully Homomorphic Encrypted Inference of Generative Large Language Model with KV Cache
A fully homomorphic encrypted LLM inference framework that efficiently integrates the KV cache for autoregressive decoding.
Ye Yu, Yifan Zhou, Yi Chen, Pedro Soto, Wenjie Xiong, Meng Li
Paper
Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference
Foresight-aligned asynchronous inference and an optimized edge runtime for real-time onboard vision-language-action model deployment.
Zebin Yang, Qi Wang, Yunhe Wang, Xiurui Guo, Bo Yu, Shaoshan Liu, Jiafeng Xu, Hao Dong, Meng Li
Paper Code Project
ROSETTA: Efficient and Accurate Privacy-Preserving LLM Decoding via Hybrid CKKS/TFHE Evaluation
A hybrid CKKS/TFHE framework for efficient and accurate privacy-preserving autoregressive LLM decoding.
Jiangrui Yu, Baosheng Zhang, Liang Kong, Lin Ding, Yi Chen, Ye Yu, Mingzhe Zhang, Meng Li
Paper
MatMoE: Matryoshka Mixture-of-Experts with Dynamic Mixed-Precision Quantization for Efficient Inference
Renjie Wei, Haochen Huang, Chuyu Qiu, Jinqi Wen, Dehao Xu, Meng Li
Helios: Melting Kernel Boundaries for GPU-Accelerated HE via Graph Rewriting and Microarchitecture-Aware Mapping
Yi Chen, Ziyu Tang, Chao Yang, Guang Fan, Mingzhe Zhang, Meng Li
OptiPrime: Optimizing Private Inference through protocol-hardware codesign
Jiangrui Yu, Ye Yu, Si Chen, Chenqi Lin, Wenxuan Zeng, Junfeng Fan, Mingyu Gao, Meng Li
PEFT: A Near-Memory Processing-Enabled Heterogeneous Accelerator for BatchPBS TFHE
A near-memory processing-enabled heterogeneous accelerator that reduces data movement for BatchPBS TFHE workloads.
Paper