1

Cachemir: Fully Homomorphic Encrypted Inference of Generative Large Language Model with KV Cache
一种在全同态加密大语言模型推理中高效集成KV缓存以加速自回归解码的框架。
Ye Yu, Yifan Zhou, Yi Chen, Pedro Soto, Wenjie Xiong, 李萌
论文
Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference
通过前瞻对齐异步推理与优化的边缘运行时，实现视觉-语言-动作模型的实时机载部署。
Zebin Yang, Qi Wang, Yunhe Wang, Xiurui Guo, Bo Yu, Shaoshan Liu, Jiafeng Xu, Hao Dong, 李萌
论文 代码 项目
ROSETTA: Efficient and Accurate Privacy-Preserving LLM Decoding via Hybrid CKKS/TFHE Evaluation
一种采用混合CKKS/TFHE计算的高效、准确隐私保护大语言模型自回归解码框架。
Jiangrui Yu, Baosheng Zhang, Liang Kong, Lin Ding, Yi Chen, Ye Yu, Mingzhe Zhang, 李萌
论文
MatMoE: Matryoshka Mixture-of-Experts with Dynamic Mixed-Precision Quantization for Efficient Inference
Renjie Wei, Haochen Huang, Chuyu Qiu, Jinqi Wen, Dehao Xu, 李萌
Helios: Melting Kernel Boundaries for GPU-Accelerated HE via Graph Rewriting and Microarchitecture-Aware Mapping
Yi Chen, Ziyu Tang, Chao Yang, Guang Fan, Mingzhe Zhang, 李萌
OptiPrime: Optimizing Private Inference through protocol-hardware codesign
Jiangrui Yu, Ye Yu, Si Chen, Chenqi Lin, Wenxuan Zeng, Junfeng Fan, Mingyu Gao, 李萌
PEFT: A Near-Memory Processing-Enabled Heterogeneous Accelerator for BatchPBS TFHE
一种面向BatchPBS TFHE工作负载、通过近存计算减少数据搬移的异构加速器。
论文
Aging Aware Adaptive Voltage Scaling for Reliable and Efficient AI Accelerators
Tong Xie, Zuodong Zhang, Chao Yang, Yuan Wang, Runsheng Wang, 李萌
论文
NICE: 3D-NAND-based In-Memory-Computing with In-Situ ECC-Protection for Fault-Tolerant and Efficient LLM Inference
Boyi Fu, Weikai Xu, Tong Xie, Jin Luo, Yaoyu Tao, 李萌
RePart: Efficient Hypergraph Partitioning with Logic Replication Optimization for Multi-FPGA System
Zizhuo Fu, Yifan Zhou, Zhaoxin Lu, Guangyu Sun, Runsheng Wang, 李萌, Yibo Lin
论文