1

BiT: Robustly Binarized Multi-distilled Transformer
Depth Shrink: Empowering Hardware-Friendly Shallow Neural Networks