Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?
Contrastive Deep Supervision
Region-aware Knowledge Distillation for Efficient Image-to-Image Translation
PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection
Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks