UNI-MB - logo
UMNIK - logo
 
E-resources
Full text
Peer reviewed
  • RDR-KD: A Knowledge Distill...
    Huang, Jinxiang; Chang, Hong; Yang, Xin; Liu, Yong; Liu, Shuqi; Song, Yong

    IEEE geoscience and remote sensing letters, 2024, Volume: 21
    Journal Article

    Drone object detection with real-time deployment is a research hotspot. On the one hand, the performance of tiny object detection is closely related to the ground detection capability of the drone platform. Existing methods are keen on designing complex networks to enhance the accuracy of tiny objects, which significantly increases computational costs. On the other hand, the limited drone hardware resources urgently require lightweight models for deployment. To address the dilemma of balancing the detection accuracy and computational efficiency, we propose a Regenerated-Decoupled-Responsive knowledge distillation (RDR-KD) framework specifically for drone scenes. First, we design the Regenerated Distillation and the Decoupled Distillation to fully transfer the tiny object feature information from the teacher model to the student model. Meanwhile, we devise the logit-based Responsive Distillation based on focal loss and EIoU to alleviate class imbalance. Finally, we conduct extensive experiments on the VisDrone2019 dataset. The experimental results demonstrate that the proposed RDR-KD framework improves AP and APS of the student model by 3.3% and 2.9% respectively, which outperforms other state-of-the-art distillation frameworks.