The detection of surface defects in metal materials has been a challenging issue in the industrial domain. The existing algorithms for metal surface defect detection are limited to a few specific types of defects and exhibit low performance with detection of defects of varying scales. A novel detection method based on the Information Enhancement YOLOv5 Network (IE-YOLOv5) for surface defects in metal parts is proposed, to realize efficient detection, which introduces a lightweight Federated Fusion Slim Neck module (FF-Slim-Neck) and a Parameter-free Spatial Attention mechanism (PSA) in YOLOv5 network. Comparative experiments were conducted using the NEU-DET dataset. The experimental results indicate that the proposed algorithm for detecting defects on metal surfaces achieves an average precision of 96.7% when identifying six different types of surface imperfections: crazing, inclusions, patches, pitting, scaling, and scratches. This represents a 2.4% enhancement in precision compared to the YOLOv5 algorithm. The measured processing velocity of this approach stands at 46.17 frames per second (FPS), highlighting its remarkable qualities of resilience, precision, and real-time capability.