In this article, a method of hybrid convolutional neural networks (CNNs) is proposed for powder-bed fusion (PBF) process monitoring. The proposed method can learn both the spatial and temporal representative features from the raw images automatically based on the advantages of the CNN architecture. The results demonstrate the superior performance of the proposed method compared with the traditional methods with handcrafted features. The overall detection accuracy of four process conditions, e.g., overheating, normal, irregularity, and balling, can be up to 0.997. In addition, it is found that the temporal information for PBF process monitoring by the vision detection of the process zone (including melt pool, plume, and spatters) is significant. As the proposed method can save image processing steps, it simplifies the procedure on feature extraction. This makes it more suitable for online monitoring applications.