Neural networks are widely used for exchange rate prediction. There are various hyperparameters affecting the prediction performance. In this paper, experimental design which is a statistical technique is used to identify the optimum hyperparameters within a given range for the prediction of USD/CAD exchange rate for 2019. In this context, multi-layer perceptron, recurrent neural networks and long-short term memories are considered as deep learning neural networks. The common hyperparameters for these neural network types are optimized via experimental design are epoch size, learning rate, batch size, number of hidden layer and number of hidden neurons. Optimum hyperparameter configurations are applied to predict test dataset.