•We present an exhaustive evaluation of Guided Regularized Random Forest (GRRF), a feature selection method based on Random Forest.•GRRF does not require fixing a priori the number of features to be selected or setting a threshold of the feature importance.•GRRF features provide similar (or slightly better) results than when using all the features.•Comparing GRRF and RF features, the mean overall accuracy increases by almost 6% in classification and, the RMSE decreases by almost 2% in regression. New Earth observation missions and technologies are delivering large amounts of data. Processing this data requires developing and evaluating novel dimensionality reduction approaches to identify the most informative features for classification and regression tasks. Here we present an exhaustive evaluation of Guided Regularized Random Forest (GRRF), a feature selection method based on Random Forest. GRRF does not require fixing a priori the number of features to be selected or setting a threshold of the feature importance. Moreover, the use of regularization ensures that features selected by GRRF are non-redundant and representative. Our experiments based on various kinds of remote sensing images, show that GRRF selected features provides similar results to those obtained when using all the available features. However, the comparison between GRRF and standard random forest features shows substantial differences: in classification, the mean overall accuracy increases by almost 6% and, in regression, the decrease in RMSE almost reaches 2%. These results demonstrate the potential of GRRF for remote sensing image classification and regression. Especially in the context of increasingly large geodatabases that challenge the application of traditional methods.