Gradient nonlinearities in magnetic resonance imaging (MRI) cause spatially varying mismatches between the imposed and the effective gradients and can cause significant biases in rotationally invariant diffusion MRI measures derived from, for example, diffusion tensor imaging. The estimation of the orientational organization of fibrous tissue, which is nowadays frequently performed with spherical deconvolution techniques ideally using higher diffusion weightings, can likewise be biased by gradient nonlinearities. We explore the sensitivity of two established spherical deconvolution approaches to gradient nonlinearities, namely constrained spherical deconvolution (CSD) and damped Richardson‐Lucy (dRL). Additionally, we propose an extension of dRL to take into account gradient imperfections, without the need of data interpolation. Simulations show that using the effective b‐matrix can improve dRL fiber orientation estimation and reduces angular deviations, while CSD can be more robust to gradient nonlinearity depending on the implementation. Angular errors depend on a complex interplay of many factors, including the direction and magnitude of gradient deviations, underlying microstructure, SNR, anisotropy of the effective response function, and diffusion weighting. Notably, angular deviations can also be observed at lower b‐values in contrast to the perhaps common assumption that only high b‐value data are affected. In in vivo Human Connectome Project data and acquisitions from an ultrastrong gradient (300 mT/m) scanner, angular differences are observed between applying and not applying the effective gradients in dRL estimation. As even small angular differences can lead to error propagation during tractography and as such impact connectivity analyses, incorporating gradient deviations into the estimation of fiber orientations should make such analyses more reliable. Gradient nonlinearities cause spatially varying mismatches between the imposed and the effective gradients in diffusion magnetic resonance imaging. We explore the sensitivity of spherical deconvolution approaches, including constrained spherical deconvolution and damped Richardson‐Lucy (dRL), to gradient nonlinearity artifacts. Additionally, we propose an extension of the dRL method to take into account gradient imperfections without the need of data interpolation. As even small angular differences can lead to error propagation during fiber tractography, incorporating gradient deviations into the estimation of the fiber orientation distributions should make such analyses more reliable.