Moving shadow elimination plays an important role in the field of moving object detection. However, the accuracy of shadow elimination is an open question, due to illumination and complex texture. Furthermore, the problem of misclassification of moving object caused by shadow has also become increasingly serious. To address this problem, this paper presents a moving shadow elimination algorithm based on the fusion of multi-feature pattern, which can enhance the accuracy of moving object detection system. In this approach, a dual-channel HSV color space feature and a uniform extended scale invariant local ternary pattern (UESILTP) texture feature are synthesized to elimination shadow. It greatly overcomes the misjudgment of dark object by color feature and the false detection caused by inconspicuous texture characteristics of moving object. Meantime, a method of region growth is adopted to fill the existing cavities in the color space. Finally, qualitative and quantitative comparisons with state-of-the-art methods show that the algorithm is effective.