Background subtraction always remains an important and challenging task for different applications. Our previous work established the effectiveness of hybrid model by exploiting the oriented patterns present in a video sequences over other statistical method. To extend this approach further, we have proposed a novel approach herein by eliminating GLCM based features with an improved local Zernike moment and color components of intensity. These features are clubbed with the orientation based features extracted from angle co-occurrence matrices (ACMs) to model the background. Furthermore the Mahalanobis distance measure is replaced by Canberra distance to categorized foreground and background pixels, which significantly reduces the computational complexity of the proposed method due to the absence of covariance matrix measure. Comparative results have shown that our proposed method is effective than other competing method on different set of video sequences.