In this paper, an image-based visual servoing control law is proposed for a quadrotor unmanned aerial vehicle using an on-board monocular camera and an inertial measurement unit sensor. Based on the perspective projection model, suitable image features are defined on a rotated image plane called virtual image plane, thus a decoupled image feature dynamics is achieved. Then, a translational velocity observer is presented using these image features. The image feature dynamics and quadrotor dynamics are combined to derive a nonlinear controller. The controller is based on backstepping technique to account for the underactuation of the quadrotor. The image-based visual servoing controller only needs three point features, which make it useable in general environment. The closed-loop system is proved globally asymptotic stable by means of Lyapunov analysis. Computer simulations that regulate a quadrotor to a desired position with respect to (w.r.t.) four points lying on a horizontal plane and three points lying on a full rotated slope are conducted separately. Smooth and efficient trajectories are obtained both in virtual image plane and Cartesian space. Finally, experimental tests including pushing and pulling the visual target are conducted to verify the validity and robustness of the proposed controller. The proposed control law regulates the quadrotor to a desired position, defined by desired image, from an unknown initial position, which can be used in monitoring, landing, and other applications.