A kind of compact all-fiber-optic vector magnetic sensor is proposed and demonstrated. The sensor consists of a side-polished-fiber (SPF)-integrated with singlemode-no core-singlemode (SNS) fiber structure. A section of side-polished fiber breaks the axially symmetry of the composite structure. The as-fabricated sensor supports vector sensing and has a magnetic field strength sensitivity of up to -2370 pm/mT over 2-6 mT range. The physical mechanism is that the modal interference is strongly influenced by the refractive index (RI) near the side-polished surface. The advantages of the proposed sensor lie in low cost, simple structure and easy manufacture, which make it attractive in the field of magnetic field vector sensing.