Polish Konik remains one of the most important horse breeds in Poland. The primitive, native horses with a stocky body and mouse-like coat color are protected by a conservation program, while their Polish population consists of about 3,480 individuals, representing 16 dam and six sire lines. To define the population’s genetic structure, mitochondrial DNA and Y chromosome sequence variables were identified. The mtDNA whole hypervariable region analysis was carried out using the Sanger sequencing method on 233 Polish Koniks belonging to all dam lines, while the Y chromosome analysis was performed with the competitive allele-specific PCR genotyping method on 36 horses belonging to all sire lines. The analysis of the mtDNA hypervariable region detected 47 SNPs, which assigned all tested horses to 43 haplotypes. Most dam lines presented more than one haplotype; however, five dam lines were represented by only one haplotype. The haplotypes were classified into six (A, B, E, J, G, R) recognized mtDNA haplogroups, with most horses belonging to haplogroup A, common among Asian horse populations. Y chromosome analysis allocated Polish Koniks in the Crown group, condensing all modern horse breeds, and divided them into three haplotypes clustering with coldblood breeds (28 horses), warmblood breeds (two horses), and Duelmener Pony (six horses). The clustering of all Wicek sire line stallions with Duelmener horses may suggest a historical relationship between the breeds. Additionally, both mtDNA and Y chromosome sequence variability results indicate crossbreeding before the studbooks closure or irregularities in the pedigrees occurred before the DNA testing introduction.