Vascular calcification (VC) and secondary hyperparathyroidism (SHPT) are important causes of the high incidence of cardiovascular events in chronic kidney disease (CKD) patients. The relationship between parathyroid hormone (PTH) and VC is very complex. The aim of this study was to determine the correlation between PTH levels and abdominal aortic calcification (AAC) in patients starting hemodialysis who had not received calcium tablets, calcium-containing phosphorus binders, calcitriol, or vitamin D analogs. Seventy-one patients were included. Latero-lateral X-ray lumbar radiography, serum intact PTH (iPTH) levels, and predialysis biochemical parameters were obtained. The degree of AAC was evaluated according to the methods described previously by Kauppila et al. We found that there was a strong negative correlation between serum PTH and AAC (Spearman's rho −0.76, p < 0.001). Receiver operating characteristic (ROC) curve analysis showed that low serum PTH level could predict the presence and extent of AAC (area under the curve values were 0.9013 p < 0.0001 and 0.780 p = 0.0041, respectively). Our results indicate that serum PTH level is significantly negatively correlated with AAC within a certain concentration range in patients starting hemodialysis who had not received calcium tablets, calcium-containing phosphorus binders, calcitriol, or vitamin D analogs.