In this work we examine the reliability and validity (in comparison to magnetic resonance imaging; MRI) of real-time ultrasound measures of lumbar erector spinae thickness. We also consider the between-day reliability of the lumbar multifidus muscle area as measured via ultrasound. 23 male subjects aged 21-45 years were measured three times over the course of nine days by one operator. The first (L1) through to the fifth (L5) lumbar vertebral levels were measured on the left and right sides. MRI was performed on the same day as first ultrasound scanning. For between-day intra-rater reliability, intra-class correlation co-efficients (ICCs), standard error of the measurement, minimal detectable difference and co-efficients of variation (CVs) were calculated along with their 95% confidence intervals and Bland-Altman analysis was performed. On Bland-Altman analysis, erector spinae thickness and multifidus area ultrasound measures 'agreed' with equivalent MR measures, though the correlation between MR and ultrasound measures was typically poor to moderate. For both ultrasound measures, the ICCs ranged from 'moderate' to 'excellent' at individual vertebral levels, although multifidus area (CV ranged from 8 to 15%) was less reliable than erector spinae thickness (CV ranged from 6 to 10%). 'Agreement' on Bland-Altmann analysis was present between days for all ultrasound measures. Averaging between sides and between vertebral levels improved reliability. Average erector spinae thickness showed a CV of 5.5% (ICC 0.77) and average multifidus area 6.2% (ICC 0.80).