Stereotactic ablative radiation therapy (SABR) is a guideline-specified treatment option for early-stage lung cancer. However, significant posttreatment fibrosis can occur and obfuscate the detection of local recurrence. The goal of this study was to assess physician ability to detect timely local recurrence and to compare physician performance with a radiomics tool. Posttreatment computed tomography (CT) scans (n=182) from 45 patients treated with SABR (15 with local recurrence matched to 30 with no local recurrence) were used to measure physician and radiomic performance in assessing response. Scans were individually scored by 3 thoracic radiation oncologists and 3 thoracic radiologists, all of whom were blinded to clinical outcomes. Radiomic features were extracted from the same images. Performances of the physician assessors and the radiomics signature were compared. When taking into account all CT scans during the whole follow-up period, median sensitivity for physician assessment of local recurrence was 83% (range, 67%-100%), and specificity was 75% (range, 67%-87%), with only moderate interobserver agreement (κ = 0.54) and a median time to detection of recurrence of 15.5 months. When determining the early prediction of recurrence within <6 months after SABR, physicians assessed the majority of images as benign injury/no recurrence, with a mean error of 35%, false positive rate (FPR) of 1%, and false negative rate (FNR) of 99%. At the same time point, a radiomic signature consisting of 5 image-appearance features demonstrated excellent discrimination, with an area under the receiver operating characteristic curve of 0.85, classification error of 24%, FPR of 24%, and FNR of 23%. These results suggest that radiomics can detect early changes associated with local recurrence that are not typically considered by physicians. This decision support system could potentially allow for early salvage therapy of patients with local recurrence after SABR.