Abstract Background Neoadjuvant chemoradiotherapy is regarded as the standard of treatment for locally advanced lower rectal cancer, although some of these cases are systemic, and distant control may be inadequate. Neoadjuvant chemotherapy could compensate for such shortcomings, potentially yielding better survival outcomes. We aimed to stratify patients into prognostic groups on the basis of preoperative factors, including response to neoadjuvant chemotherapy. Methods We retrospectively analyzed patients with locally advanced lower rectal adenocarcinoma (clinical stage II/III with high-risk features of distant metastasis) who were treated with neoadjuvant chemotherapy (without radiotherapy) followed by curative resection between 2010 and 2017. Reduction in tumor volume (before vs. after neoadjuvant chemotherapy) was measured using magnetic resonance imaging, and a reduction above 60% was defined as a good response. Recurrence and overall survival were evaluated. Results The cohort comprised 102 patients. Good response to neoadjuvant chemotherapy was associated with better 5-year recurrence-free survival (good responders: 81.1%, poor responders: 49.0%; p = 0.001) and 5-year overall survival (good responders: 94.9%, poor responders: 80.6%; p = 0.06). In a multivariate analysis, extramural venous invasion on magnetic resonance imaging after neoadjuvant chemotherapy and a tumor volume reduction rate