Gibberellic acid (GA) has been implicated in the response of plants to cadmium (Cd) stress, but the underlying mechanism remains unclear. In the present study, our aim was to confirm the role of GA in regulating the accumulation of Cd in rice. We found that Cd stress elevated the endogenous GA level in the rice roots. Exogenous GA application not only decreased the fixation of Cd in the root cell wall through reducing the hemicelluloses content, but also decreased the expression of OsNRAMP5 (Natural Resistance-Associated Macrophage Protein 5) and OsCd1 (a major facilitator superfamily gene). Both OsNRAMP5 and OsCd1 are related to Cd absorption, therefore, less Cd was accumulated in the roots. Furthermore, GA increased the expression of OsHMA3 (Heavy Metal ATPase 3) and OsCAL1 (Cadmium accumulation in Leaf 1), which are responsible for sequestering the Cd to the vacuoles and effluxing the Cd outside the cell, respectively, as a result, less Cd was accumulated in the shoots. In contrast, more Cd was accumulated in GA deficient lines. Furthermore, GA decreased the endogenous NO levels and the activity of antioxidant enzymes, while application of a NO scavenger-cPTIO diminished the alleviatory role of GA. In summary, the GA accelerated cell wall Cd exclusion mechanism probably improved rice tolerance to Cd toxicity via regulating the accumulation of NO.