We present the average [CII] $158\,\rm{\mu m}$ emission line sizes of UV-bright star-forming galaxies at $z\sim7$. Our results are derived from a stacking analysis of [CII] $158\,\rm{\mu m}$ emission lines and dust continua observed by ALMA, taking advantage of the large program Reionization Era Bright Emission Line Survey (REBELS). We find that the average [CII] emission at $z\sim7$ has an effective radius $r_e$ of $2.2\pm0.2\,\rm{kpc}$. It is $\gtrsim2\times$ larger than the dust continuum and the rest-frame UV emission, in agreement with recently reported measurements for $z\lesssim6$ galaxies. Additionally, we compared the average [CII] size with $4Comment: 9pages, 4 figures, submitted to ApJ; minor corrections were made for typos in the author list and the title