(1) Background: In a period where systematic screening of CMV during pregnancy is still debated, diagnosis of non primary infection (NPI) remains challenging and an obstacle to systematic screening. Our aim is to report kinetics of serological and molecular CMV markers of NPI. (2) Methods: We identified immunocompetent pregnant women with CMV NPI as women known to be seropositive for CMV before pregnancy who gave birth to cCMV infected infants. We performed CMV-IgG, CMV-IgM, CMV-IgG avidity and CMV PCR retrospectively on sequential serum samples collected during pregnancy. (3) Results: We collected 195 serum samples from 53 pregnant women with NPI during pregnancy. For 29/53 (55%) patients, no markers of active infection were observed (stable IgG titers, negative IgM and negative PCR). CMV PCR was positive in at least one serum for 18/53 (34%) patients and median viral load was 46 copies/mL, IQR (21–65). (4) Conclusions: For more than half of patients with confirmed CMV NPI during pregnancy, available diagnostic tools are liable to fail in detecting an active infection. These should therefore not be used and universal neonatal screening for CMV remains the only way to detect all cCMV infections.