Coronary artery calcification affects the arteries that supply the heart with blood, and percutaneous coronary intervention (PCI) is a direct and effective surgery to alleviate this symptom. In this paper, we propose a framework to judge if a patient requires surgery, based on cardiac computerized tomography scans. We adopt generative adversarial network to segment the calcified areas from slices. This architecture provides an environment for the generator to perform joint learning from ground truth images and the high-resolution discriminator. We use images reconstructed using two types of filters to test our method. An F1 score of 96.1% and 85.0% was achieved for the soft and sharp filters. In addition, we explored different recurrent neural networks for making the final decision. Including long short-term memory, which was ultimately used to deal with the calcium score normalized by the age and score threshold. Using the soft reconstruction image as the input, the whole framework achieved an accuracy of 76.6%. These results certify that our method can precisely locate lesion in artery, and make a reasonable risk assessment for PCI.