Since seeds are the foundation of agriculture and the Thai government plans to make Thailand an export hub of seeds under the Asean Economic Community (AEC) 2015, seed quality plays an important role in the seed production. Traditionally, physical attributes of seeds are inspected by human. However this method is very time-consuming and it highly relies on human skills and experience. Thus, in this paper, we focus on seed quality inspection of sweet pepper seeds using image processing techniques. Sweet peppers are very interesting since they have been one of the most important vegetable around the world and they have a variety of vitamins and nutrients. To identify defective sweet pepper seeds, two features used in our proposed algorithm are seed color and seed size. As shown in the results, percent accuracy of abnormal seed color and unaccepted seed size detection are 95.82% and 90.76%, respectively.