The quality evaluation is one of the key factors that have a major impact on the final price of agricultural products. Nowadays, image processing-based techniques are becoming as an acceptable and widespread in quality evaluation procedures. In this study, we develop a robust method based on image processing and computational intelligence for quality grading and classification of almonds. The images of five classes of almond including normal almond (NA), broken almond (BA), double almond (DA), wrinkled almond (WA) and shell of almond (SA) were acquired by a scanner. For segmentation of images, both H component in HSI color space and Otsu's thresholding method were applied. In the next step, the feature vector, which includes 8 shape features, 45 color features and 162 texture features, was composed. For choosing correlated and superior features among all the 215 extracted features, sensitivity analysis was applied. Principal component analysis method was also used to reduce the dimension of the feature vector. The classification of almonds into different classes was carried out by artificial neural networks (ANNs). Among different ANN structures, the 18-7-7-5 topology was the most optimum classifier. The accuracy of ANN classifier for each class was 98.92% for NA, 99.46% for BA, 98.38% for DA, 98.92% for WA and 100% for SA. The technique can readily be extended for online sorting machines.