Coffee leaf disease recognition is important as its quality can be affected by the disease like –rust. This paper presents a coffee leaf disease recognition system with the help of gist feature. This research can help coffee producers in diagnosis of coffee plants in initial stage. Rocole coffee leaf dataset is considered in this study. Input image is pre-processed first. Resize and filtering is used as pre-processing work. Gist feature is extracted from pre-processed image. Extracted features are trained with machine learning algorithm. In testing phase, features are extracted and tested with trained ML model. Simulation is done with 10 fold cross validation. Different ML models are used and selected the best among them based on performance. SVM achieved overall 99.8% accuracy in recognizing coffee leaf disease.