Visual surveillance System is used for analysis and interpretation of object behaviors. It involves object classification to understand the visual events in videos. In this review paper various object classification methods are used. Classification technique plays an important role in surveillance system that is used for the classification of both objects like static and moving objects in a better way. The methods in object classification are used to extract meaningful information and various features that are needed for representation of data. In this survey, we described various approaches for moving objects that are used in classification for video surveillance system based on shape and motion.