Automatic Speech Recognition presents natural phenomena for the communication among man and machine. The purpose of Speech Recognition speech system is to convert the sequence of sound units in the form of text description. The main objective of the research work is to develop the automatic spontaneous speech model for the Punjabi language. Punjabi is categorized as a constituent of the Indo-Aryan subgroup of the Indo-European family of languages. So far no work has been done in the field of spontaneous Punjabi speech recognition system. In spontaneous speech system, the sounds are usually unprompted and non- designed and are commonly described by repetitions, repairs, false start, partial words and non-planned words, silence gap etc. In this paper, the focus is on the development of the spontaneous speech model for the recognition of the Punjabi language. The GUI for Punjabi speech model also has been created and tested for the live Punjabi interview speech corpus. The recognition accuracy is 98.6% for Punjabi sentences and 98.8% for Punjabi words. The sphinx toolkit and java programming are used to build a spontaneous speech model for Punjabi live speech.