This article deals with the problem of continuous speech recognition with a vocabulary that contains extralinguistic effects. The paper describes the mathematical models and the extralinguistic phenomena clustering method by way of the effective continuous speech recognition. LVCSR system based on HTK toolkit. It is proposed to convert existing dictionaries and grammars by inserting meta characters that match extralinguistic effects. The results of experiments are presented.