The fuzzy EM algorithm in the HMM

The fuzzy EM algorithm in the HMM

Discrete HMM:

The family of fuzzy Q-functions is as follows[16]

where

·A={π,A,B}denotes the complete parameter set of the HMM,with π={πi},1≤i≤N,is the initial state distribution,A=,1≤i,j≤N is the state transition probability distribution,and B={bj(k)},1≤i≤N,1≤k≤M is the observation symbol probability distribution.

·P(O,S|ʌ)is the joint probability of the observation sequence O=o1,o2,...,oT and the state sequence S=s1,s2,...sT,given the model ʌ

·uS(O)is the membership function,denoting the degree to which the observation sequence O belongs to the state sequence S,and satisfies.

For the E step,to compute(9)is rewritten as

where uijt=uijf(0)is the membership function,denoting the degree to which,the observation sequence 0 belongs to state i at time t and to state j at time t+1,satisfying

and can be determined as follows

where

αt(i),βt(j)are the forward and backward variables,respectively.[3]

For the M step,to compute A,using the Lagrange multipliers the parameters of HMMs are reestimated as

It can be seen that,as m=1 we obtain the Baum-Welch reestimation formulas in the conventional HMM.