科学研究
报告题目:

The normalized expectation-maximization (N-EM) algorithm (正则化的EM算法)

报告人:

田国梁 教授(南方科技大学)

报告时间:

报告地点:

腾讯会议 ID:147 484 406

报告摘要:

Although theexpectation-maximization(EM) algorithm is a powerful optimization tool in statistics, it can only be applied to missing/incomplete data problems or to problems with a latent-variable structure. It is well known that the introduction of latent variables (or the data augmentation) is an art; i.e., it could only be done case by case. In this paper, we propose a new algorithm, a so-callednormalized EM(N-EM) algorithm, for a class of log-likelihood functions with integrals. As an extension of the original EM algorithm, the N-EM algorithm inherits all advantages of EM-type algorithms and consists of three steps: normalization step (N-step), expectation step (E-step) and maximization step (M-step), where the N-step is to construct anormalized density function(ndf), the E-step is to compute a well-established surrogateQ-function and the M-step is to maximize theQ-function as in the original EM algorithm. The ascent property, the best choice of the ndf, and those N-EM algorithms with a difficult M-step are also explored. By multiple real applications, we have shown that the N-EM algorithm can solve some problems which cannot be addressed by the EM algorithm. Next, for problems to which the EM can be applied (often case by case), the N-EM algorithm can be employed in a unified framework. Numerical experiments are performed and convergence properties are also established.