Extension of Comparative Analysis of Estimation Methods for Dirichlet Distribution Parameters
dirichlet distribution, parameter estimation, maximum likelihood estimator
Abstract
The Dirichlet distribution is a generalization of the Beta distribution. This research deals with the estimation of scale parameter for Dirichlet distribution with known shapes. We examined three methods to estimate the parameters of Dirichlet distribution which are Maximum Likelihood Estimator, Method of Moment Estimator and Quasi-Likelihood Estimator. The performance of these methods were compared at different sample sizes using Bias, Mean Square Error, Mean Absolute Error and Variance criteria, an extensive simulation study was carried out on the basis of the selected criterion using statistical software packages as well as the application of the criterion to real life data, all these were done to obtain the most efficient method. The simulation study and analysis revealed that Quasi-Likelihood Estimator perform better in terms of bias while Method of Moment Estimator is better than the other two methods in terms of variance; the Maximum Likelihood Estimation was the best estimation method in terms of the Mean square Error and Mean Absolute Error; while Quasi-Likelihood Estimation method was the best estimation method with real life data.
Downloads
- Article PDF
- TEI XML Kaleidoscope (download in zip)* (Beta by AI)
- Lens* NISO JATS XML (Beta by AI)
- HTML Kaleidoscope* (Beta by AI)
- DBK XML Kaleidoscope (download in zip)* (Beta by AI)
- LaTeX pdf Kaleidoscope* (Beta by AI)
- EPUB Kaleidoscope* (Beta by AI)
- MD Kaleidoscope* (Beta by AI)
- FO Kaleidoscope* (Beta by AI)
- BIB Kaleidoscope* (Beta by AI)
- LaTeX Kaleidoscope* (Beta by AI)
How to Cite
References
Murray Aitkin, Donald Rubin (1985) Estimation and Hypothesis Testing in Finite Mixture Models. 47(1), 67-75. https://doi.org/10.1111/j.2517-6161.1985.tb01331.x
H. Akaike (1973) Information theory and an extension of the maximum likelihood principle. 267-281.
C. Andrieu, A. Doucet (2001) Recursive Monte Carlo algorithms for parameter estimation in general state space models. 14-17.
Charles Antoniak (1974) Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems. 2(6), 1152-1174. https://doi.org/10.1214/aos/1176342871
Jeffrey Banfield, Adrian Raftery (1993) Model-Based Gaussian and Non-Gaussian Clustering. 49(3), 803. https://doi.org/10.2307/2532201
Christophe Biernacki, Gilles Celeux, Gérard Govaert (1999) An improvement of the NEC criterion for assessing the number of clusters in a mixture model. 20(3), 267-272. https://doi.org/10.1016/s0167-8655(98)00144-5
C. Biernacki, G. Celeux, E. Gold (2000) Assessing a mixture model for clustering with the integrated completed likelihood. 22(7), 719-725. https://doi.org/10.1109/34.865189
Kai Ng, Guo-Liang Tian, Man-Lai Tang (2011) Dirichlet and related distributions: Theory, methods and applications. 888.
Robert Kass, Adrian Raftery (1995) Bayes Factors. 90(430), 773-795. https://doi.org/10.1080/01621459.1995.10476572
Ken Aho, Dewayne Derryberry, Teri Peterson (2014) Model selection for ecologists: the worldviews of AIC and BIC. 95(3), 631-636. https://doi.org/10.1890/13-1452.1
Z. Liu, J. Almhana, V. Choulakian, R. McGorman (2005) Online EM algorithm for mixture with application to internet traffic modeling. 50(4), 1052-1071. https://doi.org/10.1016/j.csda.2004.11.002
A. Mario, Anil Figueiredo, Jain (2002) T Figueiredo and Anil K Jain Unsupervised learning of finite mixture models. 24(3), 381-396.
R. Maitra (2009) Initializing Partition-Optimization Algorithms. 6(1), 144-157. https://doi.org/10.1109/tcbb.2007.70244
B. Marlin (2004) Collaborative filtering: A machine learning perspective.
R. Maitra, V. Melnykov (2010) Assessing significance in finite mixture models. 10-01.
Ranjan Maitra, Volodymyr Melnykov (2010) Simulating Data to Study Performance of Finite Mixture Modeling and Clustering Algorithms. 19(2), 354-376. https://doi.org/10.1198/jcgs.2009.08054
G. McLachlan, T. Krishnan (1997) The EM Algorithm and Extensions.Wiley, New York.
M. Escobar, M. West (1991) Bayesian Density Estimation and Inference Using Mixtures. 90, 577-20.
Nicholas T Longford (1987) A fast scoring algorithm for maximum likelihood estimation in unbalanced mixed models with nested random effects. 74(4), 817-827.
Nizar Bouguila, Djemel Ziou (2006) A hybrid SEM algorithm for high-dimensional unsupervised learning using a finite generalized Dirichlet mixture. 15(9), 2657-2668. https://doi.org/10.1109/tip.2006.877379
Nizar Bouguila, Djemel Ziou, Jean Vaillancourt (2004) Unsupervised Learning of a Finite Mixture Model Based on the Dirichlet Distribution and Its Application. 13(11), 1533-1543.
Karl Pearson (1894) III. Contributions to the mathematical theory of evolution. 185(185), 71-110. https://doi.org/10.1098/rsta.1894.0003
Kathryn Roeder, Larry Wasserman (1997) Practical Bayesian Density Estimation Using Mixtures of Normals. 92(439), 894-902. https://doi.org/10.1080/01621459.1997.10474044
Surajit Ray, Bruce Lindsay (2008) Model Selection in High Dimensions: A Quadratic-Risk-Based Approach. 70(1), 95-118. https://doi.org/10.1111/j.1467-9868.2007.00623.x
Masa-Aki Sato, Shin Ishii (2000) On-line EM Algorithm for the Normalized Gaussian Network. 12(2), 407-432. https://doi.org/10.1162/089976600300015853
S. Choi, R. Wette (1969) Maximum Likelihood Estimation of the Parameters of the Gamma Distribution and Their Bias. 11(4), 683-690. https://doi.org/10.1080/00401706.1969.10490731
Gideon Schwarz (1978) Estimating the Dimension of a Model. 6(2), 461-464. https://doi.org/10.1214/aos/1176344136
S. MacEachern (1999) Dependent nonparametric processes.
Sethuraman J, Tiwari C (1982) Convergence of Dirichlet Measures and the Interpretation of Their Parameter Statistical Decision Theory and Related Topics, III, Gupta S. 2, 305-315.
K. Yeung, C. Fraley, A. Murua, A. Raftery, W. Ruzzo (2001) Model-based clustering and data transformations for gene expression data. 17(10), 977-987. https://doi.org/10.1093/bioinformatics/17.10.977
Z. Zivkovic, F. van der Heijden (2004) Recursive unsupervised learning of finite mixture models. 26(5), 651-656. https://doi.org/10.1109/tpami.2004.1273970
Zoran Zivkovic, Ferdinand van der Heijden (2004) Recursive unsupervised learning of finite mixture models. 26(5), 651-656. https://doi.org/10.1109/tpami.2004.1273970
Zoubin Ghahramani (2004) Unsupervised Learning. 72-112.
Published
2020-09-07
Issue
Section
License
Copyright (c) 2020 Authors and Global Journals Private Limited

This work is licensed under a Creative Commons Attribution 4.0 International License.