Non-informative Hierarchical Bayesian Inference for Non-negative Matrix Factorization

dc.contributor.authorLu, Jiang
dc.date.accessioned2020-07-27T15:31:09Z
dc.date.available2020-07-27T15:31:09Z
dc.date.issued2015
dc.description.abstractNon-negative matrix factorization (NMF) is an intuitive, non-negative, and interpretable approximation method. Canonical NMF approach could derive some basic components to represent original data, while probabilistic NMF approaches try to introduce some reasonable constraints to optimize the canonical NMF model. However, both of them cannot handle ground-truth bases discovering and model order determination problems. In general, the model order of basis matrix needs to be pre-defined. The model order determines the capability and accuracy of data structure discovering. However, how to accurately infer the model order of basis matrix has not been well investigated. In this paper, we propose a method called non-informative hierarchical Bayesian non-negative matrix factorization (NHBNMF) to automatically determine the model order and discover the data structure. They are achieved through hierarchical Bayesian inference model, maximum a posteriori (MAP) criterion, and non-informative parameters. In NHBNMF method, we first introduce a structure with two-level parameters to enable the entire model to approach the distribution of ground-truth bases. Then we use non-informative parameter scheme to eliminate the hyper-parameter to enable automatic searching. Finally, the model order and ground-truth bases are discovered by using MAP criterion and L2-norm selection. The experiments are conducted based on both synthetic and real-world datasets to show the effectiveness of our algorithm. The results demonstrate that our algorithm can accurately estimate the model order and discover the ground-truth bases. Even for the complicated FERET facial dataset, our algorithm still obtained interpretable bases an achieved satisfactory accuracy of the model order estimation.en_US
dc.identifier.citation• Q. Sun, Jiang Lu, Y. Wu, H. Qiao, X. Huang, and F. Hu, “Non-Informative Hierarchical Bayesian Inference for Non-negative Matrix Factorization," Journal of Signal Processing, vol. 108, pp. 309--321, 2015.en_US
dc.identifier.urihttps://hdl.handle.net/10657.1/2419
dc.publisherJournal of Signal Processingen_US
dc.subjectNon-negative Matrix Factorization (NMF), Bayesian inference, Model Determination, Ground-truth basesen_US
dc.titleNon-informative Hierarchical Bayesian Inference for Non-negative Matrix Factorizationen_US
dc.typeArticleen_US

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Non informative Hierarchical Bayesian Inference for Non negative Matrix Factorization.pdf
Size:
15.39 KB
Format:
Adobe Portable Document Format
Description:

License bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description: