hh.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Deep Nonnegative Matrix Factorization with Joint Global and Local Structure Preservation
Graduate University Of Advanced Technology, Kerman, Iran; Institut Für Angewandte Informatik (infai), Dresden, Germany.ORCID iD: 0000-0003-2718-229X
Rwth Aachen University, Aachen, Germany.
Halmstad University, School of Information Technology.ORCID iD: 0000-0002-2851-4260
Technische Universität Dresden, Dresden, Germany; Amazon (work Done Outside Of Amazon), Dresden, Germany.
Show others and affiliations
2024 (English)In: Expert systems with applications, ISSN 0957-4174, E-ISSN 1873-6793, Vol. 249, no B, p. 1-19, article id 123645Article in journal (Refereed) Published
Abstract [en]

Deep Non-Negative Matrix Factorization (DNMF) methods provide an efficient low-dimensional representation of given data through their layered architecture. A limitation of such methods is that they cannot effectively preserve the local and global geometric structures of the data in each layer. Consequently, a significant amount of the geometrical information within the data, present in each layer of the employed deep framework, can be overlooked by the model. This can lead to an information loss and a subsequent drop in performance. In this paper, we propose a novel deep non-negative matrix factorization method, Deep Non-Negative Matrix Factorization with Joint Global and Local Structure Preservation (dubbed Dn2MFGL), that ensures the preservation of both global and local structures within the data space. Dn2MFGL performs representation learning through a sequential embedding procedure which involves both the global data structure by accounting for the data variance, and the local data relationships by utilizing information from neighboring data points. Moreover, a regularization term that promotes sparsity by utilizing the concept of the inner product is applied to the matrices representing the lower dimensions. This aims to retain the fundamental data structure while discarding less crucial features. Simultaneously, the residual matrix of Dn2MFGL is subjected to the L2,1 norm, which ensures the robustness of the model against noisy data samples. An effective and multiplicative updating process also facilitates Dn2MFGL in solving the employed objective function. The clustering performance of the proposed deep NMF method is explored across various benchmarks of face datasets. The results point to Dn2MFGL outperforming several existing classical and state-of-the-art NMF methods. The source code is available at https://github.com/FaridSaberi/Dn2MFGO.git. © 2024 Elsevier Ltd

Place, publisher, year, edition, pages
Oxford: Elsevier, 2024. Vol. 249, no B, p. 1-19, article id 123645
Keywords [en]
Deep Non-negative Matrix Factorization, Global structure, Local structure, Non-negative Matrix Factorization, Sparsity
National Category
Signal Processing
Identifiers
URN: urn:nbn:se:hh:diva-52978DOI: 10.1016/j.eswa.2024.123645ISI: 001208336800001Scopus ID: 2-s2.0-85187805337OAI: oai:DiVA.org:hh-52978DiVA, id: diva2:1851426
Available from: 2024-04-15 Created: 2024-04-15 Last updated: 2024-06-26Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Tiwari, Prayag

Search in DiVA

By author/editor
Saberi-Movahed, FaridTiwari, Prayag
By organisation
School of Information Technology
In the same journal
Expert systems with applications
Signal Processing

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 78 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf