Research article · 3 Apr 2017
Conference abstractPublished 2016
Mining coherent patterns in multidimensional big data based on spectral decomposition
City University of Hong Kong, Hong Kong
Abstract
Select any words in the title or abstract, or press this and choose a sentence.
Although many multidimensional datasets can be very large, they may contain coherent patterns of much smaller sizes. For example, in gene expression data, we may be interested in a subset of genes that co-express under a subset of conditions during a subset of time intervals. It is a challenge to extract these coherent patterns from a large multidimensional data array. In this presentation, I will discuss a robust coherent pattern detection technique that our research group has developed recently based on spectral decomposition. In our method, we analyzed the data in singular vector spaces and detect hyperplanes that are related to subsets of data features or samples, which correspond to coherent data points. This procedure effectively suppressed the noise and removed irrelevant elements in the data. We have found several useful applications of the coherent pattern extraction algorithm to image and biomedical data analysis. Based on these patterns, we were able to recognize human facial expressions from face images and locate the points that play important roles in characterizing different expressions. With DNA microarray gene expression data, we can identify co-expressed genes for different types and subtypes of cancers. We have also used the coherent patterns to analyze the molecular mechanisms of non-small cell lung cancer drug resistance and predict the drug resistance levels for different protein mutations.
Subjects
Computer Science & ITEngineeringAsk about this article
Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.
Similar by topic
Conference abstract · 2021
Big Data focused information mining on pandemic era: COVID-19 analysis, challenges and impacts
Conference abstract · 25 Sep 2020
Establishing thresholds and effects of gender, age, and season for thyroglobulin and thyroid peroxidase antibodies by mining real-world big data
Other · Dec 2019
2020 Announcement of Big Data Analysis and Data Mining, July 17-18, 2020 | Vienna, Austria
Conference abstract · 2018
Big data mining for applied energy savings in buildings
More from this journal
The newest in Journal of Computer Engineering & Information Technology.
Review article · 27 Oct 2025
Dukan Daari Inventory Management System
Research article · 17 Jun 2025
Leveraging Information Flow Tracking for Enhanced Security in Cloud Computing
Editorial · 31 Mar 2025
Low-Code/No-Code Platforms: Democratizing Software Development
Conferences in this field
Upcoming conferences in this field.
Follow
New articles from what you follow go into your email digest, once you agree to alert emails.
- JournalJournal of Computer Engineering & Information Technology
- SubjectComputer Science & IT
- SubjectEngineering
- BylineArticles whose byline prints “Hong Yan”

