Scholars Central

Conference abstractPublished 26 Sep 2018

High-performance data analytics: Platforms, resource management and middleware

Authors: Shikharesh Majumdar

Carleton University, Canada

Ask about this article

Abstract

Select any words in the title or abstract, or press this and choose a sentence.

Enterprises, social networks and smart systems that leverage the Internet of Things technology often lead to large datasets. Data analytics concerns the extraction of knowledge from such raw data. The challenges underlying the processing of such data sets are captured in the 3V characteristics of Big Data: Volume, Velocity and Variety. The first refers to the large size of stored data sets, the second to data in motion streaming from social networks or sensor-based smart systems for example while the third concerns the large variety in data types and formats. High-performance computing platforms such as clusters and clouds are often deployed to address these challenges. Enabling technology that includes parallel processing frameworks and platforms, as well as algorithms for the management of resources in the cloud/cluster, is crucial for performing data analytics in a timely manner. Focusing on such enabling technology this talk will address the various challenges and potential solutions in the context of cloud-based systems for supporting Big Data analytics and smart systems. Issues to be discussed include (a) Management of resources in the context of latency-sensitive data analytics applications such as deadline driven MapReduce jobs and mobile object tracking (video analytics) algorithms. (b) Scheduling techniques for supporting streaming data analytics. (c) Edge-computing based platforms for performing complex event processing in the context of sensor-based streaming applications such as remote patient monitoring. (d) A cloud-based middleware for the unification of geographically dispersed resources required in the management of smart systems such as sensor-based bridges and aerospace machinery.

Ask about this article

Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.

Try:

Similar by topic

More from this journal

The newest in Journal of Computer Science & Systems Biology.

All its articles

Conferences in this field

Upcoming conferences in this field.

Follow

New articles from what you follow go into your email digest, once you agree to alert emails.

  • JournalJournal of Computer Science & Systems Biology
  • SubjectComputer Science & IT
  • BylineArticles whose byline prints “Shikharesh Majumdar”

For authors and organisers

Publish, present and keep up with your field

Find the right journal for your paper and submit your manuscript.

Photo: Pexels