Perspective · 26 Dec 2024
Conference abstractPublished 2022
Evolution of spark analytics
Oracle Corp, India
Abstract
Select any words in the title or abstract, or press this and choose a sentence.
In a world of serverless computing users tend to be frugal when it comes to expenditure on compute, storage and other resources. Paying for the same when they aren’t in use becomes a significant factor. Offering Spark as service on cloud presents very unique challenges. Apache Spark has evolved a lot from deploying it on baremetal machines to running it on containers to offering its as serverless offering which gives benefits to its users in terms of ease of use, cost and still offer same experience of using Spark. The purpose of this talk is to discuss the requirements of a data scientist and how they want to use Apache Spark. This talk covers challenges involved in providing serverless Spark clusters share the specific issues one can encounter when running large Kubernetes clusters in production. This talk will also cover what are the hurdles for Spark using Function as a service offerings and how we can overcome them by running Spark on Kubernetes and also using Knative APIs and still achieve the goal of running Spark as Serverless. Reference 1. Yanfeng Zhang, Qinxin Gao, Lixin Gao and Cuirong Wang, "iMapReduce: A Distributed Computing Framework for Iterative Computation" (2019), Parallel and Distributed Processing Workshops and Phd Forum (IPDPSW) 2011 IEEE International Symposium, pp. 1112-1121. 2. Yanfeng Zhang, Qinxin Gao, Lixin Gao and Cuirong Wang, "PrIter: A Distributed Framework for Prioritizing Iterative Computations Parallel and Distributed Systems" (2020), IEEE Transactions onTransactions on Prallel and Distributed Systems, vol. 24, no. 9, pp. 1884-1893.
Subjects
Computer Science & ITEngineeringAsk about this article
Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.
Similar by topic
Conference abstract · 22 Jan 2019
Microstructural evolution of nano-crystalline tungsten-25% rhenium-hafnium carbide composite synthesized by spark plasma sintering technique for FSW tool application
Conference abstract · 19 Nov 2018
Microstructural evolution of nanocrystalline tungsten-25% Rhenium-Hafnium carbide composite synthesized by spark plasma sintering technique for FSW tool application
Article · 27 Apr 2026
Systemic Tumor Evolution Analytics: Integrated Modeling of Cancer Progression
Article · 1 Sep 2025
The Evolution and Applications of Scientific Instrumentation in Modern Analytical and Industrial Systems
More from this journal
The newest in Journal of Computer Engineering & Information Technology.
Review article · 27 Oct 2025
Dukan Daari Inventory Management System
Research article · 17 Jun 2025
Leveraging Information Flow Tracking for Enhanced Security in Cloud Computing
Editorial · 31 Mar 2025
Low-Code/No-Code Platforms: Democratizing Software Development
Conferences in this field
Upcoming conferences in this field.
Follow
New articles from what you follow go into your email digest, once you agree to alert emails.
- JournalJournal of Computer Engineering & Information Technology
- SubjectComputer Science & IT
- SubjectEngineering
- BylineArticles whose byline prints “Rachit Arora”

