Conference abstract · 14 Nov 2016
Short communicationPublished 2014
Node-Oriented Workflow (NOW): A Command Template Workflow Management Tool for High Throughput Data Analysis Pipelines
Abstract
Select any words in the title or abstract, or press this and choose a sentence.
Next generation sequencing (NGS) systems produce vast quantities of data that require substantial computational resources for typical analysis tasks. In addition, data that are generated by different NGS systems are not homogeneous. Moreover, there are an overwhelming number of tools available for performing typical tasks. Managing NGS workflows involves writing custom scripts that quickly grow in complexity, often resulting in unwieldy workflows that underutilize typical high performance compute resources, and increase the demands of the staff managing these workflows. We present Node-Oriented Workflow (NOW), a dynamic command template workflow engine for high performance distributed computing (HPC) systems. Our system provides a simple-to-use browserbased front end for designing and managing complex workflows. Workflows are configured using a simple browser interface, and are managed by the integrated job engine, which initializes nodes, monitors node status, and processes results of individual jobs across nodes in an HPC configuration. We reduce excessive messaging across nodes by placing the burden on nodes to start tasks in a workflow when dependencies are met, i.e., node oriented workflow. Our system was designed for NGS processing in the clinical research setting, emphasizing user simplicity, tool scalability, minimization of redundancy in workflows, while maximizing throughput in an HPC environment. Furthermore, NOW is not restricted to NGS pipeline management, but can used to manage any computational pipeline.
Keywords
Ask about this article
Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.
Similar by topic
Review article · 2016
Visualization of High Throughput Genomic Data Using R and Bioconductor
Conference abstract · 3 Jul 2013
Unique workflows for targeted, non-targeted identification and quantitation for residue analysis using high resolution mass spectrometry
Review article · 2012
Advances in Bioinformatics Tools for High-Throughput Sequencing Data of DNA Methylation
Rapid communication · 23 May 2019
Interactive Web Tool for Standardizing Proteomics Workflow for Liquid Chromatography-Mass Spectrometry Data
More from this journal
The newest in Journal of Data Mining in Genomics & Proteomics.
Article · 30 Jun 2026
Artificial Intelligence-Driven Drug Discovery: Reimagining the Journey from Molecule to Medicine
Article · 30 Jun 2026
Comparative Genomics: Revealing Evolutionary Patterns Across Biological Worlds
Article · 30 Jun 2026
Predicting the Hidden Roles of Proteins through Computational Function Analysis
Conferences in this field
Upcoming conferences in this field.
Follow
New articles from what you follow go into your email digest, once you agree to alert emails.
- JournalJournal of Data Mining in Genomics & Proteomics
- SubjectBiochemistry & Biotechnology
- SubjectGenetics & Molecular Biology
- BylineArticles whose byline prints “Eric B. Lipsky”
- BylineArticles whose byline prints “Brian R. King”
- BylineArticles whose byline prints “Gerard Tromp”

