Auto-tuned optimized parallel I/O for GIScience and spatial applications

Behzad, Babak

Permalink

https://hdl.handle.net/2142/44414 Copy

Description

Title

Auto-tuned optimized parallel I/O for GIScience and spatial applications

Author(s)

Behzad, Babak

Issue Date

2013-05-24T22:15:18Z

Director of Research (if dissertation) or Advisor (if thesis)

• Snir, Marc
• Wang, Shaowen

Department of Study

Computer Science

Discipline

Computer Science

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

M.S.

Degree Level

Thesis

Keyword(s)

• Parallel I/O
• GIScience
• High Performance Computing (HPC)
• Spatial Applications
• Auto-Tuning

Abstract

Reading and writing big data is increasingly becoming a major bottleneck of using high-performance computing systems as we are heading towards the Exascale era. An unprecedented amount of data is being produced everyday by different sources. On the other hand, the computation power of HPC systems is getting scaled to hundreds of thousands cores. However, for an application to be able to utilize this much data and computation power, using I/O effectively is a must. One of the fields dealing with huge amount of data is geographic information science. In this thesis, we have implemented a parallel I/O library specialized for spatial data analysis in GIScience, capable of treating different I/O patterns such as Row-Wise, Column-Wise and Block-Wise I/O. We then establish an auto-tuning framework for finding optimal parallel I/O configurations. This auto-tuning framework is based on genetic algorithm and works on a range of configurations from the parallel file system all the way up to spatial data-analysis applications. The results and findings of a set of I/O intensive experiments executed on large HPC systems are also presented to demonstrate the effectiveness of the framework.

Graduation Semester

2013-05

Permalink

http://hdl.handle.net/2142/44414

Copyright and License Information

Copyright 2013 Babak Behzad

Owning Collections