Efficient Resource Utilization for Parallel I /O in Cluster Environments
Cho, Yong Eun
This item is only available for download by members of the University of Illinois community. Students, faculty, and staff at the U of I may log in with your NetID and password to view the item. If you are trying to access an Illinois-restricted dissertation or thesis, you can request a copy through your library's Inter-Library Loan office or purchase a copy directly from ProQuest.
Permalink
https://hdl.handle.net/2142/81953
Description
Title
Efficient Resource Utilization for Parallel I /O in Cluster Environments
Author(s)
Cho, Yong Eun
Issue Date
1999
Doctoral Committee Chair(s)
Winslett, Marianne
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
Ph.D.
Degree Level
Dissertation
Keyword(s)
Computer Science
Language
eng
Abstract
In this thesis work, performance factors for parallel I/O on clusters are examined and several algorithms are designed to support parallel I/O efficiently for scientific applications running on commodity clusters, making better utilization of system resources. Specifically, our algorithms are designed to (i) minimize data transfer over the network during I/O if network bandwidth is limited, (ii) reduce message passing latency during I/O of finely-distributed data, (iii) place I/O servers on the appropriate processors in heterogeneous environments, and (iv) balance I/O workload dynamically when necessary. These algorithms have been implemented in the Panda parallel I/O library and tested on several actual and simulated cluster environments. Performance results show that our algorithms improve overall parallel I/O performance significantly with only an insignificant amount of overhead. These algorithms can also be used in other parallel I/O runtime libraries or job schedulers for cluster systems.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
