Software topological message aggregation techniques for large-scale parallel systems
Wesolowski, Lukasz
Loading…
Permalink
https://hdl.handle.net/2142/72761
Description
Title
Software topological message aggregation techniques for large-scale parallel systems
Author(s)
Wesolowski, Lukasz
Issue Date
2015-01-21
Director of Research (if dissertation) or Advisor (if thesis)
Kale, Laxmikant V.
Doctoral Committee Chair(s)
Kale, Laxmikant V.
Committee Member(s)
Gropp, William D.
Torrellas, Josep
Balaji, Pavan
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
Ph.D.
Degree Level
Dissertation
Keyword(s)
Communication Optimization
Message Aggregation
Abstract
High overhead of fine-grained communication is a significant performance bottleneck for many classes of applications written for large scale parallel systems. This thesis explores techniques for reducing this overhead through topological aggregation, in which fine-grained messages are dynamically combined not just at each source of communication, but also at intermediate points between source and destination processors. The performance characteristics of aggregation and selection of virtual topology for routing are analyzed theoretically and experimentally. Schemes that exploit fast intra-node communication to reduce the number of inter-node messages are also explored. The presented techniques are implemented for the Charm++ parallel programming system in the Topological Routing and Aggregation Module (TRAM). It is also demonstrated how TRAM can be automated at the level of the runtime system to function with little or no configuration or input required from the user. Using TRAM, the performance of a number of benchmark and scientific applications is evaluated, with speedups of up to 10x for communication benchmarks and up to 4x for full-fledged scientific applications on petascale systems.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
