Storage and processing systems for power-law graphs

Hoque, Imranul

Permalink

https://hdl.handle.net/2142/46650 Copy

Description

Title

Storage and processing systems for power-law graphs

Author(s)

Hoque, Imranul

Issue Date

2014-01-16T17:57:32Z

Director of Research (if dissertation) or Advisor (if thesis)

Gupta, Indranil

Doctoral Committee Chair(s)

Gupta, Indranil

Committee Member(s)

• Zhai, ChengXiang
• Snir, Marc
• Steinder, Malgorzata

Department of Study

Computer Science

Discipline

Computer Science

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• Graph
• Storage
• Analytics
• Distributed System
• Power-Law

Abstract

Large graphs abound around us - online social networks, Web graphs, the Internet, citation networks, protein interaction networks, telephone call graphs, peer-to-peer overlay networks, electric power grid networks, etc. Many real- life graphs are power-law graphs. A fundamental challenge in today’s Big Data world is storage and processing of these large-scale power-law graphs. In this thesis, we show that graph processing can be made faster and graph storage can be made more efficient by using techniques that leverage the structure of the underlying power-law graphs. To this end, we present two systems. First, we present LFGraph, which is a fast, distributed, in- memory graph analytics platform. LFGraph leverages the structure and characteristics of power-law graphs in order to reduce communication overhead, and to balance communication and computation load. This makes analytics faster on power-law graphs. Next, we present Bondhu, which is a disk layout manager for graph databases. Bondhu exploits the fact that most real-life power-law graphs are also small-world and these exhibit strong com- munity structure. Bondhu utilizes this community structure in order to make layout decisions. This improves the query response time of graph databases. Our systems are evaluated on real clusters using real-world graphs.

Graduation Semester

2013-12

Permalink

http://hdl.handle.net/2142/46650

Copyright and License Information

Copyright 2013 Imranul Hoque

Owning Collections