Segment backup: datacenter-disaster tolerance for stream processing systems
Shen, Juanli
Loading…
Permalink
https://hdl.handle.net/2142/97603
Description
Title
Segment backup: datacenter-disaster tolerance for stream processing systems
Author(s)
Shen, Juanli
Issue Date
2017-04-24
Director of Research (if dissertation) or Advisor (if thesis)
Winslett, Marianne Southall
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Keyword(s)
Stream processing systems
Fault tolerance
Abstract
We design a datacenter-disaster tolerance solution called segment backup for stream processing systems. During regular running, segment backup inserts barriers into the normal tuple stream to indicate the backup versions and ensure node-level synchronization of multiple input streams. Additionally, segment backup materializes the partial results at some intermediate nodes to reduce reprocessing work after failures. The simple restarting logic can construct global consistency by connecting the segment consistency with the help of the materialized partial results. This method gives each segment flexibility to roll back to its latest version. We implement a prototype stream processing system with segment backup. Our experimental results show that segment backup can shorten the recovery delay with acceptable overhead during normal execution.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
