Evaluating sublinear estimators for big data

Brando Miranda

Permalink

https://hdl.handle.net/2142/109135 Copy

Description

Title

Evaluating sublinear estimators for big data

Author(s)

Brando Miranda

Issue Date

2014-05-16

Keyword(s)

• big data
• sublinear algorithms
• data bases

Abstract

Increasingly, databases are storing more and more data, making it costly to go through all the data one may have in a database. However, users are still interested in being able to query a database holding their data to get some understanding of the data that they have. In this paper we propose three different sampling-based methods to estimate the total mean value of one particular attribute in a particular group of records in a data set. First we approximate the number of elements pertaining to one group and then, estimate their mean value. With these two approximated quantities, we can easily estimate the total amount one group contributes by multiplying both averages. We will also argue the correctness of the algorithms that we propose. We evaluate each algorithm in practice by comparing them on real data.

Type of Resource

text

Permalink

http://hdl.handle.net/2142/109135

Owning Collections