Open access research
publication repository

A Comparison of Five Probabilistic View-Size Estimation Techniques in OLAP [r-libre/200]

Aouiche, Kamel, & Lemire, Daniel (2007). A Comparison of Five Probabilistic View-Size Estimation Techniques in OLAP. In Proceedings of the 10th International Workshop on Data Warehousing and OLAP. ACM.

File(s) available for this item:
[img]  PDF - 0703058-2  
Item Type: Papers in Conference Proceedings
Refereed: Yes
Status: Published
Abstract: A data warehouse cannot materialize all possible views, hence we must estimate quickly, accurately, and reliably the size of views to determine the best candidates for materialization. Many available techniques for view-size estimation make particular statistical assumptions and their error can be large. Comparatively, unassuming probabilistic techniques are slower, but they estimate accurately and reliability very large view sizes using little memory. We compare five unassuming hashing-based view-size estimation techniques including Stochastic Probabilistic Counting and LogLog Probabilistic Counting. Our experiments show that only Generalized Counting, Gibbons-Tirthapura, and Adaptive Counting provide universally tight estimates irrespective of the size of the view; of those, only Adaptive Counting remains constantly fast as we increase the memory budget.
Depositor: Lemire, Daniel
Owner / Manager: Daniel Lemire
Deposited: 27 Aug 2007
Last Modified: 16 Jul 2015 00:47

Actions (login required)