NOAO >  Meetings >  Tools for Astronomical Big Data >  Abstract

Tools for Astronomical Big Data

Tools for Astronomical Big Data

Tucson, Arizona, March 9-11, 2015

Talk Abstracts (Submitted)

How do you look at a billion data points? Exploratory Visualization for Big Data [1.16 MB PDF]

Carlos Scheidegger

Consider exploration of large multidimensional spatiotemporal datasets with billions of entries. Are certain attributes correlated spatially or temporally? How do we even look at data of this size? In this talk, I will present the techniques and algorithms to compute and query a nanocube, a data structure that enables interactive visualizations of data sources in the range of billions of elements.

Data cubes are widely used for exploratory data analysis. Although they are sometimes assumed to take a prohibitively large amount of space (and to consequently require disk storage), nanocubes fit in a modern laptop's main memory, even for hundreds of millions of entries. I will present live demos of the technique on a variety of real-world datasets, together with comparisons to the previous state of the art with respect to memory, timing, and network bandwidth measurements.

Authors: Carlos Scheidegger


Tools for Astronomical Big Data is sponsored by the National Optical Astronomy Observatory (NOAO). NOAO is operated by the Association of Universities for Research in Astronomy (AURA), Inc. under cooperative agreement with the National Science Foundation.

AURA, inc. NSF

NOAO >  Meetings >  Tools for Astronomical Big Data