Tim Burns' Personal Weblog Flavored with Math, Java, and Oracle
 
Wednesday, July 7, 2004 [*]
 

Great, Big Data Cubes

I've been reading the Handbook of Massive Data Sets. The article on data cubes generally gave me the impression that one just sort of makes a great, big data cube of the data warehouse and you go to town, viewing various aggregates of data. Literature always emphasises great, big, and often great, big doesn't translate into useful.

The problem with great, big data cubes isn't so much that they exceed the capabilities of the tools for viewing them, but that they take too long to analyze. I tend to set myself up for a successful analysis by planning ahead about what data I intend to load into the cube.

Lately I've been using Data Beacon, and it doesn't do great, big cubes, but is very easy to use. Instead of focusing on size and spending all their time with elaborate caching mechanisms, they've focused on making it easy to turn reports into cubes and then export those reports into Excel or a statistics package.

When I build data cubes, I am looking at some specific portion of the data warehouse and I don't want to have to drill down through countless aggregate layers. I save a lot time by thinking carefully about what data to include in the cube.

 
Comments [2]
 
xml    Blogroll Me!

Personal

Rhode Island is Famous For You

Discovering My Own Backyard

At Least Databases Don't Fly Away

Southwestern Baby Shower Menu

Morning of the Wolf

Autumn lingers in New England

Foraging and Shopping

 

Math, Java, and Oracle

Regular Expressions and Unit Tests
Data Cubing Tools and the Oracle 10g Mess
Tracking Errors with JavaMail
The SVD, Benchmarking and Optimization
The Problem with Software Engineers
Fun with Optimization
Anything new under the sun?
Really Simple Tomcat, Really
J2EE with Free Software
 

Technology

New Computer and Perl CTime
 

Mushrooms

Coprinus Plicatilis
 

The Daily Chronic

 

Currently Reading

 

References

BioInformatics

BioTech

Epicurious

Statistics

 

Archive

2004
 July 04 07 09 14 15 18 19 20
 June 02 05 09 17 21 24 28
 May 05 06 10 11 12 15 20 24 25 28 29
 April 01 04 07 09 11 16 17 18 20 22 24 25 27 29
 March 02 15 21 22 24 27
 February 13
 January 04 16 19 29
2003
 December 06 12
 November 02 23 29
 October 07 11 12 16 18 21 24 26
 September 04 09 10 12 14 28
 August 05 08 13 17 18 25 29
 July
 June
2002
2001
 

Photos

Morning of the Wolf
Phantom Farms
Providence
Baby Shower
Camden, Maine
 

Wiki

Creative Commons License
This work is licensed under a Creative Commons License