When Data Drives Your Business
  GO
Contact Us 888-828-8201

 
 The Aginity Blog

Posted by: Dan Kuhn - CTO on 11/30/2009 | 0 Comments

Unlike a traditional corporate data warehouse which only operates in a single mode of data delivery, there are three ways that data-centric business models use data and advanced analytics stored in a data factory: feed transactions and insights into software to make it more intelligent; make really critical business decisions at near real-time speeds; and deliver insights and simulations based on models and insights to end customers.

Posted by: Dan Kuhn - CTO on 11/30/2009 | 0 Comments

The many moving parts of the data factory, like any modern data factory, require a robust operations management system to keep everything running smoothly.  The operations system becomes the command center of the data factory. 

The key to the data factory approach is a clear end-to-end view of the data production system. It is important to chalk out what needs to be achieved in the short-term and the long-term. Before beginning a data factory initiative it is important to ask the question "How will the business be different after we've implemented this solution?"  Other questions that need to be asked are: what represents the real value for the end users and for the business? What are the challenges wit data and analytics quality?

The quality control subsystem typically executes during the data processing phase of the data factory. It is separated logically because it is managed differently and employs different types of processes. The most significant data quality issues are addressed in the data acquisition phase of the data factory. The quality control phase caters to the serious yet more subtle issues of data integrity and data pattern anomalies.

Posted by: Dan Kuhn - CTO on 9/1/2009 | 0 Comments

In a typical data factory environment, the data processing subsystem looks the most like a traditional data warehouse. This is where data from all sources get ground into a single version of the truth. It generally consists of a staging database where raw data extracts and data acquisition files are stored. The database is then transformed and loaded into an appropriately designed data model.  ETL platforms, as their name (Extract, Transform, Load) suggests, provide a number of tools that automate this process and the better ones also include facilities for lifecycle management, version control and error checking.  But even with these ETL tools, there is a fair amount of manual scripting that needs to be performed and maintained. 

1 2 3  Go to Page:  



  • Syndicate    
     

    Recent Posts

    Archive

    Bloggers

    Category List

    Tag Cloud

       


    MapReduce Clickstream Response Attribution
    Java AP Basket
    MapReduce Keyword Tokenization
    Interactive Reporting Patterns

    This Content Requires Adobe Flash Player | Download Now

    This Content Requires Adobe Flash Player | Download Now

    This Content Requires Adobe Flash Player | Download Now

    This Content Requires Adobe Flash Player | Download Now

    This Content Requires Adobe Flash Player | Download Now


    Privacy Statement  |  Terms Of Use  |  Copyright 2010 by Aginity, Inc. Register   |   Login