{"id":49455,"date":"2016-02-18T00:00:00","date_gmt":"2016-02-18T00:00:00","guid":{"rendered":"https:\/\/www.techopedia.com\/when-you-fuse-old-tech-with-new-tech-you-get-better-analytics\/"},"modified":"2017-04-20T15:20:32","modified_gmt":"2017-04-20T15:20:32","slug":"when-you-fuse-old-tech-with-new-tech-you-get-better-analytics","status":"publish","type":"post","link":"https:\/\/www.techopedia.com\/2\/31784\/trends\/when-you-fuse-old-tech-with-new-tech-you-get-better-analytics","title":{"rendered":"When You Fuse Old Tech with New Tech You Get Better Analytics"},"content":{"rendered":"
I get asked all the time, is the data warehouse<\/a> dead?\n<\/p>\n Not only is this relatively old idea not dead, it\u2019s more robust than ever and it plays an important role with new technology in delivering better analytics.\n<\/p>\n Is the Enterprise Data Warehouse<\/a> dead? No, it\u2019s alive and well and it will be around for many years to come. However, its purpose has changed. There\u2019s a difference in why we build the enterprise data warehouse<\/a> today because now it is part of an extended data warehouse architecture<\/a>.\n<\/p>\n There are three disruptions to the old way of doing things and these are what\u2019s behind the new extended data warehouse architecture. One is the advent of new technologies such as Hadoop<\/a>, NoSQL<\/a> and appliances. Then, there\u2019s the pressure to reduce costs through open source<\/a> and less expensive ways of doing things. Finally, there is the advent of big data<\/a> that allows us to get business insights that we\u2019ve never had before.\n<\/p>\n These drivers of disruption have opened the doors to new technologies for enhanced data management<\/a> capabilities, new deployment options such as the cloud<\/a> and on premises (most companies are doing a little bit of both), and finally, the increased adoption of advanced analytics<\/a>.\n<\/p>\n This disruption makes for an exciting time but all of these drivers mean that our traditional architectures have to adapt and expand. The extended data warehouse is just such a new architecture that encompasses three big analytic components:\n<\/p>\n This is the traditional location for fully integrated, fully cleaned up data and most activities happen in batch mode. What is interesting about the enterprise data warehouse<\/a>, what Teradata calls its Integrated Data Warehouse, is that it is the production analytic environment for reports and analyses that run on a regular schedule. It\u2019s where the trusted data is, the consistent answers to everything. It is used for production reporting and historical comparisons, analyses on lifetime value of customers and key performance indicators.\n<\/p>\n The investigative computing platform has been around for a relatively short time. This is where innovative new technologies like Hadoop, in-memory, columnar storage, data compression<\/a> and appliances shine. The difference between this and the enterprise data warehouse is that the investigative computing platform, like the name suggests, is the experimental area. It is the sandbox where we can play and do unplanned and general investigations. While activities in the Enterprise Data Warehouse are planned and known, the activities in the investigative computing platform are mostly unknown. It is used for complex, difficult queries where you need to explore the data to discover what it can tell you, rather than to provide answers to questions you already know. Examples of unplanned queries are: Did this ever happen? How often did it happen? What are the correlations to our marketplace?\n<\/p>\n Operational analytics<\/a> is the new kid on the block and has introduced us to an interesting world of real-time analytics<\/a> on real-time data<\/a>. The Enterprise Data Warehouse and the Investigative Computing Platform do not run on real-time data \u2013 there is some latency<\/a> involved in the capturing of the data for these environments. Operational analytics gives us the ability to analyze the data as it is streaming in, even before it is stored in some cases. This is where embedded business intelligence<\/a> services can be called on along with a real-time analysis using an analytic engine.\n<\/p>\n When you bring together both the old and the new technologies<\/a>, you gain additional analytic opportunities beyond what you can realize with any one of them separately. For instance, when you bring together the Enterprise Data Warehouse and Operational Analytics, it\u2019s possible to do things like stock trading analysis, risk analysis, and discovery of the correlation between seemingly unrelated data streams, like things you have never been able to do in the past such as see a link between weather and the success of a marketing campaign. This is where you can use a fraud model against streaming transactions to determine whether a transaction has the characteristics of fraudulent transactions. If it does, then it can be dealt with very quickly.\n<\/p>\n We can also create next best offers for customer service reps to suggest to customers while they\u2019re on the telephone. This more complex process means that all three environments must contribute analytics to support the CSR. From the Enterprise Data Warehouse, we derive customers\u2019 purchasing history and combine it with their recent history analyzed in the investigative computing platform. This combined information then combines with the operational analytics. The ultimate outcome is a detailed, targeted \u201cnext best offer\u201d which is presented to the representative for use with the customer.\n<\/p>\n These three analytics components have to work together because when they don\u2019t, you not only have silos, you have a chaotic environment. This is where two new technologies really are showing their value to companies, data virtualization<\/a> and data visualization<\/a>.\n<\/p>\n Simply put, data virtualization brings the data together in a virtual fashion and presents them as if they were physically together. In fact they\u2019re still residing in their original data stores. The key is to understand what you can virtualize and to recognize this technology\u2019s limitations. You need a hook between the multiple sources of data and analytics to ensure their integration. If the data requires significant amounts of integration or quality processing, then data virtualization is not your tool; you will need to use data consolidation<\/a> or ETL<\/a> processing instead.\n<\/p>\n Data visualization is another relatively new technology that is frequently employed now as companies begin collecting and analyzing more data and more types of data for data discovery<\/a>. We need to be a little bit careful that we don\u2019t get so enamored with these beautiful visualizations<\/a> that we forget that they can be difficult to understand by other, less mathematically or technically oriented people. They\u2019re complex, there\u2019s a lot going on, and understanding what these graphics mean to the company can be difficult to discern. If we\u2019re going to create these visualizations then we need to also create the interpretations for all levels of employees so they can understand what the nodes and edges and colors mean.\n<\/p>\n The future is incredibly bright for our businesses today. Every time I think it is slowing down, there\u2019s a new wave of technologies and capabilities coming at us. We now have data science<\/a>, which has given credibility to a whole industry of bright people called data scientists<\/a>. New technologies continue to spring up to support more personnel with interactive and real-time intelligence and communications. While at Teradata 2015 PARTNERS, I had the pleasure of taking part in a live streaming interview via the Periscope app<\/a>, something that no one had even heard of a year ago, where I talked about this same topic of merging the old and new technologies.\n<\/p>\nDisruption Drives New Tech for Analytics<\/span><\/h2>\n
\n
Enterprise Data Warehouse<\/h3>\n
Investigative Computing Platform<\/h3>\n
Operational Analytics<\/h3>\n
Working Together<\/h3>\n
Adoption of Advanced Analytics<\/span><\/h2>\n
Data Virtualization<\/h3>\n
Data Visualization<\/h3>\n
More New Tech<\/span><\/h2>\n