Reflections on 10 Years of Hadoop and Big Data
Joe Caserta Reflects on 10 Years of Hadoop and Big Data
“It is hard to think of a technology that is more identified with the rise of big data than Hadoop,” states DBT&A editor Joyce Wells in the article Reflections on 10 Years of Hadoop and Big Data. Caserta CEO Joe Caserta shares his thoughts on those years with his contribution Hadoop Grows Up.
“In 2009, I predicted companies that consider data insights to be their differentiator would fully adopt Hadoop as their data platform. Unfortunately, the initial immaturity of Hadoop and its inability to provide interactive queries delayed immediate adoption by the enterprise,” observed Joe Caserta, president and CEO of Caserta Concepts, a consultancy specializing in data warehouse architecture and design, BI, and master data management. “Luckily, there have been many advances in recent years and Hadoop now supports prevailing corporate requirements. I’m bullish on Hadoop as it has found its place within the corporate data ecosystem; not to replace the data warehouse, but to fit as a complementary component called the data lake.” According to Caserta, Hadoop-based data lakes will help make data management and data governance more efficient, allowing businesses to defer expensive, time-consuming data preparation work by letting trusted users immediately explore data in a semi-governed, semi-structured environment until a business value is identified. “Hadoop allows data to be more agile and enables the business to draw more meaningful conclusions faster,” he noted.