The Future of Data Science & Technology
“Big Data” was all the rage in 2012. Everyone from your company’s executives to President Obama had something to say about it. To begin the New Year, we asked our founder and CEO, Joe Caserta, to look into his crystal ball and answer the question, “What will be the biggest data trends in 2013?”
1. Big Data and data warehouses will merge to become the Big Data warehouse.
The sheer volume of data is changing the way we analyze data, and technologies will continue to emerge to support analytics on extraordinarily large, volatile data sets. The idea of pure dependence on rigid internal transactions to make business decisions will be smashed and replaced with analytics that combines structured reference data with unstructured events data. This year will reveal new technology emergence that will optimize how organizations process, manage and gain insights from both their structured and unstructured data, which will ultimately include zero latency analytics on a Big Data platform.
2. Watch for the transition from business analyst to data scientist.
Companies will no longer use business analysts to determine what the future is for a business – instead, data scientists will use machine learning and data mining techniques to discover new product trends and patterns of customer behavior that create a better picture where various aspects of the business is going. By human nature, business analysts often have preconceived notions about the factors driving a particular business, but machine learning algorithms provide statistical based predictions for real data-driven (fact-based) decision-making, ultimately making automated analytics the wave of the future.
3. Big Data warehouses will exist on the Cloud.
As businesses begin to overcome the idea that Cloud computing is “unsafe”, all future development of data analytics will move off internal corporate infrastructure onto Cloud-based solutions. With the introduction of force.com, Amazon EC2 and many other Cloud solutions, more and more companies are realizing the value of off-loading the procurement and maintenance its own hardware. I predict most enterprise transaction systems will eventually move to the Cloud and in 2013 we’ll see momentum with offerings like Microstrategy Cloud, and other cloud-based data warehouse solutions becoming the norm. The most cutting-edge Cloud-based analytics will be those that integrate core offerings with Hadoop and machine learning capabilities. It’s just a matter of time before all enterprise data warehousing vendors bring Cloud and Hadoop into the heart of their architectures.