It seems like just yesterday that we were writing about last year’s trends. Is it just me, or does time pass more quickly as we age? As we grow older, it seems that not only do the days fly by faster, but also the world around us. Technology and innovation are developing at unprecedented speeds. The exponential growth of data is also occurring at record-breaking rates, making data management critically important for any organization that wants to leverage data as a valued resource.
This year, our team of experts took a few moments to catch our collective breath, sit down and discuss the past and present of the data management industry, and consider the biggest trends shaping its future. Heading into 2019, some trends are still sweltering hot, others will gain prominence in the coming year, while others highlight new ideas and emerging technologies critical to data success across industries.
Below are our top new data trends for 2019.
As technological capabilities improve, the value of data lies primarily in the hands of business users, rather than within the confines of the IT department. More teams within organizations are seeking a unified understanding of their most critical operational and business challenges.
The proliferation of integrated platforms and advancement of data management tools increasingly empowers data consumers to understand, manage and use data quickly and simply through self-service solutions. The benefit? IT can now focus on higher-value data management projects.
Even with advanced technologies, organizations still have vast amounts of untapped dark data to process and transform into digital assets. The reason the majority of dark data remains unused is because it is typically unstructured, making it tough to categorize, difficult for data management tools to read, and impossible to be analyzed without conversion into structured formats. In 2019, organizations will digitize and migrate analog databases to leverage cloud-based predictive analytics to strengthen business decisions.
Organizations are still challenged by managing the data deluge. Every day, more and more data is created and deployed across different processes and systems. Organizations need centralized data management technologies to manage distributed data environments and deliver business users complete transparency into their data. Business users today demand a new data experience, one that emulates the “Amazon Marketplace,” so they can easily search, locate, understand and leverage data they can trust.
Businesses now require support for more than HDFS, and require the ability to process additional data sources such as S3. In 2019, organizations will shift from viewing data as a static resource to data in motion. On-premise Hadoop data lakes are transitioning to cloud-hosted data lakes. And the primary drivers are the reduced cost and the ability to scale elastically.
Trends from 2018 that will continue into 2019 will include the following:
The EU’s implementation of GDPR in 2018 motivated many businesses to advance their data governance programs quickly. Unfortunately, this newfound focus on data governance didn’t automatically translate to a better understanding of enterprise data and new analytical insights. It did, however, successfully cultivate open communication between various lines of business. As a result, many companies need to expand their data governance program into a more strategic focus beyond just governing data. By introducing governance to analytical models, businesses can aggregate the metadata around their models to ensure all teams have a complete understanding of their data and can leverage it for insights.
Managing data is increasingly a team effort. C-suite executives and senior leaders are working together to develop coordinated strategies and build a data-driven culture. Whether CDO, CIO or CTO, leaders understand the need for collaboration to advance innovative technologies and gain a competitive advantage. Organizations who defer to a single person won’t keep pace.
The GDPR deadline came and went, and the frenzy is over. Many businesses successfully became compliant, some still struggle and others outside the European Union (EU) abandoned the EU for now. Yet, there are similar regulations on the horizon in Canada and the U.S. Canada is currently adjusting its data protection law with GDPR’s standards in mind. California passed the Consumer Privacy Act of 2018 (AB375). Beginning in 2020, organizations will need to disclose personal information upon a consumer’s request. Organizations who still aren’t compliant with GDPR processing data for EU residents, will need to act quickly to avoid fines and penalties.
2018 was a breakthrough year for data management as more integrated self-service tools became available. However, technologies are still evolving to deliver a more inclusive view of an organization’s data landscape to draw meaningful, timely business conclusions. Shifting job roles thanks to advanced technologies, the increasing importance of data governance and the evolution of the data lake are all important successful analytics initiatives expected in 2019.
Looking for additional details about trends shaping our future? Please download our Listograph below.
For a deeper dive into this topic, visit our resource center. Here you will find a broad selection of content that represents the compiled wisdom, experience, and advice of our seasoned data experts and thought leaders.