5 data management and analytics trends to watch for in 2027


This audio is auto-generated. Please let us know if you have feedback.

The work of data teams covers a lot of different areas, from data ingestion through analysis, but the newest technologies and how they’re used revolve around a common theme: organizations must rethink data architecture around the demands of agentic AI workflows.

Decentralized data access, ontology layers, shift-left governance, real-time data delivery and cost control are all responses to the underlying challenge of data simultaneously requiring context, speed and cost discipline. And none of these can be addressed in isolation.

The most significant element of change is the shift toward proactive data management as both technological and business strategy. Instead of reactive processes meant to clean things up after they happen, data professionals are moving upstream to get ahead of the increasingly complex demands being made of an organization’s data, which is its most fundamental and dynamic asset. Read on for five key trends in 2027.

Agents further decentralize data

Rather than moving data through complex and costly extract, transform and load (ETL) pipelines into centralized data warehouses, lakes and lakehouses, organizations are increasingly keeping their proprietary data in myriad systems, including SaaS applications such as Salesforce and SAP where it’s created. Initially, humans were the end users empowered to query information spread throughout their organization’s data estate.

Now, that trend is being extended to AI agents.

Agents are being asked to execute business processes rather than simply respond to a user’s query. Such workflows generally require data from more than one source. Theoretically, enterprises could build ETL pipelines that bring together data from each source for agents, but that’s time-consuming, complex and expensive. Plus, it exposes data to potential security breaches.

The answer is to enable agents to call on data where it lives.

“I expect access to data where it lives to become table stakes across enterprise data and AI platforms — in fact, you could say it already is table stakes,” David Menninger, an analyst at ISG, told TechTarget. “Agents increase the urgency because business workflows often span multiple systems, and requiring a separate integration project for each workflow slows deployment.”

However, Menninger noted that there is more to building agents that can be trusted in production than connecting them with the right data, irrespective of where it lives. Context must also be part of the equation. And while enterprises are figuring out how to connect agents with their data, connecting agents with relevant context is an ongoing challenge.

“There is still a need to distinguish between making data accessible and making it usable,” Menninger said. “Agents need consistent definitions and context. Sharing data is not sufficient. Context needs to be shared as well. That’s hard to do right now because enterprises haven’t fully tackled the issue of context yet.”

The ontology layer becomes more important

Semantic layers have long been incorporated into BI platforms, enabling users to standardize how business metrics are calculated and what different terms related to their data mean. Semantic layers alone, however, have not enabled enterprises to connect agents with context that’s spread across disparate systems — such as data warehouses, lakes and lakehouses, databases and SaaS applications — to successfully build agents and other AI tools.

Enter the ontology layer, which is not new but is taking on added importance.

Ontologies are formal models that define the core concepts and metrics of an organization, such as its products and customers; define the rules that govern the relationships between core concepts; and directly connect those formal models to underlying data. In effect, semantic models define consistent data terms across the business, and ontologies go further by modeling how businesses truly operate.



Source link

Recent Articles

Related Stories