Data Modelling and Data Engineering

Definition

Data Modelling and Data Engineering

Data modelling defines the entities, relationships, events, identifiers, semantics and lifecycle states that software relies on. Data engineering builds the pipelines, storage, validation, lineage and access patterns that make data usable. AI systems need both: models can only reason well over data that is coherent, current, governed and connected to the business meaning of the task.

Why It Matters

Data modelling represents entities, relations, events, constraints, lineage and lifecycle. AI does not compensate for ambiguous semantics or poor-quality source data.

For AI applications, data engineering also includes provenance, freshness, retention and access policies for retrieved context, traces, feedback and eval datasets.

Failure mode

The recurring risk is treating this concept as a label rather than an engineering decision with trade-offs, evidence needs and operational consequences.

Evaluation check

Ask what observable evidence would show that this concept has been applied well in a real system, repository or learning exercise.

Related Concepts

• Embeddings, vector search, graphs and semantic layers
• Data and context in the shaping canvas

Further study: Martin Kleppmann, Designing Data-Intensive Applications, and Joe Reis and Matt Housley, Fundamentals of Data Engineering.