Andy Brownsword takes us through a concept:
Medallion architecture is the go-to for handling analytical data, particularly with the prominence of lakehouses in Databricks and Fabric.
Whilst the layers are well defined, their definitions don’t tell you where particular tasks belong. So here I wanted to present my view from a more practical perspective of what goes into each layer.
What I’ve found interesting is that, despite almost everyone agreeing on the rules of what goes where, you can easily get into debates with other data architects and lakehouse practitioners once you start asking concrete questions around specific datasets and specific levels of transformation. The edges between silver and gold get really fuzzy.
Leave a Comment