Delta Lake Change Data Feed in Fabric Lakehouses
Andy As I start to look at how to architect and develop data solutions using Microsoft Fabric, I come back to the thought in my head of how to detect changes…
Partition Pruning with Delta Tables in Azure Synapse Analytics
A question that is often asked about Azure Synapse Analytics is how it handles Delta tables that are partitioned. Delta tables (or the Delta Lake) is one of the technologies…
Databricks Data Engineer Associate Certification Overview
I've been looking at taking the Databricks Data Engineer Associate Certification (the Databricks page for the certification is here) as I've noted the certification covers areas such as the overall…
Elastic Queries with Azure SQL Database and Synapse Analytics Serverless SQL Pools
Recently I have been exploring an option to use an Azure SQL Database for a small footprint Data Warehouse and wondered whether I could create an elastic query connection to…
How does Serverless SQL Pools deal with different file schemas? Part 3 – Delta
Welcome to the 3rd and final part in this blog series in which we're looking at how Azure Synapse Analytics Serverless SQL Pools deals with changing schemas in CSV (delimited),…