Creating a Lake Database using the Database Designer
Andy Synapse Analytics allows the creation of External Tables and Views within a Serverless SQL Pools database and also a Spark database. These objects can be shared between Spark and Serverless…
Azure Synapse Analytics in the Azure Architecture Centre
Microsoft provide an Azure Architecture Centre which contains resources to understand which Azure services are appropriate in certain scenarios and workloads. The centre contains a series of reference architectures which…
Using Access Control Lists To Manage Fine-Grain Data Lake Permissions
When data is stored in Azure Data Lake Gen2, we can use Azure Active Directory and Access Control Lists (ACLs) to control who can access this data in containers and…
Integrating Azure Purview with Synapse Analytics Serverless SQL Pools
Azure Purview is a Microsoft Data Governance service which enables an organisation to map their data infrastructure including data lineage and link these assets to a business glossary. An organisation…
Using Temporary Tables within Serverless SQL Pools
Temporary (temp) tables have been a feature of Microsoft SQL Server (and other database systems) for many years. Temp tables are supported within Azure Synapse Analytics in both Dedicated SQL…
External Tables vs Views…Which to Use and Why?
Serverless SQL Pools do not contain data (unlike Dedicated SQL Pools) but rather allow you to cast structure over data in Azure Storage, Azure Data Lake Gen1 & 2, Cosmos…
Azure Storage Folder Filtering using the Filepath Function
Serverless SQL Pools includes 2 SQL functions, filepath and filename, that can be used to return the folder path/name and file name from which a row of data originates from…
10 Billion Rows: Parquet File Size and Distribution When using CETAS
When using Serverless SQL Pools to write data to Azure Storage/Data Lake Gen2 using the CREATE EXTERNAL TABLE AS SELECT (CETAS) syntax, the number of source rows and size of…
Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 4 of 4 – Connecting Power BI to the Dimensional Model
Welcome to Part 4 in the Creating a Logical Data Warehouse with Synapse Serverless SQL Pools series. We are now looking at connecting Power BI to Serverless SQL Pools to…
Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 3 of 4 – Incremental Fact Loading and Slowly Changing Dimensions
Welcome to part 3 of the Logical Data Warehouse with Serverless SQL Pools series. In this part we'll be covering Incrementally loading Fact data when new sales data becomes available…