Getting Started with Microsoft Fabric: Enabling 60-Day Trial and Analysing Data by Andy
May 23, 2023 There’s been an exciting new announcement at Microsoft Build in the form of Microsoft Fabric, a unified platform that brings…
Synapse Link for Dataverse: Delta Lake Export Configuration by Andy
May 22, 2023 Welcome to part 2 in the Synapse Link for Dataverse Delta Lake series. In the recently released functionality in Synapse…
Synapse Link for Dataverse: Exporting to Delta Lake by Andy
May 19, 2023 Microsoft recently released the ability to configure Synapse Link for Dataverse and use Delta Lake as the export format. As…
Parallel Loading of Tables with Power BI & Azure Synapse Analytics by Andy
April 19, 2023 In this blog I’m continuing my series about using Power BI and Azure Synapse Analytics together and the features between…
What Does A “Conformed Dimension” Actually Do? by Andy
March 12, 2023 Every so often the “star schema is dead! dimensional modelling is dead!” discussion rolls around again, and we end up…
Azure Synapse Serverless SQL Pools Cheat Sheet by Andy
March 9, 2023 Here’s an Azure Synapse Serverless SQL Pools Cheat Sheet I created to help anyone reference any objects or syntax they…
Why Cloud Data Platforms? by Andy
March 5, 2023 Always ask “why.” I really couldn’t think of a better blog title, I usually do technical stuff and the title…
Understanding ResultSet Caching in Dedicated SQL Pools with Power BI by Andy
March 2, 2023 Welcome to this new blog series in which I’ll be diving into both Power BI and Azure Synapse Analytics features…
Mastering DP-500 Exam: Upcoming Changes on February 6th by Andy
February 4, 2023 Some of the skills measured for the DP-500 Azure Enterprise Data Analyst Associate certification are changing on February 6th 2023…
Partition Pruning with Delta Tables in Azure Synapse Analytics by Andy
February 2, 2023 A question that is often asked about Azure Synapse Analytics is how it handles Delta tables that are partitioned. Delta…
Synapse Link for Dataverse: Video Series by Andy
January 31, 2023 I’ve been diving into Synapse Link for Dataverse recently for a project and created a series of videos going through…
Azure Analysis Services Migration to Power BI Premium by Andy
January 22, 2023 Around November 2022, Microsoft announced a new feature within Power BI which allows you to migrate Tabular models from Azure…
Azure Synapse Link for Dataverse: Understanding Advanced Configuration Settings by Andy
January 19, 2023 In the first part of this blog series we looked at how to configure Synapse Link for Dataverse with Dynamics…
Azure Synapse Analytics in 2022: Retrospective by Andy
January 5, 2023 Retrospective Another year has rolled by (where does the time go…) and another year in the life of Azure Synapse…
Azure Synapse Analytics at SQLBit 2023 by Andy
December 21, 2022 The General Session agenda for SQLBits 2023 is now available here and covers the agenda on Thursday, Friday, and Saturday.…
Mastering DP-500 Exam: Configuring Synapse Analytics Source Control with Azure DevOps by Andy
December 18, 2022 This blog forms part of the DP-500 blog series on this site here and also from Data Mozart’s blog here.…
Databricks Data Engineer Associate Certification Overview by Andy
December 8, 2022 I’ve been looking at taking the Databricks Data Engineer Associate Certification (the Databricks page for the certification is here) as…
Azure Synapse Link for Dataverse: Getting Started with Dynamics 365 Sales and Synapse Analytics by Andy
November 25, 2022 Part of the Azure Synapse Analytics suite of services is Synapse Link. This enables synchronization of data from sources including…
Connecting Power BI to Azure SQL Database using Private Endpoints by Andy
November 21, 2022 This was originally posted on my Datahai company blog in November 2021. This blog has now been updated as of…
Mastering DP-500 Exam: Querying JSON Data in Serverless SQL Pools by Andy
November 8, 2022 This blog forms part of the DP-500 blog series on this site here and also from Data Mozart’s blog here.…
Dedicated SQL Pools DMVs: Show Name of Synapse Studio Script Being Executed by Andy
October 19, 2022 I’m currently in the process of building a Query and Workload Analyser Power BI report which queries several DMVs (Dynamic…
User Permissions in Serverless SQL Pools: External Tables vs Views by Andy
October 12, 2022 In a recent Synapse Analytics Serverless SQL Pools QnA session, the Serverless SQL Pools team stated that using External Tables…
Up and Running: How to make your Azure Synapse Analytics Proof of Concept a Success (Data Relay Session) by Andy
October 7, 2022 Firstly, I’d like to say a huge thank you to the Data Relay team, the helpers, the sponsors, the attendees,…
Elastic Queries with Azure SQL Database and Synapse Analytics Serverless SQL Pools by Andy
September 12, 2022 Recently I have been exploring an option to use an Azure SQL Database for a small footprint Data Warehouse and…
Use Azure Log Analytics to analyse Azure Data Lake Gen2 activity from Serverless SQL Pools by Andy
August 11, 2022 This blog is marked as intermediate knowledge as an understanding of Serverless SQL Pools is preferable, but not essential. Refer to Getting Started…
Use Azure Storage Logs to analyse Synapse Analytics Serverless SQL Pools Activity by Andy
July 21, 2022 This blog is marked as intermediate knowledge as an understanding of Serverless SQL Pools is preferable, but not essential. Refer…
PASS Summit Recording Available: Creating a Logical Data Warehouse using Azure Synapse Analytics Serverless SQL Pools by Andy
July 14, 2022 My PASS Data Community Summit 2021 recording is now available, please click here for the recording. I’ve re-watched the session…
How does Serverless SQL Pools deal with different file schemas? Part 3 – Delta by Andy
July 7, 2022 Welcome to the 3rd and final part in this blog series in which we’re looking at how Azure Synapse Analytics…
How does Serverless SQL Pools deal with different file schemas? Part 2 – Parquet by Andy
June 30, 2022 Welcome to part 2 in this blog series in which we’re looking at what happens when schema changes are made…
Lake Databases And The Importance of Data Types by Andy
May 18, 2022 I encountered an issue with Azure Synapse Analytics Lake Databases and I’d like to share the problem and the solution.…
Mastering DP-500 Exam: Using the Data Map in Microsoft Purview by Andy
May 3, 2022 Part of the upcoming Azure Enterprise Data Analyst Associate exam, the DP-500, is to understand how to identify data sources…
Mastering DP-500 Exam: Integrating Microsoft Purview with Power BI by Andy
April 29, 2022 Part of the upcoming Azure Enterprise Data Analyst Associate exam, the DP-500, is to understand how Microsoft Purview integrates with…
Mastering DP-500 Exam: Querying Partitioned Sources in Azure Storage by Andy
April 21, 2022 This blog forms part of the Mastering DP-500 exam series. A list of available blogs is here and is in…
Mastering DP-500 Exam: Using Synapse Analytics Serverless SQL Pools to query Azure Storage by Andy
April 19, 2022 This blog forms part of the Mastering DP-500 exam series. A list of available blogs is here and is in…
Mastering DP-500 Exam: Blog Resources by Andy
April 18, 2022 I am collaborating with Data Mozart on blogging around the upcoming Microsoft Certified: Azure Enterprise Data Analyst Associate certification. Please…
New Certification: Microsoft Certified Azure Enterprise Data Analyst Associate by Andy
April 9, 2022 Microsoft has created a new certification, the Microsoft Certified Azure Enterprise Data Analyst Associate (link here). There is a single…
How does Serverless SQL Pools deal with different file schemas? Part 1 – CSV by Andy
March 24, 2022 Serverless SQL Pools offers a straight-forward method of querying data including CSV, JSON, and Parquet format stored in Azure Storage.…
Integrating Power BI & Azure Synapse Analytics – Power BI UK User Group by Andy
March 17, 2022 Here is the link to the slides for the Power BI UK User Group session on Thursday 17th March, 2022…
SQLBits 2022 – The Dream Team: Synapse Analytics Serverless SQL Pools and Pipelines by Andy
March 14, 2022 I presented a 20 minute session at SQLBits 2022 in which I talked about how useful Synapse Pipelines can be…
Trigger The Process – Using CETAS in Serverless SQL Pools to Generate Pre-Calculated Datasets – Part 2 of 2 by Andy
February 10, 2022 In part one we looked at a process in which a pre-aggregated dataset can be created by Azure Synapse Analytics…
Using CETAS in Serverless SQL Pools to Generate Pre-Calculated Datasets – Part 1 of 2 by Andy
January 27, 2022 Dedicated SQL Pools have a feature called Materialized Views which can generate a pre-calculated/processed dataset ready for consumption and is…
DataMinutes #2 Session Companion for Turbocharging Power BI using Synapse Analytics by Andy
January 21, 2022 The slides for the DataMinutes #2 session Turbocharging Power BI using Synapse Analytics is available here to download. GitHub Code…
SQLBits Session – The Dream Team: Synapse Analytics Serverless SQL Pools and Pipelines by Andy
January 13, 2022 SQLBits is back this year and is running from Tuesday 8th to Sunday 12th March at the ExCel in London.…
DataMinutes #2 Conference – Azure Synapse Analytics Sessions by Andy
January 5, 2022 The next DataMinutes conference (#2) is taking place on Friday 21st January. What’s different about DataMinutes is that it is…
Power BI Hybrid Tables with Synapse Analytics Serverless SQL Pools by Andy
December 23, 2021 In this video we’re talking a look at the new Power BI Hybrid Tables feature which combines Import, Incremental Refresh,…
View Generation in Serverless SQL Pools by Andy
December 16, 2021 One of the objects that can be created within a Serverless SQL Pools database is a View. A View, along…
Testing Error Handling in Serverless SQL Pools by Andy
December 9, 2021 A recent feature to be released for Serverless SQL Pools is error handling when processing external data (please see the…
Data Toboggan Azure Synapse Analytics Event – Call For Speakers by Andy
December 2, 2021 Data Toboggan is a community-driven conference focused on Azure Synapse Analytics, Microsoft’s flagship data warehousing, big data, and analytics service.…
PASS Data Community Summit Companion Resources by Andy
November 12, 2021 PASS Data Community Summit 2021 Slides Please click here for a PDF copy of the slides. Polaris (Serverless SQL Pools…
Creating a Lake Database using the Database Designer by Andy
November 3, 2021 Synapse Analytics allows the creation of External Tables and Views within a Serverless SQL Pools database and also a Spark…
Azure Synapse Analytics in the Azure Architecture Centre by Andy
October 22, 2021 Microsoft provide an Azure Architecture Centre which contains resources to understand which Azure services are appropriate in certain scenarios and…
Using Access Control Lists To Manage Fine-Grain Data Lake Permissions by Andy
October 11, 2021 When data is stored in Azure Data Lake Gen2, we can use Azure Active Directory and Access Control Lists (ACLs)…
Integrating Azure Purview with Synapse Analytics Serverless SQL Pools by Andy
September 16, 2021 Azure Purview is a Microsoft Data Governance service which enables an organisation to map their data infrastructure including data lineage…
Using Temporary Tables within Serverless SQL Pools by Andy
August 29, 2021 Temporary (temp) tables have been a feature of Microsoft SQL Server (and other database systems) for many years. Temp tables…
External Tables vs Views…Which to Use and Why? by Andy
July 22, 2021 Serverless SQL Pools do not contain data (unlike Dedicated SQL Pools) but rather allow you to cast structure over data…
Azure Storage Folder Filtering using the Filepath Function by Andy
July 7, 2021 Serverless SQL Pools includes 2 SQL functions, filepath and filename, that can be used to return the folder path/name and…
10 Billion Rows: Parquet File Size and Distribution When using CETAS by Andy
July 5, 2021 When using Serverless SQL Pools to write data to Azure Storage/Data Lake Gen2 using the CREATE EXTERNAL TABLE AS SELECT…
Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 4 of 4 – Connecting Power BI to the Dimensional Model by Andy
July 1, 2021 Welcome to Part 4 in the Creating a Logical Data Warehouse with Synapse Serverless SQL Pools series. We are now…
Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 3 of 4 – Incremental Fact Loading and Slowly Changing Dimensions by Andy
June 26, 2021 Welcome to part 3 of the Logical Data Warehouse with Serverless SQL Pools series. In this part we’ll be covering…
Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 2 of 4 – Creating a Dimensional Model by Andy
May 31, 2021 Welcome to part 2 of this 4 part blog series on creating a Logical Data Warehouse with Azure Synapse Analytics…
Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 1 of 4 – Setting Up and Querying Source Data by Andy
May 1, 2021 Welcome to part one of a four part blog series where we’ll be looking at one of the main scenarios…
Azure Synapse Analytics Serverless SQL Pools Learning Resources by Andy
April 1, 2021 Welcome to this collection of links to resources focussed on Azure Synapse Analytics Serverless SQL Pools. It includes official Microsoft…
Azure Synapse Analytics Serverless SQL Best Practices by Andy
March 1, 2021 Microsoft have a best practices document available here which highlights certain actions that can be taken to optimise use of…
Getting Started with Azure Synapse Analytics SQL Serverless by Andy
February 1, 2021 The new Azure Synapse Analytics SQL Serverless service enables querying file-based data stored in an Azure Data Lake Gen2 storage…
Harnessing Azure Synapse Analytics SQL Serverless in Power BI Dataflows by Andy
January 1, 2021 Power BI Dataflows are a Power BI Service component that allow the creation of centralised, cleansed, transformed and certified tabular…
Serverless SQL Pools Managed Private Endpoint by Andy
June 11, 2020 Steps Created new Synapse Workspace and selected Managed VNet option Opened Synapse Studio and clicked Manage > Manage Private Endpoints…