Getting started with Azure Data Factory Mapping Data Flows 29. May 2019 matthow Azure, Azure SQL DB, Data Factory, Data Factory V2, Execute Pipeline, For Each Activity, JSON, Lookup Activity, Pipeline Parameters, SSIS, SSIS Optimisation, Mapping Data Flows, Data Transformation, ETL, Databricks, Spark (0) Azure Data Factory V2 is the go-to service for moving large amounts of data within the Azure platfor... [More]
New Features for Workload Management in Azure SQL Data Warehouse 14. November 2018 matthow SQL Data Warehouse, Azure, Azure SQL DW, MPP, Azure SQL Data Warehouse (1) I was lucky enough to attend the PASS Summit in Seattle last week and was therefore able to see some... [More]
Using ADF V2 Activities in Logic Apps 23. June 2018 matthow Data Factory V2, Execute Pipeline, Flow, For Each Activity, JSON, Logic Apps, Pipeline Parameters, SSIS, SSIS Optimisation (10) Logic Apps recently introduced the ability to connect to an Azure Data Factory V2 instance and perfo... [More]
Using Lookup, Execute Pipeline and For Each Activity in Azure Data Factory V2 24. October 2017 matthow Data Factory V2, Data Factory, Azure SQL DB, JSON, Pipeline Parameters, For Each Activity, Execute Pipeline, Lookup Activity (24) In my previous blog I looked how we can utilise pipeline parameters to variablise certain aspects of... [More]
Pipeline Parameters in Azure Data Factory V2 23. October 2017 matthow Azure SQL DB, Data Factory, Data Factory V2, Pipeline Parameters, JSON (25) The second release of Azure Data Factory (ADF) includes several new features that vastly improve th... [More]
Master Data in the Cloud 17. October 2017 matthow (2) As data warehouses become more advanced and move to the cloud, Referential Data Management is often ... [More]
How to Find Your Next Job with Power Apps and Flow 11. August 2017 matthow Logic Apps, Power BI, Flow, PowerApps, Common Data Service (4) Both PowerApps and Flow exist within the Office 365 suite and bring enormous amounts of possibilitie... [More]
Optimising Lookups with Caching 12. April 2017 matthow SSIS, Cache Connection Manager, SSIS Optimisation (1) One of, if not the most, used transformations in SQL Server Integration Services (SSIS) must be the ... [More]
Power BI Mobile Feature Review 5. April 2017 matthow Power Bi Mobile, Power BI, Data Visualisation (4) In March Microsoft released Deep Touch integration for iOS amongst several other improvements to the... [More]
Extracting Data from Salesforce using SSIS 18. January 2017 matthow Salesforce, SSIS (3) This blog looks at a couple of methods of extracting data from Salesforce and gives a demo of how to... [More]