Writing an Azure Function to programmatically update Azure Data Factory

Let’s imagine that we create an Azure Data Factory (ADF) with a pipeline containing a Copy Activity that populates SQL Azure with data from an on-premise SQL Server database. If we set the schedule with a short interval, say to run every 15 minutes over a 3 month period, then we will discover that it will generate a large number of executions or slices (around 9000). Continue reading “Writing an Azure Function to programmatically update Azure Data Factory”

Copying data from On-Premise ODBC to Sql Azure using Azure Data Factory Copy Activity

Azure Data Factory (ADF) is a great cloud product for copying virtually any kind of data: on-premise, in the cloud, or between on-premise and the cloud. It has user designed pipelines with activities to transfer data and is configured using JSON templates. However, writing these templates is not easy. Continue reading “Copying data from On-Premise ODBC to Sql Azure using Azure Data Factory Copy Activity”