Tag Archives: Azure Data Factory
How to create a Xero Data Source in Azure Data Factory
Hello, in this blog we will understand the steps required to create Xero as a data source in Azure Data Factory which can be then used to copy data from Xero into various target systems such as Azure SQL. Create a new Data Source in Azure Data Factory and search for Xero. Add the desired … Continue reading How to create a Xero Data Source in Azure Data Factory
Trigger Azure Pipeline with logic app
Hello, friends in this blog we will see how to trigger an azure data factory pipeline using a logic app. Step 1: Create an Azure Data Factory pipeline for your integration. Step 2: Create a logic app of your preference, for this blog, I am creating an HTTP trigger logic app. Step 3: Now click … Continue reading Trigger Azure Pipeline with logic app
ADF’s Wrangling Data Flow (Power Query)– How do you get matched rows from the two data sources using Inner Joins?
In this blog, we will learn how to get matched rows from the two data sources using inner join in ADF’s Wrangling Data Flow step by step. Step 1: Add a Power query flow as per the below screenshot. Step 2: In the New power query give the proper power query name and add the … Continue reading ADF’s Wrangling Data Flow (Power Query)– How do you get matched rows from the two data sources using Inner Joins?
ADF’s Mapping Data flows – How do you get matched rows from the two data sources using Inner Joins?
In this blog, we will learn how to get matched rows from the two data sources using inner join in ADF’s Mapping Data flows step by step. Step 1: Add a data flow activity and name as “InnerJoin_Test”, in the settings tab add a new data flow. Select the Source Settings tab, add a source … Continue reading ADF’s Mapping Data flows – How do you get matched rows from the two data sources using Inner Joins?
ADF’s Mapping Data flows – How do you get distinct rows and rows count from the data source?
In this blog, we will learn how to get distinct rows and rows count from the data source via ADF’s Mapping Data flows step by step. Step 1: Create an Azure Data Pipeline. Step 2: Add a data flow activity and name as “DistinctRows”. Step 3: Go to settings and add a new data flow. … Continue reading ADF’s Mapping Data flows – How do you get distinct rows and rows count from the data source?
Creating On Premise SQL Server Linked Service in ADF
In this blog we will see how we can create on-premise SQL server linked serviceSteps Create Linked Service in ADF for SQL server It will ask for Server name, database and credentials along with integration runtime as we are using the On-premise SQL Server, we must configure Integration runtime. We have already created integration runtime … Continue reading Creating On Premise SQL Server Linked Service in ADF
Integration of CSV file from ADLS to Azure SQL DB using ADF
Go through the blog to understand how to integrate a CSV file stored in your ADLS to Azure SQL DB.
Creating Azure Data Factory
Login to azure portal, click on create a resource>Analytics>Data Factory Enter the required details and data factory gets created, enable git option will prompt to enter the git repository details which can later be used for CI/CD. In this way we can create Azure Data factory.
Incremental refresh in Azure Data Factory
In this article we are going to do Incremental refresh for Account entity from Dynamics 365 CRM to Azure SQL. Steps: Create Linked Service for Azure SQL and Dynamics 365 CRM and create a table in Azure SQL DB Now we will create pipeline, in the pipeline we have two blocks, one is for getting … Continue reading Incremental refresh in Azure Data Factory
How to Connect your Azure Data Factory with Github
Introduction: In order to move your Pipeline from one environment to other you require your Pipeline to be saved on Github. This Blog will guide you through how to connect your Azure Data Factory Pipeline with your Github account. Step 1: Create a new Azure Data Factory and Tick the Enable GIT checkbox. … Continue reading How to Connect your Azure Data Factory with Github