How to copy data from rest API to Azure data lake via Azure Data Factory
In this blog I am going to explain you how to copy data from rest API to Azure data lake using Azure Data Factory.
Step 1: Create an azure storage account via azure portal using your credentials.
Step 2: Once your storage creation done, create a container called “restapidata” that will going to use to store rest API data.
Step 3: If you have rest API endpoint then its fine otherwise search dummy rest api example in google and copy one of the URL. Here I have taken employee endpoint (http://dummy.restapiexample.com/api/v1/employees)
Step 4: Create an Azure Data Factory service in azure portal and create a pipeline.
Step 5: Create a link service for rest API.
Step 6: Create a link service for Azure data storage.
Step 7: Create a dataset for rest API.
Step 8: Create a dataset for Azure data lake storage.
Step 9: Drag a copy activity in the pipeline and set a general property.
Step 10: Set a source property of copy activity. You can also click on preview data to check whether data is populated or not.
Step 11: Set a sink property of copy activity.
Step 11: Set a mapping property of copy activity.
Step 12: Debug the pipeline and check the output.
Also click on details to check record proceed.
I hope this will help you.
