Reader small image

You're reading from  Azure Data Engineering Cookbook

Product typeBook
Published inApr 2021
Reading LevelBeginner
PublisherPackt
ISBN-139781800206557
Edition1st Edition
Languages
Right arrow
Author (1)
Ahmad Osama
Ahmad Osama
author image
Ahmad Osama

Ahmad Osama works for Pitney Bowes Pvt. Ltd. as a technical architect and is a former Microsoft Data Platform MVP. In his day job, he works on developing and maintaining high performant, on-premises and cloud SQL Server OLTP environments as well as deployment and automating tasks using PowerShell. When not working, Ahmad blogs at DataPlatformLabs and can be found glued to his Xbox.
Read more about Ahmad Osama

Right arrow

Triggering a pipeline in Azure Data Factory

An Azure Data Factory pipeline can be triggered manually, scheduled, or triggered by an event. In this recipe, we'll configure an event-based trigger to run the pipeline created in the previous recipe whenever a new file is uploaded to the data lake store.

Getting ready

Before you start, perform the following steps:

  1. Log into Azure from PowerShell. To do this, execute the following command and follow the instructions to log into Azure:
    Connect-AzAccount
  2. Open https://portal.azure.com and log in using your Azure credentials.
  3. Create the pipeline as specified in the previous recipe, if not already created.

How to do it…

To create the trigger, perform the following steps:

  1. The event trigger requires the eventgrid resource to be registered in the subscription. To do that, execute the following PowerShell command:
    Register-AzResourceProvider -ProviderNamespace Microsoft.EventHub
  2. In the Azure portal...
lock icon
The rest of the page is locked
Previous PageNext Chapter
You have been reading a chapter from
Azure Data Engineering Cookbook
Published in: Apr 2021Publisher: PacktISBN-13: 9781800206557

Author (1)

author image
Ahmad Osama

Ahmad Osama works for Pitney Bowes Pvt. Ltd. as a technical architect and is a former Microsoft Data Platform MVP. In his day job, he works on developing and maintaining high performant, on-premises and cloud SQL Server OLTP environments as well as deployment and automating tasks using PowerShell. When not working, Ahmad blogs at DataPlatformLabs and can be found glued to his Xbox.
Read more about Ahmad Osama