Search icon
Subscription
0
Cart icon
Close icon
You have no products in your basket yet
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Azure Data Factory Cookbook - Second Edition

You're reading from  Azure Data Factory Cookbook - Second Edition

Product type Book
Published in Feb 2024
Publisher Packt
ISBN-13 9781803246598
Pages 532 pages
Edition 2nd Edition
Languages
Authors (4):
Dmitry Foshin Dmitry Foshin
Profile icon Dmitry Foshin
Tonya Chernyshova Tonya Chernyshova
Profile icon Tonya Chernyshova
Dmitry Anoshin Dmitry Anoshin
Profile icon Dmitry Anoshin
Xenia Ireton Xenia Ireton
Profile icon Xenia Ireton
View More author details

Table of Contents (15) Chapters

Preface 1. Getting Started with ADF 2. Orchestration and Control Flow 3. Setting Up Synapse Analytics 4. Working with Data Lake and Spark Pools 5. Working with Big Data and Databricks 6. Data Migration – Azure Data Factory and Other Cloud Services 7. Extending Azure Data Factory with Logic Apps and Azure Functions 8. Microsoft Fabric and Power BI, Azure ML, and Cognitive Services 9. Managing Deployment Processes with Azure DevOps 10. Monitoring and Troubleshooting Data Pipelines 11. Working with Azure Data Explorer 12. The Best Practices of Working with ADF 13. Other Books You May Enjoy
14. Index

Creating a data factory using PowerShell

Often, we don’t have access to the UI and we want to create infrastructure as code. It is easily maintainable and deployable and allows us to track versions and have code commit and change requests. In this recipe, we will use PowerShell to create a data factory. If you have never used PowerShell before, you can find information about how to get PowerShell and install it onto your machine at the end of this recipe.

Getting ready

For this exercise, we will use PowerShell to create a data pipeline and copy our file from one folder to another.

How to do it…

Let’s create an ADF job using PowerShell:

  1. In the case of macOS, we can run the following command to install PowerShell:
    brew install powershell/tap/powershell
    
  2. Check that it is working:
    pwsh
    

    Optionally, we can download PowerShell for our OS from https://github.com/PowerShell/PowerShell/.

    ...
lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at AU $19.99/month. Cancel anytime}