You're reading from Limitless Analytics with Azure Synapse

Product typeBook

Published inJun 2021

Reading LevelBeginner

PublisherPackt

ISBN-139781800205659

Edition1st Edition

Languages

Python

Tools

Azure Stream Analytics

Concepts

Data Science

Author (1)

Prashant Kumar Mishra

Chapter 11: Performing Backup and Restore in Azure Synapse Analytics

High-availability solutions ensure that your data is never lost, even in the case of unplanned events, such as underlying hardware, software, or network failures. Azure Synapse Analytics uses database screenshots to provide the high availability of dedicated SQL pools. These screenshots create several restore points that can be used to recover your data to a previous state.

In this chapter, you will learn about backup and restore operations on Azure Synapse Analytics. We will begin this chapter by creating restore points for Azure Synapse Analytics; we are also going to create geo-redundant restores using PowerShell. Then, we will learn about the geo-backup and disaster recovery of Synapse SQL pools.

To learn more about these concepts, the following topics will be covered in this chapter:

Creating restore points
Geo-backups and disaster recovery
Cross-subscription restore

Technical requirements

Before you start orchestrating your data, there are certain prerequisites to meet:

You should have an Azure subscription or access to any other subscription with contributor-level access.
Create your Synapse workspace on this subscription. You can follow the instructions from Chapter 1, Introduction to Azure Synapse, to create your Synapse workspace.
Create a SQL pool on Azure Synapse. This has been covered in Chapter 2, Considerations for Your Compute Environment.
Install Azure PowerShell on your machine.

Creating restore points

Azure Synapse Analytics creates various restore points throughout the day by using screenshots. These restore points are available for 7 days and we do not have the luxury of modifying this retention period. But we do have the luxury of creating a new SQL pool in the primary region, by using any of the screenshots taken within the last 7 days. We can create our own restore points as well. Let's learn about both types of restore points in the following sections.

Automatic restore points

By using an automatic restore point, we can select any date and time within the range of the last 7 days to restore the SQL pool in our primary region. This is a built-in feature, so we do not need to enable this feature manually. However, if we pause our dedicated SQL pool very frequently, then these automatic restore points cannot be generated. Users do not have the privilege of deleting these restore points.

It takes just a couple of steps to create and restore...

Geo-backups and disaster recovery

Synapse performs a geo-backup once per day to a paired data center automatically, and that's why the option to enable a geo-backup policy for your dedicated SQL pool is disabled. The Recovery Point Objective (RPO) for a geo-backup is 24 hours. This geo-backup can be used to restore your SQL pool if the restore points in the primary region are not available.

In this section, we are going to create geo-redundant restore points using the Azure portal and PowerShell script as well. This PowerShell script can be used for any dedicated SQL pool just by providing correct values for the parameters in the script.

As shown in the following screenshot, we cannot create a geo-backup policy for a dedicated SQL pool because the SQL pool is automatically backed up to the region pair. You can read about region pairs at the following link—https://docs.microsoft.com/en-us/azure/best-practices-availability-paired-regions:

Figure 11.6 – A screenshot of a geo-backup policy for a dedicated SQL pool on the Azure portal

...

Cross-subscription restore

As of the time of writing, cross-subscription restore is not supported in Azure Synapse. However, there have been various requests submitted for this particular feature, hence the Synapse team might consider this request for the next release cycle.

In the future, whenever this feature becomes available in Azure Synapse, we will capture it in the book.

With this, we have learned everything about the backup and restoration of Azure Synapse dedicated SQL pools, along with their limitations and usages.

Summary

In this chapter, we learned how data warehouse (dedicated SQL pool) screenshots create various restore points automatically to provide high-availability solutions in Azure Synapse. Apart from this, we also learned how can we create our own restore points in Azure Synapse and when we would need to create these restore points. Later, we learned how to leverage these restore points to restore our dedicated SQL pool within the same primary region or to any other region. In this chapter, we covered both of the ways to restore our SQL pool, through the Azure portal and PowerShell script as well.

In the next chapter, we are going to explore the security aspects of Azure Synapse. We will learn how Azure Synapse protects our data, and about all the layers of security that Azure Synapse provides us to protect our data.

The rest of the chapter is locked

You have been reading a chapter from

Limitless Analytics with Azure Synapse

Published in: Jun 2021Publisher: PacktISBN-13: 9781800205659

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

undefined

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at $15.99/month. Cancel anytime

Author (1)

Prashant Kumar Mishra

Prashant Kumar Mishra is an engineering architect at Microsoft. He has more than 10 years of professional expertise in the Microsoft data and AI segment as a developer, consultant, and architect. He has been focused on Microsoft Azure Cloud technologies for several years now and has helped various customers in their data journey. He prefers to share his knowledge with others to make the data community stronger day by day through his blogs and meetup groups.
Read more about Prashant Kumar Mishra

Other recommended products

Related to this chapter

Azure Data Factory Cookbook

With the help of well-structured and practical recipes, this book will teach you how to integrate data from the cloud and on-premise. You’ll learn how to transform, clean, and consolidate data into a single data platform and get to grips with using ADF as the main ETL and orchestration tool for your data warehouse or data platform project.

BookDec 2020382 pages

Azure Data Engineering Cookbook

This book will help you design and implement modern ETL workflows along with data management, monitoring, and security aspects to meet the current organization's needs. You will use various services such as Azure Data Factory, Azure Databricks, Azure Stream Analytics, and Azure Data Explorer to design efficient data processing solutions.

BookApr 2021454 pages

Cloud Analytics with Microsoft Azure

Cloud Analytics with Microsoft Azure enables you to understand the design and business considerations that you must keep in mind while planning to adopt the cloud analytics model for your business.

BookJan 2021184 pages

Cloud Scale Analytics with Azure Data Services

This book will help you to understand the architectural components of a modern data warehouse and select those suitable for your requirements. You’ll learn everything from how to integrate your source data into Azure Data Lake at scale to how to structure your analytical data estate and more.

BookJul 2021520 pages

Data Modeling for Azure Data Services

Data modeling for Azure Data Services teaches you the core concepts of setting up different types of databases for different use cases. With this hands-on guide, you'll learn how to implement the resulting data model in Azure efficiently.

BookJul 2021428 pages

Cloud Analytics with Microsoft Azure

Cloud Analytics with Microsoft Azure is an end-to-end guide to processing and analyzing big data using a range of Microsoft Azure features. This book covers everything you need to build your own data warehouse and learn numerous techniques to gain useful insights by analyzing big data.

BookNov 2019242 pages

Azure Databricks Cookbook

The Azure Databricks Cookbook shows you how to work with the latest as well as older versions of Apache Spark and integrate with various Azure resources for orchestrating, deploying, and monitoring big data solutions. You'll use Azure Databricks to build end-to-end solutions and address challenges in securing, productionizing, and monitoring them.

BookSep 2021452 pages

ETL with Azure Cookbook

This book will take you through hand-on recipes for extracting, transforming, and loading data using big data tools and Azure services such as Data Factory and Azure Databricks. You will learn how to interact effectively with Azure services, along with covering automation with BIML and data profiling in Azure.

BookSep 2020446 pages

Stream Analytics with Microsoft Azure

This book is your guide to understanding the basics of how Azure Stream Analytics works, and build your own analytics solution using its capabilities. By the end of this book, you will be well-versed in using Azure Stream Analytics to develop an efficient analytics solution which can work with any type of data.

BookDec 2017322 pages

SQL Server 2017 Integration Services Cookbook

SQL Server Integration Services is a tool that facilitates data extraction, consolidation, and loading options (ETL), SQL Server coding enhancements, data warehousing, and customizations. With the help of this book, you’ll gain complete hands-on experience of SSIS 2017’s new features, and design and development improvements including SCD, Profiling, Tuning, and Customizations.

BookJun 2017558 pages

Professional Azure SQL Managed Database Administration

Whether it is learning different techniques to monitor and tune an Azure SQL database or improving performance using in-memory technology, this book will enable you to make the most out of Azure SQL database features and functionality for data management solutions.

BookMar 2021724 pages

Hands-On Data Warehousing with Azure Data Factory

Azure Data Factory (ADF) is a Microsoft Azure PaaS solution which supports data movement between many on premises and cloud data sources. This book covers custom tailored tutorials to help you develop , maintain and troubleshoot data movement processes and environments using Azure Data Factory V2 and SQL Server Integration Services 2017

BookMay 2018284 pages

Personalised recommendations for you

Based on your interests and search pattern

Et al.

Ever wonder why speech recognition systems don't understand the Scottish accent, or what would happen if an astronaut only ate mac 'n' cheese, or other spurious reflections you'd have at a bar? We did, then collated those deliberations into absurd research articles with fake figures and methodologies inspired by even more fictionally absurd studies.

BookAug 2023230 pages5

Generative AI with LangChain

This book is a comprehensive introduction to LLMs and LangChain, demystifying the basic mechanics of LangChain, its functionalities, and the myriad of applications it can be integrated into.

BookDec 2023360 pages4

Generative AI with LangChain

This book is a comprehensive introduction to LLMs and LangChain, demystifying the basic mechanics of LangChain, its functionalities, and the myriad of applications it can be integrated into.

BookDec 2023360 pages5

Generative AI with LangChain

This book is a comprehensive introduction to LLMs and LangChain, demystifying the basic mechanics of LangChain, its functionalities, and the myriad of applications it can be integrated into.

BookDec 2023360 pages1

Generative AI with LangChain

This book is a comprehensive introduction to LLMs and LangChain, demystifying the basic mechanics of LangChain, its functionalities, and the myriad of applications it can be integrated into.

BookDec 2023360 pages5

Mastering Tableau 2023

This book is a comprehensive resource to mastering your Tableau skills and becoming a BI expert. As you progress, you will learn how to build advanced dashboards and improve your storytelling to derive key business insight, as well as make you well-versed with advanced functionalities of Tableau in the business intelligence domain.

BookAug 2023684 pages

Building AI Applications with ChatGPT APIs

This guide covers all ChatGPT API features for effortless creation of robust AI powered apps. With its help, you’ll be able to leverage ChatGPT’s cutting-edge NLP models to take your app development skills to the next level. You’ll also work on ten exciting projects that will give you the practical know-how that you can apply to your existing applications.

BookSep 2023258 pages5

Building AI Applications with ChatGPT APIs

This guide covers all ChatGPT API features for effortless creation of robust AI powered apps. With its help, you’ll be able to leverage ChatGPT’s cutting-edge NLP models to take your app development skills to the next level. You’ll also work on ten exciting projects that will give you the practical know-how that you can apply to your existing applications.

BookSep 2023258 pages2

Data Engineering with AWS

Embark on a journey to master data engineering pipelines on AWS! Our book offers a hands-on experience of AWS services for ingesting, transforming, and consuming data. Whether you're an absolute beginner or someone with basic data engineering experience, this guide is an indispensable resource.

BookOct 2023636 pages5

Modern Data Architecture on AWS

Every organization wants an agile, performant, and cost-effective data platform that meets all their current and future business needs. Purpose-built AWS analytics services and their features play a big part in building such a modern data platform. This book brings to you all the design and architectural patterns that’ll help you achieve this goal.

BookAug 2023420 pages5

Practical Guide to Applied Conformal Prediction in Python

Discover the power of Conformal Prediction with the "Practical Guide to Applied Conformal Prediction in Python." Master the latest techniques to quantify uncertainty in machine learning and computer vision models, and seamlessly apply them to your industry applications.

BookDec 2023240 pages

TinyML Cookbook

With over 70 project-based recipes, the TinyML Cookbook is a practical guide that will help you to get the most out of your microcontrollers. It provides a comprehensive understanding of the theoretical foundations while giving you hands-on experience training ML models for deployment on Arduino Nano 33 BLE Sense, Raspberry Pi Pico, and SparkFun RedBoard Artemis Nano microcontrollers.

BookNov 2023664 pages