You're reading from Kubernetes - A Complete DevOps Cookbook

Product typeBook

Published inMar 2020

PublisherPackt

ISBN-139781838828042

Edition1st Edition

Tools

Kubernetes

Concepts

DevOps

Author (1)

Murat Karslioglu

Preparing for Stateful Workloads

In this chapter, we will discuss using popular open source storage solutions on Kubernetes and how to protect the state of applications from node or application failures and share the same data, or how to handle reattaching volumes when the pod is rescheduled on a different node. After following the recipes in this chapter, you will have acquired the skills to use both block and file storage options in self-managed infrastructure or private clouds.

In this chapter, we will be covering the following recipes:

Managing Amazon EBS volumes in Kubernetes
Managing GCE PD volumes in Kubernetes
Managing Azure Disk volumes in Kubernetes
Configuring and managing persistent storage using Rook
Configuring and managing persistent storage using OpenEBS
Setting up NFS for shared storage on Kubernetes
Troubleshooting storage issues

Technical requirements

Recipes in this section assume that you have a functional Kubernetes cluster deployed according to one of the recommended methods described in Chapter 1, Building Production-Ready Kubernetes Clusters.

Kubernetes' command-line tool, kubectl, will be used for the remainder of the recipes in this section since it is the main command-line interface for running commands against Kubernetes clusters. We will also use helm where helm charts are available to deploy solutions.

Managing Amazon EBS volumes in Kubernetes

Amazon Elastic Block Store (Amazon EBS) provides persistent block-level storage volumes for Amazon EC2 instances used in both kops-created Kubernetes clusters and Amazon EKS clusters in AWS. In this section, we will create storage classes for your applications in Kubernetes running in AWS. You will learn how to create a StorageClass resource in Kubernetes, you will learn about the parameters available with the variation in performance of EBS volume types and also use the new Container Storage Interface (CSI) to consume EBS volumes.

Getting ready

Clone the k8sdevopscookbook/src repository to your workstation in order to be able to use manifest files under the chapter5 directory:

$ git clone https://github.com/k8sdevopscookbook/src.git
$ cd chapter5

Make sure that you have a Kubernetes cluster ready and kubectl configured to manage the cluster resources.

How to do it…

This section is sub-divided further into the following subsections to facilitate...

Managing GCE PD volumes in Kubernetes

Google Cloud Platform (GCP) provides persistent block-level storage volumes for use with Google Kubernetes Engine (GKE) instances. In this section, we will create storage classes for your applications in Kubernetes running in the GKE. You will learn to create a StorageClass resource in Kubernetes, you will learn about the parameters available with the variation in performance of GCP PD volume types, and also use the new CSI.

Getting ready

Clone the k8sdevopscookbook/src repository to your workstation:

$ git clone https://github.com/k8sdevopscookbook/src.git
$ cd src/chapter5

Make sure that you have a regional GKE cluster ready and kubectl configured to manage the cluster resources.

How to do it…

This section is sub-divided further into the following subsections to facilitate the process:

Creating a GCE persistent disk storage class
Changing the default storage class
Using GCE PD volumes for persistent storage
Using GCE PD storage classes to...

Managing Azure Disk volumes in Kubernetes

Azure Cloud provides persistent block-level storage volumes for use with Azure Kubernetes Engine (AKS). In this section, we will create storage classes for your applications in Kubernetes running in the AKS. You will learn how to create a StorageClass resource in Kubernetes, you will learn about the parameters available with the variation in performance of Azure Disk volume types, and you will also learn how to use the new CSI.

Getting ready

Clone the k8sdevopscookbook/src repository to your workstation in order to use manifest files under the chapter5 directory:

$ git clone https://github.com/k8sdevopscookbook/src.git
$ cd src/chapter5

Make sure you have a regional GKE cluster ready and kubectl configured to manage the cluster resources.

How to do it…

This section is sub-divided further into the following subsections to facilitate the process:

Creating an Azure Disk storage class
Changing the default storage class to ZRS
Using Azure Disk...

Configuring and managing persistent storage using Rook

Rook is a cloud-native, open source storage orchestrator for Kubernetes. Rook provides self-managing, self-scaling, and self-healing distributed storage systems in Kubernetes. In this section, we will create multiple storage providers using the Rook storage orchestrator for your applications in Kubernetes. You will learn to create a Ceph provider for your stateful applications that require persistent storage.

Getting ready

Make sure that you have a Kubernetes cluster ready and kubectl configured to manage the cluster resources.

How to do it…

This section is sub-divided further into the following subsections to facilitate the process:

Installing a Ceph provider using Rook
Creating a Ceph cluster
Verifying a Ceph cluster's health
Create a Ceph block storage class
Using a Ceph block storage class to create dynamic PVs

Installing a Ceph provider using Rook

Let's perform the following steps to get a Ceph scale-out storage...

Configuring and managing persistent storage using OpenEBS

OpenEBS is a popular open source, cloud-native storage (CNS) project with a large community. In this section, we will install an OpenEBS persistent storage provider. You will learn how to create volumes using different types of storage engine options for stateful workloads on Kubernetes.

Getting ready

For this recipe, we need to have helm and kubectl installed. Make sure you have a Kubernetes cluster ready and kubectl configured to manage the cluster resources.

How to do it…

This section is sub-divided further into the following subsections to facilitate the process:

Installing iSCSI client prerequisites
Installing OpenEBS
Using ephemeral storage to create persistent volumes
Creating storage pools
Creating OpenEBS storage classes
Using an OpenEBS storage class to create dynamic PVs

Installing iSCSI client prerequisites

The OpenEBS storage provider requires that the iSCSI client runs on all worker nodes:

On all your worker...

Setting up NFS for shared storage on Kubernetes

Although it's not the best-performing solution, NFS is still used with cloud-native applications where multi-node write access is required. In this section, we will create an NFS-based persistent storage for this type of application. You will learn how to use OpenEBS and Rook to ReadWriteMany (RWX) accessible persistent volumes for stateful workloads that require shared storage on Kubernetes.

Getting ready

For this recipe, we need to have either rook or openebs installed as an orchestrator. Make sure that you have a Kubernetes cluster ready and kubectl configured to manage the cluster resources.

How to do it…

There are two popular alternatives when it comes to providing an NFS service. This section is sub-divided further into the following subsections to explain the process using Rook and OpenEBS:

Installing NFS prerequisites
Installing an NFS provider using a Rook NFS operator
Using a Rook NFS operator storage class to create...

Troubleshooting storage issues

In this section, you will learn how to solve the most common storage issues associated with Kubernetes. After following the recipes in this chapter, you will gain the basic skills required to troubleshoot persistent volumes stuck in pending or termination states.

Getting ready

Make sure that you have a Kubernetes cluster ready and kubectl configured to manage the cluster resources.

How to do it…

This section is sub-divided further into the following subsections to facilitate the process:

Persistent volumes in the pending state
A PV is stuck once a PVC has been deleted

Persistent volumes in the pending state

You have deployed an application, but both pods and persistent volume claims are stuck in the pending state, similar to the following:

$ kubectl get pvc
NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE
mysql-pv-claim Pending rook-ceph-block 28s

Let's perform the following steps to start troubleshooting:

First, describe the PVC to...

The rest of the chapter is locked

You have been reading a chapter from

Kubernetes - A Complete DevOps Cookbook

Published in: Mar 2020Publisher: PacktISBN-13: 9781838828042

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

undefined

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at $15.99/month. Cancel anytime

Author (1)

Murat Karslioglu

Murat Karslioglu is a distinguished technologist with years of experience using infrastructure tools and technologies. Murat is currently the VP of products at MayaData, a start-up that builds data agility platform for stateful applications, and a maintainer of open source projects, namely OpenEBS and Litmus. In his free time, Murat is busy writing practical articles about DevOps best practices, CI/CD, Kubernetes, and running stateful applications on popular Kubernetes platforms on his blog, Containerized Me. Murat also runs a cloud-native news curator site, The Containerized Today, where he regularly publishes updates on the Kubernetes ecosystem.
Read more about Murat Karslioglu

Other recommended products

Related to this chapter

kubectl: Command-Line Kubernetes in a Nutshell

Kubernetes is a de facto container orchestration system. To manage Kubernetes, you must understand how to work with kubectl, its command-line tool that lets you interact with your clusters to deploy applications and manage their lifecycle. This book is a comprehensive introduction for those who are new to Kubernetes management via the command line.

BookNov 2020136 pages

Kubernetes in Production Best Practices

Kubernetes is a portable, extensible, and open source platform used for orchestrating and managing workloads and services. This book provides detailed coverage of cloud industry standards and best practices and serves as a reference guide for building and operating production-ready Kubernetes infrastructure.

BookMar 2021292 pages

Kubernetes Cookbook

Kubernetes is one of the most popular, sophisticated, and fast-evolving container orchestrators. In this book, you’ll learn the essentials and find out about the advanced administration in Kubernetes. We’ll take you through a step-by-step hands-on approach, which will familiarize you with the Kubernetes ecosystem.

BookMay 2018554 pages

Mastering Service Mesh

Service Mesh helps overcome the operational challenges of connecting, securing, controlling, and observing modern microservices deployment. This book shows you exactly how to use a Service Mesh architecture to manage and operationalize your microservices-based applications.

BookMar 2020626 pages

Hands-On Kubernetes on Azure

This book will help readers to Deploy web applications securely in Microsoft Azure with docker container and having the need for clustering services to achieve high availability, dynamic scalability, and to monitor applications

BookMar 2019258 pages

The DevOps 2.3 Toolkit

Viktor Farcic’s latest book, The DevOps 2.3 Toolkit: Kubernetes, will take you on a hands-on journey with Viktor into the world of Kubernetes, and the tools not only behind the official project but also the wide-range of third-party apps that are available for you to use.

BookSep 2018418 pages

Cloud Native with Kubernetes

Cloud Native with Kubernetes will guide you effectively - from your first steps using Kubernetes right up to running enterprise-grade cloud native applications with best practices. The book covers every aspect of deploying, securing, and operating modern cloud native applications on Kubernetes.

BookJan 2021446 pages

The DevOps 2.4 Toolkit

The DevOps Toolkit 2.4 is a deep exploration of continuous delivery and deployment in Kubernetes using Jenkins. It shows readers how to build, test, and deploy applications in Kubernetes using fully automated Jenkins pipelines.

BookNov 2019398 pages

Learn Kubernetes Security

Kubernetes is a widely used opensource orchestration platform for managing container applications. Developers are not yet aware of the pitfalls of a containerized environment. This book takes you through core security principles, best practices, and real-world use cases to learn mitigation or prevention strategies from known attacks and CVEs.

BookJul 2020330 pages

DevOps with Kubernetes

This book will guide you from container basic concepts to orchestrating containerized applications in Kubernetes. You’ll learn about the Kubernetes basic architecture, components, resources, admission control, and extensions. We’ll show you how to utilize Kubernetes services in three top cloud providers.

BookJan 2019484 pages

Kubernetes Design Patterns and Extensions

Kubernetes is an open source platform that automates scaling, deployment, and management of container-based applications. The book starts by explaining basics about container orchestration and then moves on to explain how the components of a complex system, such as Kubernetes, interact with each other and helps develop vital skills for troubleshooting Kubernetes clusters and applications running in Kubernetes clusters. Once you are done reading the book, you can easily develop and deploy your own applications with Kubernetes in no time.

BookSep 2018106 pages

Kubernetes for Developers

Kubernetes provides a means to describe what your application needs and how it should run by orchestrating containers on your behalf to operate your software across a single, dozens, or hundreds of machines. Originally created and open sourced from Google, you can use their technology to help run, test, and scale your applications regardless of which cloud provider you use, or even running it locally on your own hardware. This book will show you how to take advantage of this amazing technology by introducing the key concepts and walking you through examples in both NodeJS and Python.

BookApr 2018374 pages

Personalised recommendations for you

Based on your interests and search pattern

Designing and Implementing Microsoft Azure Networking Solutions

Designing and Implementing Microsoft Azure Networking Solutions Exam Ref AZ-700 is an all-encompassing guide to the AZ-700 exam and contains all the information you need to succeed in the world of virtual networking with Azure. With this book, you will be fully prepared for the exam and the world of cloud networking.

BookAug 2023524 pages

Microsoft 365 Security, Compliance, and Identity Administration

The Microsoft 365 Security, Compliance, and Identity Administration is a comprehensive guide that helps you employ Microsoft 365's robust suite of features and empowers you to optimize your administrative tasks.

BookAug 2023630 pages

Zero Trust Overview and Playbook Introduction

Get started on Zero Trust with this step-by-step playbook and learn everything you need to know for a successful Zero Trust journey with tailored guidance for every role, covering strategy, operations, architecture, implementation, and measuring success. This book will become an indispensable reference for everyone in your organization.

BookOct 2023240 pages

The Self-Taught Cloud Computing Engineer

This self-study book helps you master multiple clouds, including AWS, Azure, and GCP, and serves as a roadmap to becoming a certified cloud computing expert. The book will guide you to develop a professional cloud career by helping you build a broad cloud knowledge base, developing hands-on cloud computing skills, and getting cloud certified.

BookSep 2023472 pages

Technology Operating Models for Cloud and Edge

This book will help you build and create ownership of a technology operating model, as well as connect your leadership with engineering and operations, keeping your internal and external customers in mind. It provides practical tips on why, where, and how to make the cloud and edge platform paradigm sing for you, your team, and your organization.

BookAug 2023228 pages

Azure Architecture Explained

Azure is the preferred platform to build mission-critical and secure apps. This book provides comprehensive coverage of essential Azure products, services, and solutions vital for every solution architect's success. Elevate your knowledge and master the critical components of Azure to excel in your role with Azure Architecture Explained.

BookSep 2023446 pages

Pentesting Active Directory and Windows-based Infrastructure

This practical guide helps you explore the pentesting of Microsoft infrastructure in detail, and enhances your offensive skillset by showing you the different ways to perform security assessment. This book will help blue teamers and IT engineers get up to speed with possible security issues they may encounter in their Windows environments.

BookNov 2023360 pages

Practical Ansible

In Practical Ansible, you'll work with the latest release of Ansible and learn to solve complex issues quickly with the help of task-oriented scenarios. You'll start by installing and configuring Ansible to automate monotonous and repetitive IT tasks and get to grips with concepts such as playbooks, inventories, plugins, collections, and network modules.

BookSep 2023420 pages

Windows 11 for Enterprise Administrators

Microsoft’s launch of Windows 11 is a step toward satisfying the enterprise administrator’s needs for better management and enhanced user experience customization. This book provides the enterprise administrator with the knowledge needed to fully utilize the advanced feature set of Windows 11 Enterprise.

BookOct 2023286 pages

The Linux DevOps Handbook

This book is for software and IT professionals seeking knowledge on Linux systems and DevOps practices. This book will provide you with guidance and tools to learn and gain proficiency in managing Linux-based infrastructures and knowledge of DevOps.

BookNov 2023428 pages2