You're reading from Kubernetes - A Complete DevOps Cookbook

Product typeBook

Published inMar 2020

PublisherPackt

ISBN-139781838828042

Edition1st Edition

Tools

Kubernetes

Concepts

DevOps

Author (1)

Murat Karslioglu

Building CI/CD Pipelines

In this chapter, we will discuss the configuration of end-to-end Continuous Integration/Continuous Delivery (CI/CD) pipelines using the most popular CI/CD tools on both self-managed public clouds and SaaS solutions using Kubernetes. After following the recipes in this chapter, you will have gained the skills needed to build, deploy, and promote applications from development to a production environment. You will be able to use the tools that we will implement in these recipes to detect bugs, anti-patterns, and license concerns during the continuous integration process.

In this chapter, we will cover the following recipes:

Creating a CI/CD pipeline in Jenkins X
Creating a CI/CD pipeline in GitLab
Creating a CI/CD pipeline using CircleCI
Setting up a CI/CD pipeline using GitHub Actions
Setting up a CI/CD pipeline on Amazon Web Services
Setting up a CI/CD...

Technical requirements

The recipes in this section assume that you have a functional Kubernetes cluster deployed after following one of the recommended methods described in Chapter 1, Building Production-Ready Kubernetes Clusters.

Kubernetes' command-line interface, kubectl, will be used for the rest of the recipes in this section since it's the main command-line interface for running commands against Kubernetes clusters. If you are using a Red Hat OpenShift cluster, you can replace kubectl with oc. All the commands are expected to function similarly.

The recipes in this section require a Git repository with a containerized project.

Creating a CI/CD pipeline in Jenkins X

Jenkins X is a fairly new open source solution that extends the Jenkins ecosystem and solves the problem of automating CI/CD in the cloud using Kubernetes.

In this section, we will learn how to get your application as a pipeline into Jenkins X, which you will have deployed by following the Deploying and managing the life cycle of Jenkins X recipe instructions in Chapter 2, Operating Applications on Kubernetes. With that, you will learn how to create a CI/CD pipeline with automated GitOps and promote an application from staging to production, all by using simple commands.

Getting ready

Make sure you have followed the instructions in Chapter 2, Operating Applications on Kubernetes, in the Deploying and managing the life cycle of Jenkins X recipe and have a functional Kubernetes cluster with a Jenkins X deployment ready. You can find the instructions to install helm in that chapter as well.

In the following recipe, you will learn how to create a pipeline...

Creating a CI/CD pipeline in GitLab

GitLab is a complete DevOps toolchain that's delivered in a single application platform. GitLab provides all the necessary tooling you need to manage, plan, create, verify, package, release, configure, monitor, and secure your applications.

In this section, we will focus on the CI/CD pipeline features of GitLab that can be consumed as SaaS or self-hosted service. We will import an application and create a pipeline in GitLab. You will learn how to create a CI/CD pipeline with Auto DevOps and promote an application from staging into production.

Getting ready

In the following recipe, you will learn how to create a pipeline with Auto DevOps. This recipe requires GitLab (self-managed or SaaS) and an account with your preferred cloud vendor where you installed your Kubernetes cluster using GitLab.

The Community Edition of GitLab includes the Auto Build, Auto Test, Auto Review Apps, Auto Deploy, and Auto Monitoring features. In addition to these features...

Creating a CI/CD pipeline in CircleCI

In this section, we will cover the initial configuration and requirements to deploy and manage Kubernetes services using CircleCI. You will learn how to create a pipeline so that you can build container images and store them in a Container Registry.

Getting ready

This recipe requires an active GitHub account with a project to build. We will use AWS EKS to demonstrate CI with CircleCI.

First, visit the following GitHub page of our demo application project and fork your copy to your GitHub account:

$ git clone https://github.com/k8sdevopscookbook/circleci-demo-aws-eks.git

Clone the k8sdevopscookbook/circleci-demo-aws-eks repository to your workstation in order to use the circleci-demo-aws-eks example at https://github.com/k8sdevopscookbook/circleci-demo-aws-eks.

How to do it...

This section is further divided into the following subsections to make this process easier:

Getting started with CircleCI
Deploying changes to a Kubernetes cluster on Amazon...

Setting up a CI/CD pipeline using GitHub Actions

GitHub Actions enable you to create custom software development workflows directly in your GitHub repository. If you are already using GitHub as your code repository, built-in CI/CD capabilities make this option very compelling.

In this section, we will cover the GitHub Actions workflow configuration and built-in CI/CD capabilities. You will learn how to manage workflows and create new GitHub Actions.

Getting ready

In the following recipe, you will learn how to create a basic action example in a repository you own by adding a Dockerfile. This recipe requires an active GitHub account with a project to build. We will use AWS EKS to demonstrate CI with GitHub.

How to do it...

This section is further divided into the following subsections to make this process easier:

Creating a workflow file
Creating a basic Docker build workflow
Building and publishing images to Docker Registry
Adding a workflow status badge

Creating a workflow file

GitHub...

Setting up a CI/CD pipeline on Amazon Web Services

In this section, we will cover the CI/CD pipeline construction workflow on AWS and built-in CI/CD capabilities. You will learn how to manage pipelines, how to run build commands during the pipeline steps, and how to store build result images on the Amazon Elastic Container Registry (ECR).

Getting ready

In the following recipe, you will learn how to build, test, and deploy an example service based on AWS services. All the operations mentioned here require an AWS account and an AWS user with a policy that has permission to use the related services, have HTTPS Git credentials for CodeCommit assigned, and a Kubernetes cluster deployed using AWS EKS. If you don't have one, go to https://aws.amazon.com/account/ and create one.

How to do it...

This section is further divided into the following subsections to make this process easier:

Creating an AWS CodeCommit code repository
Building projects with AWS CodeBuild
Creating an AWS CodeDeploy...

Setting up a CI/CD pipeline with Spinnaker on Google Cloud Build

Google Cloud Build is a managed CI/CD and deployment platform that lets you build, test, and deploy in the cloud. In this section, we will cover the CI/CD pipeline with Google Cloud Build configuration using Spinnaker capabilities, an open source, multi-cloud continuous delivery platform.

Getting ready

Clone the k8sdevopscookbook/src repository to your workstation to use the manifest files under the chapter3 directory:

$ git clone https://github.com/k8sdevopscookbook/src.git
$ cd /src/chapter3

Make sure you have the necessary credentials to use GCP services and have access to the current project. If you don't have one already, go to https://console.cloud.google.com and create an account.

How to do it...

This section is further divided into the following subsections to make this process easier:

Installing and configuring the Spin CLI
Configuring a service account for the CI/CD
Configuring events to trigger the pipeline...

Setting up a CI/CD pipeline on Azure DevOps

Azure DevOps provides version control, reporting, automated builds, and project/lab/testing and release management capabilities. Azure DevOps is available as a SaaS or on-premises server product. In this section, we will cover the Azure DevOps workflow configuration and built-in CI/CD capabilities using the SaaS product. You will learn how to manage workflows and create Azure pipelines.

Getting ready

In the following recipe, you will learn how to create a pipeline example in a repository you own by adding a YAML file. This recipe requires an active GitHub account with a project ready to be built. We will use AKS to demonstrate continuous delivery with Azure Pipelines.

All the operations mentioned here require an Azure DevOps account. If you don't have one, go to https://azure.microsoft.com/services/devops/ and create one. Deploying the application on Azure Kubernetes Service also requires an active Azure Cloud subscription.

How to do it...

The rest of the chapter is locked

You have been reading a chapter from

Kubernetes - A Complete DevOps Cookbook

Published in: Mar 2020Publisher: PacktISBN-13: 9781838828042

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

undefined

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at €14.99/month. Cancel anytime

Author (1)

Murat Karslioglu

Murat Karslioglu is a distinguished technologist with years of experience using infrastructure tools and technologies. Murat is currently the VP of products at MayaData, a start-up that builds data agility platform for stateful applications, and a maintainer of open source projects, namely OpenEBS and Litmus. In his free time, Murat is busy writing practical articles about DevOps best practices, CI/CD, Kubernetes, and running stateful applications on popular Kubernetes platforms on his blog, Containerized Me. Murat also runs a cloud-native news curator site, The Containerized Today, where he regularly publishes updates on the Kubernetes ecosystem.
Read more about Murat Karslioglu

Other recommended products

Related to this chapter

kubectl: Command-Line Kubernetes in a Nutshell

Kubernetes is a de facto container orchestration system. To manage Kubernetes, you must understand how to work with kubectl, its command-line tool that lets you interact with your clusters to deploy applications and manage their lifecycle. This book is a comprehensive introduction for those who are new to Kubernetes management via the command line.

BookNov 2020136 pages

Kubernetes in Production Best Practices

Kubernetes is a portable, extensible, and open source platform used for orchestrating and managing workloads and services. This book provides detailed coverage of cloud industry standards and best practices and serves as a reference guide for building and operating production-ready Kubernetes infrastructure.

BookMar 2021292 pages

Kubernetes Cookbook

Kubernetes is one of the most popular, sophisticated, and fast-evolving container orchestrators. In this book, you’ll learn the essentials and find out about the advanced administration in Kubernetes. We’ll take you through a step-by-step hands-on approach, which will familiarize you with the Kubernetes ecosystem.

BookMay 2018554 pages

Mastering Service Mesh

Service Mesh helps overcome the operational challenges of connecting, securing, controlling, and observing modern microservices deployment. This book shows you exactly how to use a Service Mesh architecture to manage and operationalize your microservices-based applications.

BookMar 2020626 pages

Hands-On Kubernetes on Azure

This book will help readers to Deploy web applications securely in Microsoft Azure with docker container and having the need for clustering services to achieve high availability, dynamic scalability, and to monitor applications

BookMar 2019258 pages

The DevOps 2.3 Toolkit

Viktor Farcic’s latest book, The DevOps 2.3 Toolkit: Kubernetes, will take you on a hands-on journey with Viktor into the world of Kubernetes, and the tools not only behind the official project but also the wide-range of third-party apps that are available for you to use.

BookSep 2018418 pages

Cloud Native with Kubernetes

Cloud Native with Kubernetes will guide you effectively - from your first steps using Kubernetes right up to running enterprise-grade cloud native applications with best practices. The book covers every aspect of deploying, securing, and operating modern cloud native applications on Kubernetes.

BookJan 2021446 pages

The DevOps 2.4 Toolkit

The DevOps Toolkit 2.4 is a deep exploration of continuous delivery and deployment in Kubernetes using Jenkins. It shows readers how to build, test, and deploy applications in Kubernetes using fully automated Jenkins pipelines.

BookNov 2019398 pages

Learn Kubernetes Security

Kubernetes is a widely used opensource orchestration platform for managing container applications. Developers are not yet aware of the pitfalls of a containerized environment. This book takes you through core security principles, best practices, and real-world use cases to learn mitigation or prevention strategies from known attacks and CVEs.

BookJul 2020330 pages

DevOps with Kubernetes

This book will guide you from container basic concepts to orchestrating containerized applications in Kubernetes. You’ll learn about the Kubernetes basic architecture, components, resources, admission control, and extensions. We’ll show you how to utilize Kubernetes services in three top cloud providers.

BookJan 2019484 pages

Kubernetes Design Patterns and Extensions

Kubernetes is an open source platform that automates scaling, deployment, and management of container-based applications. The book starts by explaining basics about container orchestration and then moves on to explain how the components of a complex system, such as Kubernetes, interact with each other and helps develop vital skills for troubleshooting Kubernetes clusters and applications running in Kubernetes clusters. Once you are done reading the book, you can easily develop and deploy your own applications with Kubernetes in no time.

BookSep 2018106 pages

Kubernetes for Developers

Kubernetes provides a means to describe what your application needs and how it should run by orchestrating containers on your behalf to operate your software across a single, dozens, or hundreds of machines. Originally created and open sourced from Google, you can use their technology to help run, test, and scale your applications regardless of which cloud provider you use, or even running it locally on your own hardware. This book will show you how to take advantage of this amazing technology by introducing the key concepts and walking you through examples in both NodeJS and Python.

BookApr 2018374 pages

Personalised recommendations for you

Based on your interests and search pattern

Designing and Implementing Microsoft Azure Networking Solutions

Designing and Implementing Microsoft Azure Networking Solutions Exam Ref AZ-700 is an all-encompassing guide to the AZ-700 exam and contains all the information you need to succeed in the world of virtual networking with Azure. With this book, you will be fully prepared for the exam and the world of cloud networking.

BookAug 2023524 pages

Microsoft 365 Security, Compliance, and Identity Administration

The Microsoft 365 Security, Compliance, and Identity Administration is a comprehensive guide that helps you employ Microsoft 365's robust suite of features and empowers you to optimize your administrative tasks.

BookAug 2023630 pages

Zero Trust Overview and Playbook Introduction

Get started on Zero Trust with this step-by-step playbook and learn everything you need to know for a successful Zero Trust journey with tailored guidance for every role, covering strategy, operations, architecture, implementation, and measuring success. This book will become an indispensable reference for everyone in your organization.

BookOct 2023240 pages

The Self-Taught Cloud Computing Engineer

This self-study book helps you master multiple clouds, including AWS, Azure, and GCP, and serves as a roadmap to becoming a certified cloud computing expert. The book will guide you to develop a professional cloud career by helping you build a broad cloud knowledge base, developing hands-on cloud computing skills, and getting cloud certified.

BookSep 2023472 pages

Technology Operating Models for Cloud and Edge

This book will help you build and create ownership of a technology operating model, as well as connect your leadership with engineering and operations, keeping your internal and external customers in mind. It provides practical tips on why, where, and how to make the cloud and edge platform paradigm sing for you, your team, and your organization.

BookAug 2023228 pages

Azure Architecture Explained

Azure is the preferred platform to build mission-critical and secure apps. This book provides comprehensive coverage of essential Azure products, services, and solutions vital for every solution architect's success. Elevate your knowledge and master the critical components of Azure to excel in your role with Azure Architecture Explained.

BookSep 2023446 pages

Pentesting Active Directory and Windows-based Infrastructure

This practical guide helps you explore the pentesting of Microsoft infrastructure in detail, and enhances your offensive skillset by showing you the different ways to perform security assessment. This book will help blue teamers and IT engineers get up to speed with possible security issues they may encounter in their Windows environments.

BookNov 2023360 pages

Practical Ansible

In Practical Ansible, you'll work with the latest release of Ansible and learn to solve complex issues quickly with the help of task-oriented scenarios. You'll start by installing and configuring Ansible to automate monotonous and repetitive IT tasks and get to grips with concepts such as playbooks, inventories, plugins, collections, and network modules.

BookSep 2023420 pages

Windows 11 for Enterprise Administrators

Microsoft’s launch of Windows 11 is a step toward satisfying the enterprise administrator’s needs for better management and enhanced user experience customization. This book provides the enterprise administrator with the knowledge needed to fully utilize the advanced feature set of Windows 11 Enterprise.

BookOct 2023286 pages

The Linux DevOps Handbook

This book is for software and IT professionals seeking knowledge on Linux systems and DevOps practices. This book will provide you with guidance and tools to learn and gain proficiency in managing Linux-based infrastructures and knowledge of DevOps.

BookNov 2023428 pages2