Ceph Cookbook

Over 100 effective recipes to help you design, implement, and manage the software-defined and massively scalable Ceph storage system

Ceph Cookbook

Cookbook
Karan Singh

3 customer reviews
Over 100 effective recipes to help you design, implement, and manage the software-defined and massively scalable Ceph storage system
$35.99
$44.99
RRP $35.99
RRP $44.99
eBook
Print + eBook

Instantly access this course right now and get the skills you need in 2017

With unlimited access to a constantly growing library of over 4,000 eBooks and Videos, a subscription to Mapt gives you everything you need to learn new skills. Cancel anytime.

Preview in Mapt

Book Details

ISBN 139781784393502
Paperback326 pages

Book Description

Ceph is a unified, distributed storage system designed for excellent performance, reliability, and scalability. This cutting-edge technology has been transforming the storage industry, and is evolving rapidly as a leader in software-defined storage space, extending full support to cloud platforms such as Openstack and Cloudstack, including virtualization platforms. It is the most popular storage backend for Openstack, public, and private clouds, so is the first choice for a storage solution. Ceph is backed by RedHat and is developed by a thriving open source community of individual developers as well as several companies across the globe.

This book takes you from a basic knowledge of Ceph to an expert understanding of the most advanced features, walking you through building up a production-grade Ceph storage cluster and helping you develop all the skills you need to plan, deploy, and effectively manage your Ceph cluster. Beginning with the basics, you’ll create a Ceph cluster, followed by block, object, and file storage provisioning. Next, you’ll get a step-by-step tutorial on integrating it with OpenStack and building a Dropbox-like object storage solution. We’ll also take a look at federated architecture and CephFS, and you’ll dive into Calamari and VSM for monitoring the Ceph environment. You’ll develop expert knowledge on troubleshooting and benchmarking your Ceph storage cluster. Finally, you’ll get to grips with the best practices to operate Ceph in a production environment.

Table of Contents

Chapter 1: Ceph – Introduction and Beyond
Introduction
Ceph – the beginning of a new era
RAID – the end of an era
Ceph – the architectural overview
Planning the Ceph deployment
Setting up a virtual infrastructure
Installing and configuring Ceph
Scaling up your Ceph cluster
Using Ceph cluster with a hands-on approach
Chapter 2: Working with Ceph Block Device
Introduction
Working with Ceph Block Device
Configuring Ceph client
Creating Ceph Block Device
Mapping Ceph Block Device
Ceph RBD resizing
Working with RBD snapshots
Working with RBD Clones
A quick look at OpenStack
Ceph – the best match for OpenStack
Setting up OpenStack
Configuring OpenStack as Ceph clients
Configuring Glance for Ceph backend
Configuring Cinder for Ceph backend
Configuring Nova to attach Ceph RBD
Configuring Nova to boot instances from Ceph RBD
Chapter 3: Working with Ceph Object Storage
Introduction
Understanding Ceph object storage
RADOS Gateway standard setup, installation, and configuration
Creating the radosgw user
Accessing Ceph object storage using S3 API
Accessing Ceph object storage using the Swift API
Integrating RADOS Gateway with OpenStack Keystone
Configuring Ceph federated gateways
Testing the radosgw federated configuration
Building file sync and share service using RGW
Chapter 4: Working with the Ceph Filesystem
Introduction
Understanding Ceph Filesystem and MDS
Deploying Ceph MDS
Accessing CephFS via kernel driver
Accessing CephFS via FUSE client
Exporting Ceph Filesystem as NFS
ceph-dokan – CephFS for Windows clients
CephFS a drop-in replacement for HDFS
Chapter 5: Monitoring Ceph Clusters using Calamari
Introduction
Ceph cluster monitoring – the classic way
Monitoring Ceph clusters
Introducing Ceph Calamari
Building Calamari server packages
Building Calamari client packages
Setting up Calamari master server
Adding Ceph nodes to Calamari
Monitoring Ceph clusters from the Calamari dashboard
Troubleshooting Calamari
Chapter 6: Operating and Managing a Ceph Cluster
Introduction
Understanding Ceph service management
Managing the cluster configuration file
Running Ceph with SYSVINIT
Running Ceph as a service
Scale-up versus scale-out
Scaling out your Ceph cluster
Scaling down your Ceph cluster
Replacing a failed disk in the Ceph cluster
Upgrading your Ceph cluster
Maintaining a Ceph cluster
Chapter 7: Ceph under the Hood
Introduction
Ceph scalability and high availability
Understanding the CRUSH mechanism
CRUSH map internals
Ceph cluster map
High availability monitors
Ceph authentication and authorization
Ceph dynamic cluster management
Ceph placement group
Placement group states
Creating Ceph pools on specific OSDs
Chapter 8: Production Planning and Performance Tuning for Ceph
Introduction
The dynamics of capacity, performance, and cost
Choosing the hardware and software components for Ceph
Ceph recommendation and performance tuning
Ceph erasure coding
Creating an erasure coded pool
Ceph cache tiering
Creating a pool for cache tiering
Creating a cache tier
Configuring a cache tier
Testing a cache tier
Chapter 9: The Virtual Storage Manager for Ceph
Introduction
Understanding the VSM architecture
Setting up the VSM environment
Getting ready for VSM
Installing VSM
Creating a Ceph cluster using VSM
Exploring the VSM dashboard
Upgrading the Ceph cluster using VSM
VSM roadmap
VSM resources
Chapter 10: More on Ceph
Introduction
Benchmarking the Ceph cluster
Disk performance baseline
Baseline network performance
Ceph RADOS bench
RADOS load-gen
Benchmarking the Ceph block device
Benchmarking Ceph RBD using FIO
Ceph admin socket
Using the ceph tell command
Ceph REST API
Profiling Ceph memory
Deploying Ceph using Ansible
The ceph-objectstore tool

What You Will Learn

  • Understand, install, configure, and manage the Ceph storage system
  • Get to grips with performance tuning and benchmarking, and gain practical tips to run Ceph in production
  • Integrate Ceph with OpenStack Cinder, Glance, and nova components
  • Deep dive into Ceph object storage, including s3, swift, and keystone integration
  • Build a Dropbox-like file sync and share service and Ceph federated gateway setup
  • Gain hands-on experience with Calamari and VSM for cluster monitoring
  • Familiarize yourself with Ceph operations such as maintenance, monitoring, and troubleshooting
  • Understand advanced topics including erasure coding, CRUSH map, cache pool, and system maintenance

Authors

Table of Contents

Chapter 1: Ceph – Introduction and Beyond
Introduction
Ceph – the beginning of a new era
RAID – the end of an era
Ceph – the architectural overview
Planning the Ceph deployment
Setting up a virtual infrastructure
Installing and configuring Ceph
Scaling up your Ceph cluster
Using Ceph cluster with a hands-on approach
Chapter 2: Working with Ceph Block Device
Introduction
Working with Ceph Block Device
Configuring Ceph client
Creating Ceph Block Device
Mapping Ceph Block Device
Ceph RBD resizing
Working with RBD snapshots
Working with RBD Clones
A quick look at OpenStack
Ceph – the best match for OpenStack
Setting up OpenStack
Configuring OpenStack as Ceph clients
Configuring Glance for Ceph backend
Configuring Cinder for Ceph backend
Configuring Nova to attach Ceph RBD
Configuring Nova to boot instances from Ceph RBD
Chapter 3: Working with Ceph Object Storage
Introduction
Understanding Ceph object storage
RADOS Gateway standard setup, installation, and configuration
Creating the radosgw user
Accessing Ceph object storage using S3 API
Accessing Ceph object storage using the Swift API
Integrating RADOS Gateway with OpenStack Keystone
Configuring Ceph federated gateways
Testing the radosgw federated configuration
Building file sync and share service using RGW
Chapter 4: Working with the Ceph Filesystem
Introduction
Understanding Ceph Filesystem and MDS
Deploying Ceph MDS
Accessing CephFS via kernel driver
Accessing CephFS via FUSE client
Exporting Ceph Filesystem as NFS
ceph-dokan – CephFS for Windows clients
CephFS a drop-in replacement for HDFS
Chapter 5: Monitoring Ceph Clusters using Calamari
Introduction
Ceph cluster monitoring – the classic way
Monitoring Ceph clusters
Introducing Ceph Calamari
Building Calamari server packages
Building Calamari client packages
Setting up Calamari master server
Adding Ceph nodes to Calamari
Monitoring Ceph clusters from the Calamari dashboard
Troubleshooting Calamari
Chapter 6: Operating and Managing a Ceph Cluster
Introduction
Understanding Ceph service management
Managing the cluster configuration file
Running Ceph with SYSVINIT
Running Ceph as a service
Scale-up versus scale-out
Scaling out your Ceph cluster
Scaling down your Ceph cluster
Replacing a failed disk in the Ceph cluster
Upgrading your Ceph cluster
Maintaining a Ceph cluster
Chapter 7: Ceph under the Hood
Introduction
Ceph scalability and high availability
Understanding the CRUSH mechanism
CRUSH map internals
Ceph cluster map
High availability monitors
Ceph authentication and authorization
Ceph dynamic cluster management
Ceph placement group
Placement group states
Creating Ceph pools on specific OSDs
Chapter 8: Production Planning and Performance Tuning for Ceph
Introduction
The dynamics of capacity, performance, and cost
Choosing the hardware and software components for Ceph
Ceph recommendation and performance tuning
Ceph erasure coding
Creating an erasure coded pool
Ceph cache tiering
Creating a pool for cache tiering
Creating a cache tier
Configuring a cache tier
Testing a cache tier
Chapter 9: The Virtual Storage Manager for Ceph
Introduction
Understanding the VSM architecture
Setting up the VSM environment
Getting ready for VSM
Installing VSM
Creating a Ceph cluster using VSM
Exploring the VSM dashboard
Upgrading the Ceph cluster using VSM
VSM roadmap
VSM resources
Chapter 10: More on Ceph
Introduction
Benchmarking the Ceph cluster
Disk performance baseline
Baseline network performance
Ceph RADOS bench
RADOS load-gen
Benchmarking the Ceph block device
Benchmarking Ceph RBD using FIO
Ceph admin socket
Using the ceph tell command
Ceph REST API
Profiling Ceph memory
Deploying Ceph using Ansible
The ceph-objectstore tool

Book Details

ISBN 139781784393502
Paperback326 pages
Read More
From 3 reviews

Read More Reviews