Packt+ | Advance your knowledge in tech

0

All Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Free Learning

Ceph Cookbook

You're reading from Ceph Cookbook Practical recipes to design, implement, operate, and manage Ceph storage systems

Product type Paperback

Published in Nov 2017

Publisher Packt

ISBN-13 9781788391061

Length 466 pages

Edition 2nd Edition

Languages

C++

Tools

Ceph

Concepts

Cloud Computing

Authors (3):

Karan Singh

Hackett

Umrao

View More author details

Table of Contents (23) Chapters

Title Page

Credits

Disclaimer

Foreword

About the Authors

About the Reviewer

www.PacktPub.com

Customer Feedback

Preface

1. Ceph – Introduction and Beyond FREE CHAPTER

2. Working with Ceph Block Device

3. Working with Ceph and OpenStack

4. Working with Ceph Object Storage

5. Working with Ceph Object Storage Multi-Site v2

6. Working with the Ceph Filesystem

7. Monitoring Ceph Clusters

8. Operating and Managing a Ceph Cluster

9. Ceph under the Hood

10. Production Planning and Performance Tuning for Ceph

11. The Virtual Storage Manager for Ceph

12. More on Ceph

13. An Introduction to Troubleshooting Ceph

14. Upgrading Your Ceph Cluster from Hammer to Jewel

Integrating RADOS Gateway with Hadoop S3A plugin

For data analytics applications that require Hadoop Distributed File System (HDFS) access, the Ceph object gateway can be accessed using the Apache S3A connector for Hadoop. The S3A connector is an open source tool that presents S3 compatible object storage as an HDFS file system with HDFS file system read and write semantics to the applications while data is stored in the Ceph object gateway.

Ceph object gateway Jewel version 10.2.9 is fully compatible with the S3A connector that ships with Hadoop 2.7.3.

How to do it...

You can use client-node1 to configure Hadoop S3A client.

Install Java packages in the client-node1:

    # yum install java* -y

Download the Hadoop .tar file from https://archive.apache.org/dist/hadoop/core/hadoop-2.7.3/hadoop-2.7.3.tar.gz:

Note

We have also uploaded the hadoop-2.7.3.tar.gz file in GitHub - https://github.com/PacktPublishing/Ceph-Cookbook-Second-Edition/raw/master/hadoop-2.7.3.tar.gz if it will be removed from http...

The rest of the chapter is locked

Register for a free Packt account to unlock a world of extra content!

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at $15.99/month. Cancel anytime

Authors (3)

Karan Singh

Karan Singh

Karan is an IT expert and passionate tech enthusiast living with his beautiful wife Monika in Finland. He holds Honours degree in Bachelor of Computer Science and a Master degree in System Engineering from BITS, Pilani. Apart from this, he is a certified professional for technologies like OpenStack, NetApp and Oracle Solaris. Karan is currently working as a System Specialist of Storage and Cloud Platform for CSC - IT Center for Science Ltd. focusing all his energies on providing IaaS cloud solutions based on OpenStack and Ceph and building economic multi-petabyte storage system using Ceph. Karan possesses a rich skill set and working experience of a variety of cloud technologies. He devotes a part of his time to R&D and learning technologies. He is also the author of the very first book on Ceph titled Learning Ceph, published in 2014. Karan possesses extensive system administration skills and has excellent working experience on a variety of Unix environments, backup, enterprise storage systems, and cloud platforms. When not working on Ceph and OpenStack, Karan can be found working with Configuration management, containers and devops related tools. He loves writing about technologies and is an avid blogger. You can reach him on Twitter.

See other products by Karan Singh

Hackett

Hackett

Michael Hackett is a storage and SAN expert in customer support. He has been working on Ceph and storage-related products for over 12 years. Apart from this, he holds several storage and SAN-based certifications and prides himself on his ability to troubleshoot and adapt to new complex issues. Michael is currently working at Red Hat, based in Massachusetts, where he is a principal software maintenance engineer for Red Hat Ceph and the technical product lead for the global Ceph team. Michael lives in Massachusetts with his wife, Nicole, his two sons, and their dog. He is an avid sports fan and enjoys time with his family.

See other products by Hackett

Umrao

Umrao

Vikhyat Umrao has 9 years of experience with distributed storage products as a sustenance engineer and in the last couple of years, he has been working on software-defined storage technology, with specific expertise in Ceph Unified Storage. He has been working on Ceph for over 3 years now and in his current position at Red Hat, he focuses on the support and development of Ceph to solve Red Hat Ceph storage customer issues and upstream reported issues. He is based in the Greater Boston area, where he is a principal software maintenance engineer for Red Hat Ceph Storage. Vikhyat lives with his wife, Pratima, and he likes to explore new places.

See other products by Umrao

Other recommended products

Related to this chapter

Ceph is an open source, software-defined storage solution that leverages and runs on a commodity hardware to provide Exabyte-level scalability. Ceph's popularity is growing as it is well known to be a highly reliable storage system with no single point of failure and no vendor lock-in.

Oct 2017 11h 20m

Ceph is an open source distributed storage system that is scalable to Exabyte deployments. Mastering Ceph guides you through the journey to become an expert on ceph.

Ceph has enjoyed rapid adoption both from developers and end users alike, with several well-known corporations being involved in the project. With every new release the scale of its performance and feature set continue to grow, further enhancing Ceph's status. In this book we will cover a wide variety of topics from installing and managing a Ceph cluster, and how to recover from disasters, should you ever find yourself in that situation.

Mar 2019 11h 52m

Mastering Proxmox

Mastering Proxmox

Proxmox is an open source server virtualization solution that has enterprise-class features to manage virtual machines, to be used for storage, and to virtualize both Linux and Windows application workloads. This book will help you become an expert in effectively building virtual environments with Proxmox and also help you tackle the day-to-day challenges faced while managing Proxmox clusters.

Nov 2017 16h 28m

Extending OpenStack

Extending OpenStack

OpenStack is a very popular cloud computing platform that has enabled several organizations during the last few years to successfully implement their Infrastructure as a Service (IaaS) platforms. This book will guide you through new features of the latest OpenStack releases and how to bring them into production straightaway in an agile way.

Feb 2018 10h 0m

Mastering OpenStack

Mastering OpenStack

The book will show you how to carry out performance tuning based on OpenStack service logs. You will be able to master OpenStack benchmarking and performance tuning. By the end of the book, you'll be ready to take steps to deploy and manage an OpenStack cloud with the latest open source technologies

Apr 2017 15h 40m

Personalised recommendations for you

Based on your interests and search pattern

Mastering Palo Alto Networks

Mastering Palo Alto Networks

Mastering Palo Alto Networks is a hands-on guide that helps you progress from a beginner to an expert in configuring Palo Alto firewalls. It covers setup, management, and optimization with real-world examples for both on-prem and cloud environments.

May 2025 21h 32m

Cloud Native Anti-Patterns

Cloud Native Anti-Patterns

Uncover and fix cloud native anti-patterns across strategy, culture, security, and operations. This book guides you through the practical steps to avoid common traps and shift your organization toward cloud-native best practices that drive lasting success.

Mar 2025 14h 44m

AWS for System Administrators

AWS for System Administrators

Master the art of designing, deploying, and managing AWS infrastructure with industry best practices. You'll learn to automate workflows, optimize costs, and implement robust disaster recovery strategies for scalable cloud success.

May 2025 14h 12m

Kubernetes for Generative AI Solutions

Kubernetes for Generative AI Solutions

Learn step by step how to design, optimize, and deploy Generative AI projects on Kubernetes. Covering networking, observability, security, scaling, and cost optimization strategies, this guide takes you from first deployment to production excellence.

Jun 2025 11h 8m

Azure Cloud Projects

Azure Cloud Projects

Azure Cloud Projects offers a hands-on introduction to Microsoft Azure, designed to help you build real-world cloud solutions, develop job-ready skills, and apply best practices that are widely used across the cloud computing industry.

May 2025 8h 28m

Sustainable Cloud Development

Sustainable Cloud Development

This book introduces best practices for developing and deploying high-performing, eco-friendly cloud applications, helping you meet sustainability goals while delivering efficient cloud solutions.

Mar 2025 9h 12m

SLIs and SLOs Demystified

SLIs and SLOs Demystified

This comprehensive guide to reliability engineering dives deep into SLIs, SLOs, observability, and incident management. It shows you how to optimize system reliability and make data-driven decisions to balance performance and business goals.

Apr 2025 10h 0m