Cephalocon 2024

Pawsey receives infrequent blocks of government funding to provide supercomputing, cloud and data services typically at no cost to scientific researchers in Australia. This has a big impact on both the way requirements are determined and on the design and procurement model. Our new 20PB cluster pushes the bounds of what is recommended, for performance and for node density, but we are confident it will serve researchers' needs over the lifespan of the equipment and beyond. This talk will look at the details of this design, and how we determined them, tested them, and increased our confidence of success. Many of these factors are useful in deploying any new cluster, so you will take away some tips on how to get started, or use the experience you already have to build the next one.

Ceph supports a wide range of Erasure Coding plugins and techniques. This talk will give a brief overview of the different erasure coding plugins supported by Ceph along with some interesting detail about how the various techniques for each plugin works. After giving an overview of the different plugins and techniques, we will discuss our motivations for changing the default plugin from Jerasure to ISA-L, including highlighting some of the more recent optimisations supported by ISA-L. We will also show some preliminary performance results supporting this decision.

// What if... there is a 24*7 running Ceph cluster at every home? // What is CephBox project? A DIY opensource Home cloud NAS solution with Ceph as the backbone. Why CephBox? A product must be a solution to real world problem: Cloud storage for personal use is 'expensive' and 'superfluous', whereas the external Hard drives and USB stick which we use as alternative have a short 'shell life'; waiting for the memories to be lost forever. Although personal data doesn't have high monetary value associated to it like enterprise business data, it has tremendous emotional value. There should be a de-centralized hybrid solution for personal data storage without cutting off the benefits of cloud storage. I would like to present my research and experience of building a small but efficient Ceph cluster on Raspberry pi servers to manage the storage needs of my family and myself. Agenda : Building a Ceph cluster on Raspberry pi servers. Why is CephBox better than other NAS alternatives. How to use S3 apps to store and automatically backup photos from the phone in the home network. How to create a 3-2-1 storage solution with CephBox which guarantee lifetime longevity of your personal data.

Remote replication (for block, file, and object workload) is a highly desirable feature for backup, migration, and disaster recovery. Ceph offers a highly capable but non-homogenous user experience for remote replication across different workloads (RBD mirroring, CephFS mirroring, and RGW Multisite). The Squid release of MicroCeph introduces a new set of APIs that expose standardized procedures for remote cluster awareness and remote replication for the mentioned Ceph workloads. This lightning talk will highlight implementation details while demoing RBD remote replication in MicroCeph and plans for CephFs and RGW remote replication roadmap.