Cephalocon 2024

Remote replication (for block, file, and object workload) is a highly desirable feature for backup, migration, and disaster recovery. Ceph offers a highly capable but non-homogenous user experience for remote replication across different workloads (RBD mirroring, CephFS mirroring, and RGW Multisite). The Squid release of MicroCeph introduces a new set of APIs that expose standardized procedures for remote cluster awareness and remote replication for the mentioned Ceph workloads. This lightning talk will highlight implementation details while demoing RBD remote replication in MicroCeph and plans for CephFs and RGW remote replication roadmap.

Pawsey receives infrequent blocks of government funding to provide supercomputing, cloud and data services typically at no cost to scientific researchers in Australia. This has a big impact on both the way requirements are determined and on the design and procurement model. Our new 20PB cluster pushes the bounds of what is recommended, for performance and for node density, but we are confident it will serve researchers' needs over the lifespan of the equipment and beyond. This talk will look at the details of this design, and how we determined them, tested them, and increased our confidence of success. Many of these factors are useful in deploying any new cluster, so you will take away some tips on how to get started, or use the experience you already have to build the next one.

Ceph supports a wide range of Erasure Coding plugins and techniques. This talk will give a brief overview of the different erasure coding plugins supported by Ceph along with some interesting detail about how the various techniques for each plugin works. After giving an overview of the different plugins and techniques, we will discuss our motivations for changing the default plugin from Jerasure to ISA-L, including highlighting some of the more recent optimisations supported by ISA-L. We will also show some preliminary performance results supporting this decision.

// What if... there is a 24*7 running Ceph cluster at every home? // What is CephBox project? A DIY opensource Home cloud NAS solution with Ceph as the backbone. Why CephBox? A product must be a solution to real world problem: Cloud storage for personal use is 'expensive' and 'superfluous', whereas the external Hard drives and USB stick which we use as alternative have a short 'shell life'; waiting for the memories to be lost forever. Although personal data doesn't have high monetary value associated to it like enterprise business data, it has tremendous emotional value. There should be a de-centralized hybrid solution for personal data storage without cutting off the benefits of cloud storage. I would like to present my research and experience of building a small but efficient Ceph cluster on Raspberry pi servers to manage the storage needs of my family and myself. Agenda : Building a Ceph cluster on Raspberry pi servers. Why is CephBox better than other NAS alternatives. How to use S3 apps to store and automatically backup photos from the phone in the home network. How to create a 3-2-1 storage solution with CephBox which guarantee lifetime longevity of your personal data.

The ARM ecosystem is becoming increasingly robust, and ensuring the stability and high performance of Ceph on the ARM platform is crucial. Due to some reasons, the ARM CI has been almost abandoned in recent years. Over the past year, Rongqi's team has been actively fixing environment and software issues to maintain Ceph's operation on ARM. The team also continuously monitors Ceph's performance on ARM. In this Lightning Talk, he will showcase the achievements on the ARM CI up to now. Additionally, in the performance section, he will discuss how Ceph's integration with UADK (User Space Accelerator Development Kit, a general-purpose user space accelerator framework that uses shared virtual address (SVA) technology to provide a unified programming interface for hardware acceleration computing cryptography and compression algorithms) enables compression under low CPU load. The T version will include this by default.

The Ceph Ambassador program recognizes individuals in the community who are participating and helping with community activities and engaging with other community members. They are an amazing group of Ceph experts and community leaders in various regions across the world who are available to support the Ceph community within their region. This talk will cover an Overview of the Ceph Ambassador program and its goals. I’ll be sharing about the various events and initiatives involving the ambassadors to inspire and drive future activities, community growth, engagement, and development collecting feedback from the community. It has been a nice year in the Ceph community with Ceph Days being successfully organized across the world. The Ceph Ambassadors look forward to inspiring the community and contributing towards the Ceph project's success.

We have been working to improve erasure coding performance, such that it performs almost as well as replica 3 configurations for all configurations, including block and file. Our aim here is to expose the wider Ceph community to the changes we're making to erasure coding and pave the way for wider adoption as we increase visibility of performance improvements over time. In this talk we will share the latest news on erasure coding improvements, highlight both merged and in progress PRs that are of interest, and include performance benchmarks on the latest experimental code.

Introducing the new Pulpito interface with unique features, including job scheduling from web, one-click run termination, rerunning and sharing saved command configurations, and more! This talk will walk you through all the new capabilities and tricks of Pulpito-NG, which streamline the entire Teuthology experience.

A cyclic redundancy check (CRC) is an error-detecting code widely used in digital networks and storage devices to identify accidental changes in digital data. Ceph employs CRC checksums to ensure data correctness during network transmission and to maintain data integrity in Bluestore. For RBD 4K random write and random read workloads, we observed that the CRC32C operation size primarily ranges from 4 to 292 bytes. Specifically, for 4K random writes, 80% of the operations are smaller than 292 bytes, while for 4K random reads, 83% are smaller than 254 bytes. The most common sizes are 28 bytes and 41 bytes, accounting for nearly 40%; these correspond to 'preamble_block_t' and 'ceph_msg_header2', respectively. Given the characteristics of the CRC32C operation, we optimized it for smaller sizes by using inline assembly code to unfold the CRC32C function 'ceph_crc32c_aarch64'. Additionally, we optimized the encoding procedure to minimize the occurrence of small-sized data segments. We tested these optimizations on the RBD 4K random write and random read workloads, resulting in a 2% improvement in throughput.

File system gateways like NFS-Ganesha are capable of immense throughput but can be hindered by thread-centric synchronicity. The default I/O interfaces built in libcephfs rely on threading this way which makes it difficult to achieve high performance throughput. Enter async I/O in libcephfs – a transformative approach that changes how file system gateways interact with CephFS. By leveraging async I/O, protocols can maximize resource utilization, enhance system responsiveness especially to low latency operations. In this talk, we will explore how NFS-Ganesha led to the development of async I/O in CephFS, detailing its journey from inception through various phases of improvement and stabilization. We will discuss the current state of async I/O in CephFS, including how NFS-Ganesha makes the most out of it, how it boosts performance with CephFS, and future applications of the API on other gateways. Think I/O in CephFS? Think Async I/O!