Ampere_Arm_Processors_for_Ceph_WP_v1_00_20230222_1_fcd19200fb.pdf
免费下载
Ampere® Arm® Processors for Ceph White Paper
Ampere Computing Proprietary and Confidential
AMP 2023-0015
Ampere® Altra® Family 64-Bit Multi-Core Processors
Ampere® Arm® Processors for Ceph White Paper
February 22, 2023
Document Issue 1.00
Ampere® Arm® Processors for Ceph White Paper
Document Issue 1.00
Ampere Computing Proprietary and Confidential
2
Contents
1. Executive Summary ................................................................................................................................................................. 6
1.1 Scope and Audience ........................................................................................................................................................ 6
2. Ceph Architecture Overview ................................................................................................................................................... 7
2.1 Ceph Components ........................................................................................................................................................... 7
2.2 Design Considerations for Ceph ...................................................................................................................................... 8
3. Ampere Tests and Validation of Ceph ..................................................................................................................................... 9
3.1 Ampere Test Bed Architecture and BOM ....................................................................................................................... 9
3.2 Hardware Components ................................................................................................................................................... 9
3.3 Software Components................................................................................................................................................... 10
3.4 Supermicro Servers ....................................................................................................................................................... 10
3.5 KIOXIA CD8 NVMes ........................................................................................................................................................ 10
3.6 Pre-Installation Checks and Best Practices ................................................................................................................... 10
3.6.1 BIOS Changes ........................................................................................................................................................ 10
3.6.2 System Memory .................................................................................................................................................... 10
3.6.3 PCIe Bifurcation ..................................................................................................................................................... 10
3.6.4 Network Interface Cards (NICs) ............................................................................................................................ 10
3.6.5 Sysctl ...................................................................................................................................................................... 11
3.6.6 MTU Settings for Cluster Network ........................................................................................................................ 11
3.6.7 Bandwidth Check Between Servers and Clients ................................................................................................... 11
3.6.8 OSD Disks ............................................................................................................................................................... 11
3.6.9 Run Baseline Tests on Disks .................................................................................................................................. 11
3.6.10 FIO (Flexible I/O) for Arm ...................................................................................................................................... 11
4. Ceph Installation .................................................................................................................................................................... 12
5. Performance Testing ............................................................................................................................................................. 13
5.1 Block Storage Tests ....................................................................................................................................................... 13
5.1.1 Single FIO Process on Cluster ................................................................................................................................ 13
5.1.2 Multiple FIO Processes on Cluster ........................................................................................................................ 14
5.2 Object Storage Tests ..................................................................................................................................................... 14
5.2.1 Summary ............................................................................................................................................................... 15
6. Continuous OSD Stress Tests ................................................................................................................................................. 16
6.1 Summary ....................................................................................................................................................................... 16
7. Interoperability tests Heterogeneous CPU Topology ........................................................................................................ 17
8. Power Consumption .............................................................................................................................................................. 18
8.1 Power Consumption: Four-node Cluster with Ampere Processors .............................................................................. 18
8.1.1 Summary ............................................................................................................................................................... 18
Ampere® Arm® Processors for Ceph White Paper
Contents (continued)
Document Issue 1.00
Ampere Computing Proprietary and Confidential
3
8.2 Power Consumption: Ampere vs AMD Nodes .............................................................................................................. 18
8.2.1 Summary ............................................................................................................................................................... 18
9. Migrating an x86 Cluster to Ampere Nodes .......................................................................................................................... 19
9.1 Node and Components Swap-Out ................................................................................................................................ 19
9.1.1 Steps to be Followed ............................................................................................................................................. 19
9.2 Node Swap-Out and Disk Reuse .................................................................................................................................... 20
9.2.1 Steps to be Followed ............................................................................................................................................. 20
9.2.2 Observations ......................................................................................................................................................... 21
10. Ceph Tracker Issues ........................................................................................................................................................... 22
11. Conclusion ......................................................................................................................................................................... 23
12. Appendix ............................................................................................................................................................................ 24
12.1 BIOS ............................................................................................................................................................................... 24
12.2 Linux .............................................................................................................................................................................. 24
12.3 /etc/sysctl.conf .............................................................................................................................................................. 24
12.4 /etc/security/limits.conf ................................................................................................................................................ 24
12.5 Ceph ............................................................................................................................................................................... 25
12.6 FIO Commands .............................................................................................................................................................. 25
12.7 COSbench Workload-config.xml ................................................................................................................................ 26
Document Revision History ........................................................................................................................................................... 27
of 28
免费下载
【版权声明】本文为墨天轮用户原创内容，转载时必须标注文档的来源（墨天轮），文档链接，文档作者等基本信息，否则作者和墨天轮有权追究责任。如果您发现墨天轮中有涉嫌抄袭或者侵权的内容，欢迎发送邮件至：contact@modb.pro进行举报，并提供相关证据，一经查实，墨天轮将立刻删除相关内容。
相关文档
评论