Skip to main content

CES 1.0.0

Release Date: 2024
Based on: Ceph Quincy 17.2.7
Previous Version: Initial Release

Summary​

CES 1.0.0 is the initial release of Clyso Enterprise Storage, based on Ceph Quincy 17.2.7. This release establishes the foundation with essential performance optimizations, stability improvements, and enterprise-focused enhancements.

What's New​

  • Initial CES release based on proven Ceph Quincy 17.2.7
  • Comprehensive performance optimizations for RGW workloads
  • Enhanced OSD performance and stability
  • Improved cluster management and balancing
  • Enterprise dashboard branding
  • Optimized default configurations for production use

Downstream Patches​

common/options: Reduce rgw_thread_pool_size​

Increase default bucket shard count​

  • Change: from 11 to 31
  • Benefit: Improves per-bucket PUT performance dramatically on initial ingest. Pushes off bucket resharding. Some impact on list performance for small buckets, but doesn't hurt large bucket listing performance.

common/options: Increase objecter inflight thresholds​

  • Max in-flight data in bytes: 100_M to 1_G
  • Max in-flight operations: 1_K to 8_K
  • Benefit: Increases performance of RGW workloads and is a common optimization. Allows 8192 128K objects, similar object size target relative to upstream defaults.

ceph-objectstore-tool: make 'rm-omap' command support remove many keys​

osd: increase osd_max_pg_per_osd_hard_ratio to 10​

  • Issue: Hard ratio of 3 hit too often during normal maintenance tasks
  • Solution: Increased to 10 to prevent PG peering issues during host additions

mgr/balancer: set upmap_max_deviation to 1​

  • Issue: Default upmax_max_deviation 5 not effective for balanced clusters
  • Solution: Set to 1 for better cluster balance, especially with many pools

osd: default osd_op_type wpq​

  • Issue: mclock unstable in corner cases in quincy
  • Solution: Setting to wpq for improved stability

Dashboard Enhancements​

  • Update logo on create cluster page
  • CES dashboard branding (logo, constants, favicon, login page links)

Images​

  • Change: Container images use harbor.clyso.com instead of quay.io

Upstream Backports​

os/bluestore: get rid off resulting lba alignment in allocators​

osd/scrub: increasing max_osd_scrubs from 1 to 3​

  • Improvement: Better scrub scheduling resilience
  • Benefit: Reduces susceptibility to scrub delays from local issues

cmake/modules: Fix Debian/Ubuntu RocksDB Performance Issues​

  • Fix: CXXFLAGS optimization for BlueStore RocksDB performance

osd/ECTransaction: Remove incorrect asserts in generate_transactions​

common/options: Set LZ4 compression for bluestore RocksDB​

common/options: Update RocksDB CF Tuning​

  • Optimizations: Multiple buffer and write settings tuned for performance
  • Result: Better RocksDB performance for BlueStore operations

common/options: increase mds_cache_trim_threshold 2x​

  • Change: 256K to 512K
  • Benefit: More active LRU cache management for MDS

mgr/dashboard: disable dashboard v3 in quincy​

IPv6 Support Improvements​

Kubernetes Integration Updates​

Prometheus Integration Fix​

Known Issues​

  • None at time of release