Skip to main content
RunBook Academy

CephLXXXIII · Dedicated Ceph ClusterDedicated Ceph Cluster

Comparing the architectures honestly

Intermediate⏱ ~17 minceph

What you'll learn

  • Apply a decision framework to the architecture choice
  • Weight the criteria for a specific situation
  • Recognise when the answer changes
  • Document the decision and its assumptions

Prerequisites

None — start here.

Verified against Ceph Tentacle 20.2.x · Ceph Squid 19.2.x (supported previous) · cephadm matches the verified Ceph release · podman 4.x · csi-rbd and csi-cephfs current · RBD / CephFS / RGW current (matches Ceph release) · Linux kernel 5.15+ (5.10 minimum) · Ubuntu 24.04 LTS (Ceph host baseline) · Debian 12 (Bookworm) (Ceph host baseline) · Rocky Linux / RHEL / AlmaLinux 9.x (Ceph host baseline) · Proxmox VE 9.x (cross-course integration) · Kubernetes 1.31+ (cross-course integration) · 2026-08-18

Not yet marked complete on this device.

Why this matters in production

The choice is frequently made on cost or on preference. A framework makes it a decision that can be revisited when the inputs change.

The criteria

CriterionHyper-convergedDedicatedWeight when
Hardware costbetterworsebudget constrained
Capacity efficiencyworse at small Nbettercapacity constrained
Contentionpresentabsentlatency sensitive
Failure independenceworsebetteravailability critical
Scaling flexibilityfixed ratioindependentgrowth uncertain
Operational simplicityone clustertwo systemssmall team
Maintenance coordinationworsebetterfrequent changes
Multi-consumer supportpoorgoodshared service

Weighting for a situation

Small business, 3 nodes, one workload, cost-sensitive:
  hardware cost:      high weight → hyper-converged
  failure independence: low weight (accepted)
  contention:         low weight (single workload)
  → hyper-converged

Enterprise, 20 nodes, mixed workloads, availability-critical:
  failure independence: high weight → dedicated
  contention:         high weight → dedicated
  multi-consumer:     high weight → dedicated
  hardware cost:      moderate weight
  → dedicated

Growing team, 8 nodes, uncertain growth:
  scaling flexibility: high weight → dedicated
  hardware cost:      high weight → hyper-converged
  → depends on which uncertainty costs more

The third case is genuinely ambiguous, and recognising that is more useful than forcing an answer.

When the answer changes

ChangeMay flip the decision
Node count crossing ~12toward dedicated
A second consumer appearingtoward dedicated
Compute and storage growth divergingtoward dedicated
Budget pressuretoward hyper-converged
Latency requirements tighteningtoward dedicated
Team size shrinkingtoward hyper-converged, if simpler
# the measurable signals
ceph osd df | awk 'NR>1 {n++} END {print n, "OSDs"}'
pvecm nodes | tail -n +2 | wc -l

Documenting the decision

Architecture decision: hyper-converged
Date:       2026-03-14
Scale:      6 nodes
Assumptions:
  - single consumer (the Proxmox cluster itself)
  - compute and storage growing together
  - latency requirement: p99 under 20 ms
  - budget constrained
Revisit when:
  - node count exceeds 10
  - a second consumer appears
  - latency requirement tightens below 10 ms
  - compute and storage growth diverge by more than 2x

The revisit triggers are what make the decision reviewable rather than permanent by default.

Quiz

Knowledge check · 4 questions

  1. Q1. Why should revisit triggers be recorded with an architecture decision?

  2. Q2. The architecture choice always has a clearly correct answer if the criteria are weighed properly.

  3. Q3. Review an existing architecture decision.

    A hyper-converged cluster chosen three years ago at six nodes now runs eighteen nodes and serves two additional teams. No review has occurred.

  4. Q4. Why are the ambiguous architecture cases the most important to document?

Passing score: 75%. Answers are checked in this browser.

Production discipline

Record the architecture decision with its assumptions and explicit revisit triggers — node count, consumer count, latency requirements — or it becomes permanent by default. Document the ambiguous cases most carefully; those are the ones a future reviewer cannot reconstruct.

Cross-course references

  • Kubernetes: architecture decision records serve exactly this reviewability purpose
  • Linux: any infrastructure choice outlives the conditions that produced it