Ceph OSD peering
Before you can write data to a placement group, it must be in an active
state, and it should be in a clean state. For Ceph to determine the current
state of a placement group, the primary OSD of the placement group that is, the first OSD in the
acting set, peers with the secondary and tertiary OSDs to establish agreement on the current state
of the placement group.
Figure 1 is an example that assumes a pool with three replicas of the PG.