Can one SCM support multiple OM HAs? #4803
-
Hi, I'm currently exploring the possibilities of allowing multiple OM HAs to share one SCM (and the Datanodes it manages). From what I currently understand, SCM should technically be able to support multiple OM HAs since its responsibility is as a block space manager. Hence it should not matter whether there are multiple OM HAs (i.e. SCM clients). Are there any possibilities of conflicts between the OM HAs or things I should look out for? Thanks in advance. |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 10 replies
-
Do you mean OM HA ? In a cluster, I have seen multiple OMs in which one is leader and other followers, not sure what you meant by "SCM support multiple OMs" |
Beta Was this translation helpful? Give feedback.
-
@ivandika3 Architecturally, the separation of front-end load and back-end load does allow for what you ask, but it would need significant code changes in the client to have a unified view across OMs. |
Beta Was this translation helpful? Give feedback.
@ivandika3 that is super interesting. The HDDS layer in the architecture (SCM + Datanode) should not depend on OM's decisions. This is a worthy experiment to run and test. If a single namespace is unnecessary and OM's can operate as independent entities, you gain by pooling the capacity across multiple namespaces, which has value. Feel free to let us know how we can help.