CDH Zookeeper Support

CDH Zookeeper Support

https://blueprints.launchpad.net/sahara/+spec/cdh-zookeeper-support

This specification proposes to add Zookeeper support for CDH Plugin in Sahara.

Problem description

Currently, Zookeeper isn’t supported in the cdh plugin. Zookeeper is a centralized service to provide functions like maintaining configuration, distributed synchronization, and providing group services. It’s important to have a Zookeeper to prevent data loss and to avoid a single point failure(SPoF) in a cluster. It has become a basic service to deploy a hadoop cluster in CDH environment.

Proposed change

The implementation will support CDH 5.0.0. Support Features:

  • Install Zookeeper Service in a CDH cluster
  • Support to run Standalone Zookeeper in a cluster
  • Support to run Replicated Zookeepers(Multiple Servers) in a cluster
  • To have an option to select Zookeeper in the node group templates
  • Most Configuration Parameters Support in a CDH cluster

Alternatives

None

Data model impact

None

REST API impact

None

Other end user impact

The end users need to select Zookeeper process in their node group templates.

Deployer impact

None

Developer impact

None

Sahara-image-elements impact

It will be required to put the necessary packages in the cdh image.

Sahara-dashboard / Horizon impact

None

Implementation

Assignee(s)

Primary assignee:
ken chen
Other contributors:
weiting-chen

Work Items

The work items can be divided to several parts:

  • Investigate Zookeeper service in a CDH cluster via Cloudera Manager(CM)
  • Leverage CM-API Client to call functions to install Zookeep via CM
  • Test and Evaluate the Concept
  • Implement Source Code in Sahara cdh plugin
  • Test the Code

Dependencies

None

Testing

Writing Unit Tests to basically test the configuration. It is also required to have an integration test with the cluster creation.

Documentation Impact

Add Zookeeper in the list and add more information about the configuration.

Creative Commons Attribution 3.0 License

Except where otherwise noted, this document is licensed under Creative Commons Attribution 3.0 License. See all OpenStack Legal Documents.

sahara-specs 0.0.1.dev331