Add More Services into CDH plugin¶
This specification proposes to add below services into CDH plugins: Flume, Sentry, Sqoop, SOLR, Key-Value Store Indexer, and Impala.
Those services can be added into CDH plugin by using CM API first_run to start them, which can save much effort to prepare and start those services one by one.
Now services supported in Sahara CDH plugin is still limited. We want to add more services ASAP. They are Flume, Sentry, Sqoop, SOLR, Key-Value Store Indexer, and Impala.
Since we plan to use first_run to prepare and start those services, we will not need to call other CM APIs for those services in start_cluster() method.
The implementation will need below changes on codes for each service:
Add process names of the service in some places.
Add service or process configuration, and network ports to open.
Add service validation.
Modify some utils methods, like get_service, to meet more services.
Some other changes for a few specific services if needed.
Data model impact¶
REST API impact¶
Other end user impact¶
Sahara-dashboard / Horizon impact¶
- Primary assignee:
- Other contributors:
The work items will be:
Change python codes in sahara/sahara/plugins/cdh.
Add more service resource files in sahara/sahara/plugins/cdh/resources.
Test and evaluate the change.
Use an integration test to create a cluster.