Plugin for Sahara with MapR¶
This specification proposes to add MapR plugin with MapR Distribution of Hadoop in Sahara.
The MapR Distribution for Apache Hadoop provides organizations with an enterprise-grade distributed data platform to reliably store and process big data. MapR packages a broad set of Apache open source ecosystem projects enabling batch, interactive, or real-time applications. The data platform and the projects are all tied together through an advanced management console to monitor and manage the entire system.
MapR is one of the largest distributions for Hadoop supporting more than 20 open source projects. MapR also supports multiple versions of the various individual projects thereby allowing users to migrate to the latest versions at their own pace. The table below shows all of the projects actively supported in the current GA version of MapR Distribution for Hadoop as well as in the next Beta release.
MapR plugin implementation will support Hadoop 0.20.2 and Hadoop 2.4.1. Plugin will support key Sahara features:
Cluster topology validation
Integration with Swift
Plugin will be able to install following services:
Oozie (two versions are supported)
Hive (two versions are supported)
MapR plugin will support the following OS: Ubuntu 14.04 and CentOS 6.5.
MapR plugin will support the following node types:
Nodes Running ZooKeeper and CLDB
Nodes for Data Storage and Processing
In a production MapR cluster, some nodes are typically dedicated to cluster coordination and management, and other nodes are tasked with data storage and processing duties. An edge node provides user access to the cluster, concentrating open user privileges on a single host.
Data model impact¶
REST API impact¶
Other end user impact¶
MapR plugin uses specific pre-installed images with MapR local repository files.
Sahara-dashboard / Horizon impact¶
- Primary assignee:
- Other contributors:
Add implementation of plugin for bare images.
Depends on OpenStack requirements.
Add unit tests to Sahara to cover basic functionality of plugin
Add integration tests to Sahara
MapR plugin documentation should be added to the plugin section of Sahara docs.