cookbook 'hadoop', '= 0.8.0'
hadoop
(72) Versions
0.8.0
-
-
2.14.0
-
2.13.0
-
2.12.0
-
2.11.5
-
2.11.4
-
2.11.3
-
2.11.2
-
2.11.1
-
2.11.0
-
2.10.1
-
2.10.0
-
2.9.0
-
2.8.0
-
2.7.1
-
2.7.0
-
2.6.0
-
2.5.0
-
2.4.1
-
2.4.0
-
2.3.3
-
2.3.2
-
2.3.1
-
2.3.0
-
2.2.1
-
2.2.0
-
2.1.0
-
2.0.9
-
2.0.8
-
2.0.7
-
2.0.6
-
2.0.5
-
2.0.4
-
2.0.3
-
2.0.2
-
2.0.1
-
2.0.0
-
1.13.1
-
1.13.0
-
1.12.0
-
1.11.2
-
1.11.1
-
1.10.1
-
1.10.0
-
1.9.2
-
1.9.1
-
1.9.0
-
1.8.1
-
1.8.0
-
1.7.1
-
1.7.0
-
1.6.1
-
1.6.0
-
1.5.0
-
1.4.1
-
1.4.0
-
1.3.2
-
1.3.1
-
1.3.0
-
1.2.0
-
1.1.1
-
1.1.0
-
1.0.9
-
1.0.8
-
1.0.7
-
1.0.6
-
1.0.5
-
1.0.4
-
1.0.3
-
1.0.2
-
1.0.1
-
1.0.0
-
0.8.0
Follow52
- 2.14.0
- 2.13.0
- 2.12.0
- 2.11.5
- 2.11.4
- 2.11.3
- 2.11.2
- 2.11.1
- 2.11.0
- 2.10.1
- 2.10.0
- 2.9.0
- 2.8.0
- 2.7.1
- 2.7.0
- 2.6.0
- 2.5.0
- 2.4.1
- 2.4.0
- 2.3.3
- 2.3.2
- 2.3.1
- 2.3.0
- 2.2.1
- 2.2.0
- 2.1.0
- 2.0.9
- 2.0.8
- 2.0.7
- 2.0.6
- 2.0.5
- 2.0.4
- 2.0.3
- 2.0.2
- 2.0.1
- 2.0.0
- 1.13.1
- 1.13.0
- 1.12.0
- 1.11.2
- 1.11.1
- 1.10.1
- 1.10.0
- 1.9.2
- 1.9.1
- 1.9.0
- 1.8.1
- 1.8.0
- 1.7.1
- 1.7.0
- 1.6.1
- 1.6.0
- 1.5.0
- 1.4.1
- 1.4.0
- 1.3.2
- 1.3.1
- 1.3.0
- 1.2.0
- 1.1.1
- 1.1.0
- 1.0.9
- 1.0.8
- 1.0.7
- 1.0.6
- 1.0.5
- 1.0.4
- 1.0.3
- 1.0.2
- 1.0.1
- 1.0.0
- 0.8.0
Installs/Configures Hadoop (HDFS/YARN/MRv2), HBase, Hive, Flume, Oozie, Pig, Spark, Storm, Tez, and ZooKeeper
cookbook 'hadoop', '= 0.8.0', :supermarket
knife supermarket install hadoop
knife supermarket download hadoop
= DESCRIPTION:
Installs Apache hadoop and sets up a basic distributed cluster per the quick start documentation.
= REQUIREMENTS:
== Platform:
Tested on Ubuntu 8.10, though should work on most Linux distributions, see hadoop[:java_home].
== Cookbooks:
Opscode cookbooks, http://github.com/opscode/cookbooks/tree/master:
* java
= ATTRIBUTES:
* hadoop[:mirror_url] - Get a mirror from http://www.apache.org/dyn/closer.cgi/hadoop/core/.
* hadoop[:version] - Specify the version of hadoop to install.
* hadoop[:uid] - Default userid of the hadoop user.
* hadoop[:gid] - Default group for the hadoop user.
* hadoop[:java_home] - You will probably want to change this to match where Java is installed on your platform.
You may wish to add more attributes for tuning the configuration file templates.
= USAGE:
This cookbook performs the tasks described in the Hadoop Quick Start[1] to get the software installed. You should copy this to a site-cookbook and modify the templates to meet your requirements.
Once the recipe is run, the distributed filesystem can be formated using the script /usr/bin/hadoop.
sudo -u hadoop /usr/bin/hadoop namenode -format
You may need to set up SSH keys for hadoop management commands.
Note that this is not the 'default' config per se, so using the start-all.sh script won't start the processes because the config files live elsewhere. For running various hadoop processes as services, we suggest runit. A sample 'run' script is provided. The HADOOP_LOG_DIR in the run script must exist for each process. These could be wrapped in a define.
* datanode
* jobtracker
* namenode
* tasktracker
[1] http://hadoop.apache.org/core/docs/current/quickstart.html
= LICENSE and AUTHOR:
Author:: Joshua Timberman (<joshua@opscode.com>)
Copyright:: 2009, Opscode, Inc
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
