Adoptable Cookbooks List

Looking for a cookbook to adopt? You can now see a list of cookbooks available for adoption!
List of Adoptable Cookbooks

Supermarket Belongs to the Community

Supermarket belongs to the community. While Chef has the responsibility to keep it running and be stewards of its functionality, what it does and how it works is driven by the community. The chef/supermarket repository will continue to be where development of the Supermarket application takes place. Come be part of shaping the direction of Supermarket by opening issues and pull requests or by joining us on the Chef Mailing List.

Select Badges

Select Supported Platforms

Select Status

RSS

apache_hadoop (2) Versions 0.1.1

Installs/Configures the Apache Hadoop distribution

Policyfile
Berkshelf
Knife
cookbook 'apache_hadoop', '~> 0.1.1', :supermarket
cookbook 'apache_hadoop', '~> 0.1.1'
knife supermarket install apache_hadoop
knife supermarket download apache_hadoop
README
Dependencies
Quality 17%

Apache Hadoop cookbook

Apache License 2.0

Requirements

This cookbook has been tested on the following versions (but may work on earlier ones):

  • Chef 12.3.0+
  • CentOS 7.0+
  • Ubuntu 14.04+

Recipes

  • install.rb - Installs the Apache Hadoop Binaries
  • nn.rb - Configures and starts the NameNode
  • dn.rb - Configures and starts the DataNode
  • rm.rb - Configures and starts the ResourceManager
  • nm.rb - Configures and starts the NodeManager
  • jhs.rb- Configures and starts the JobHistoryServer
  • ps.rb - Configures and starts the ProxyServer

Karamel usage

This cookbook is karamelized (www.karamel.io). You can launch a Hadoop Cluster using the following yml file. It will create 3 VMs, where one is the master running NameNode, ResourceManager, and Job history server. The two other VMs are workers and will run the DataNode and NodeManager.

name: eu-west-1

cookbooks:                                                                      
  apache_hadoop: 
    github: "hopshadoop/apache-hadoop-chef"
    tag: "v0.1.0"

groups: 
  namenodes:
    size: 1
    recipes: 
        - apache_hadoop::nn
        - apache_hadoop::rm
        - apache_hadoop::jhs                                                            
  datanodes:
    size: 2
    recipes: 
        - apache_hadoop::dn
        - apache_hadoop::nm

Authors

Authors:: Jim Dowling. (jdowling@kth.se), Marc Bux

License

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this software except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Collaborator Number Metric
            

0.1.1 failed this metric

Failure: Cookbook has 0 collaborators. A cookbook must have at least 2 collaborators to pass this metric.

Contributing File Metric
            

0.1.1 failed this metric

Failure: To pass this metric, your cookbook metadata must include a source url, the source url must be in the form of https://github.com/user/repo, and your repo must contain a CONTRIBUTING.md file

Foodcritic Metric
            

0.1.1 failed this metric

FC007: Ensure recipe dependencies are reflected in cookbook metadata: apache_hadoop/recipes/install.rb:109
FC009: Resource attribute not recognised: apache_hadoop/recipes/install.rb:56
FC026: Conditional execution block attribute contains only string: apache_hadoop/recipes/default.rb:142
FC033: Missing template file: apache_hadoop/recipes/nn.rb:52
FC033: Missing template file: apache_hadoop/recipes/nn.rb:59
FC034: Unused template variables: apache_hadoop/templates/default/capacity-scheduler.xml.erb:1
FC034: Unused template variables: apache_hadoop/templates/default/hdfs-site.xml.erb:1
FC034: Unused template variables: apache_hadoop/templates/default/yarn-site.xml.erb:1
FC043: Prefer new notification syntax: apache_hadoop/recipes/dn.rb:72
FC043: Prefer new notification syntax: apache_hadoop/recipes/jhs.rb:57
FC043: Prefer new notification syntax: apache_hadoop/recipes/jhs.rb:95
FC043: Prefer new notification syntax: apache_hadoop/recipes/nm.rb:32
FC043: Prefer new notification syntax: apache_hadoop/recipes/nm.rb:69
FC043: Prefer new notification syntax: apache_hadoop/recipes/nn.rb:135
FC043: Prefer new notification syntax: apache_hadoop/recipes/ps.rb:54
FC043: Prefer new notification syntax: apache_hadoop/recipes/rm.rb:105
FC064: Ensure issues_url is set in metadata: apache_hadoop/metadata.rb:1
FC066: Ensure chef_version is set in metadata: apache_hadoop/metadata.rb:1
FC069: Ensure standardized license defined in metadata: apache_hadoop/metadata.rb:1
FC070: Ensure supports metadata defines valid platforms: apache_hadoop/metadata.rb:1
FC072: Metadata should not contain "attribute" keyword: apache_hadoop/metadata.rb:1
FC121: Cookbook depends on cookbook made obsolete by Chef 14: apache_hadoop/metadata.rb:1
FC122: Use the build_essential resource instead of the recipe: apache_hadoop/recipes/install.rb:109
Run with Foodcritic Version 16.3.0 with tags metadata,correctness ~FC031 ~FC045 and failure tags any

No Binaries Metric
            

0.1.1 passed this metric

Testing File Metric
            

0.1.1 failed this metric

Failure: To pass this metric, your cookbook metadata must include a source url, the source url must be in the form of https://github.com/user/repo, and your repo must contain a TESTING.md file

Version Tag Metric
            

0.1.1 failed this metric

Failure: To pass this metric, your cookbook metadata must include a source url, the source url must be in the form of https://github.com/user/repo, and your repo must include a tag that matches this cookbook version number