Skip to content

Releases: jacobstanley/hadoop-tools

Hadoop Tools v1.0.1

25 Feb 04:24
Compare
Choose a tag to compare

New Features

Kerberos / SASL support

💼 hh is now full enterprise thanks to @luke-clifton

RPM Install (for RHEL/CentOS 6.x only)

Sourcing /etc/profile.d/bash_completion.sh activates bash completion for the current bash session, alternatively you can just log out and log in again.

$ yum install hadoop-tools-1.0-1.x86_64.rpm
$ source /etc/profile.d/bash_completion.sh

Other Platforms

hh should work fine on other Linux distros, as well as Mac OS/X, but you'll have to build it from source using GHC 7.8.x or 7.10.x

The easiest way to do this is using mafia or cabal-install:

$ mafia install hadoop-tools
$ cabal install hadoop-tools

Hadoop Tools v0.7.2

24 Jul 01:15
Compare
Choose a tag to compare

New Features

This releases fixes the long standing problem of automatic name node switchover. Now, if you have two or more name nodes in a high availability (HA) setup, hh will automatically select the active name node.

If you previously were using a ~/.hh config file to work around this problem, it should be safe to delete it.

RPM Install (for RHEL/CentOS 6.x only)

Sourcing /etc/profile.d/bash_completion.sh activates bash completion for the current bash session, alternatively you can just log out and log in again.

$ yum install hadoop-tools-0.7-2.x86_64.rpm
$ source /etc/profile.d/bash_completion.sh

Other Platforms

hh should work fine on other Linux distros, as well as Mac OS/X, but you'll have to build it from source using GHC 7.10.1.

The easiest way to do this is via cabal-install:

$ cabal install hadoop-tools

Hadoop Tools v0.7

24 Jul 02:14
Compare
Choose a tag to compare

Hadoop Tools v0.6 (for RHEL/CentOS 6.x)

26 Jun 08:49
Compare
Choose a tag to compare

RPM Install (hadoop-tools-0.6-1.x86_64.rpm)

Sourcing /etc/profile.d/bash_completion.sh activates bash completion for the current bash session, alternatively you can just log out and log in again.

$ yum install hadoop-tools-0.6-1.x86_64.rpm
$ source /etc/profile.d/bash_completion.sh

Manual Install (hh-0.6.tar.gz)

Contains hh compiled for RHEL/CentOS 6.x as well as bash completion.

You will need to install libgmp before hh will work:

$ yum install gmp

If you want bash completion, you need to install that too:

$ yum install bash-completion

One way to install this would be to unpack the tarball to /usr/local which would install:

/usr/local/hh-0.6/bin/hh
/usr/local/hh-0.6/etc/bash_completion.d/hh-completion.bash

You would then need to create symlinks:

$ ln -s /usr/local/hh-0.6/bin/hh /usr/local/bin/
$ ln -s /usr/local/hh-0.6/etc/bash_completion.d/hh-completion.bash /etc/bash_completion.d/

You can also install it in your home directory as long as you source the bash completion script in your .bashrc or .bash_profile and put the hh executable in your PATH.

Known Issues

On a cluster with a HA namenode setup, you may find the primary namenode switching back and forth. Currently we only attempt to contact the first namenode found in hdfs-site.xml, if you get a standby exception or something like that, you can work around the issue by creating a ~/.hh config file and overriding the namenode host:

namenode {
    host = "<alternate namenode ip or hostname>"
}