Skip to content

Perl client library for Hadoop WebHDFS and HttpFs, with Kerberos support

Notifications You must be signed in to change notification settings

Perl-Hadoop/Net-Hadoop-WebHDFS-LWP

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

57 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

NAME

Net::Hadoop::WebHDFS::LWP - Client library for Hadoop WebHDFS and HttpFs, with Kerberos support

VERSION

version 0.005

SYNOPSIS

use Net::Hadoop::WebHDFS::LWP;

my $client = Net::Hadoop::WebHDFS::LWP->new(
    host        => 'webhdfs.local',
    port        => 14000,
    username    => 'jdoe',
    httpfs_mode => 1,
);
$client->create(
    '/foo/bar', # path
    "...",      # content
    permission => '644',
    overwrite => 'true'
) or die "Could not write to HDFS";

DESCRIPTION

This module is a quick and dirty hack to add Kerberos support to Satoshi Tagomori's module Net::Hadoop::WebHDFS, to access Hadoop secure clusters. It simply subclasses the original module, replacing Furl with LWP, which will transparently use LWP::Authen::Negotiate when needed. So the real documentation is contained in Net::Hadoop::WebHDFS.

ACKNOWLEDGEMENTS

As mentioned above, the real work was done by Satoshi Tagomori

Thanks to my employer Booking.com to allow me to release this module for public use

AUTHOR

David Morel david.morel@amakuru.net

COPYRIGHT AND LICENSE

This software is copyright (c) 2014 by David Morel.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.

About

Perl client library for Hadoop WebHDFS and HttpFs, with Kerberos support

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages