Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Documentation on installing Hadoop 2.2.0 on Microsoft Windows


Copy link to this message
-
Re: Documentation on installing Hadoop 2.2.0 on Microsoft Windows
It was my understanding that HortonWorks depended on CygWin (UNIX emulation
on Windows) for most of the "Bigtop" family of tools - Hadoop core,
MapReduce, etc. - so, you will probably make all your configuration files
in Windows, since XML is agnostic, and can develop in Windows, since JARs
and other Java constructs are agnostic by design, but when things are
actually happening on your cluster, CygWin is in the middle. For a
framework like Hadoop, I question the wisdom of deciding to use a host
environment that uses more memory to begin with, then adding an emulation
layer that complicates things and takes still more memory (since most
Hadoop constraints are memory-based) simply for the convenience of being
able to use my mouse.

If you have a competent *NIX admin, you may consider the benefits of using
Hadoop in Linux/UNIX, and leveraging the many web-based management tools
(usually will come with a Hadoop distribution) and 3rd-party development
tools from Informatica or Pentaho (let you build MapReduce, Pig, etc jobs
in GUI) rather than going the Windows route - not only are you using
hardware resources better, you also don't need to worry about licensing,
and you won't need to reboot your cluster every Patch Tuesday. :-)

Thanks!

*Devin Suiter*
Jr. Data Solutions Software Engineer
100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212
Google Voice: 412-256-8556 | www.rdx.com
On Thu, Oct 24, 2013 at 8:49 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote:

> Disclosure: I do not work for Hortonworks, I just use their product.
> please do not bash me up
> Angelo,
> thats not entirely correct now.
>
> Hortonworks has done tremendous amount of work to port hadoop to windows
> os as well.
> Here is there press release:
> http://hortonworks.com/about-us/news/hadoop-on-windows/
>
> Chris,
> I do remember seeing hadoop 2.x for windows (
> http://hortonworks.com/blog/announcing-beta-release-of-apache-hadoop-2/)
> I never tried it myself it on windows but you can reach out to their
> support forum and I am sure someone will be happy to help .
>
>
>
>
> On Thu, Oct 24, 2013 at 6:08 PM, Angelo Matarazzo <
> [EMAIL PROTECTED]> wrote:
>
>> Hi,
>> I think that it is not useful trying to install hadoop on Windows because
>> hadoop is very integrated in Linux and there is no support for Windows
>>
>>
>> 2013/10/23 chris bidwell <[EMAIL PROTECTED]>
>>
>>> Is there any documentation or instructions on installing Hadoop 2.2.0 on
>>> Microsoft Windows?
>>> Thank you.
>>>
>>> -Chris
>>>
>>>
>>
>
>
> --
> Nitin Pawar
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB