Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Documentation on installing Hadoop 2.2.0 on Microsoft Windows


Copy link to this message
-
Re: Documentation on installing Hadoop 2.2.0 on Microsoft Windows
Very cool Adam! Thanks for the clarification, and great work for you guys
porting it over to native running.

*Devin Suiter*
Jr. Data Solutions Software Engineer
100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212
Google Voice: 412-256-8556 | www.rdx.com
On Thu, Oct 24, 2013 at 9:27 AM, Adam Diaz <[EMAIL PROTECTED]> wrote:

> No Cygwin is involved...We have the installation via MSI clearly
> documented on our site. Python, Visual C++, JDK and .Net framework. This
> work was done in conjunction with Microsoft who is not in the business of
> supporting Cygwin. Hadoop is Java and Java runs on windows.
>
>
> On Thu, Oct 24, 2013 at 9:20 AM, DSuiter RDX <[EMAIL PROTECTED]> wrote:
>
>> It was my understanding that HortonWorks depended on CygWin (UNIX
>> emulation on Windows) for most of the "Bigtop" family of tools - Hadoop
>> core, MapReduce, etc. - so, you will probably make all your configuration
>> files in Windows, since XML is agnostic, and can develop in Windows, since
>> JARs and other Java constructs are agnostic by design, but when things are
>> actually happening on your cluster, CygWin is in the middle. For a
>> framework like Hadoop, I question the wisdom of deciding to use a host
>> environment that uses more memory to begin with, then adding an emulation
>> layer that complicates things and takes still more memory (since most
>> Hadoop constraints are memory-based) simply for the convenience of being
>> able to use my mouse.
>>
>> If you have a competent *NIX admin, you may consider the benefits of
>> using Hadoop in Linux/UNIX, and leveraging the many web-based management
>> tools (usually will come with a Hadoop distribution) and 3rd-party
>> development tools from Informatica or Pentaho (let you build MapReduce,
>> Pig, etc jobs in GUI) rather than going the Windows route - not only are
>> you using hardware resources better, you also don't need to worry about
>> licensing, and you won't need to reboot your cluster every Patch Tuesday.
>> :-)
>>
>> Thanks!
>>
>> *Devin Suiter*
>> Jr. Data Solutions Software Engineer
>> 100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212
>> Google Voice: 412-256-8556 | www.rdx.com
>>
>>
>> On Thu, Oct 24, 2013 at 8:49 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote:
>>
>>> Disclosure: I do not work for Hortonworks, I just use their product.
>>> please do not bash me up
>>> Angelo,
>>> thats not entirely correct now.
>>>
>>> Hortonworks has done tremendous amount of work to port hadoop to windows
>>> os as well.
>>> Here is there press release:
>>> http://hortonworks.com/about-us/news/hadoop-on-windows/
>>>
>>> Chris,
>>> I do remember seeing hadoop 2.x for windows (
>>> http://hortonworks.com/blog/announcing-beta-release-of-apache-hadoop-2/
>>> )
>>> I never tried it myself it on windows but you can reach out to their
>>> support forum and I am sure someone will be happy to help .
>>>
>>>
>>>
>>>
>>> On Thu, Oct 24, 2013 at 6:08 PM, Angelo Matarazzo <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Hi,
>>>> I think that it is not useful trying to install hadoop on Windows
>>>> because hadoop is very integrated in Linux and there is no support for
>>>> Windows
>>>>
>>>>
>>>> 2013/10/23 chris bidwell <[EMAIL PROTECTED]>
>>>>
>>>>> Is there any documentation or instructions on installing Hadoop 2.2.0
>>>>> on Microsoft Windows?
>>>>> Thank you.
>>>>>
>>>>> -Chris
>>>>>
>>>>>
>>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>
>>
>
>
> --
>    * Adam Diaz * * *  *   * Solution Engineer - Big Data
> ------------------------------
>
>     Phone:        919 609 4842
>   Email:      [EMAIL PROTECTED]
>   Website:   http://www.hortonworks.com/
>
>       * Follow Us: *
> <http://facebook.com/hortonworks/?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature>
> <http://twitter.com/hortonworks?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature>
> <http://www.linkedin.com/company/hortonworks?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB