Hi all,

As we know setting up hadoop cluster contains doing different settings
in all machines, so time consuming and non effective.
anybody knows about setting up a hadoop cluster easily?
some ways such as puppet does not have enough docs or clear road map.

Thanks,
B.S

We did 2pb clusters by puppet.
What did you find unclear?

P

On Mar 9, 2012, at 21:32, Masoud <[EMAIL PROTECTED]> wrote:

> Hi all,
>
> As we know setting up hadoop cluster contains doing different settings in all machines, so time consuming and non effective.
> anybody knows about setting up a hadoop cluster easily?
> some ways such as puppet does not have enough docs or clear road map.
>
> Thanks,
> B.S
>

Dear Patai,

Thanks for your reply.
we need only to install hadoop no Hbase or other tools,
Could you please introduce some useful sites or docs to use puppet for
setting up hadoop cluster?

Thanks.
Masoud.

On 03/10/2012 04:30 PM, Patai Sangbutsarakum wrote:
> We did 2pb clusters by puppet.
> What did you find unclear?
>
> P
>
> On Mar 9, 2012, at 21:32, Masoud<[EMAIL PROTECTED]>  wrote:
>
>> Hi all,
>>
>> As we know setting up hadoop cluster contains doing different settings in all machines, so time consuming and non effective.
>> anybody knows about setting up a hadoop cluster easily?
>> some ways such as puppet does not have enough docs or clear road map.
>>
>> Thanks,
>> B.S
>>

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/

On Mon, Mar 12, 2012 at 11:21 AM, Masoud <[EMAIL PROTECTED]> wrote:

> Dear Patai,
>
> Thanks for your reply.
> we need only to install hadoop no Hbase or other tools,
> Could you please introduce some useful sites or docs to use puppet for
> setting up hadoop cluster?
>
> Thanks.
> Masoud.
>
>
> On 03/10/2012 04:30 PM, Patai Sangbutsarakum wrote:
>
>> We did 2pb clusters by puppet.
>> What did you find unclear?
>>
>> P
>>
>> On Mar 9, 2012, at 21:32, Masoud<[EMAIL PROTECTED]ang.**ac.kr<[EMAIL PROTECTED]>>
>>  wrote:
>>
>>  Hi all,
>>>
>>> As we know setting up hadoop cluster contains doing different settings
>>> in all machines, so time consuming and non effective.
>>> anybody knows about setting up a hadoop cluster easily?
>>> some ways such as puppet does not have enough docs or clear road map.
>>>
>>> Thanks,
>>> B.S
>>>
>>>
>
--
Regards
Tousif
+918050227279

This is not about using Puppet to setup hadoop cluster, just about
single node and cluster (2 node) setup in normal way.

Thanks,
Masoud
On 03/12/2012 02:59 PM, tousif wrote:
> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/
>
>
>
> On Mon, Mar 12, 2012 at 11:21 AM, Masoud<[EMAIL PROTECTED]>  wrote:
>
>> Dear Patai,
>>
>> Thanks for your reply.
>> we need only to install hadoop no Hbase or other tools,
>> Could you please introduce some useful sites or docs to use puppet for
>> setting up hadoop cluster?
>>
>> Thanks.
>> Masoud.
>>
>>
>> On 03/10/2012 04:30 PM, Patai Sangbutsarakum wrote:
>>
>>> We did 2pb clusters by puppet.
>>> What did you find unclear?
>>>
>>> P
>>>
>>> On Mar 9, 2012, at 21:32, Masoud<[EMAIL PROTECTED]ang.**ac.kr<[EMAIL PROTECTED]>>
>>>   wrote:
>>>
>>>   Hi all,
>>>> As we know setting up hadoop cluster contains doing different settings
>>>> in all machines, so time consuming and non effective.
>>>> anybody knows about setting up a hadoop cluster easily?
>>>> some ways such as puppet does not have enough docs or clear road map.
>>>>
>>>> Thanks,
>>>> B.S
>>>>
>>>>
>

Masoud,
this are where I started off.
https://github.com/seanhead/puppet_module_hadoop
And hadoop puppet module publish by adobe.

Hth
p

On 3/11/12 11:26 PM, "Masoud" <[EMAIL PROTECTED]> wrote:

>
>This is not about using Puppet to setup hadoop cluster, just about
>single node and cluster (2 node) setup in normal way.
>
>Thanks,
>Masoud
>
>
>On 03/12/2012 02:59 PM, tousif wrote:
>>
>>http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-sing
>>le-node-cluster/
>>
>>
>>
>> On Mon, Mar 12, 2012 at 11:21 AM, Masoud<[EMAIL PROTECTED]>
>>wrote:
>>
>>> Dear Patai,
>>>
>>> Thanks for your reply.
>>> we need only to install hadoop no Hbase or other tools,
>>> Could you please introduce some useful sites or docs to use puppet for
>>> setting up hadoop cluster?
>>>
>>> Thanks.
>>> Masoud.
>>>
>>>
>>> On 03/10/2012 04:30 PM, Patai Sangbutsarakum wrote:
>>>
>>>> We did 2pb clusters by puppet.
>>>> What did you find unclear?
>>>>
>>>> P
>>>>
>>>> On Mar 9, 2012, at 21:32,
>>>>Masoud<[EMAIL PROTECTED]ang.**ac.kr<[EMAIL PROTECTED]>>
>>>>   wrote:
>>>>
>>>>   Hi all,
>>>>> As we know setting up hadoop cluster contains doing different
>>>>>settings
>>>>> in all machines, so time consuming and non effective.
>>>>> anybody knows about setting up a hadoop cluster easily?
>>>>> some ways such as puppet does not have enough docs or clear road map.
>>>>>
>>>>> Thanks,
>>>>> B.S
>>>>>
>>>>>
>>
>

Apache Bigtop also has Hadoop puppet modules. For the modules based on
Hadoop 0.20.205 you can look at them here:

https://svn.apache.org/repos/asf/incubator/bigtop/branches/branch-0.2/bigtop-deploy/puppet/

I haven't seen any documentation on the modules.

-Joey

On Mon, Mar 12, 2012 at 1:43 PM, Patai Sangbutsarakum
<[EMAIL PROTECTED]> wrote:
> Masoud,
> this are where I started off.
> https://github.com/seanhead/puppet_module_hadoop
> And hadoop puppet module publish by adobe.
>
> Hth
> p
>
> On 3/11/12 11:26 PM, "Masoud" <[EMAIL PROTECTED]> wrote:
>
>>
>>This is not about using Puppet to setup hadoop cluster, just about
>>single node and cluster (2 node) setup in normal way.
>>
>>Thanks,
>>Masoud
>>
>>
>>On 03/12/2012 02:59 PM, tousif wrote:
>>>
>>>http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-sing
>>>le-node-cluster/
>>>
>>>
>>>
>>> On Mon, Mar 12, 2012 at 11:21 AM, Masoud<[EMAIL PROTECTED]>
>>>wrote:
>>>
>>>> Dear Patai,
>>>>
>>>> Thanks for your reply.
>>>> we need only to install hadoop no Hbase or other tools,
>>>> Could you please introduce some useful sites or docs to use puppet for
>>>> setting up hadoop cluster?
>>>>
>>>> Thanks.
>>>> Masoud.
>>>>
>>>>
>>>> On 03/10/2012 04:30 PM, Patai Sangbutsarakum wrote:
>>>>
>>>>> We did 2pb clusters by puppet.
>>>>> What did you find unclear?
>>>>>
>>>>> P
>>>>>
>>>>> On Mar 9, 2012, at 21:32,
>>>>>Masoud<[EMAIL PROTECTED]ang.**ac.kr<[EMAIL PROTECTED]>>
>>>>>   wrote:
>>>>>
>>>>>   Hi all,
>>>>>> As we know setting up hadoop cluster contains doing different
>>>>>>settings
>>>>>> in all machines, so time consuming and non effective.
>>>>>> anybody knows about setting up a hadoop cluster easily?
>>>>>> some ways such as puppet does not have enough docs or clear road map.
>>>>>>
>>>>>> Thanks,
>>>>>> B.S
>>>>>>
>>>>>>
>>>
>>
>

--
Joseph Echeverria
Cloudera, Inc.
443.305.9434

Patai,

as you know unfortunately Puppet is not open source and free version
only support 10 nodes,
I think we have to setup our stack manually.. haha

Thanks

On 03/13/2012 02:43 AM, Patai Sangbutsarakum wrote:
> Masoud,
> this are where I started off.
> https://github.com/seanhead/puppet_module_hadoop
> And hadoop puppet module publish by adobe.
>
> Hth
> p
>
> On 3/11/12 11:26 PM, "Masoud"<[EMAIL PROTECTED]>  wrote:
>
>> This is not about using Puppet to setup hadoop cluster, just about
>> single node and cluster (2 node) setup in normal way.
>>
>> Thanks,
>> Masoud
>>
>>
>> On 03/12/2012 02:59 PM, tousif wrote:
>>> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-sing
>>> le-node-cluster/
>>>
>>>
>>>
>>> On Mon, Mar 12, 2012 at 11:21 AM, Masoud<[EMAIL PROTECTED]>
>>> wrote:
>>>
>>>> Dear Patai,
>>>>
>>>> Thanks for your reply.
>>>> we need only to install hadoop no Hbase or other tools,
>>>> Could you please introduce some useful sites or docs to use puppet for
>>>> setting up hadoop cluster?
>>>>
>>>> Thanks.
>>>> Masoud.
>>>>
>>>>
>>>> On 03/10/2012 04:30 PM, Patai Sangbutsarakum wrote:
>>>>
>>>>> We did 2pb clusters by puppet.
>>>>> What did you find unclear?
>>>>>
>>>>> P
>>>>>
>>>>> On Mar 9, 2012, at 21:32,
>>>>> Masoud<[EMAIL PROTECTED]ang.**ac.kr<[EMAIL PROTECTED]>>
>>>>>    wrote:
>>>>>
>>>>>    Hi all,
>>>>>> As we know setting up hadoop cluster contains doing different
>>>>>> settings
>>>>>> in all machines, so time consuming and non effective.
>>>>>> anybody knows about setting up a hadoop cluster easily?
>>>>>> some ways such as puppet does not have enough docs or clear road map.
>>>>>>
>>>>>> Thanks,
>>>>>> B.S
>>>>>>
>>>>>>

Masoud,

I know that the Puppet Labs website is confusing, but puppet is open
source and has no node limit. You can download it from here:

http://puppetlabs.com/misc/download-options/

If you're using a Red Hat compatible linux distribution, you can get
RPMs from EPEL:

http://projects.puppetlabs.com/projects/puppet/wiki/Downloading_Puppet#RPM+Packages

If you prefer source, you can get it from github:

https://github.com/puppetlabs/puppet

If you're curious about the license, it's Apache 2.0:

https://github.com/puppetlabs/puppet/blob/master/LICENSE

-Joey

On Mon, Mar 12, 2012 at 8:12 PM, Masoud <[EMAIL PROTECTED]> wrote:
> Patai,
>
> as you know unfortunately Puppet is not open source and free version only
> support 10 nodes,
> I think we have to setup our stack manually.. haha
>
> Thanks
>
>
> On 03/13/2012 02:43 AM, Patai Sangbutsarakum wrote:
>>
>> Masoud,
>> this are where I started off.
>> https://github.com/seanhead/puppet_module_hadoop
>> And hadoop puppet module publish by adobe.
>>
>> Hth
>> p
>>
>> On 3/11/12 11:26 PM, "Masoud"<[EMAIL PROTECTED]>  wrote:
>>
>>> This is not about using Puppet to setup hadoop cluster, just about
>>> single node and cluster (2 node) setup in normal way.
>>>
>>> Thanks,
>>> Masoud
>>>
>>>
>>> On 03/12/2012 02:59 PM, tousif wrote:
>>>>
>>>>
>>>> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-sing
>>>> le-node-cluster/
>>>>
>>>>
>>>>
>>>> On Mon, Mar 12, 2012 at 11:21 AM, Masoud<[EMAIL PROTECTED]>
>>>> wrote:
>>>>
>>>>> Dear Patai,
>>>>>
>>>>> Thanks for your reply.
>>>>> we need only to install hadoop no Hbase or other tools,
>>>>> Could you please introduce some useful sites or docs to use puppet for
>>>>> setting up hadoop cluster?
>>>>>
>>>>> Thanks.
>>>>> Masoud.
>>>>>
>>>>>
>>>>> On 03/10/2012 04:30 PM, Patai Sangbutsarakum wrote:
>>>>>
>>>>>> We did 2pb clusters by puppet.
>>>>>> What did you find unclear?
>>>>>>
>>>>>> P
>>>>>>
>>>>>> On Mar 9, 2012, at 21:32,
>>>>>> Masoud<[EMAIL PROTECTED]ang.**ac.kr<[EMAIL PROTECTED]>>
>>>>>>   wrote:
>>>>>>
>>>>>>   Hi all,
>>>>>>>
>>>>>>> As we know setting up hadoop cluster contains doing different
>>>>>>> settings
>>>>>>> in all machines, so time consuming and non effective.
>>>>>>> anybody knows about setting up a hadoop cluster easily?
>>>>>>> some ways such as puppet does not have enough docs or clear road map.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> B.S
>>>>>>>
>>>>>>>
>

--
Joseph Echeverria
Cloudera, Inc.
443.305.9434

Dear Joey,

Really thankful for your great help,
I hope could find docs there too,

Best Regards,
Masoud

On 03/13/2012 10:35 AM, Joey Echeverria wrote:
> Masoud,
>
> I know that the Puppet Labs website is confusing, but puppet is open
> source and has no node limit. You can download it from here:
>
> http://puppetlabs.com/misc/download-options/
>
> If you're using a Red Hat compatible linux distribution, you can get
> RPMs from EPEL:
>
> http://projects.puppetlabs.com/projects/puppet/wiki/Downloading_Puppet#RPM+Packages
>
> If you prefer source, you can get it from github:
>
> https://github.com/puppetlabs/puppet
>
> If you're curious about the license, it's Apache 2.0:
>
> https://github.com/puppetlabs/puppet/blob/master/LICENSE
>
> -Joey
>
> On Mon, Mar 12, 2012 at 8:12 PM, Masoud<[EMAIL PROTECTED]>  wrote:
>> Patai,
>>
>> as you know unfortunately Puppet is not open source and free version only
>> support 10 nodes,
>> I think we have to setup our stack manually.. haha
>>
>> Thanks
>>
>>
>> On 03/13/2012 02:43 AM, Patai Sangbutsarakum wrote:
>>> Masoud,
>>> this are where I started off.
>>> https://github.com/seanhead/puppet_module_hadoop
>>> And hadoop puppet module publish by adobe.
>>>
>>> Hth
>>> p
>>>
>>> On 3/11/12 11:26 PM, "Masoud"<[EMAIL PROTECTED]>    wrote:
>>>
>>>> This is not about using Puppet to setup hadoop cluster, just about
>>>> single node and cluster (2 node) setup in normal way.
>>>>
>>>> Thanks,
>>>> Masoud
>>>>
>>>>
>>>> On 03/12/2012 02:59 PM, tousif wrote:
>>>>>
>>>>> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-sing
>>>>> le-node-cluster/
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Mar 12, 2012 at 11:21 AM, Masoud<[EMAIL PROTECTED]>
>>>>> wrote:
>>>>>
>>>>>> Dear Patai,
>>>>>>
>>>>>> Thanks for your reply.
>>>>>> we need only to install hadoop no Hbase or other tools,
>>>>>> Could you please introduce some useful sites or docs to use puppet for
>>>>>> setting up hadoop cluster?
>>>>>>
>>>>>> Thanks.
>>>>>> Masoud.
>>>>>>
>>>>>>
>>>>>> On 03/10/2012 04:30 PM, Patai Sangbutsarakum wrote:
>>>>>>
>>>>>>> We did 2pb clusters by puppet.
>>>>>>> What did you find unclear?
>>>>>>>
>>>>>>> P
>>>>>>>
>>>>>>> On Mar 9, 2012, at 21:32,
>>>>>>> Masoud<[EMAIL PROTECTED]ang.**ac.kr<[EMAIL PROTECTED]>>
>>>>>>>    wrote:
>>>>>>>
>>>>>>>    Hi all,
>>>>>>>> As we know setting up hadoop cluster contains doing different
>>>>>>>> settings
>>>>>>>> in all machines, so time consuming and non effective.
>>>>>>>> anybody knows about setting up a hadoop cluster easily?
>>>>>>>> some ways such as puppet does not have enough docs or clear road map.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> B.S
>>>>>>>>
>>>>>>>>
>
>