|
|
-
Re: Hello and request some advice.
Nitin Pawar 2013-01-04, 17:45
- Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S. If you want a free O.S , ubuntu is good but if you are familiar with RedHat then you may want to have look at Scientific Linux (Its free as well)
- Is there a way to learn Hadoop without a static IP address? That was really a problem for me when dealing with Infosphere, since I travel frequently. If you got a laptop with you then thats all you need to learn hadoop. Hadoop can be installed in a pseudo distributed mode on a single machine and you can use it with localhost all the time. On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza < [EMAIL PROTECTED]> wrote:
> Hi all in this list! > > My name is Cristián Carranza, a statistician and quality consultant that > for the second time, intends to learn Hadoop and Big Data related issues. > I’am requesting advice in order to plan my learning. > I read the page “ Products that include Apache Hadoop or derivative works > and Commercial Support” > but after that, I am still with doubts. > > Please, as a newcomer, I want some advice about the following topics: > > - I want to begin by learning how to find specified strings of text in a > hiuge data set (csv, txt format, huge means 10 Gb. > - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the > past using Red Hat & Infosphere Biginsights, but I need a free O.S. > - Is there a way to learn Hadoop without a static IP address? That was > really a problem for me when dealing with Infosphere, since I travel > frequently. > > That’s all for now. > Any help will be greatly appreciated. > > thanks! > > Cristián Carranza > Brazil. > >
-- Nitin Pawar
-
Re: Hello and request some advice.
Jay Vyas 2013-01-04, 17:47
for the basics, all you need is a java IDE . Hadoop Map/Reduce can run in local filesystem mode without any kind of HDFS backing. On Fri, Jan 4, 2013 at 12:45 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote: > - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the > past using Red Hat & Infosphere Biginsights, but I need a free O.S. > If you want a free O.S , ubuntu is good but if you are familiar with > RedHat then you may want to have look at Scientific Linux (Its free as well) > > - Is there a way to learn Hadoop without a static IP address? That was > really a problem for me when dealing with Infosphere, since I travel > frequently. > If you got a laptop with you then thats all you need to learn hadoop. > Hadoop can be installed in a pseudo distributed mode on a single machine > and you can use it with localhost all the time. > > > On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza < > [EMAIL PROTECTED]> wrote: > >> Hi all in this list! >> >> My name is Cristián Carranza, a statistician and quality consultant that >> for the second time, intends to learn Hadoop and Big Data related issues. >> I’am requesting advice in order to plan my learning. >> I read the page “ Products that include Apache Hadoop or derivative >> works and Commercial Support” >> but after that, I am still with doubts. >> >> Please, as a newcomer, I want some advice about the following topics: >> >> - I want to begin by learning how to find specified strings of text in a >> hiuge data set (csv, txt format, huge means 10 Gb. >> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the >> past using Red Hat & Infosphere Biginsights, but I need a free O.S. >> - Is there a way to learn Hadoop without a static IP address? That was >> really a problem for me when dealing with Infosphere, since I travel >> frequently. >> >> That’s all for now. >> Any help will be greatly appreciated. >> >> thanks! >> >> Cristián Carranza >> Brazil. >> >> > > > > -- > Nitin Pawar > -- Jay Vyas http://jayunit100.blogspot.com
-
Re: Hello and request some advice.
Gangadhar Ramini 2013-01-04, 17:50
Hi Nitin,
I tried latest stable Hadoop version on windows with cygwin, I see following error in JobTracker logs. Do you have any advice?
C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M at java.security.AccessController.doPrivileged(Native Method)^M at javax.security.auth.Subject.doAs(Subject.java:415)^M at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M Thanks -Gangadhar On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote:
> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the > past using Red Hat & Infosphere Biginsights, but I need a free O.S. > If you want a free O.S , ubuntu is good but if you are familiar with > RedHat then you may want to have look at Scientific Linux (Its free as well) > > - Is there a way to learn Hadoop without a static IP address? That was > really a problem for me when dealing with Infosphere, since I travel > frequently. > If you got a laptop with you then thats all you need to learn hadoop. > Hadoop can be installed in a pseudo distributed mode on a single machine > and you can use it with localhost all the time. > > > On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza < > [EMAIL PROTECTED]> wrote: > >> Hi all in this list! >> >> My name is Cristián Carranza, a statistician and quality consultant that >> for the second time, intends to learn Hadoop and Big Data related issues. >> I’am requesting advice in order to plan my learning. >> I read the page “ Products that include Apache Hadoop or derivative >> works and Commercial Support” >> but after that, I am still with doubts. >> >> Please, as a newcomer, I want some advice about the following topics: >> >> - I want to begin by learning how to find specified strings of text in a >> hiuge data set (csv, txt format, huge means 10 Gb. >> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the >> past using Red Hat & Infosphere Biginsights, but I need a free O.S. >> - Is there a way to learn Hadoop without a static IP address? That was >> really a problem for me when dealing with Infosphere, since I travel >> frequently. >> >> That’s all for now. >> Any help will be greatly appreciated. >> >> thanks! >> >> Cristián Carranza >> Brazil. >> >> > > > > -- > Nitin Pawar >
-
Re: Hello and request some advice.
Nitin Pawar 2013-01-04, 17:55
Does your user have permissions to read/write on the dfs directories you made?
try changing the directory ownerships to the user which is running hadoop. On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <[EMAIL PROTECTED]>wrote:
> Hi Nitin, > > I tried latest stable Hadoop version on windows with cygwin, I see > following error in JobTracker logs. Do you have any advice? > > C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M > at > org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M > at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M > at > org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M > at > org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M > at > org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M > at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M > at > org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M > at > org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M > at java.security.AccessController.doPrivileged(Native Method)^M > at javax.security.auth.Subject.doAs(Subject.java:415)^M > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M > at > org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M > at > org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M > at > org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M > at > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M > at > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M > at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M > Thanks > -Gangadhar > > > On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote: > >> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the >> past using Red Hat & Infosphere Biginsights, but I need a free O.S. >> If you want a free O.S , ubuntu is good but if you are familiar with >> RedHat then you may want to have look at Scientific Linux (Its free as well) >> >> - Is there a way to learn Hadoop without a static IP address? That was >> really a problem for me when dealing with Infosphere, since I travel >> frequently. >> If you got a laptop with you then thats all you need to learn hadoop. >> Hadoop can be installed in a pseudo distributed mode on a single machine >> and you can use it with localhost all the time. >> >> >> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza < >> [EMAIL PROTECTED]> wrote: >> >>> Hi all in this list! >>> >>> My name is Cristián Carranza, a statistician and quality consultant that >>> for the second time, intends to learn Hadoop and Big Data related issues. >>> I’am requesting advice in order to plan my learning. >>> I read the page “ Products that include Apache Hadoop or derivative >>> works and Commercial Support” >>> but after that, I am still with doubts. >>> >>> Please, as a newcomer, I want some advice about the following topics: >>> >>> - I want to begin by learning how to find specified strings of text in a >>> hiuge data set (csv, txt format, huge means 10 Gb. >>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the >>> past using Red Hat & Infosphere Biginsights, but I need a free O.S. >>> - Is there a way to learn Hadoop without a static IP address? That was >>> really a problem for me when dealing with Infosphere, since I travel >>> frequently. >>> >>> That’s all for now. >>> Any help will be greatly appreciated. >>> >>> thanks! >>> >>> Cristián Carranza >>> Brazil. >>> >>> >> >> >> >> -- >> Nitin Pawar >> > > -- Nitin Pawar
-
Re: Hello and request some advice.
Gangadhar Ramini 2013-01-04, 18:04
Yes user owns the directory and had right permissions, still i don't understand what could be the issue. ls -ltr ~/hadoop-1.0.4/logs/history total 0 drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15
Thanks -Gangadhar On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote:
> Does your user have permissions to read/write on the dfs directories you > made? > > try changing the directory ownerships to the user which is running hadoop. > > > On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <[EMAIL PROTECTED]>wrote: > >> Hi Nitin, >> >> I tried latest stable Hadoop version on windows with cygwin, I see >> following error in JobTracker logs. Do you have any advice? >> >> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M >> at >> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M >> at >> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M >> at >> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M >> at >> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M >> at >> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M >> at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M >> at >> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M >> at >> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M >> at java.security.AccessController.doPrivileged(Native Method)^M >> at javax.security.auth.Subject.doAs(Subject.java:415)^M >> at >> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M >> at >> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M >> at >> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M >> at >> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M >> at >> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M >> at >> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M >> at >> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M >> Thanks >> -Gangadhar >> >> >> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote: >> >>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the >>> past using Red Hat & Infosphere Biginsights, but I need a free O.S. >>> If you want a free O.S , ubuntu is good but if you are familiar with >>> RedHat then you may want to have look at Scientific Linux (Its free as well) >>> >>> - Is there a way to learn Hadoop without a static IP address? That was >>> really a problem for me when dealing with Infosphere, since I travel >>> frequently. >>> If you got a laptop with you then thats all you need to learn hadoop. >>> Hadoop can be installed in a pseudo distributed mode on a single machine >>> and you can use it with localhost all the time. >>> >>> >>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza < >>> [EMAIL PROTECTED]> wrote: >>> >>>> Hi all in this list! >>>> >>>> My name is Cristián Carranza, a statistician and quality consultant >>>> that for the second time, intends to learn Hadoop and Big Data related >>>> issues. >>>> I’am requesting advice in order to plan my learning. >>>> I read the page “ Products that include Apache Hadoop or derivative >>>> works and Commercial Support” >>>> but after that, I am still with doubts. >>>> >>>> Please, as a newcomer, I want some advice about the following topics: >>>> >>>> - I want to begin by learning how to find specified strings of text in >>>> a hiuge data set (csv, txt format, huge means 10 Gb. >>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the >>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S. >>>> - Is there a way to learn Hadoop without a static IP address? That was >>>> really a problem for me when dealing with Infosphere, since I travel
-
RE: Hello and request some advice.
John Lilley 2013-01-04, 18:12
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro. John From: Nitin Pawar [mailto:[EMAIL PROTECTED]] Sent: Friday, January 04, 2013 10:46 AM To: [EMAIL PROTECTED] Subject: Re: Hello and request some advice.
- Is Ubuntu a good O.S. for running Hadoop? I've tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S. If you want a free O.S , ubuntu is good but if you are familiar with RedHat then you may want to have look at Scientific Linux (Its free as well)
-
Re: Hello and request some advice.
Nitin Pawar 2013-01-04, 18:19
what about other directories like hdfs directories and tmp directories ? On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <[EMAIL PROTECTED]>wrote:
> Yes user owns the directory and had right permissions, still i don't > understand what could be the issue. > > > ls -ltr ~/hadoop-1.0.4/logs/history > total 0 > drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15 > > Thanks > -Gangadhar > > > > > > > > > On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote: > >> Does your user have permissions to read/write on the dfs directories you >> made? >> >> try changing the directory ownerships to the user which is running >> hadoop. >> >> >> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <[EMAIL PROTECTED]>wrote: >> >>> Hi Nitin, >>> >>> I tried latest stable Hadoop version on windows with cygwin, I see >>> following error in JobTracker logs. Do you have any advice? >>> >>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M >>> at >>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M >>> at >>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M >>> at >>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M >>> at >>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M >>> at >>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M >>> at >>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M >>> at >>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M >>> at >>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M >>> at java.security.AccessController.doPrivileged(Native Method)^M >>> at javax.security.auth.Subject.doAs(Subject.java:415)^M >>> at >>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M >>> at >>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M >>> at >>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M >>> at >>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M >>> at >>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M >>> at >>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M >>> at >>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M >>> Thanks >>> -Gangadhar >>> >>> >>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote: >>> >>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the >>>> past using Red Hat & Infosphere Biginsights, but I need a free O.S. >>>> If you want a free O.S , ubuntu is good but if you are familiar with >>>> RedHat then you may want to have look at Scientific Linux (Its free as well) >>>> >>>> - Is there a way to learn Hadoop without a static IP address? That was >>>> really a problem for me when dealing with Infosphere, since I travel >>>> frequently. >>>> If you got a laptop with you then thats all you need to learn hadoop. >>>> Hadoop can be installed in a pseudo distributed mode on a single machine >>>> and you can use it with localhost all the time. >>>> >>>> >>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza < >>>> [EMAIL PROTECTED]> wrote: >>>> >>>>> Hi all in this list! >>>>> >>>>> My name is Cristián Carranza, a statistician and quality consultant >>>>> that for the second time, intends to learn Hadoop and Big Data related >>>>> issues. >>>>> I’am requesting advice in order to plan my learning. >>>>> I read the page “ Products that include Apache Hadoop or derivative >>>>> works and Commercial Support” >>>>> but after that, I am still with doubts. >>>>> >>>>> Please, as a newcomer, I want some advice about the following topics: >>>>> >>>>> - I want to begin by learning how to find specified strings of text in >>>>> a hiuge data set (csv, txt format, huge means 10 Gb. Nitin Pawar
-
Re: Hello and request some advice.
Gangadhar Ramini 2013-01-04, 18:51
Following is the configuration i put in config. core-site.xml
<property> <name>hadoop.tmp.dir</name> <value>/usr/local/hadoop/datastore/hadoop-${user.name}</value> </property>
hdfs-site.xml
<property> <name>dfs.name.dir</name> <value>C:/cygwin/dfs/logs</value> </property> <property> <name>dfs.data.dir</name> <value>C:/cygwin/dfs/data</value> </property>
Thanks -Gangadhar On Fri, Jan 4, 2013 at 10:19 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote:
> what about other directories like hdfs directories and tmp directories ? > > > On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <[EMAIL PROTECTED]>wrote: > >> Yes user owns the directory and had right permissions, still i don't >> understand what could be the issue. >> >> >> ls -ltr ~/hadoop-1.0.4/logs/history >> total 0 >> drwxr-xr-x+ 1 garamini mkgroup 0 Jan 2 22:15 >> >> Thanks >> -Gangadhar >> >> >> >> >> >> >> >> >> On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote: >> >>> Does your user have permissions to read/write on the dfs directories you >>> made? >>> >>> try changing the directory ownerships to the user which is running >>> hadoop. >>> >>> >>> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <[EMAIL PROTECTED]>wrote: >>> >>>> Hi Nitin, >>>> >>>> I tried latest stable Hadoop version on windows with cygwin, I see >>>> following error in JobTracker logs. Do you have any advice? >>>> >>>> C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M >>>> at >>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M >>>> at >>>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M >>>> at >>>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M >>>> at >>>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M >>>> at >>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M >>>> at >>>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M >>>> at >>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M >>>> at >>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M >>>> at java.security.AccessController.doPrivileged(Native Method)^M >>>> at javax.security.auth.Subject.doAs(Subject.java:415)^M >>>> at >>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M >>>> at >>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M >>>> at >>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M >>>> at >>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M >>>> at >>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M >>>> at >>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M >>>> at >>>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M >>>> Thanks >>>> -Gangadhar >>>> >>>> >>>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote: >>>> >>>>> - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in >>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S. >>>>> If you want a free O.S , ubuntu is good but if you are familiar with >>>>> RedHat then you may want to have look at Scientific Linux (Its free as well) >>>>> >>>>> - Is there a way to learn Hadoop without a static IP address? That was >>>>> really a problem for me when dealing with Infosphere, since I travel >>>>> frequently. >>>>> If you got a laptop with you then thats all you need to learn hadoop. >>>>> Hadoop can be installed in a pseudo distributed mode on a single machine >>>>> and you can use it with localhost all the time. >>>>> >>>>> >>>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza < >>>>> [EMAIL PROTECTED]> wrote: >>>>> >>>>>> Hi all in this list! >>>>
-
RE: Hello and request some advice.
Rajeev Yadav 2013-01-04, 19:18
Hi john,which would be a better option between Linux and windows from learning perspective of Hadoop? --- On Fri, 4/1/13, John Lilley <[EMAIL PROTECTED]> wrote:
From: John Lilley <[EMAIL PROTECTED]> Subject: RE: Hello and request some advice. To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> Date: Friday, 4 January, 2013, 6:12 PM
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro. John From: Nitin Pawar [mailto:[EMAIL PROTECTED]] Sent: Friday, January 04, 2013 10:46 AM
To: [EMAIL PROTECTED]
Subject: Re: Hello and request some advice. - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn in the past using Red Hat & Infosphere Biginsights, but I need a free O.S. If you want a free O.S , ubuntu is good but if you are familiar with RedHat then you may want to have look at Scientific Linux (Its free as well)
-
RE: Hello and request some advice.
John Lilley 2013-01-04, 19:27
I personally find Windows easier to use, however it is not a supported Hadoop production environment, and I *think* you have to use Cygwin under Windows even for development. Given that, if you want to use a Windows machine and performance is not a consideration, you could spin up a VirtualBox VM under Windows and install CentOS on it. John
From: Rajeev Yadav [mailto:[EMAIL PROTECTED]] Sent: Friday, January 04, 2013 12:19 PM To: [EMAIL PROTECTED] Subject: RE: Hello and request some advice.
Hi john, which would be a better option between Linux and windows from learning perspective of Hadoop?
--- On Fri, 4/1/13, John Lilley <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
From: John Lilley <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> Subject: RE: Hello and request some advice. To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> Date: Friday, 4 January, 2013, 6:12 PM
If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro.
John
-
Re: Hello and request some advice.
Michael Segel 2013-01-04, 19:53
Uhm...
Well, you can talk to Microsoft and Hortonworks about Microsoft as a platform.
Depending on the power of your laptop, you could create a VM and run hadoop in a pseudo distributed mode there.
You could also get an Amazon Web Services account and build a small cluster via EMR...
In terms of OS, Centos is free and its a solid platform for Hadoop. You could then download Cloudera's CHDx and run it in a pseudo distributed cluster on a single node. Lots of options...
On Jan 4, 2013, at 1:27 PM, John Lilley <[EMAIL PROTECTED]> wrote:
> I personally find Windows easier to use, however it is not a supported Hadoop production environment, and I *think* you have to use Cygwin under Windows even for development. > Given that, if you want to use a Windows machine and performance is not a consideration, you could spin up a VirtualBox VM under Windows and install CentOS on it. > John > > From: Rajeev Yadav [mailto:[EMAIL PROTECTED]] > Sent: Friday, January 04, 2013 12:19 PM > To: [EMAIL PROTECTED] > Subject: RE: Hello and request some advice. > > Hi john, > which would be a better option between Linux and windows from learning perspective of Hadoop? > > --- On Fri, 4/1/13, John Lilley <[EMAIL PROTECTED]> wrote: > > From: John Lilley <[EMAIL PROTECTED]> > Subject: RE: Hello and request some advice. > To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> > Date: Friday, 4 January, 2013, 6:12 PM > > If you like RedHat, consider Centos also; it is a nearly-complete clone of the RHEL distro. > > John >
-
Re: Hello and request some advice.
Glen Mazza 2013-01-04, 21:46
I would say Linux, because in your job you're most likely going to use a *nix-type system instead of Windows for hosting Hadoop, so it's good to gain experience with whatever headaches come along. Further, you're also learning Linux simultaneously, killing two birds with one stone.
Glen
On 01/04/2013 02:18 PM, Rajeev Yadav wrote: > Hi john, > which would be a better option between Linux and windows from > learning perspective of Hadoop? > > --- On *Fri, 4/1/13, John Lilley /<[EMAIL PROTECTED]>/*wrote: > > > From: John Lilley <[EMAIL PROTECTED]> > Subject: RE: Hello and request some advice. > To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> > Date: Friday, 4 January, 2013, 6:12 PM > > If you like RedHat, consider Centos also; it is a nearly-complete > clone of the RHEL distro. > > John > > *From:*Nitin Pawar [mailto:[EMAIL PROTECTED]] > *Sent:* Friday, January 04, 2013 10:46 AM > *To:* [EMAIL PROTECTED] > *Subject:* Re: Hello and request some advice. > > - Is Ubuntu a good O.S. for running Hadoop? I’ve tried to learn > in the past using Red Hat & Infosphere Biginsights, but I need a > free O.S. > > If you want a free O.S , ubuntu is good but if you are familiar > with RedHat then you may want to have look at Scientific Linux > (Its free as well) > -- Glen Mazza Talend Community Coders - coders.talend.com blog: www.jroller.com/gmazza
|
|