|
Babak Bastan
2012-06-05, 17:13
Bejoy Ks
2012-06-05, 17:33
shashwat shriparv
2012-06-05, 18:02
Babak Bastan
2012-06-05, 18:13
shashwat shriparv
2012-06-05, 18:15
shashwat shriparv
2012-06-05, 18:19
Babak Bastan
2012-06-05, 18:20
Babak Bastan
2012-06-05, 18:23
shashwat shriparv
2012-06-05, 18:34
Babak Bastan
2012-06-05, 18:43
Babak Bastan
2012-06-05, 19:30
Bejoy KS
2012-06-05, 19:55
Babak Bastan
2012-06-05, 20:00
shashwat shriparv
2012-06-06, 13:32
Babak Bastan
2012-06-06, 14:58
Mohammad Tariq
2012-06-06, 17:42
Mohammad Tariq
2012-06-06, 17:44
Babak Bastan
2012-06-06, 17:47
Mohammad Tariq
2012-06-06, 17:49
Babak Bastan
2012-06-06, 17:52
Mohammad Tariq
2012-06-06, 17:59
Babak Bastan
2012-06-06, 18:12
Mohammad Tariq
2012-06-06, 18:24
Mohammad Tariq
2012-06-06, 18:25
Babak Bastan
2012-06-06, 19:32
Mohammad Tariq
2012-06-06, 19:36
Babak Bastan
2012-06-06, 19:39
Mohammad Tariq
2012-06-06, 19:41
Babak Bastan
2012-06-06, 19:55
shashwat shriparv
2012-06-06, 20:02
Mohammad Tariq
2012-06-06, 20:04
Babak Bastan
2012-06-06, 20:12
Babak Bastan
2012-06-06, 20:15
Babak Bastan
2012-06-06, 20:22
Mohammad Tariq
2012-06-06, 20:26
Mohammad Tariq
2012-06-06, 20:33
Babak Bastan
2012-06-06, 20:52
Mohammad Tariq
2012-06-06, 21:21
Babak Bastan
2012-06-06, 21:34
Mohammad Tariq
2012-06-06, 21:43
|
-
Error while Creating Table in HiveBabak Bastan 2012-06-05, 17:13
Hello Experts ,
I'm new in Hive .When try to create a test Table in Hive I get an error.I want to run this command: *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* but this error occured: FAILED: Error in metadata: MetaException(message:Got exception: java.io.FileNotFoundException File file:/user/hive/warehouse/test does not exist.) FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask How can I solve this Problem? Thank you so much
-
Re: Error while Creating Table in HiveBejoy Ks 2012-06-05, 17:33
HI Babak
It looks like a hadoop configuration problem for me. Have you configured your 'fs.default.name' in core-site.xl to point to hdfs:// instead of file:/// ? If not that is likely to be the issue. Also if you are usinh hdfs for first time there are other steps like formatting namenode and all to be performed. http://hadoop.apache.org/common/docs/r0.20.2/quickstart.html Ensure your hadoop installation is fully working before you get on to hive. Regards Bejoy KS ________________________________ From: Babak Bastan <[EMAIL PROTECTED]> To: [EMAIL PROTECTED] Sent: Tuesday, June 5, 2012 10:43 PM Subject: Error while Creating Table in Hive Hello Experts , I'm new in Hive .When try to create a test Table in Hive I get an error.I want to run this command: CREATE TABLE Test (DateT STRING, Url STRING, Content STRING); but this error occured: FAILED: Error in metadata: MetaException(message:Got exception: java.io.FileNotFoundException File file:/user/hive/warehouse/test does not exist.) FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask How can I solve this Problem? Thank you so much
-
Re: Error while Creating Table in Hiveshashwat shriparv 2012-06-05, 18:02
set
hive.metastore.warehouse.dir in hive-site.xml <property> <name>hive.metastore.local</name> <value>true</value> </property> <name>hive.metastore.warehouse.dir</name> <value>/home/<your username>/hivefolder</value> <description>location of default database for the warehouse</description> </property> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > Hello Experts , > > I'm new in Hive .When try to create a test Table in Hive I get an error.I > want to run this command: > *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* > but this error occured: > FAILED: Error in metadata: MetaException(message:Got exception: > java.io.FileNotFoundException File file:/user/hive/warehouse/test does not > exist.) > FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.DDLTask > How can I solve this Problem? > Thank you so much > -- ∞ Shashwat Shriparv
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-05, 18:13
Thanks sShashwat, and where is this hive-site.xml
On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv <[EMAIL PROTECTED] > wrote: > set > > hive.metastore.warehouse.dir in hive-site.xml > > <property> > <name>hive.metastore.local</name> > <value>true</value> > </property> > > <name>hive.metastore.warehouse.dir</name> > <value>/home/<your username>/hivefolder</value> > <description>location of default database for the > warehouse</description> > </property> > > > On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > >> Hello Experts , >> >> I'm new in Hive .When try to create a test Table in Hive I get an error.I >> want to run this command: >> *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* >> but this error occured: >> FAILED: Error in metadata: MetaException(message:Got exception: >> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not >> exist.) >> FAILED: Execution Error, return code 1 from >> org.apache.hadoop.hive.ql.exec.DDLTask >> How can I solve this Problem? >> Thank you so much >> > > > > -- > > > ∞ > Shashwat Shriparv > > >
-
Re: Error while Creating Table in Hiveshashwat shriparv 2012-06-05, 18:15
It will be inside hive/conf
On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > Thanks sShashwat, and where is this hive-site.xml > > On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < > [EMAIL PROTECTED]> wrote: > >> set >> >> hive.metastore.warehouse.dir in hive-site.xml >> >> <property> >> <name>hive.metastore.local</name> >> <value>true</value> >> </property> >> >> <name>hive.metastore.warehouse.dir</name> >> <value>/home/<your username>/hivefolder</value> >> <description>location of default database for the >> warehouse</description> >> </property> >> >> >> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> >>> Hello Experts , >>> >>> I'm new in Hive .When try to create a test Table in Hive I get an >>> error.I want to run this command: >>> *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* >>> but this error occured: >>> FAILED: Error in metadata: MetaException(message:Got exception: >>> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not >>> exist.) >>> FAILED: Execution Error, return code 1 from >>> org.apache.hadoop.hive.ql.exec.DDLTask >>> How can I solve this Problem? >>> Thank you so much >>> >> >> >> >> -- >> >> >> ∞ >> Shashwat Shriparv >> >> >> > -- ∞ Shashwat Shriparv
-
Re: Error while Creating Table in Hiveshashwat shriparv 2012-06-05, 18:19
/etc/hive/conf/hive-site.xml
check out at above folder there you make changes for help i am sending you link https://ccp.cloudera.com/display/CDHDOC/Hive+Installation On Tue, Jun 5, 2012 at 11:45 PM, shashwat shriparv < [EMAIL PROTECTED]> wrote: > It will be inside hive/conf > > > On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > >> Thanks sShashwat, and where is this hive-site.xml >> >> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < >> [EMAIL PROTECTED]> wrote: >> >>> set >>> >>> hive.metastore.warehouse.dir in hive-site.xml >>> >>> <property> >>> <name>hive.metastore.local</name> >>> <value>true</value> >>> </property> >>> >>> <name>hive.metastore.warehouse.dir</name> >>> <value>/home/<your username>/hivefolder</value> >>> <description>location of default database for the >>> warehouse</description> >>> </property> >>> >>> >>> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>> >>>> Hello Experts , >>>> >>>> I'm new in Hive .When try to create a test Table in Hive I get an >>>> error.I want to run this command: >>>> *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* >>>> but this error occured: >>>> FAILED: Error in metadata: MetaException(message:Got exception: >>>> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not >>>> exist.) >>>> FAILED: Execution Error, return code 1 from >>>> org.apache.hadoop.hive.ql.exec.DDLTask >>>> How can I solve this Problem? >>>> Thank you so much >>>> >>> >>> >>> >>> -- >>> >>> >>> ∞ >>> Shashwat Shriparv >>> >>> >>> >> > > > -- > > > ∞ > Shashwat Shriparv > > > -- ∞ Shashwat Shriparv
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-05, 18:20
It must be inside the <configuration></configuration> or outside this?
On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv <[EMAIL PROTECTED] > wrote: > It will be inside hive/conf > > > On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > >> Thanks sShashwat, and where is this hive-site.xml >> >> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < >> [EMAIL PROTECTED]> wrote: >> >>> set >>> >>> hive.metastore.warehouse.dir in hive-site.xml >>> >>> <property> >>> <name>hive.metastore.local</name> >>> <value>true</value> >>> </property> >>> >>> <name>hive.metastore.warehouse.dir</name> >>> <value>/home/<your username>/hivefolder</value> >>> <description>location of default database for the >>> warehouse</description> >>> </property> >>> >>> >>> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>> >>>> Hello Experts , >>>> >>>> I'm new in Hive .When try to create a test Table in Hive I get an >>>> error.I want to run this command: >>>> *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* >>>> but this error occured: >>>> FAILED: Error in metadata: MetaException(message:Got exception: >>>> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not >>>> exist.) >>>> FAILED: Execution Error, return code 1 from >>>> org.apache.hadoop.hive.ql.exec.DDLTask >>>> How can I solve this Problem? >>>> Thank you so much >>>> >>> >>> >>> >>> -- >>> >>> >>> ∞ >>> Shashwat Shriparv >>> >>> >>> >> > > > -- > > > ∞ > Shashwat Shriparv > > >
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-05, 18:23
Thank you so much my friend your idee works fine(no error) you are the best
:) On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > It must be inside the <configuration></configuration> or outside this? > > > On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv < > [EMAIL PROTECTED]> wrote: > >> It will be inside hive/conf >> >> >> On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> >>> Thanks sShashwat, and where is this hive-site.xml >>> >>> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < >>> [EMAIL PROTECTED]> wrote: >>> >>>> set >>>> >>>> hive.metastore.warehouse.dir in hive-site.xml >>>> >>>> <property> >>>> <name>hive.metastore.local</name> >>>> <value>true</value> >>>> </property> >>>> >>>> <name>hive.metastore.warehouse.dir</name> >>>> <value>/home/<your username>/hivefolder</value> >>>> <description>location of default database for the >>>> warehouse</description> >>>> </property> >>>> >>>> >>>> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>> >>>>> Hello Experts , >>>>> >>>>> I'm new in Hive .When try to create a test Table in Hive I get an >>>>> error.I want to run this command: >>>>> *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* >>>>> but this error occured: >>>>> FAILED: Error in metadata: MetaException(message:Got exception: >>>>> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not >>>>> exist.) >>>>> FAILED: Execution Error, return code 1 from >>>>> org.apache.hadoop.hive.ql.exec.DDLTask >>>>> How can I solve this Problem? >>>>> Thank you so much >>>>> >>>> >>>> >>>> >>>> -- >>>> >>>> >>>> ∞ >>>> Shashwat Shriparv >>>> >>>> >>>> >>> >> >> >> -- >> >> >> ∞ >> Shashwat Shriparv >> >> >> >
-
Re: Error while Creating Table in Hiveshashwat shriparv 2012-06-05, 18:34
inside configuration. all properties will be inside the configuration tags
On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > Thank you so much my friend your idee works fine(no error) you are the > best :) > > > On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > >> It must be inside the <configuration></configuration> or outside this? >> >> >> On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv < >> [EMAIL PROTECTED]> wrote: >> >>> It will be inside hive/conf >>> >>> >>> On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>> >>>> Thanks sShashwat, and where is this hive-site.xml >>>> >>>> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < >>>> [EMAIL PROTECTED]> wrote: >>>> >>>>> set >>>>> >>>>> hive.metastore.warehouse.dir in hive-site.xml >>>>> >>>>> <property> >>>>> <name>hive.metastore.local</name> >>>>> <value>true</value> >>>>> </property> >>>>> >>>>> <name>hive.metastore.warehouse.dir</name> >>>>> <value>/home/<your username>/hivefolder</value> >>>>> <description>location of default database for the >>>>> warehouse</description> >>>>> </property> >>>>> >>>>> >>>>> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>> >>>>>> Hello Experts , >>>>>> >>>>>> I'm new in Hive .When try to create a test Table in Hive I get an >>>>>> error.I want to run this command: >>>>>> *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* >>>>>> but this error occured: >>>>>> FAILED: Error in metadata: MetaException(message:Got exception: >>>>>> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not >>>>>> exist.) >>>>>> FAILED: Execution Error, return code 1 from >>>>>> org.apache.hadoop.hive.ql.exec.DDLTask >>>>>> How can I solve this Problem? >>>>>> Thank you so much >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> >>>>> ∞ >>>>> Shashwat Shriparv >>>>> >>>>> >>>>> >>>> >>> >>> >>> -- >>> >>> >>> ∞ >>> Shashwat Shriparv >>> >>> >>> >> > -- ∞ Shashwat Shriparv
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-05, 18:43
Ok sorry but that was my Mistake .I thought it works but no.
I wrote the command without ; and then I think It works but with ; at the end of command CREATE TABLE pokes (foo INT, bar STRING); does'nt work On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv <[EMAIL PROTECTED] > wrote: > inside configuration. all properties will be inside the configuration tags > > > On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > >> Thank you so much my friend your idee works fine(no error) you are the >> best :) >> >> >> On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> >>> It must be inside the <configuration></configuration> or outside this? >>> >>> >>> On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv < >>> [EMAIL PROTECTED]> wrote: >>> >>>> It will be inside hive/conf >>>> >>>> >>>> On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>> >>>>> Thanks sShashwat, and where is this hive-site.xml >>>>> >>>>> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < >>>>> [EMAIL PROTECTED]> wrote: >>>>> >>>>>> set >>>>>> >>>>>> hive.metastore.warehouse.dir in hive-site.xml >>>>>> >>>>>> <property> >>>>>> <name>hive.metastore.local</name> >>>>>> <value>true</value> >>>>>> </property> >>>>>> >>>>>> <name>hive.metastore.warehouse.dir</name> >>>>>> <value>/home/<your username>/hivefolder</value> >>>>>> <description>location of default database for the >>>>>> warehouse</description> >>>>>> </property> >>>>>> >>>>>> >>>>>> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>>> >>>>>>> Hello Experts , >>>>>>> >>>>>>> I'm new in Hive .When try to create a test Table in Hive I get an >>>>>>> error.I want to run this command: >>>>>>> *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* >>>>>>> but this error occured: >>>>>>> FAILED: Error in metadata: MetaException(message:Got exception: >>>>>>> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not >>>>>>> exist.) >>>>>>> FAILED: Execution Error, return code 1 from >>>>>>> org.apache.hadoop.hive.ql.exec.DDLTask >>>>>>> How can I solve this Problem? >>>>>>> Thank you so much >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> >>>>>> ∞ >>>>>> Shashwat Shriparv >>>>>> >>>>>> >>>>>> >>>>> >>>> >>>> >>>> -- >>>> >>>> >>>> ∞ >>>> Shashwat Shriparv >>>> >>>> >>>> >>> >> > > > -- > > > ∞ > Shashwat Shriparv > > >
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-05, 19:30
@Bejoy: I set the fs.default.name in the core-site.xml and I did all of
thing that was mentioned in the reference but no effect On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > Ok sorry but that was my Mistake .I thought it works but no. > I wrote the command without ; and then I think It works but with ; at the > end of command > > CREATE TABLE pokes (foo INT, bar STRING); > > does'nt work > > > On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv < > [EMAIL PROTECTED]> wrote: > >> inside configuration. all properties will be inside the configuration tags >> >> >> On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> >>> Thank you so much my friend your idee works fine(no error) you are the >>> best :) >>> >>> >>> On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >>> >>>> It must be inside the <configuration></configuration> or outside this? >>>> >>>> >>>> On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv < >>>> [EMAIL PROTECTED]> wrote: >>>> >>>>> It will be inside hive/conf >>>>> >>>>> >>>>> On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>> >>>>>> Thanks sShashwat, and where is this hive-site.xml >>>>>> >>>>>> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < >>>>>> [EMAIL PROTECTED]> wrote: >>>>>> >>>>>>> set >>>>>>> >>>>>>> hive.metastore.warehouse.dir in hive-site.xml >>>>>>> >>>>>>> <property> >>>>>>> <name>hive.metastore.local</name> >>>>>>> <value>true</value> >>>>>>> </property> >>>>>>> >>>>>>> <name>hive.metastore.warehouse.dir</name> >>>>>>> <value>/home/<your username>/hivefolder</value> >>>>>>> <description>location of default database for the >>>>>>> warehouse</description> >>>>>>> </property> >>>>>>> >>>>>>> >>>>>>> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>>>> >>>>>>>> Hello Experts , >>>>>>>> >>>>>>>> I'm new in Hive .When try to create a test Table in Hive I get an >>>>>>>> error.I want to run this command: >>>>>>>> *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* >>>>>>>> but this error occured: >>>>>>>> FAILED: Error in metadata: MetaException(message:Got exception: >>>>>>>> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not >>>>>>>> exist.) >>>>>>>> FAILED: Execution Error, return code 1 from >>>>>>>> org.apache.hadoop.hive.ql.exec.DDLTask >>>>>>>> How can I solve this Problem? >>>>>>>> Thank you so much >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> >>>>>>> >>>>>>> ∞ >>>>>>> Shashwat Shriparv >>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> >>>>> ∞ >>>>> Shashwat Shriparv >>>>> >>>>> >>>>> >>>> >>> >> >> >> -- >> >> >> ∞ >> Shashwat Shriparv >> >> >> >
-
Re: Error while Creating Table in HiveBejoy KS 2012-06-05, 19:55
Hi Babak
You gotta follow those instructions in the apace site to set up hadoop from scratch and ensure that hdfs is working first. You should be able to read and write files to hdfs before you do your next steps. Are you on CDH or apache distribution of hadoop? If it is CDH there are detailed instructions on Cloudera web site. Regards Bejoy KS Sent from handheld, please excuse typos. -----Original Message----- From: Babak Bastan <[EMAIL PROTECTED]> Date: Tue, 5 Jun 2012 21:30:22 To: <[EMAIL PROTECTED]> Reply-To: [EMAIL PROTECTED] Subject: Re: Error while Creating Table in Hive @Bejoy: I set the fs.default.name in the core-site.xml and I did all of thing that was mentioned in the reference but no effect On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > Ok sorry but that was my Mistake .I thought it works but no. > I wrote the command without ; and then I think It works but with ; at the > end of command > > CREATE TABLE pokes (foo INT, bar STRING); > > does'nt work > > > On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv < > [EMAIL PROTECTED]> wrote: > >> inside configuration. all properties will be inside the configuration tags >> >> >> On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> >>> Thank you so much my friend your idee works fine(no error) you are the >>> best :) >>> >>> >>> On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >>> >>>> It must be inside the <configuration></configuration> or outside this? >>>> >>>> >>>> On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv < >>>> [EMAIL PROTECTED]> wrote: >>>> >>>>> It will be inside hive/conf >>>>> >>>>> >>>>> On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>> >>>>>> Thanks sShashwat, and where is this hive-site.xml >>>>>> >>>>>> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < >>>>>> [EMAIL PROTECTED]> wrote: >>>>>> >>>>>>> set >>>>>>> >>>>>>> hive.metastore.warehouse.dir in hive-site.xml >>>>>>> >>>>>>> <property> >>>>>>> <name>hive.metastore.local</name> >>>>>>> <value>true</value> >>>>>>> </property> >>>>>>> >>>>>>> <name>hive.metastore.warehouse.dir</name> >>>>>>> <value>/home/<your username>/hivefolder</value> >>>>>>> <description>location of default database for the >>>>>>> warehouse</description> >>>>>>> </property> >>>>>>> >>>>>>> >>>>>>> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>>>> >>>>>>>> Hello Experts , >>>>>>>> >>>>>>>> I'm new in Hive .When try to create a test Table in Hive I get an >>>>>>>> error.I want to run this command: >>>>>>>> *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* >>>>>>>> but this error occured: >>>>>>>> FAILED: Error in metadata: MetaException(message:Got exception: >>>>>>>> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not >>>>>>>> exist.) >>>>>>>> FAILED: Execution Error, return code 1 from >>>>>>>> org.apache.hadoop.hive.ql.exec.DDLTask >>>>>>>> How can I solve this Problem? >>>>>>>> Thank you so much >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> >>>>>>> >>>>>>> ∞ >>>>>>> Shashwat Shriparv >>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> >>>>> ∞ >>>>> Shashwat Shriparv >>>>> >>>>> >>>>> >>>> >>> >> >> >> -- >> >> >> ∞ >> Shashwat Shriparv >> >> >> >
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-05, 20:00
no I'm not working on CDH.Is there a way to test if my Hadoop works fine or
not? On Tue, Jun 5, 2012 at 9:55 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: > ** > Hi Babak > > You gotta follow those instructions in the apace site to set up hadoop > from scratch and ensure that hdfs is working first. You should be able to > read and write files to hdfs before you do your next steps. > > Are you on CDH or apache distribution of hadoop? If it is CDH there are > detailed instructions on Cloudera web site. > > Regards > Bejoy KS > > Sent from handheld, please excuse typos. > ------------------------------ > *From: * Babak Bastan <[EMAIL PROTECTED]> > *Date: *Tue, 5 Jun 2012 21:30:22 +0200 > *To: *<[EMAIL PROTECTED]> > *ReplyTo: * [EMAIL PROTECTED] > *Subject: *Re: Error while Creating Table in Hive > > @Bejoy: I set the fs.default.name in the core-site.xml and I did all of > thing that was mentioned in the reference but no effect > > On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > >> Ok sorry but that was my Mistake .I thought it works but no. >> I wrote the command without ; and then I think It works but with ; at the >> end of command >> >> CREATE TABLE pokes (foo INT, bar STRING); >> >> does'nt work >> >> >> On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv < >> [EMAIL PROTECTED]> wrote: >> >>> inside configuration. all properties will be inside the configuration >>> tags >>> >>> >>> On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>> >>>> Thank you so much my friend your idee works fine(no error) you are the >>>> best :) >>>> >>>> >>>> On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>> >>>>> It must be inside the <configuration></configuration> or outside this? >>>>> >>>>> >>>>> On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv < >>>>> [EMAIL PROTECTED]> wrote: >>>>> >>>>>> It will be inside hive/conf >>>>>> >>>>>> >>>>>> On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>>> >>>>>>> Thanks sShashwat, and where is this hive-site.xml >>>>>>> >>>>>>> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < >>>>>>> [EMAIL PROTECTED]> wrote: >>>>>>> >>>>>>>> set >>>>>>>> >>>>>>>> hive.metastore.warehouse.dir in hive-site.xml >>>>>>>> >>>>>>>> <property> >>>>>>>> <name>hive.metastore.local</name> >>>>>>>> <value>true</value> >>>>>>>> </property> >>>>>>>> >>>>>>>> <name>hive.metastore.warehouse.dir</name> >>>>>>>> <value>/home/<your username>/hivefolder</value> >>>>>>>> <description>location of default database for the >>>>>>>> warehouse</description> >>>>>>>> </property> >>>>>>>> >>>>>>>> >>>>>>>> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>>>>> >>>>>>>>> Hello Experts , >>>>>>>>> >>>>>>>>> I'm new in Hive .When try to create a test Table in Hive I get an >>>>>>>>> error.I want to run this command: >>>>>>>>> *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* >>>>>>>>> but this error occured: >>>>>>>>> FAILED: Error in metadata: MetaException(message:Got exception: >>>>>>>>> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not >>>>>>>>> exist.) >>>>>>>>> FAILED: Execution Error, return code 1 from >>>>>>>>> org.apache.hadoop.hive.ql.exec.DDLTask >>>>>>>>> How can I solve this Problem? >>>>>>>>> Thank you so much >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> >>>>>>>> >>>>>>>> ∞ >>>>>>>> Shashwat Shriparv >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> >>>>>> ∞ >>>>>> Shashwat Shriparv >>>>>> >>>>>> >>>>>> >>>>> >>>> >>> >>> >>> -- >>> >>> >>> ∞ >>> Shashwat Shriparv >>> >>> >>> >> >
-
Re: Error while Creating Table in Hiveshashwat shriparv 2012-06-06, 13:32
first type http://localhost:50070 whether this is opening or not and check
how many nodes are available, check some of the hadoop shell commands from http://hadoop.apache.org/common/docs/r0.18.3/hdfs_shell.html run example mapreduce task on hadoop take example from here : http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/ if all the above you can do sucessfully means hadoop is configured correctly Regards Shashwat On Wed, Jun 6, 2012 at 1:30 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > no I'm not working on CDH.Is there a way to test if my Hadoop works fine > or not? > > > On Tue, Jun 5, 2012 at 9:55 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: > >> ** >> Hi Babak >> >> You gotta follow those instructions in the apace site to set up hadoop >> from scratch and ensure that hdfs is working first. You should be able to >> read and write files to hdfs before you do your next steps. >> >> Are you on CDH or apache distribution of hadoop? If it is CDH there are >> detailed instructions on Cloudera web site. >> >> Regards >> Bejoy KS >> >> Sent from handheld, please excuse typos. >> ------------------------------ >> *From: * Babak Bastan <[EMAIL PROTECTED]> >> *Date: *Tue, 5 Jun 2012 21:30:22 +0200 >> *To: *<[EMAIL PROTECTED]> >> *ReplyTo: * [EMAIL PROTECTED] >> *Subject: *Re: Error while Creating Table in Hive >> >> @Bejoy: I set the fs.default.name in the core-site.xml and I did all of >> thing that was mentioned in the reference but no effect >> >> On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> >>> Ok sorry but that was my Mistake .I thought it works but no. >>> I wrote the command without ; and then I think It works but with ; at >>> the end of command >>> >>> CREATE TABLE pokes (foo INT, bar STRING); >>> >>> does'nt work >>> >>> >>> On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv < >>> [EMAIL PROTECTED]> wrote: >>> >>>> inside configuration. all properties will be inside the configuration >>>> tags >>>> >>>> >>>> On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>> >>>>> Thank you so much my friend your idee works fine(no error) you are the >>>>> best :) >>>>> >>>>> >>>>> On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>> >>>>>> It must be inside the <configuration></configuration> or outside this? >>>>>> >>>>>> >>>>>> On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv < >>>>>> [EMAIL PROTECTED]> wrote: >>>>>> >>>>>>> It will be inside hive/conf >>>>>>> >>>>>>> >>>>>>> On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>>>> >>>>>>>> Thanks sShashwat, and where is this hive-site.xml >>>>>>>> >>>>>>>> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < >>>>>>>> [EMAIL PROTECTED]> wrote: >>>>>>>> >>>>>>>>> set >>>>>>>>> >>>>>>>>> hive.metastore.warehouse.dir in hive-site.xml >>>>>>>>> >>>>>>>>> <property> >>>>>>>>> <name>hive.metastore.local</name> >>>>>>>>> <value>true</value> >>>>>>>>> </property> >>>>>>>>> >>>>>>>>> <name>hive.metastore.warehouse.dir</name> >>>>>>>>> <value>/home/<your username>/hivefolder</value> >>>>>>>>> <description>location of default database for the >>>>>>>>> warehouse</description> >>>>>>>>> </property> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>>>>>> >>>>>>>>>> Hello Experts , >>>>>>>>>> >>>>>>>>>> I'm new in Hive .When try to create a test Table in Hive I get an >>>>>>>>>> error.I want to run this command: >>>>>>>>>> *CREATE TABLE Test (DateT STRING, Url STRING, Content STRING);* >>>>>>>>>> but this error occured: >>>>>>>>>> FAILED: Error in metadata: MetaException(message:Got exception: >>>>>>>>>> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not >>>>>>>>>> exist.) >>>>>>>>>> FAILED: Execution Error, return code 1 from >>>>>>>>>> org.apache.hadoop.hive.ql.exec.DDLTask ∞ Shashwat Shriparv
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 14:58
Thank you shashwat for the answer,
where should I type http://localhost:50070? I typed here: hive>http://localhost:50070 but nothing as result On Wed, Jun 6, 2012 at 3:32 PM, shashwat shriparv <[EMAIL PROTECTED] > wrote: > first type http://localhost:50070 whether this is opening or not and > check how many nodes are available, check some of the hadoop shell commands > from http://hadoop.apache.org/common/docs/r0.18.3/hdfs_shell.html run > example mapreduce task on hadoop take example from here : > http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/ > > if all the above you can do sucessfully means hadoop is configured > correctly > > Regards > Shashwat > > > On Wed, Jun 6, 2012 at 1:30 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > >> no I'm not working on CDH.Is there a way to test if my Hadoop works fine >> or not? >> >> >> On Tue, Jun 5, 2012 at 9:55 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: >> >>> ** >>> Hi Babak >>> >>> You gotta follow those instructions in the apace site to set up hadoop >>> from scratch and ensure that hdfs is working first. You should be able to >>> read and write files to hdfs before you do your next steps. >>> >>> Are you on CDH or apache distribution of hadoop? If it is CDH there are >>> detailed instructions on Cloudera web site. >>> >>> Regards >>> Bejoy KS >>> >>> Sent from handheld, please excuse typos. >>> ------------------------------ >>> *From: * Babak Bastan <[EMAIL PROTECTED]> >>> *Date: *Tue, 5 Jun 2012 21:30:22 +0200 >>> *To: *<[EMAIL PROTECTED]> >>> *ReplyTo: * [EMAIL PROTECTED] >>> *Subject: *Re: Error while Creating Table in Hive >>> >>> @Bejoy: I set the fs.default.name in the core-site.xml and I did all of >>> thing that was mentioned in the reference but no effect >>> >>> On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >>> >>>> Ok sorry but that was my Mistake .I thought it works but no. >>>> I wrote the command without ; and then I think It works but with ; at >>>> the end of command >>>> >>>> CREATE TABLE pokes (foo INT, bar STRING); >>>> >>>> does'nt work >>>> >>>> >>>> On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv < >>>> [EMAIL PROTECTED]> wrote: >>>> >>>>> inside configuration. all properties will be inside the configuration >>>>> tags >>>>> >>>>> >>>>> On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>> >>>>>> Thank you so much my friend your idee works fine(no error) you are >>>>>> the best :) >>>>>> >>>>>> >>>>>> On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>>> >>>>>>> It must be inside the <configuration></configuration> or outside >>>>>>> this? >>>>>>> >>>>>>> >>>>>>> On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv < >>>>>>> [EMAIL PROTECTED]> wrote: >>>>>>> >>>>>>>> It will be inside hive/conf >>>>>>>> >>>>>>>> >>>>>>>> On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]>wrote: >>>>>>>> >>>>>>>>> Thanks sShashwat, and where is this hive-site.xml >>>>>>>>> >>>>>>>>> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv < >>>>>>>>> [EMAIL PROTECTED]> wrote: >>>>>>>>> >>>>>>>>>> set >>>>>>>>>> >>>>>>>>>> hive.metastore.warehouse.dir in hive-site.xml >>>>>>>>>> >>>>>>>>>> <property> >>>>>>>>>> <name>hive.metastore.local</name> >>>>>>>>>> <value>true</value> >>>>>>>>>> </property> >>>>>>>>>> >>>>>>>>>> <name>hive.metastore.warehouse.dir</name> >>>>>>>>>> <value>/home/<your username>/hivefolder</value> >>>>>>>>>> <description>location of default database for the >>>>>>>>>> warehouse</description> >>>>>>>>>> </property> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan <[EMAIL PROTECTED] >>>>>>>>>> > wrote: >>>>>>>>>> >>>>>>>>>>> Hello Experts , >>>>>>>>>>> >>>>>>>>>>> I'm new in Hive .When try to create a test Table in Hive I get >>>>>>>>>>> an error.I want to run this command: >>>>>>>>>
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 17:42
Hi Babak,
You have to type it in you web browser..Hadoop provides us a web GUI that not only allows us to browse through the file system, but to download the files as well..Apart from that it also provides a web GUI that can be used to see the status of Jobtracker and Tasktracker..When you run a Hive or Pig job or a Mapreduce job, you can point your browser to http://localhost:50030 to see the status and logs of your job. Regards, Mohammad Tariq On Wed, Jun 6, 2012 at 8:28 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > Thank you shashwat for the answer, > where should I type http://localhost:50070? > I typed here: hive>http://localhost:50070 but nothing as result > > > On Wed, Jun 6, 2012 at 3:32 PM, shashwat shriparv > <[EMAIL PROTECTED]> wrote: >> >> first type http://localhost:50070 whether this is opening or not and check >> how many nodes are available, check some of the hadoop shell commands >> from http://hadoop.apache.org/common/docs/r0.18.3/hdfs_shell.html run >> example mapreduce task on hadoop take example from here >> : http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/ >> >> if all the above you can do sucessfully means hadoop is configured >> correctly >> >> Regards >> Shashwat >> >> >> On Wed, Jun 6, 2012 at 1:30 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: >>> >>> no I'm not working on CDH.Is there a way to test if my Hadoop works fine >>> or not? >>> >>> >>> On Tue, Jun 5, 2012 at 9:55 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: >>>> >>>> Hi Babak >>>> >>>> You gotta follow those instructions in the apace site to set up hadoop >>>> from scratch and ensure that hdfs is working first. You should be able to >>>> read and write files to hdfs before you do your next steps. >>>> >>>> Are you on CDH or apache distribution of hadoop? If it is CDH there are >>>> detailed instructions on Cloudera web site. >>>> >>>> Regards >>>> Bejoy KS >>>> >>>> Sent from handheld, please excuse typos. >>>> ________________________________ >>>> From: Babak Bastan <[EMAIL PROTECTED]> >>>> Date: Tue, 5 Jun 2012 21:30:22 +0200 >>>> To: <[EMAIL PROTECTED]> >>>> ReplyTo: [EMAIL PROTECTED] >>>> Subject: Re: Error while Creating Table in Hive >>>> >>>> @Bejoy: I set the fs.default.name in the core-site.xml and I did all of >>>> thing that was mentioned in the reference but no effect >>>> >>>> On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >>>>> >>>>> Ok sorry but that was my Mistake .I thought it works but no. >>>>> I wrote the command without ; and then I think It works but with ; at >>>>> the end of command >>>>> >>>>> CREATE TABLE pokes (foo INT, bar STRING); >>>>> >>>>> does'nt work >>>>> >>>>> >>>>> On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv >>>>> <[EMAIL PROTECTED]> wrote: >>>>>> >>>>>> inside configuration. all properties will be inside the configuration >>>>>> tags >>>>>> >>>>>> >>>>>> On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan <[EMAIL PROTECTED]> >>>>>> wrote: >>>>>>> >>>>>>> Thank you so much my friend your idee works fine(no error) you are >>>>>>> the best :) >>>>>>> >>>>>>> >>>>>>> On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan <[EMAIL PROTECTED]> >>>>>>> wrote: >>>>>>>> >>>>>>>> It must be inside the <configuration></configuration> or outside >>>>>>>> this? >>>>>>>> >>>>>>>> >>>>>>>> On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv >>>>>>>> <[EMAIL PROTECTED]> wrote: >>>>>>>>> >>>>>>>>> It will be inside hive/conf >>>>>>>>> >>>>>>>>> >>>>>>>>> On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]> >>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>> Thanks sShashwat, and where is this hive-site.xml >>>>>>>>>> >>>>>>>>>> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv >>>>>>>>>> <[EMAIL PROTECTED]> wrote: >>>>>>>>>>> >>>>>>>>>>> set >>>>>>>>>>> >>>>>>>>>>> hive.metastore.warehouse.dir in hive-site.xml >>>>>>>>>>> >>>>>>>>>>> <property> >>>>>>>>>>> <name>hive.metastore.local</name>
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 17:44
you can also use "jps" command at your shell to see whether Hadoop
processes are running or not. Regards, Mohammad Tariq On Wed, Jun 6, 2012 at 11:12 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > Hi Babak, > > You have to type it in you web browser..Hadoop provides us a web GUI > that not only allows us to browse through the file system, but to > download the files as well..Apart from that it also provides a web GUI > that can be used to see the status of Jobtracker and Tasktracker..When > you run a Hive or Pig job or a Mapreduce job, you can point your > browser to http://localhost:50030 to see the status and logs of your > job. > > Regards, > Mohammad Tariq > > > On Wed, Jun 6, 2012 at 8:28 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> Thank you shashwat for the answer, >> where should I type http://localhost:50070? >> I typed here: hive>http://localhost:50070 but nothing as result >> >> >> On Wed, Jun 6, 2012 at 3:32 PM, shashwat shriparv >> <[EMAIL PROTECTED]> wrote: >>> >>> first type http://localhost:50070 whether this is opening or not and check >>> how many nodes are available, check some of the hadoop shell commands >>> from http://hadoop.apache.org/common/docs/r0.18.3/hdfs_shell.html run >>> example mapreduce task on hadoop take example from here >>> : http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/ >>> >>> if all the above you can do sucessfully means hadoop is configured >>> correctly >>> >>> Regards >>> Shashwat >>> >>> >>> On Wed, Jun 6, 2012 at 1:30 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: >>>> >>>> no I'm not working on CDH.Is there a way to test if my Hadoop works fine >>>> or not? >>>> >>>> >>>> On Tue, Jun 5, 2012 at 9:55 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: >>>>> >>>>> Hi Babak >>>>> >>>>> You gotta follow those instructions in the apace site to set up hadoop >>>>> from scratch and ensure that hdfs is working first. You should be able to >>>>> read and write files to hdfs before you do your next steps. >>>>> >>>>> Are you on CDH or apache distribution of hadoop? If it is CDH there are >>>>> detailed instructions on Cloudera web site. >>>>> >>>>> Regards >>>>> Bejoy KS >>>>> >>>>> Sent from handheld, please excuse typos. >>>>> ________________________________ >>>>> From: Babak Bastan <[EMAIL PROTECTED]> >>>>> Date: Tue, 5 Jun 2012 21:30:22 +0200 >>>>> To: <[EMAIL PROTECTED]> >>>>> ReplyTo: [EMAIL PROTECTED] >>>>> Subject: Re: Error while Creating Table in Hive >>>>> >>>>> @Bejoy: I set the fs.default.name in the core-site.xml and I did all of >>>>> thing that was mentioned in the reference but no effect >>>>> >>>>> On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >>>>>> >>>>>> Ok sorry but that was my Mistake .I thought it works but no. >>>>>> I wrote the command without ; and then I think It works but with ; at >>>>>> the end of command >>>>>> >>>>>> CREATE TABLE pokes (foo INT, bar STRING); >>>>>> >>>>>> does'nt work >>>>>> >>>>>> >>>>>> On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv >>>>>> <[EMAIL PROTECTED]> wrote: >>>>>>> >>>>>>> inside configuration. all properties will be inside the configuration >>>>>>> tags >>>>>>> >>>>>>> >>>>>>> On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan <[EMAIL PROTECTED]> >>>>>>> wrote: >>>>>>>> >>>>>>>> Thank you so much my friend your idee works fine(no error) you are >>>>>>>> the best :) >>>>>>>> >>>>>>>> >>>>>>>> On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan <[EMAIL PROTECTED]> >>>>>>>> wrote: >>>>>>>>> >>>>>>>>> It must be inside the <configuration></configuration> or outside >>>>>>>>> this? >>>>>>>>> >>>>>>>>> >>>>>>>>> On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv >>>>>>>>> <[EMAIL PROTECTED]> wrote: >>>>>>>>>> >>>>>>>>>> It will be inside hive/conf >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan <[EMAIL PROTECTED]> >>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>> Thanks sShashwat, and where is this hive-site.xml
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 17:47
Hi MohammadmI irun jps in my shel I can see this result:
2213 Jps On Wed, Jun 6, 2012 at 7:44 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > you can also use "jps" command at your shell to see whether Hadoop > processes are running or not. > > Regards, > Mohammad Tariq > > > On Wed, Jun 6, 2012 at 11:12 PM, Mohammad Tariq <[EMAIL PROTECTED]> > wrote: > > Hi Babak, > > > > You have to type it in you web browser..Hadoop provides us a web GUI > > that not only allows us to browse through the file system, but to > > download the files as well..Apart from that it also provides a web GUI > > that can be used to see the status of Jobtracker and Tasktracker..When > > you run a Hive or Pig job or a Mapreduce job, you can point your > > browser to http://localhost:50030 to see the status and logs of your > > job. > > > > Regards, > > Mohammad Tariq > > > > > > On Wed, Jun 6, 2012 at 8:28 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > >> Thank you shashwat for the answer, > >> where should I type http://localhost:50070? > >> I typed here: hive>http://localhost:50070 but nothing as result > >> > >> > >> On Wed, Jun 6, 2012 at 3:32 PM, shashwat shriparv > >> <[EMAIL PROTECTED]> wrote: > >>> > >>> first type http://localhost:50070 whether this is opening or not and > check > >>> how many nodes are available, check some of the hadoop shell commands > >>> from http://hadoop.apache.org/common/docs/r0.18.3/hdfs_shell.html run > >>> example mapreduce task on hadoop take example from here > >>> : > http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/ > >>> > >>> if all the above you can do sucessfully means hadoop is configured > >>> correctly > >>> > >>> Regards > >>> Shashwat > >>> > >>> > >>> On Wed, Jun 6, 2012 at 1:30 AM, Babak Bastan <[EMAIL PROTECTED]> > wrote: > >>>> > >>>> no I'm not working on CDH.Is there a way to test if my Hadoop works > fine > >>>> or not? > >>>> > >>>> > >>>> On Tue, Jun 5, 2012 at 9:55 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: > >>>>> > >>>>> Hi Babak > >>>>> > >>>>> You gotta follow those instructions in the apace site to set up > hadoop > >>>>> from scratch and ensure that hdfs is working first. You should be > able to > >>>>> read and write files to hdfs before you do your next steps. > >>>>> > >>>>> Are you on CDH or apache distribution of hadoop? If it is CDH there > are > >>>>> detailed instructions on Cloudera web site. > >>>>> > >>>>> Regards > >>>>> Bejoy KS > >>>>> > >>>>> Sent from handheld, please excuse typos. > >>>>> ________________________________ > >>>>> From: Babak Bastan <[EMAIL PROTECTED]> > >>>>> Date: Tue, 5 Jun 2012 21:30:22 +0200 > >>>>> To: <[EMAIL PROTECTED]> > >>>>> ReplyTo: [EMAIL PROTECTED] > >>>>> Subject: Re: Error while Creating Table in Hive > >>>>> > >>>>> @Bejoy: I set the fs.default.name in the core-site.xml and I did > all of > >>>>> thing that was mentioned in the reference but no effect > >>>>> > >>>>> On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan <[EMAIL PROTECTED]> > wrote: > >>>>>> > >>>>>> Ok sorry but that was my Mistake .I thought it works but no. > >>>>>> I wrote the command without ; and then I think It works but with ; > at > >>>>>> the end of command > >>>>>> > >>>>>> CREATE TABLE pokes (foo INT, bar STRING); > >>>>>> > >>>>>> does'nt work > >>>>>> > >>>>>> > >>>>>> On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv > >>>>>> <[EMAIL PROTECTED]> wrote: > >>>>>>> > >>>>>>> inside configuration. all properties will be inside the > configuration > >>>>>>> tags > >>>>>>> > >>>>>>> > >>>>>>> On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan <[EMAIL PROTECTED]> > >>>>>>> wrote: > >>>>>>>> > >>>>>>>> Thank you so much my friend your idee works fine(no error) you are > >>>>>>>> the best :) > >>>>>>>> > >>>>>>>> > >>>>>>>> On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan <[EMAIL PROTECTED]> > >>>>>>>> wrote: > >>>>>>>>> > >>>>>>>>> It must be inside the <configuration></configuration> or outside
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 17:49
if you are getting only this, it means your hadoop is not
running..were you able to format hdfs properly??? Regards, Mohammad Tariq On Wed, Jun 6, 2012 at 11:17 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > Hi MohammadmI irun jps in my shel I can see this result: > 2213 Jps > > > On Wed, Jun 6, 2012 at 7:44 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: >> >> you can also use "jps" command at your shell to see whether Hadoop >> processes are running or not. >> >> Regards, >> Mohammad Tariq >> >> >> On Wed, Jun 6, 2012 at 11:12 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> wrote: >> > Hi Babak, >> > >> > You have to type it in you web browser..Hadoop provides us a web GUI >> > that not only allows us to browse through the file system, but to >> > download the files as well..Apart from that it also provides a web GUI >> > that can be used to see the status of Jobtracker and Tasktracker..When >> > you run a Hive or Pig job or a Mapreduce job, you can point your >> > browser to http://localhost:50030 to see the status and logs of your >> > job. >> > >> > Regards, >> > Mohammad Tariq >> > >> > >> > On Wed, Jun 6, 2012 at 8:28 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> >> Thank you shashwat for the answer, >> >> where should I type http://localhost:50070? >> >> I typed here: hive>http://localhost:50070 but nothing as result >> >> >> >> >> >> On Wed, Jun 6, 2012 at 3:32 PM, shashwat shriparv >> >> <[EMAIL PROTECTED]> wrote: >> >>> >> >>> first type http://localhost:50070 whether this is opening or not and >> >>> check >> >>> how many nodes are available, check some of the hadoop shell commands >> >>> from http://hadoop.apache.org/common/docs/r0.18.3/hdfs_shell.html run >> >>> example mapreduce task on hadoop take example from here >> >>> >> >>> : http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/ >> >>> >> >>> if all the above you can do sucessfully means hadoop is configured >> >>> correctly >> >>> >> >>> Regards >> >>> Shashwat >> >>> >> >>> >> >>> On Wed, Jun 6, 2012 at 1:30 AM, Babak Bastan <[EMAIL PROTECTED]> >> >>> wrote: >> >>>> >> >>>> no I'm not working on CDH.Is there a way to test if my Hadoop works >> >>>> fine >> >>>> or not? >> >>>> >> >>>> >> >>>> On Tue, Jun 5, 2012 at 9:55 PM, Bejoy KS <[EMAIL PROTECTED]> wrote: >> >>>>> >> >>>>> Hi Babak >> >>>>> >> >>>>> You gotta follow those instructions in the apace site to set up >> >>>>> hadoop >> >>>>> from scratch and ensure that hdfs is working first. You should be >> >>>>> able to >> >>>>> read and write files to hdfs before you do your next steps. >> >>>>> >> >>>>> Are you on CDH or apache distribution of hadoop? If it is CDH there >> >>>>> are >> >>>>> detailed instructions on Cloudera web site. >> >>>>> >> >>>>> Regards >> >>>>> Bejoy KS >> >>>>> >> >>>>> Sent from handheld, please excuse typos. >> >>>>> ________________________________ >> >>>>> From: Babak Bastan <[EMAIL PROTECTED]> >> >>>>> Date: Tue, 5 Jun 2012 21:30:22 +0200 >> >>>>> To: <[EMAIL PROTECTED]> >> >>>>> ReplyTo: [EMAIL PROTECTED] >> >>>>> Subject: Re: Error while Creating Table in Hive >> >>>>> >> >>>>> @Bejoy: I set the fs.default.name in the core-site.xml and I did all >> >>>>> of >> >>>>> thing that was mentioned in the reference but no effect >> >>>>> >> >>>>> On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan <[EMAIL PROTECTED]> >> >>>>> wrote: >> >>>>>> >> >>>>>> Ok sorry but that was my Mistake .I thought it works but no. >> >>>>>> I wrote the command without ; and then I think It works but with ; >> >>>>>> at >> >>>>>> the end of command >> >>>>>> >> >>>>>> CREATE TABLE pokes (foo INT, bar STRING); >> >>>>>> >> >>>>>> does'nt work >> >>>>>> >> >>>>>> >> >>>>>> On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv >> >>>>>> <[EMAIL PROTECTED]> wrote: >> >>>>>>> >> >>>>>>> inside configuration. all properties will be inside the >> >>>>>>> configuration >> >>>>>>> tags >> >>>>>>>
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 17:52
*were you able to format hdfs properly???*
I did'nt get your question,Do you mean HADOOP_HOME? or where did I install Hadoop? On Wed, Jun 6, 2012 at 7:49 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > if you are getting only this, it means your hadoop is not > running..were you able to format hdfs properly??? > > Regards, > Mohammad Tariq > > > On Wed, Jun 6, 2012 at 11:17 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > > Hi MohammadmI irun jps in my shel I can see this result: > > 2213 Jps > > > > > > On Wed, Jun 6, 2012 at 7:44 PM, Mohammad Tariq <[EMAIL PROTECTED]> > wrote: > >> > >> you can also use "jps" command at your shell to see whether Hadoop > >> processes are running or not. > >> > >> Regards, > >> Mohammad Tariq > >> > >> > >> On Wed, Jun 6, 2012 at 11:12 PM, Mohammad Tariq <[EMAIL PROTECTED]> > >> wrote: > >> > Hi Babak, > >> > > >> > You have to type it in you web browser..Hadoop provides us a web GUI > >> > that not only allows us to browse through the file system, but to > >> > download the files as well..Apart from that it also provides a web GUI > >> > that can be used to see the status of Jobtracker and Tasktracker..When > >> > you run a Hive or Pig job or a Mapreduce job, you can point your > >> > browser to http://localhost:50030 to see the status and logs of your > >> > job. > >> > > >> > Regards, > >> > Mohammad Tariq > >> > > >> > > >> > On Wed, Jun 6, 2012 at 8:28 PM, Babak Bastan <[EMAIL PROTECTED]> > wrote: > >> >> Thank you shashwat for the answer, > >> >> where should I type http://localhost:50070? > >> >> I typed here: hive>http://localhost:50070 but nothing as result > >> >> > >> >> > >> >> On Wed, Jun 6, 2012 at 3:32 PM, shashwat shriparv > >> >> <[EMAIL PROTECTED]> wrote: > >> >>> > >> >>> first type http://localhost:50070 whether this is opening or not > and > >> >>> check > >> >>> how many nodes are available, check some of the hadoop shell > commands > >> >>> from http://hadoop.apache.org/common/docs/r0.18.3/hdfs_shell.html > run > >> >>> example mapreduce task on hadoop take example from here > >> >>> > >> >>> : > http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/ > >> >>> > >> >>> if all the above you can do sucessfully means hadoop is configured > >> >>> correctly > >> >>> > >> >>> Regards > >> >>> Shashwat > >> >>> > >> >>> > >> >>> On Wed, Jun 6, 2012 at 1:30 AM, Babak Bastan <[EMAIL PROTECTED]> > >> >>> wrote: > >> >>>> > >> >>>> no I'm not working on CDH.Is there a way to test if my Hadoop works > >> >>>> fine > >> >>>> or not? > >> >>>> > >> >>>> > >> >>>> On Tue, Jun 5, 2012 at 9:55 PM, Bejoy KS <[EMAIL PROTECTED]> > wrote: > >> >>>>> > >> >>>>> Hi Babak > >> >>>>> > >> >>>>> You gotta follow those instructions in the apace site to set up > >> >>>>> hadoop > >> >>>>> from scratch and ensure that hdfs is working first. You should be > >> >>>>> able to > >> >>>>> read and write files to hdfs before you do your next steps. > >> >>>>> > >> >>>>> Are you on CDH or apache distribution of hadoop? If it is CDH > there > >> >>>>> are > >> >>>>> detailed instructions on Cloudera web site. > >> >>>>> > >> >>>>> Regards > >> >>>>> Bejoy KS > >> >>>>> > >> >>>>> Sent from handheld, please excuse typos. > >> >>>>> ________________________________ > >> >>>>> From: Babak Bastan <[EMAIL PROTECTED]> > >> >>>>> Date: Tue, 5 Jun 2012 21:30:22 +0200 > >> >>>>> To: <[EMAIL PROTECTED]> > >> >>>>> ReplyTo: [EMAIL PROTECTED] > >> >>>>> Subject: Re: Error while Creating Table in Hive > >> >>>>> > >> >>>>> @Bejoy: I set the fs.default.name in the core-site.xml and I did > all > >> >>>>> of > >> >>>>> thing that was mentioned in the reference but no effect > >> >>>>> > >> >>>>> On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan <[EMAIL PROTECTED]> > >> >>>>> wrote: > >> >>>>>> > >> >>>>>> Ok sorry but that was my Mistake .I thought it works but no. > >> >>>>>> I wrote the command without ; and then I think It works but with
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 17:59
once we are done with the configuration, we need to format the file
system..use this command to do that- bin/hadoop namenode -format after this, hadoop daemon processes should be started using following commands - bin/start-dfs.sh (it'll start NN & DN) bin/start-mapred.sh (it'll start JT & TT) after this use jps to check if everything is alright or point your browser to localhost:50070..if you further find any problem provide us with the error logs..:) Regards, Mohammad Tariq On Wed, Jun 6, 2012 at 11:22 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > were you able to format hdfs properly??? > I did'nt get your question,Do you mean HADOOP_HOME? or where did I install > Hadoop? > > On Wed, Jun 6, 2012 at 7:49 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: >> >> if you are getting only this, it means your hadoop is not >> running..were you able to format hdfs properly??? >> >> Regards, >> Mohammad Tariq >> >> >> On Wed, Jun 6, 2012 at 11:17 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> > Hi MohammadmI irun jps in my shel I can see this result: >> > 2213 Jps >> > >> > >> > On Wed, Jun 6, 2012 at 7:44 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> > wrote: >> >> >> >> you can also use "jps" command at your shell to see whether Hadoop >> >> processes are running or not. >> >> >> >> Regards, >> >> Mohammad Tariq >> >> >> >> >> >> On Wed, Jun 6, 2012 at 11:12 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> >> wrote: >> >> > Hi Babak, >> >> > >> >> > You have to type it in you web browser..Hadoop provides us a web GUI >> >> > that not only allows us to browse through the file system, but to >> >> > download the files as well..Apart from that it also provides a web >> >> > GUI >> >> > that can be used to see the status of Jobtracker and >> >> > Tasktracker..When >> >> > you run a Hive or Pig job or a Mapreduce job, you can point your >> >> > browser to http://localhost:50030 to see the status and logs of your >> >> > job. >> >> > >> >> > Regards, >> >> > Mohammad Tariq >> >> > >> >> > >> >> > On Wed, Jun 6, 2012 at 8:28 PM, Babak Bastan <[EMAIL PROTECTED]> >> >> > wrote: >> >> >> Thank you shashwat for the answer, >> >> >> where should I type http://localhost:50070? >> >> >> I typed here: hive>http://localhost:50070 but nothing as result >> >> >> >> >> >> >> >> >> On Wed, Jun 6, 2012 at 3:32 PM, shashwat shriparv >> >> >> <[EMAIL PROTECTED]> wrote: >> >> >>> >> >> >>> first type http://localhost:50070 whether this is opening or not >> >> >>> and >> >> >>> check >> >> >>> how many nodes are available, check some of the hadoop shell >> >> >>> commands >> >> >>> from http://hadoop.apache.org/common/docs/r0.18.3/hdfs_shell.html >> >> >>> run >> >> >>> example mapreduce task on hadoop take example from here >> >> >>> >> >> >>> >> >> >>> : http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/ >> >> >>> >> >> >>> if all the above you can do sucessfully means hadoop is configured >> >> >>> correctly >> >> >>> >> >> >>> Regards >> >> >>> Shashwat >> >> >>> >> >> >>> >> >> >>> On Wed, Jun 6, 2012 at 1:30 AM, Babak Bastan <[EMAIL PROTECTED]> >> >> >>> wrote: >> >> >>>> >> >> >>>> no I'm not working on CDH.Is there a way to test if my Hadoop >> >> >>>> works >> >> >>>> fine >> >> >>>> or not? >> >> >>>> >> >> >>>> >> >> >>>> On Tue, Jun 5, 2012 at 9:55 PM, Bejoy KS <[EMAIL PROTECTED]> >> >> >>>> wrote: >> >> >>>>> >> >> >>>>> Hi Babak >> >> >>>>> >> >> >>>>> You gotta follow those instructions in the apace site to set up >> >> >>>>> hadoop >> >> >>>>> from scratch and ensure that hdfs is working first. You should be >> >> >>>>> able to >> >> >>>>> read and write files to hdfs before you do your next steps. >> >> >>>>> >> >> >>>>> Are you on CDH or apache distribution of hadoop? If it is CDH >> >> >>>>> there >> >> >>>>> are >> >> >>>>> detailed instructions on Cloudera web site. >> >> >>>>> >> >> >>>>> Regards >> >> >>>>> Bejoy KS >> >> >>>>>
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 18:12
thank's Mohammad
with this command: babak@ubuntu:~/Downloads/hadoop/bin$ hadoop namenode -format this is my output: 12/06/06 20:05:20 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = ubuntu/127.0.1.1 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 0.20.2 STARTUP_MSG: build https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 ************************************************************/ 12/06/06 20:05:20 INFO namenode.FSNamesystem: fsOwner=babak,babak,adm,dialout,cdrom,plugdev,lpadmin,admin,sambashare 12/06/06 20:05:20 INFO namenode.FSNamesystem: supergroup=supergroup 12/06/06 20:05:20 INFO namenode.FSNamesystem: isPermissionEnabled=true 12/06/06 20:05:20 INFO common.Storage: Image file of size 95 saved in 0 seconds. 12/06/06 20:05:20 INFO common.Storage: Storage directory /tmp/hadoop-babak/dfs/name has been successfully formatted. 12/06/06 20:05:20 INFO namenode.NameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down NameNode at ubuntu/127.0.1.1 ************************************************************/ by this command: babak@ubuntu:~/Downloads/hadoop/bin$ start-dfs.sh this is the out put mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung this out put(it's in german and it means no right to make this folder) On Wed, Jun 6, 2012 at 7:59 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > once we are done with the configuration, we need to format the file > system..use this command to do that- > bin/hadoop namenode -format > > after this, hadoop daemon processes should be started using following > commands - > bin/start-dfs.sh (it'll start NN & DN) > bin/start-mapred.sh (it'll start JT & TT) > > after this use jps to check if everything is alright or point your > browser to localhost:50070..if you further find any problem provide us > with the error logs..:) > > Regards, > Mohammad Tariq > > > On Wed, Jun 6, 2012 at 11:22 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > > were you able to format hdfs properly??? > > I did'nt get your question,Do you mean HADOOP_HOME? or where did I > install > > Hadoop? > > > > On Wed, Jun 6, 2012 at 7:49 PM, Mohammad Tariq <[EMAIL PROTECTED]> > wrote: > >> > >> if you are getting only this, it means your hadoop is not > >> running..were you able to format hdfs properly??? > >> > >> Regards, > >> Mohammad Tariq > >> > >> > >> On Wed, Jun 6, 2012 at 11:17 PM, Babak Bastan <[EMAIL PROTECTED]> > wrote: > >> > Hi MohammadmI irun jps in my shel I can see this result: > >> > 2213 Jps > >> > > >> > > >> > On Wed, Jun 6, 2012 at 7:44 PM, Mohammad Tariq <[EMAIL PROTECTED]> > >> > wrote: > >> >> > >> >> you can also use "jps" command at your shell to see whether Hadoop > >> >> processes are running or not. > >> >> > >> >> Regards, > >> >> Mohammad Tariq > >> >> > >> >> > >> >> On Wed, Jun 6, 2012 at 11:12 PM, Mohammad Tariq <[EMAIL PROTECTED]> > >> >> wrote: > >> >> > Hi Babak, > >> >> > > >> >> > You have to type it in you web browser..Hadoop provides us a web > GUI > >> >> > that not only allows us to browse through the file system, but to > >> >> > download the files as well..Apart from that it also provides a web > >> >> > GUI > >> >> > that can be used to see the status of Jobtracker and > >> >> > Tasktracker..When > >> >> > you run a Hive or Pig job or a Mapreduce job, you can point your > >> >> > browser to http://localhost:50030 to see the status and logs of > your > >> >> > job. > >> >> > > >> >> > Regards, > >> >> > Mohammad Tariq > >> >> > > >> >> > > >> >> > On Wed, Jun 6, 2012 at 8:28 PM, Babak Bastan <[EMAIL PROTECTED]> > >> >> > wrote: > >> >> >> Thank you shashwat for the answer, > >> >> >> where should I type http://localhost:50070? > >> >> >> I typed here: hive
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 18:24
create a directory "/home/username/hdfs" (or at some place of your
choice)..inside this hdfs directory create three sub directories - name, data, and temp, then follow these steps : add following properties in your core-site.xml - <property> <name>fs.default.name</name> <value>hdfs://localhost:9000/</value> </property> <property> <name>hadoop.tmp.dir</name> <value>/home/mohammad/hdfs/temp</value> </property> then add following two properties in your hdfs-site.xml - <property> <name>dfs.replication</name> <value>1</value> </property> <property> <name>dfs.name.dir</name> <value>/home/mohammad/hdfs/name</value> </property> <property> <name>dfs.data.dir</name> <value>/home/mohammad/hdfs/data</value> </property> finally add this property in your mapred-site.xml - <property> <name>mapred.job.tracker</name> <value>hdfs://localhost:9001</value> </property> NOTE: you can give any name to these directories of your choice, just keep in mind you have to give same names as values of above specified properties in your configuration files. (give full path of these directories, not just the name of the directory) After this follow the steps provided in the previous reply. Regards, Mohammad Tariq On Wed, Jun 6, 2012 at 11:42 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > thank's Mohammad > > with this command: > > babak@ubuntu:~/Downloads/hadoop/bin$ hadoop namenode -format > > this is my output: > > 12/06/06 20:05:20 INFO namenode.NameNode: STARTUP_MSG: > /************************************************************ > STARTUP_MSG: Starting NameNode > STARTUP_MSG: host = ubuntu/127.0.1.1 > STARTUP_MSG: args = [-format] > STARTUP_MSG: version = 0.20.2 > STARTUP_MSG: build > https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r > 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 > ************************************************************/ > 12/06/06 20:05:20 INFO namenode.FSNamesystem: > fsOwner=babak,babak,adm,dialout,cdrom,plugdev,lpadmin,admin,sambashare > 12/06/06 20:05:20 INFO namenode.FSNamesystem: supergroup=supergroup > 12/06/06 20:05:20 INFO namenode.FSNamesystem: isPermissionEnabled=true > 12/06/06 20:05:20 INFO common.Storage: Image file of size 95 saved in 0 > seconds. > 12/06/06 20:05:20 INFO common.Storage: Storage directory > /tmp/hadoop-babak/dfs/name has been successfully formatted. > 12/06/06 20:05:20 INFO namenode.NameNode: SHUTDOWN_MSG: > /************************************************************ > SHUTDOWN_MSG: Shutting down NameNode at ubuntu/127.0.1.1 > ************************************************************/ > > by this command: > > babak@ubuntu:~/Downloads/hadoop/bin$ start-dfs.sh > > this is the out put > > mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ nicht > anlegen: Keine Berechtigung > > this out put(it's in german and it means no right to make this folder) > > > On Wed, Jun 6, 2012 at 7:59 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: >> >> once we are done with the configuration, we need to format the file >> system..use this command to do that- >> bin/hadoop namenode -format >> >> after this, hadoop daemon processes should be started using following >> commands - >> bin/start-dfs.sh (it'll start NN & DN) >> bin/start-mapred.sh (it'll start JT & TT) >> >> after this use jps to check if everything is alright or point your >> browser to localhost:50070..if you further find any problem provide us >> with the error logs..:) >> >> Regards, >> Mohammad Tariq >> >> >> On Wed, Jun 6, 2012 at 11:22 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> > were you able to format hdfs properly??? >> > I did'nt get your question,Do you mean HADOOP_HOME? or where did I >> > install >> > Hadoop? >> > >> > On Wed, Jun 6, 2012 at 7:49 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> > wrote: >> >> >> >> if you are getting only this, it means your hadoop is not >> >> running..were you able to format hdfs properly???
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 18:25
also change the permissions of these directories to 777.
Regards, Mohammad Tariq On Wed, Jun 6, 2012 at 11:54 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > create a directory "/home/username/hdfs" (or at some place of your > choice)..inside this hdfs directory create three sub directories - > name, data, and temp, then follow these steps : > > add following properties in your core-site.xml - > > <property> > <name>fs.default.name</name> > <value>hdfs://localhost:9000/</value> > </property> > > <property> > <name>hadoop.tmp.dir</name> > <value>/home/mohammad/hdfs/temp</value> > </property> > > then add following two properties in your hdfs-site.xml - > > <property> > <name>dfs.replication</name> > <value>1</value> > </property> > > <property> > <name>dfs.name.dir</name> > <value>/home/mohammad/hdfs/name</value> > </property> > > <property> > <name>dfs.data.dir</name> > <value>/home/mohammad/hdfs/data</value> > </property> > > finally add this property in your mapred-site.xml - > > <property> > <name>mapred.job.tracker</name> > <value>hdfs://localhost:9001</value> > </property> > > NOTE: you can give any name to these directories of your choice, just > keep in mind you have to give same names as values of > above specified properties in your configuration files. > (give full path of these directories, not just the name of the > directory) > > After this follow the steps provided in the previous reply. > > Regards, > Mohammad Tariq > > > On Wed, Jun 6, 2012 at 11:42 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> thank's Mohammad >> >> with this command: >> >> babak@ubuntu:~/Downloads/hadoop/bin$ hadoop namenode -format >> >> this is my output: >> >> 12/06/06 20:05:20 INFO namenode.NameNode: STARTUP_MSG: >> /************************************************************ >> STARTUP_MSG: Starting NameNode >> STARTUP_MSG: host = ubuntu/127.0.1.1 >> STARTUP_MSG: args = [-format] >> STARTUP_MSG: version = 0.20.2 >> STARTUP_MSG: build >> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r >> 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 >> ************************************************************/ >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: >> fsOwner=babak,babak,adm,dialout,cdrom,plugdev,lpadmin,admin,sambashare >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: supergroup=supergroup >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: isPermissionEnabled=true >> 12/06/06 20:05:20 INFO common.Storage: Image file of size 95 saved in 0 >> seconds. >> 12/06/06 20:05:20 INFO common.Storage: Storage directory >> /tmp/hadoop-babak/dfs/name has been successfully formatted. >> 12/06/06 20:05:20 INFO namenode.NameNode: SHUTDOWN_MSG: >> /************************************************************ >> SHUTDOWN_MSG: Shutting down NameNode at ubuntu/127.0.1.1 >> ************************************************************/ >> >> by this command: >> >> babak@ubuntu:~/Downloads/hadoop/bin$ start-dfs.sh >> >> this is the out put >> >> mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ nicht >> anlegen: Keine Berechtigung >> >> this out put(it's in german and it means no right to make this folder) >> >> >> On Wed, Jun 6, 2012 at 7:59 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: >>> >>> once we are done with the configuration, we need to format the file >>> system..use this command to do that- >>> bin/hadoop namenode -format >>> >>> after this, hadoop daemon processes should be started using following >>> commands - >>> bin/start-dfs.sh (it'll start NN & DN) >>> bin/start-mapred.sh (it'll start JT & TT) >>> >>> after this use jps to check if everything is alright or point your >>> browser to localhost:50070..if you further find any problem provide us >>> with the error logs..:)
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 19:32
Thank you very much mohamad for your attention.I followed the steps but the
error is the same as the last time. and there is my hosts file: 127.0.0.1 localhost #127.0.0.1 ubuntu.ubuntu-domain ubuntu # The following lines are desirable for IPv6 capable hosts #::1 ip6-localhost ip6-loopback #fe00::0 ip6-localnet #ff00::0 ip6-mcastprefix #ff02::1 ip6-allnodes #ff02::2 ip6-allrouters but no effect :( On Wed, Jun 6, 2012 at 8:25 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > also change the permissions of these directories to 777. > > Regards, > Mohammad Tariq > > > On Wed, Jun 6, 2012 at 11:54 PM, Mohammad Tariq <[EMAIL PROTECTED]> > wrote: > > create a directory "/home/username/hdfs" (or at some place of your > > choice)..inside this hdfs directory create three sub directories - > > name, data, and temp, then follow these steps : > > > > add following properties in your core-site.xml - > > > > <property> > > <name>fs.default.name</name> > > <value>hdfs://localhost:9000/</value> > > </property> > > > > <property> > > <name>hadoop.tmp.dir</name> > > <value>/home/mohammad/hdfs/temp</value> > > </property> > > > > then add following two properties in your hdfs-site.xml - > > > > <property> > > <name>dfs.replication</name> > > <value>1</value> > > </property> > > > > <property> > > <name>dfs.name.dir</name> > > <value>/home/mohammad/hdfs/name</value> > > </property> > > > > <property> > > <name>dfs.data.dir</name> > > <value>/home/mohammad/hdfs/data</value> > > </property> > > > > finally add this property in your mapred-site.xml - > > > > <property> > > <name>mapred.job.tracker</name> > > <value>hdfs://localhost:9001</value> > > </property> > > > > NOTE: you can give any name to these directories of your choice, just > > keep in mind you have to give same names as values of > > above specified properties in your configuration files. > > (give full path of these directories, not just the name of the > > directory) > > > > After this follow the steps provided in the previous reply. > > > > Regards, > > Mohammad Tariq > > > > > > On Wed, Jun 6, 2012 at 11:42 PM, Babak Bastan <[EMAIL PROTECTED]> > wrote: > >> thank's Mohammad > >> > >> with this command: > >> > >> babak@ubuntu:~/Downloads/hadoop/bin$ hadoop namenode -format > >> > >> this is my output: > >> > >> 12/06/06 20:05:20 INFO namenode.NameNode: STARTUP_MSG: > >> /************************************************************ > >> STARTUP_MSG: Starting NameNode > >> STARTUP_MSG: host = ubuntu/127.0.1.1 > >> STARTUP_MSG: args = [-format] > >> STARTUP_MSG: version = 0.20.2 > >> STARTUP_MSG: build > >> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r > >> 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 > >> ************************************************************/ > >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: > >> fsOwner=babak,babak,adm,dialout,cdrom,plugdev,lpadmin,admin,sambashare > >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: supergroup=supergroup > >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: isPermissionEnabled=true > >> 12/06/06 20:05:20 INFO common.Storage: Image file of size 95 saved in 0 > >> seconds. > >> 12/06/06 20:05:20 INFO common.Storage: Storage directory > >> /tmp/hadoop-babak/dfs/name has been successfully formatted. > >> 12/06/06 20:05:20 INFO namenode.NameNode: SHUTDOWN_MSG: > >> /************************************************************ > >> SHUTDOWN_MSG: Shutting down NameNode at ubuntu/127.0.1.1 > >> ************************************************************/ > >> > >> by this command: > >> > >> babak@ubuntu:~/Downloads/hadoop/bin$ start-dfs.sh > >> > >> this is the out put > >> > >> mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ nicht
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 19:36
could you post your logs???that would help me in understanding the
problem properly. Regards, Mohammad Tariq On Thu, Jun 7, 2012 at 1:02 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > Thank you very much mohamad for your attention.I followed the steps but the > error is the same as the last time. > and there is my hosts file: > > 127.0.0.1 localhost > #127.0.0.1 ubuntu.ubuntu-domain ubuntu > > > # The following lines are desirable for IPv6 capable hosts > > #::1 ip6-localhost ip6-loopback > #fe00::0 ip6-localnet > #ff00::0 ip6-mcastprefix > #ff02::1 ip6-allnodes > #ff02::2 ip6-allrouters > > but no effect :( > > On Wed, Jun 6, 2012 at 8:25 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: >> >> also change the permissions of these directories to 777. >> >> Regards, >> Mohammad Tariq >> >> >> On Wed, Jun 6, 2012 at 11:54 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> wrote: >> > create a directory "/home/username/hdfs" (or at some place of your >> > choice)..inside this hdfs directory create three sub directories - >> > name, data, and temp, then follow these steps : >> > >> > add following properties in your core-site.xml - >> > >> > <property> >> > <name>fs.default.name</name> >> > <value>hdfs://localhost:9000/</value> >> > </property> >> > >> > <property> >> > <name>hadoop.tmp.dir</name> >> > <value>/home/mohammad/hdfs/temp</value> >> > </property> >> > >> > then add following two properties in your hdfs-site.xml - >> > >> > <property> >> > <name>dfs.replication</name> >> > <value>1</value> >> > </property> >> > >> > <property> >> > <name>dfs.name.dir</name> >> > <value>/home/mohammad/hdfs/name</value> >> > </property> >> > >> > <property> >> > <name>dfs.data.dir</name> >> > <value>/home/mohammad/hdfs/data</value> >> > </property> >> > >> > finally add this property in your mapred-site.xml - >> > >> > <property> >> > <name>mapred.job.tracker</name> >> > <value>hdfs://localhost:9001</value> >> > </property> >> > >> > NOTE: you can give any name to these directories of your choice, just >> > keep in mind you have to give same names as values of >> > above specified properties in your configuration files. >> > (give full path of these directories, not just the name of the >> > directory) >> > >> > After this follow the steps provided in the previous reply. >> > >> > Regards, >> > Mohammad Tariq >> > >> > >> > On Wed, Jun 6, 2012 at 11:42 PM, Babak Bastan <[EMAIL PROTECTED]> >> > wrote: >> >> thank's Mohammad >> >> >> >> with this command: >> >> >> >> babak@ubuntu:~/Downloads/hadoop/bin$ hadoop namenode -format >> >> >> >> this is my output: >> >> >> >> 12/06/06 20:05:20 INFO namenode.NameNode: STARTUP_MSG: >> >> /************************************************************ >> >> STARTUP_MSG: Starting NameNode >> >> STARTUP_MSG: host = ubuntu/127.0.1.1 >> >> STARTUP_MSG: args = [-format] >> >> STARTUP_MSG: version = 0.20.2 >> >> STARTUP_MSG: build >> >> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r >> >> 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 >> >> ************************************************************/ >> >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: >> >> fsOwner=babak,babak,adm,dialout,cdrom,plugdev,lpadmin,admin,sambashare >> >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: supergroup=supergroup >> >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: isPermissionEnabled=true >> >> 12/06/06 20:05:20 INFO common.Storage: Image file of size 95 saved in 0 >> >> seconds. >> >> 12/06/06 20:05:20 INFO common.Storage: Storage directory >> >> /tmp/hadoop-babak/dfs/name has been successfully formatted. >> >> 12/06/06 20:05:20 INFO namenode.NameNode: SHUTDOWN_MSG: >> >> /************************************************************
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 19:39
hoe can I get my log mohammad?
On Wed, Jun 6, 2012 at 9:36 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > could you post your logs???that would help me in understanding the > problem properly. > > Regards, > Mohammad Tariq > > > On Thu, Jun 7, 2012 at 1:02 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > > Thank you very much mohamad for your attention.I followed the steps but > the > > error is the same as the last time. > > and there is my hosts file: > > > > 127.0.0.1 localhost > > #127.0.0.1 ubuntu.ubuntu-domain ubuntu > > > > > > # The following lines are desirable for IPv6 capable hosts > > > > #::1 ip6-localhost ip6-loopback > > #fe00::0 ip6-localnet > > #ff00::0 ip6-mcastprefix > > #ff02::1 ip6-allnodes > > #ff02::2 ip6-allrouters > > > > but no effect :( > > > > On Wed, Jun 6, 2012 at 8:25 PM, Mohammad Tariq <[EMAIL PROTECTED]> > wrote: > >> > >> also change the permissions of these directories to 777. > >> > >> Regards, > >> Mohammad Tariq > >> > >> > >> On Wed, Jun 6, 2012 at 11:54 PM, Mohammad Tariq <[EMAIL PROTECTED]> > >> wrote: > >> > create a directory "/home/username/hdfs" (or at some place of your > >> > choice)..inside this hdfs directory create three sub directories - > >> > name, data, and temp, then follow these steps : > >> > > >> > add following properties in your core-site.xml - > >> > > >> > <property> > >> > <name>fs.default.name</name> > >> > <value>hdfs://localhost:9000/</value> > >> > </property> > >> > > >> > <property> > >> > <name>hadoop.tmp.dir</name> > >> > <value>/home/mohammad/hdfs/temp</value> > >> > </property> > >> > > >> > then add following two properties in your hdfs-site.xml - > >> > > >> > <property> > >> > <name>dfs.replication</name> > >> > <value>1</value> > >> > </property> > >> > > >> > <property> > >> > <name>dfs.name.dir</name> > >> > <value>/home/mohammad/hdfs/name</value> > >> > </property> > >> > > >> > <property> > >> > <name>dfs.data.dir</name> > >> > <value>/home/mohammad/hdfs/data</value> > >> > </property> > >> > > >> > finally add this property in your mapred-site.xml - > >> > > >> > <property> > >> > <name>mapred.job.tracker</name> > >> > <value>hdfs://localhost:9001</value> > >> > </property> > >> > > >> > NOTE: you can give any name to these directories of your choice, just > >> > keep in mind you have to give same names as values of > >> > above specified properties in your configuration files. > >> > (give full path of these directories, not just the name of the > >> > directory) > >> > > >> > After this follow the steps provided in the previous reply. > >> > > >> > Regards, > >> > Mohammad Tariq > >> > > >> > > >> > On Wed, Jun 6, 2012 at 11:42 PM, Babak Bastan <[EMAIL PROTECTED]> > >> > wrote: > >> >> thank's Mohammad > >> >> > >> >> with this command: > >> >> > >> >> babak@ubuntu:~/Downloads/hadoop/bin$ hadoop namenode -format > >> >> > >> >> this is my output: > >> >> > >> >> 12/06/06 20:05:20 INFO namenode.NameNode: STARTUP_MSG: > >> >> /************************************************************ > >> >> STARTUP_MSG: Starting NameNode > >> >> STARTUP_MSG: host = ubuntu/127.0.1.1 > >> >> STARTUP_MSG: args = [-format] > >> >> STARTUP_MSG: version = 0.20.2 > >> >> STARTUP_MSG: build > >> >> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-r > >> >> 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 > >> >> ************************************************************/ > >> >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: > >> >> > fsOwner=babak,babak,adm,dialout,cdrom,plugdev,lpadmin,admin,sambashare > >> >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: supergroup=supergroup > >> >> 12/06/06 20:05:20 INFO namenode.FSNamesystem: > isPermissionEnabled=true > >> >> 12/06/06 20:05:20 INFO common.Storage: Image file of size 95 saved
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 19:41
go to your HADOOP_HOME i.e your hadoop directory(that includes bin,
conf etc)..you can find logs directory there.. Regards, Mohammad Tariq On Thu, Jun 7, 2012 at 1:09 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > hoe can I get my log mohammad? > > > On Wed, Jun 6, 2012 at 9:36 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: >> >> could you post your logs???that would help me in understanding the >> problem properly. >> >> Regards, >> Mohammad Tariq >> >> >> On Thu, Jun 7, 2012 at 1:02 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> > Thank you very much mohamad for your attention.I followed the steps but >> > the >> > error is the same as the last time. >> > and there is my hosts file: >> > >> > 127.0.0.1 localhost >> > #127.0.0.1 ubuntu.ubuntu-domain ubuntu >> > >> > >> > # The following lines are desirable for IPv6 capable hosts >> > >> > #::1 ip6-localhost ip6-loopback >> > #fe00::0 ip6-localnet >> > #ff00::0 ip6-mcastprefix >> > #ff02::1 ip6-allnodes >> > #ff02::2 ip6-allrouters >> > >> > but no effect :( >> > >> > On Wed, Jun 6, 2012 at 8:25 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> > wrote: >> >> >> >> also change the permissions of these directories to 777. >> >> >> >> Regards, >> >> Mohammad Tariq >> >> >> >> >> >> On Wed, Jun 6, 2012 at 11:54 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> >> wrote: >> >> > create a directory "/home/username/hdfs" (or at some place of your >> >> > choice)..inside this hdfs directory create three sub directories - >> >> > name, data, and temp, then follow these steps : >> >> > >> >> > add following properties in your core-site.xml - >> >> > >> >> > <property> >> >> > <name>fs.default.name</name> >> >> > <value>hdfs://localhost:9000/</value> >> >> > </property> >> >> > >> >> > <property> >> >> > <name>hadoop.tmp.dir</name> >> >> > <value>/home/mohammad/hdfs/temp</value> >> >> > </property> >> >> > >> >> > then add following two properties in your hdfs-site.xml - >> >> > >> >> > <property> >> >> > <name>dfs.replication</name> >> >> > <value>1</value> >> >> > </property> >> >> > >> >> > <property> >> >> > <name>dfs.name.dir</name> >> >> > <value>/home/mohammad/hdfs/name</value> >> >> > </property> >> >> > >> >> > <property> >> >> > <name>dfs.data.dir</name> >> >> > <value>/home/mohammad/hdfs/data</value> >> >> > </property> >> >> > >> >> > finally add this property in your mapred-site.xml - >> >> > >> >> > <property> >> >> > <name>mapred.job.tracker</name> >> >> > <value>hdfs://localhost:9001</value> >> >> > </property> >> >> > >> >> > NOTE: you can give any name to these directories of your choice, just >> >> > keep in mind you have to give same names as values of >> >> > above specified properties in your configuration files. >> >> > (give full path of these directories, not just the name of the >> >> > directory) >> >> > >> >> > After this follow the steps provided in the previous reply. >> >> > >> >> > Regards, >> >> > Mohammad Tariq >> >> > >> >> > >> >> > On Wed, Jun 6, 2012 at 11:42 PM, Babak Bastan <[EMAIL PROTECTED]> >> >> > wrote: >> >> >> thank's Mohammad >> >> >> >> >> >> with this command: >> >> >> >> >> >> babak@ubuntu:~/Downloads/hadoop/bin$ hadoop namenode -format >> >> >> >> >> >> this is my output: >> >> >> >> >> >> 12/06/06 20:05:20 INFO namenode.NameNode: STARTUP_MSG: >> >> >> /************************************************************ >> >> >> STARTUP_MSG: Starting NameNode >> >> >> STARTUP_MSG: host = ubuntu/127.0.1.1 >> >> >> STARTUP_MSG: args = [-format] >> >> >> STARTUP_MSG: version = 0.20.2 >> >> >> STARTUP_MSG: build >> >> >> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 >> >> >> -r >> >> >> 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 >> >> >> ************************************************************/
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 19:55
What the hell is that?I see no log folder there
On Wed, Jun 6, 2012 at 9:41 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > go to your HADOOP_HOME i.e your hadoop directory(that includes bin, > conf etc)..you can find logs directory there.. > > Regards, > Mohammad Tariq > > > On Thu, Jun 7, 2012 at 1:09 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > > hoe can I get my log mohammad? > > > > > > On Wed, Jun 6, 2012 at 9:36 PM, Mohammad Tariq <[EMAIL PROTECTED]> > wrote: > >> > >> could you post your logs???that would help me in understanding the > >> problem properly. > >> > >> Regards, > >> Mohammad Tariq > >> > >> > >> On Thu, Jun 7, 2012 at 1:02 AM, Babak Bastan <[EMAIL PROTECTED]> > wrote: > >> > Thank you very much mohamad for your attention.I followed the steps > but > >> > the > >> > error is the same as the last time. > >> > and there is my hosts file: > >> > > >> > 127.0.0.1 localhost > >> > #127.0.0.1 ubuntu.ubuntu-domain ubuntu > >> > > >> > > >> > # The following lines are desirable for IPv6 capable hosts > >> > > >> > #::1 ip6-localhost ip6-loopback > >> > #fe00::0 ip6-localnet > >> > #ff00::0 ip6-mcastprefix > >> > #ff02::1 ip6-allnodes > >> > #ff02::2 ip6-allrouters > >> > > >> > but no effect :( > >> > > >> > On Wed, Jun 6, 2012 at 8:25 PM, Mohammad Tariq <[EMAIL PROTECTED]> > >> > wrote: > >> >> > >> >> also change the permissions of these directories to 777. > >> >> > >> >> Regards, > >> >> Mohammad Tariq > >> >> > >> >> > >> >> On Wed, Jun 6, 2012 at 11:54 PM, Mohammad Tariq <[EMAIL PROTECTED]> > >> >> wrote: > >> >> > create a directory "/home/username/hdfs" (or at some place of your > >> >> > choice)..inside this hdfs directory create three sub directories - > >> >> > name, data, and temp, then follow these steps : > >> >> > > >> >> > add following properties in your core-site.xml - > >> >> > > >> >> > <property> > >> >> > <name>fs.default.name</name> > >> >> > <value>hdfs://localhost:9000/</value> > >> >> > </property> > >> >> > > >> >> > <property> > >> >> > <name>hadoop.tmp.dir</name> > >> >> > <value>/home/mohammad/hdfs/temp</value> > >> >> > </property> > >> >> > > >> >> > then add following two properties in your hdfs-site.xml - > >> >> > > >> >> > <property> > >> >> > <name>dfs.replication</name> > >> >> > <value>1</value> > >> >> > </property> > >> >> > > >> >> > <property> > >> >> > <name>dfs.name.dir</name> > >> >> > <value>/home/mohammad/hdfs/name</value> > >> >> > </property> > >> >> > > >> >> > <property> > >> >> > <name>dfs.data.dir</name> > >> >> > <value>/home/mohammad/hdfs/data</value> > >> >> > </property> > >> >> > > >> >> > finally add this property in your mapred-site.xml - > >> >> > > >> >> > <property> > >> >> > <name>mapred.job.tracker</name> > >> >> > <value>hdfs://localhost:9001</value> > >> >> > </property> > >> >> > > >> >> > NOTE: you can give any name to these directories of your choice, > just > >> >> > keep in mind you have to give same names as values of > >> >> > above specified properties in your configuration files. > >> >> > (give full path of these directories, not just the name of the > >> >> > directory) > >> >> > > >> >> > After this follow the steps provided in the previous reply. > >> >> > > >> >> > Regards, > >> >> > Mohammad Tariq > >> >> > > >> >> > > >> >> > On Wed, Jun 6, 2012 at 11:42 PM, Babak Bastan <[EMAIL PROTECTED]> > >> >> > wrote: > >> >> >> thank's Mohammad > >> >> >> > >> >> >> with this command: > >> >> >> > >> >> >> babak@ubuntu:~/Downloads/hadoop/bin$ hadoop namenode -format > >> >> >> > >> >> >> this is my output: > >> >> >> > >> >> >> 12/06/06 20:05:20 INFO namenode.NameNode: STARTUP_MSG: > >> >> >> /************************************************************ > >> >> >> STARTUP_MSG: Starting NameNode
-
Re: Error while Creating Table in Hiveshashwat shriparv 2012-06-06, 20:02
whats the error babak ???
On Thu, Jun 7, 2012 at 1:25 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > What the hell is that?I see no log folder there > > > On Wed, Jun 6, 2012 at 9:41 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > >> go to your HADOOP_HOME i.e your hadoop directory(that includes bin, >> conf etc)..you can find logs directory there.. >> >> Regards, >> Mohammad Tariq >> >> >> On Thu, Jun 7, 2012 at 1:09 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> > hoe can I get my log mohammad? >> > >> > >> > On Wed, Jun 6, 2012 at 9:36 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> wrote: >> >> >> >> could you post your logs???that would help me in understanding the >> >> problem properly. >> >> >> >> Regards, >> >> Mohammad Tariq >> >> >> >> >> >> On Thu, Jun 7, 2012 at 1:02 AM, Babak Bastan <[EMAIL PROTECTED]> >> wrote: >> >> > Thank you very much mohamad for your attention.I followed the steps >> but >> >> > the >> >> > error is the same as the last time. >> >> > and there is my hosts file: >> >> > >> >> > 127.0.0.1 localhost >> >> > #127.0.0.1 ubuntu.ubuntu-domain ubuntu >> >> > >> >> > >> >> > # The following lines are desirable for IPv6 capable hosts >> >> > >> >> > #::1 ip6-localhost ip6-loopback >> >> > #fe00::0 ip6-localnet >> >> > #ff00::0 ip6-mcastprefix >> >> > #ff02::1 ip6-allnodes >> >> > #ff02::2 ip6-allrouters >> >> > >> >> > but no effect :( >> >> > >> >> > On Wed, Jun 6, 2012 at 8:25 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> >> > wrote: >> >> >> >> >> >> also change the permissions of these directories to 777. >> >> >> >> >> >> Regards, >> >> >> Mohammad Tariq >> >> >> >> >> >> >> >> >> On Wed, Jun 6, 2012 at 11:54 PM, Mohammad Tariq <[EMAIL PROTECTED] >> > >> >> >> wrote: >> >> >> > create a directory "/home/username/hdfs" (or at some place of your >> >> >> > choice)..inside this hdfs directory create three sub directories - >> >> >> > name, data, and temp, then follow these steps : >> >> >> > >> >> >> > add following properties in your core-site.xml - >> >> >> > >> >> >> > <property> >> >> >> > <name>fs.default.name</name> >> >> >> > <value>hdfs://localhost:9000/</value> >> >> >> > </property> >> >> >> > >> >> >> > <property> >> >> >> > <name>hadoop.tmp.dir</name> >> >> >> > <value>/home/mohammad/hdfs/temp</value> >> >> >> > </property> >> >> >> > >> >> >> > then add following two properties in your hdfs-site.xml - >> >> >> > >> >> >> > <property> >> >> >> > <name>dfs.replication</name> >> >> >> > <value>1</value> >> >> >> > </property> >> >> >> > >> >> >> > <property> >> >> >> > <name>dfs.name.dir</name> >> >> >> > <value>/home/mohammad/hdfs/name</value> >> >> >> > </property> >> >> >> > >> >> >> > <property> >> >> >> > <name>dfs.data.dir</name> >> >> >> > <value>/home/mohammad/hdfs/data</value> >> >> >> > </property> >> >> >> > >> >> >> > finally add this property in your mapred-site.xml - >> >> >> > >> >> >> > <property> >> >> >> > <name>mapred.job.tracker</name> >> >> >> > <value>hdfs://localhost:9001</value> >> >> >> > </property> >> >> >> > >> >> >> > NOTE: you can give any name to these directories of your choice, >> just >> >> >> > keep in mind you have to give same names as values of >> >> >> > above specified properties in your configuration files. >> >> >> > (give full path of these directories, not just the name of the >> >> >> > directory) >> >> >> > >> >> >> > After this follow the steps provided in the previous reply. >> >> >> > >> >> >> > Regards, >> >> >> > Mohammad Tariq >> >> >> > >> >> >> > >> >> >> > On Wed, Jun 6, 2012 at 11:42 PM, Babak Bastan <[EMAIL PROTECTED] >> > >> >> >> > wrote: >> >> >> >> thank's Mohammad >> >> >> >> >> >> >> >> with this command: >> >> >> >> >> >> >> >> babak@ubuntu:~/Downloads/hadoop/bin$ hadoop namenode -format ∞ Shashwat Shriparv
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 20:04
check your /var/log/hadoop/...also when you do something wrong your
will find your terminal full of many error messages, you can use them as well..and by the way learning something new requires great deal of patience Regards, Mohammad Tariq On Thu, Jun 7, 2012 at 1:25 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > What the hell is that?I see no log folder there > > > On Wed, Jun 6, 2012 at 9:41 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: >> >> go to your HADOOP_HOME i.e your hadoop directory(that includes bin, >> conf etc)..you can find logs directory there.. >> >> Regards, >> Mohammad Tariq >> >> >> On Thu, Jun 7, 2012 at 1:09 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> > hoe can I get my log mohammad? >> > >> > >> > On Wed, Jun 6, 2012 at 9:36 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> > wrote: >> >> >> >> could you post your logs???that would help me in understanding the >> >> problem properly. >> >> >> >> Regards, >> >> Mohammad Tariq >> >> >> >> >> >> On Thu, Jun 7, 2012 at 1:02 AM, Babak Bastan <[EMAIL PROTECTED]> >> >> wrote: >> >> > Thank you very much mohamad for your attention.I followed the steps >> >> > but >> >> > the >> >> > error is the same as the last time. >> >> > and there is my hosts file: >> >> > >> >> > 127.0.0.1 localhost >> >> > #127.0.0.1 ubuntu.ubuntu-domain ubuntu >> >> > >> >> > >> >> > # The following lines are desirable for IPv6 capable hosts >> >> > >> >> > #::1 ip6-localhost ip6-loopback >> >> > #fe00::0 ip6-localnet >> >> > #ff00::0 ip6-mcastprefix >> >> > #ff02::1 ip6-allnodes >> >> > #ff02::2 ip6-allrouters >> >> > >> >> > but no effect :( >> >> > >> >> > On Wed, Jun 6, 2012 at 8:25 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> >> > wrote: >> >> >> >> >> >> also change the permissions of these directories to 777. >> >> >> >> >> >> Regards, >> >> >> Mohammad Tariq >> >> >> >> >> >> >> >> >> On Wed, Jun 6, 2012 at 11:54 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> >> >> wrote: >> >> >> > create a directory "/home/username/hdfs" (or at some place of your >> >> >> > choice)..inside this hdfs directory create three sub directories - >> >> >> > name, data, and temp, then follow these steps : >> >> >> > >> >> >> > add following properties in your core-site.xml - >> >> >> > >> >> >> > <property> >> >> >> > <name>fs.default.name</name> >> >> >> > <value>hdfs://localhost:9000/</value> >> >> >> > </property> >> >> >> > >> >> >> > <property> >> >> >> > <name>hadoop.tmp.dir</name> >> >> >> > <value>/home/mohammad/hdfs/temp</value> >> >> >> > </property> >> >> >> > >> >> >> > then add following two properties in your hdfs-site.xml - >> >> >> > >> >> >> > <property> >> >> >> > <name>dfs.replication</name> >> >> >> > <value>1</value> >> >> >> > </property> >> >> >> > >> >> >> > <property> >> >> >> > <name>dfs.name.dir</name> >> >> >> > <value>/home/mohammad/hdfs/name</value> >> >> >> > </property> >> >> >> > >> >> >> > <property> >> >> >> > <name>dfs.data.dir</name> >> >> >> > <value>/home/mohammad/hdfs/data</value> >> >> >> > </property> >> >> >> > >> >> >> > finally add this property in your mapred-site.xml - >> >> >> > >> >> >> > <property> >> >> >> > <name>mapred.job.tracker</name> >> >> >> > <value>hdfs://localhost:9001</value> >> >> >> > </property> >> >> >> > >> >> >> > NOTE: you can give any name to these directories of your choice, >> >> >> > just >> >> >> > keep in mind you have to give same names as values of >> >> >> > above specified properties in your configuration files. >> >> >> > (give full path of these directories, not just the name of the >> >> >> > directory) >> >> >> > >> >> >> > After this follow the steps provided in the previous reply. >> >> >> > >> >> >> > Regards, >> >> >> > Mohammad Tariq >> >> >> > >> >> >> > >> >> >
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 20:12
no one error:
i.e if I run this one *hostname --fqdn* with the condition that I send to you : *127.0.0.1 localhost* *#127.0.0.1 ubuntu.ubuntu-domain ubuntu* *# The following lines are desirable for IPv6 capable hosts* *#::1 ip6-localhost ip6-loopback* *#fe00::0 ip6-localnet* *#ff00::0 ip6-mcastprefix* *#ff02::1 ip6-allnodes* *#ff02::2 ip6-allrouters* I get this error: *hostname: Name or service not known* Or in the second step by this command: *babak@ubuntu:~/Downloads/hadoop/bin$ start-hdfs.sh* these lines of error: mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung starting namenode, logging to /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out: Datei oder Verzeichnis nicht gefunden head: „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out“ kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden localhost: mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung localhost: starting datanode, logging to /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out: Datei oder Verzeichnis nicht gefunden localhost: head: „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out“ kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden localhost: mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung localhost: starting secondarynamenode, logging to /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out: Datei oder Verzeichnis nicht gefunden localhost: head: „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out“ kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden they said no permision to make logs in this path:/home/babak/Downloads/hadoop/bin/../logs and generally I cant create a table in hive and get this one: FAILED: Error in metadata: MetaException(message:Got exception: java.io.FileNotFoundException File file:/user/hive/warehouse/test does not exist.) FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask On Wed, Jun 6, 2012 at 10:02 PM, shashwat shriparv < [EMAIL PROTECTED]> wrote: > whats the error babak ??? > > > On Thu, Jun 7, 2012 at 1:25 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > >> What the hell is that?I see no log folder there >> >> >> On Wed, Jun 6, 2012 at 9:41 PM, Mohammad Tariq <[EMAIL PROTECTED]>wrote: >> >>> go to your HADOOP_HOME i.e your hadoop directory(that includes bin, >>> conf etc)..you can find logs directory there.. >>> >>> Regards, >>> Mohammad Tariq >>> >>> >>> On Thu, Jun 7, 2012 at 1:09 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: >>> > hoe can I get my log mohammad? >>> > >>> > >>> > On Wed, Jun 6, 2012 at 9:36 PM, Mohammad Tariq <[EMAIL PROTECTED]> >>> wrote: >>> >> >>> >> could you post your logs???that would help me in understanding the >>> >> problem properly. >>> >> >>> >> Regards, >>> >> Mohammad Tariq >>> >> >>> >> >>> >> On Thu, Jun 7, 2012 at 1:02 AM, Babak Bastan <[EMAIL PROTECTED]> >>> wrote: >>> >> > Thank you very much mohamad for your attention.I followed the steps >>> but >>> >> > the >>> >> > error is the same as the last time. >>> >> > and there is my hosts file: >>> >> > >>> >> > 127.0.0.1 localhost >>> >> > #127.0.0.1 ubuntu.ubuntu-domain ubuntu >>> >> > >>> >> > >>> >> > # The following lines are desirable for IPv6 capable hosts
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 20:15
I checked it but no hadoop folder :(
yes you are right.I'm a student and I want to make a very very simple programm hive but untill now hmmmmmmmmm On Wed, Jun 6, 2012 at 10:12 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > no one error: > i.e if I run this one > > *hostname --fqdn* > > with the condition that I send to you : > > *127.0.0.1 localhost* > *#127.0.0.1 ubuntu.ubuntu-domain ubuntu* > *# The following lines are desirable for IPv6 capable hosts* > *#::1 ip6-localhost ip6-loopback* > *#fe00::0 ip6-localnet* > *#ff00::0 ip6-mcastprefix* > *#ff02::1 ip6-allnodes* > *#ff02::2 ip6-allrouters* > > I get this error: > > *hostname: Name or service not known* > > Or in the second step by this command: > > *babak@ubuntu:~/Downloads/hadoop/bin$ start-hdfs.sh* > > these lines of error: > > > mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ nicht > anlegen: Keine Berechtigung > starting namenode, logging to > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out > /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out: > Datei oder Verzeichnis nicht gefunden > head: > „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out“ > kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden > localhost: mkdir: kann Verzeichnis > „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung > localhost: starting datanode, logging to > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out > localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out: > Datei oder Verzeichnis nicht gefunden > localhost: head: > „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out“ > kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden > localhost: mkdir: kann Verzeichnis > „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung > localhost: starting secondarynamenode, logging to > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out > localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out: > Datei oder Verzeichnis nicht gefunden > localhost: head: > „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out“ > kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden > > they said no permision to make logs in this > path:/home/babak/Downloads/hadoop/bin/../logs > > and generally I cant create a table in hive and get this one: > > FAILED: Error in metadata: MetaException(message:Got exception: java.io.FileNotFoundException File file:/user/hive/warehouse/test does not exist.) > FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask > > On Wed, Jun 6, 2012 at 10:02 PM, shashwat shriparv < > [EMAIL PROTECTED]> wrote: > >> whats the error babak ??? >> >> >> On Thu, Jun 7, 2012 at 1:25 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> >>> What the hell is that?I see no log folder there >>> >>> >>> On Wed, Jun 6, 2012 at 9:41 PM, Mohammad Tariq <[EMAIL PROTECTED]>wrote: >>> >>>> go to your HADOOP_HOME i.e your hadoop directory(that includes bin, >>>> conf etc)..you can find logs directory there.. >>>> >>>> Regards, >>>> Mohammad Tariq >>>> >>>> >>>> On Thu, Jun 7, 2012 at 1:09 AM, Babak Bastan <[EMAIL PROTECTED]> >>>> wrote: >>>> > hoe can I get my log mohammad? >>>> > >>>> > >>>> > On Wed, Jun 6, 2012 at 9:36 PM, Mohammad Tariq <[EMAIL PROTECTED]> >>>> wrote: >>>> >> >>>> >> could you post your logs???that would help me in understanding the >>>> >> problem properly. >>>> >> >>>> >> Regards, >>>> >> Mohammad Tariq >>>> >> >>>> >> >>>> >> On Thu, Jun 7, 2012 at 1:02 AM, Babak Bastan <[EMAIL PROTECTED]>
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 20:22
by the way,you are a very nice man my friend:Thank you so much :)
what do you mean aboat this post in stackoverflow? I am assuming that is your first installation of hadoop. At the beginning please check if your daemons are working. To do that use (in terminal): jps If only jps appears that means all daemons are down. Please check the log files. Especially the namenode. Log folder is probably somewhere there /usr/lib/hadoop/logs If you have some permission problems. Use this guide during the installation. Good installation guide<http://blog.timmattison.com/archives/2011/12/23/how-to-install-hadoop-on-debian-ubuntu/> I am shooting with this explanations but these are most common problems. On Wed, Jun 6, 2012 at 10:15 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > I checked it but no hadoop folder :( > yes you are right.I'm a student and I want to make a very very simple > programm hive but untill now hmmmmmmmmm > > > On Wed, Jun 6, 2012 at 10:12 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: > >> no one error: >> i.e if I run this one >> >> *hostname --fqdn* >> >> with the condition that I send to you : >> >> *127.0.0.1 localhost* >> *#127.0.0.1 ubuntu.ubuntu-domain ubuntu* >> *# The following lines are desirable for IPv6 capable hosts* >> *#::1 ip6-localhost ip6-loopback* >> *#fe00::0 ip6-localnet* >> *#ff00::0 ip6-mcastprefix* >> *#ff02::1 ip6-allnodes* >> *#ff02::2 ip6-allrouters* >> >> I get this error: >> >> *hostname: Name or service not known* >> >> Or in the second step by this command: >> >> *babak@ubuntu:~/Downloads/hadoop/bin$ start-hdfs.sh* >> >> these lines of error: >> >> >> mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ nicht >> anlegen: Keine Berechtigung >> starting namenode, logging to >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out >> /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out: >> Datei oder Verzeichnis nicht gefunden >> head: >> „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out“ >> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden >> localhost: mkdir: kann Verzeichnis >> „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung >> localhost: starting datanode, logging to >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out >> localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out: >> Datei oder Verzeichnis nicht gefunden >> localhost: head: >> „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out“ >> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden >> localhost: mkdir: kann Verzeichnis >> „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung >> localhost: starting secondarynamenode, logging to >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out >> localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out: >> Datei oder Verzeichnis nicht gefunden >> localhost: head: >> „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out“ >> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden >> >> they said no permision to make logs in this >> path:/home/babak/Downloads/hadoop/bin/../logs >> >> and generally I cant create a table in hive and get this one: >> >> FAILED: Error in metadata: MetaException(message:Got exception: java.io.FileNotFoundException File file:/user/hive/warehouse/test does not exist.) >> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask >> >> On Wed, Jun 6, 2012 at 10:02 PM, shashwat shriparv < >> [EMAIL PROTECTED]> wrote: >> >>> whats the error babak ???
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 20:26
need not worry.. i am also a student..just keep your calm..start fresh
and follow these steps - 1 - download hadoop from apache using this link - http://apache.techartifact.com/mirror/hadoop/common/hadoop-0.20.205.0/hadoop-0.20.205.0.tar.gz 2 - untar it - right click+extract here 3 - set JAVA_HOME in your hadoop-env.sh file and save it 4 - add the properties specified in previous replies in your core-site.xml, hdfs-site.xml and mapredif it doesn't work still i'll send you the configured hadoop-site.xml files 5 - format HDFS 6 - start the hadoop processes also your hosts file should look like this - 127.0.0.1 localhost 127.0.0.1 ubuntu.ubuntu-domain ubuntu # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters it'll work..if you further face any problem, i'll send you a configured copy of hadoop. Regards, Mohammad Tariq On Thu, Jun 7, 2012 at 1:45 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > I checked it but no hadoop folder :( > yes you are right.I'm a student and I want to make a very very simple > programm hive but untill now hmmmmmmmmm > > > On Wed, Jun 6, 2012 at 10:12 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> >> no one error: >> i.e if I run this one >> >> hostname --fqdn >> >> with the condition that I send to you : >> >> 127.0.0.1 localhost >> #127.0.0.1 ubuntu.ubuntu-domain ubuntu >> # The following lines are desirable for IPv6 capable hosts >> #::1 ip6-localhost ip6-loopback >> #fe00::0 ip6-localnet >> #ff00::0 ip6-mcastprefix >> #ff02::1 ip6-allnodes >> #ff02::2 ip6-allrouters >> >> I get this error: >> >> hostname: Name or service not known >> >> Or in the second step by this command: >> >> babak@ubuntu:~/Downloads/hadoop/bin$ start-hdfs.sh >> >> these lines of error: >> >> >> mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ nicht >> anlegen: Keine Berechtigung >> starting namenode, logging to >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out >> /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out: >> Datei oder Verzeichnis nicht gefunden >> head: >> „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out“ >> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden >> localhost: mkdir: kann Verzeichnis >> „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung >> localhost: starting datanode, logging to >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out >> localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out: >> Datei oder Verzeichnis nicht gefunden >> localhost: head: >> „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out“ >> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden >> localhost: mkdir: kann Verzeichnis >> „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung >> localhost: starting secondarynamenode, logging to >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out >> localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: >> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out: >> Datei oder Verzeichnis nicht gefunden >> localhost: head: >> „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out“ >> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden >> >> they said no permision to make logs in this >> path:/home/babak/Downloads/hadoop/bin/../logs >> >> and generally I cant create a table in hive and get this one: >> >> FAILED: Error in metadata: MetaException(message:Got exception: >> java.io.FileNotFoundException File file:/user/hive/warehouse/test does not
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 20:33
actually this blog post explains how to install cloudera's hadoop
distribution...if you have followed this post and installed cloudera's distribution then your logs should ideally be inside /usr/lib/hadoop/logs (if everything was fine)..anyway try the steps I have given and let me know. Regards, Mohammad Tariq On Thu, Jun 7, 2012 at 1:52 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > by the way,you are a very nice man my friend:Thank you so much :) > > what do you mean aboat this post in stackoverflow? > > I am assuming that is your first installation of hadoop. > > At the beginning please check if your daemons are working. To do that use > (in terminal): > > jps > > If only jps appears that means all daemons are down. Please check the log > files. Especially the namenode. Log folder is probably somewhere there > /usr/lib/hadoop/logs > > If you have some permission problems. Use this guide during the > installation. > > Good installation guide > > I am shooting with this explanations but these are most common problems. > > > On Wed, Jun 6, 2012 at 10:15 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> >> I checked it but no hadoop folder :( >> yes you are right.I'm a student and I want to make a very very simple >> programm hive but untill now hmmmmmmmmm >> >> >> On Wed, Jun 6, 2012 at 10:12 PM, Babak Bastan <[EMAIL PROTECTED]> wrote: >>> >>> no one error: >>> i.e if I run this one >>> >>> hostname --fqdn >>> >>> with the condition that I send to you : >>> >>> 127.0.0.1 localhost >>> #127.0.0.1 ubuntu.ubuntu-domain ubuntu >>> # The following lines are desirable for IPv6 capable hosts >>> #::1 ip6-localhost ip6-loopback >>> #fe00::0 ip6-localnet >>> #ff00::0 ip6-mcastprefix >>> #ff02::1 ip6-allnodes >>> #ff02::2 ip6-allrouters >>> >>> I get this error: >>> >>> hostname: Name or service not known >>> >>> Or in the second step by this command: >>> >>> babak@ubuntu:~/Downloads/hadoop/bin$ start-hdfs.sh >>> >>> these lines of error: >>> >>> >>> mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ nicht >>> anlegen: Keine Berechtigung >>> starting namenode, logging to >>> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out >>> /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: >>> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out: >>> Datei oder Verzeichnis nicht gefunden >>> head: >>> „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out“ >>> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden >>> localhost: mkdir: kann Verzeichnis >>> „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung >>> localhost: starting datanode, logging to >>> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out >>> localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: >>> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out: >>> Datei oder Verzeichnis nicht gefunden >>> localhost: head: >>> „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out“ >>> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden >>> localhost: mkdir: kann Verzeichnis >>> „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine Berechtigung >>> localhost: starting secondarynamenode, logging to >>> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out >>> localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: >>> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out: >>> Datei oder Verzeichnis nicht gefunden >>> localhost: head: >>> „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out“ >>> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht gefunden >>> >>> they said no permision to make logs in this >>> path:/home/babak/Downloads/hadoop/bin/../logs >>> >>> and generally I cant create a table in hive and get this one:
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 20:52
I 've performed the steps but the same error in this step as before:
bin/start-dfs.sh It is about my permission to make directory On Wed, Jun 6, 2012 at 10:33 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > actually this blog post explains how to install cloudera's hadoop > distribution...if you have followed this post and installed cloudera's > distribution then your logs should ideally be inside > /usr/lib/hadoop/logs (if everything was fine)..anyway try the steps I > have given and let me know. > > Regards, > Mohammad Tariq > > > On Thu, Jun 7, 2012 at 1:52 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > > by the way,you are a very nice man my friend:Thank you so much :) > > > > what do you mean aboat this post in stackoverflow? > > > > I am assuming that is your first installation of hadoop. > > > > At the beginning please check if your daemons are working. To do that use > > (in terminal): > > > > jps > > > > If only jps appears that means all daemons are down. Please check the log > > files. Especially the namenode. Log folder is probably somewhere there > > /usr/lib/hadoop/logs > > > > If you have some permission problems. Use this guide during the > > installation. > > > > Good installation guide > > > > I am shooting with this explanations but these are most common problems. > > > > > > On Wed, Jun 6, 2012 at 10:15 PM, Babak Bastan <[EMAIL PROTECTED]> > wrote: > >> > >> I checked it but no hadoop folder :( > >> yes you are right.I'm a student and I want to make a very very simple > >> programm hive but untill now hmmmmmmmmm > >> > >> > >> On Wed, Jun 6, 2012 at 10:12 PM, Babak Bastan <[EMAIL PROTECTED]> > wrote: > >>> > >>> no one error: > >>> i.e if I run this one > >>> > >>> hostname --fqdn > >>> > >>> with the condition that I send to you : > >>> > >>> 127.0.0.1 localhost > >>> #127.0.0.1 ubuntu.ubuntu-domain ubuntu > >>> # The following lines are desirable for IPv6 capable hosts > >>> #::1 ip6-localhost ip6-loopback > >>> #fe00::0 ip6-localnet > >>> #ff00::0 ip6-mcastprefix > >>> #ff02::1 ip6-allnodes > >>> #ff02::2 ip6-allrouters > >>> > >>> I get this error: > >>> > >>> hostname: Name or service not known > >>> > >>> Or in the second step by this command: > >>> > >>> babak@ubuntu:~/Downloads/hadoop/bin$ start-hdfs.sh > >>> > >>> these lines of error: > >>> > >>> > >>> mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ > nicht > >>> anlegen: Keine Berechtigung > >>> starting namenode, logging to > >>> > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out > >>> /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: > >>> > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out: > >>> Datei oder Verzeichnis nicht gefunden > >>> head: > >>> > „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out“ > >>> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht > gefunden > >>> localhost: mkdir: kann Verzeichnis > >>> „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine > Berechtigung > >>> localhost: starting datanode, logging to > >>> > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out > >>> localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile > 117: > >>> > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out: > >>> Datei oder Verzeichnis nicht gefunden > >>> localhost: head: > >>> > „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out“ > >>> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht > gefunden > >>> localhost: mkdir: kann Verzeichnis > >>> „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine > Berechtigung > >>> localhost: starting secondarynamenode, logging to > >>> > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out > >>> localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile > 117: > >>> > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-secondarynamenode-ubuntu.out:
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 21:21
ok..we'll give it a final shot..then i'll email configured hadoop to
your email address..delete the hdfs directory which contains tmp, data and name..recreate it..format hdfs again and then start the processes. Regards, Mohammad Tariq On Thu, Jun 7, 2012 at 2:22 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > I 've performed the steps but the same error in this step as before: > bin/start-dfs.sh > It is about my permission to make directory > > On Wed, Jun 6, 2012 at 10:33 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: >> >> actually this blog post explains how to install cloudera's hadoop >> distribution...if you have followed this post and installed cloudera's >> distribution then your logs should ideally be inside >> /usr/lib/hadoop/logs (if everything was fine)..anyway try the steps I >> have given and let me know. >> >> Regards, >> Mohammad Tariq >> >> >> On Thu, Jun 7, 2012 at 1:52 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> > by the way,you are a very nice man my friend:Thank you so much :) >> > >> > what do you mean aboat this post in stackoverflow? >> > >> > I am assuming that is your first installation of hadoop. >> > >> > At the beginning please check if your daemons are working. To do that >> > use >> > (in terminal): >> > >> > jps >> > >> > If only jps appears that means all daemons are down. Please check the >> > log >> > files. Especially the namenode. Log folder is probably somewhere there >> > /usr/lib/hadoop/logs >> > >> > If you have some permission problems. Use this guide during the >> > installation. >> > >> > Good installation guide >> > >> > I am shooting with this explanations but these are most common problems. >> > >> > >> > On Wed, Jun 6, 2012 at 10:15 PM, Babak Bastan <[EMAIL PROTECTED]> >> > wrote: >> >> >> >> I checked it but no hadoop folder :( >> >> yes you are right.I'm a student and I want to make a very very simple >> >> programm hive but untill now hmmmmmmmmm >> >> >> >> >> >> On Wed, Jun 6, 2012 at 10:12 PM, Babak Bastan <[EMAIL PROTECTED]> >> >> wrote: >> >>> >> >>> no one error: >> >>> i.e if I run this one >> >>> >> >>> hostname --fqdn >> >>> >> >>> with the condition that I send to you : >> >>> >> >>> 127.0.0.1 localhost >> >>> #127.0.0.1 ubuntu.ubuntu-domain ubuntu >> >>> # The following lines are desirable for IPv6 capable hosts >> >>> #::1 ip6-localhost ip6-loopback >> >>> #fe00::0 ip6-localnet >> >>> #ff00::0 ip6-mcastprefix >> >>> #ff02::1 ip6-allnodes >> >>> #ff02::2 ip6-allrouters >> >>> >> >>> I get this error: >> >>> >> >>> hostname: Name or service not known >> >>> >> >>> Or in the second step by this command: >> >>> >> >>> babak@ubuntu:~/Downloads/hadoop/bin$ start-hdfs.sh >> >>> >> >>> these lines of error: >> >>> >> >>> >> >>> mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ >> >>> nicht >> >>> anlegen: Keine Berechtigung >> >>> starting namenode, logging to >> >>> >> >>> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out >> >>> /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: >> >>> >> >>> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out: >> >>> Datei oder Verzeichnis nicht gefunden >> >>> head: >> >>> >> >>> „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out“ >> >>> kann nicht zum Lesen geöffnet werden: Datei oder Verzeichnis nicht >> >>> gefunden >> >>> localhost: mkdir: kann Verzeichnis >> >>> „/home/babak/Downloads/hadoop/bin/../logs“ nicht anlegen: Keine >> >>> Berechtigung >> >>> localhost: starting datanode, logging to >> >>> >> >>> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out >> >>> localhost: /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile >> >>> 117: >> >>> >> >>> /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out: >> >>> Datei oder Verzeichnis nicht gefunden >> >>> localhost: head: >> >>> >> >>> „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-datanode-ubuntu.out“
-
Re: Error while Creating Table in HiveBabak Bastan 2012-06-06, 21:34
I try to install another one in blog,most of them was performed without
problem but in this step udo mkdir /hadoop && sudo chown hdfs:hdfs /hadoop && sudo chmod 777 /hadoop I get this error: Error: 0: couldn't open source file </hadoop.ui> and in this step: mkdir /usr/lib/hadoop-0.20/.ssh this error: mkdir: kann Verzeichnis „/usr/lib/hadoop-0.20/.ssh“ nicht anlegen: Keine Berechtigung ---> no permission to make a directory On Wed, Jun 6, 2012 at 11:21 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > ok..we'll give it a final shot..then i'll email configured hadoop to > your email address..delete the hdfs directory which contains tmp, data > and name..recreate it..format hdfs again and then start the processes. > > Regards, > Mohammad Tariq > > > On Thu, Jun 7, 2012 at 2:22 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > > I 've performed the steps but the same error in this step as before: > > bin/start-dfs.sh > > It is about my permission to make directory > > > > On Wed, Jun 6, 2012 at 10:33 PM, Mohammad Tariq <[EMAIL PROTECTED]> > wrote: > >> > >> actually this blog post explains how to install cloudera's hadoop > >> distribution...if you have followed this post and installed cloudera's > >> distribution then your logs should ideally be inside > >> /usr/lib/hadoop/logs (if everything was fine)..anyway try the steps I > >> have given and let me know. > >> > >> Regards, > >> Mohammad Tariq > >> > >> > >> On Thu, Jun 7, 2012 at 1:52 AM, Babak Bastan <[EMAIL PROTECTED]> > wrote: > >> > by the way,you are a very nice man my friend:Thank you so much :) > >> > > >> > what do you mean aboat this post in stackoverflow? > >> > > >> > I am assuming that is your first installation of hadoop. > >> > > >> > At the beginning please check if your daemons are working. To do that > >> > use > >> > (in terminal): > >> > > >> > jps > >> > > >> > If only jps appears that means all daemons are down. Please check the > >> > log > >> > files. Especially the namenode. Log folder is probably somewhere there > >> > /usr/lib/hadoop/logs > >> > > >> > If you have some permission problems. Use this guide during the > >> > installation. > >> > > >> > Good installation guide > >> > > >> > I am shooting with this explanations but these are most common > problems. > >> > > >> > > >> > On Wed, Jun 6, 2012 at 10:15 PM, Babak Bastan <[EMAIL PROTECTED]> > >> > wrote: > >> >> > >> >> I checked it but no hadoop folder :( > >> >> yes you are right.I'm a student and I want to make a very very simple > >> >> programm hive but untill now hmmmmmmmmm > >> >> > >> >> > >> >> On Wed, Jun 6, 2012 at 10:12 PM, Babak Bastan <[EMAIL PROTECTED]> > >> >> wrote: > >> >>> > >> >>> no one error: > >> >>> i.e if I run this one > >> >>> > >> >>> hostname --fqdn > >> >>> > >> >>> with the condition that I send to you : > >> >>> > >> >>> 127.0.0.1 localhost > >> >>> #127.0.0.1 ubuntu.ubuntu-domain ubuntu > >> >>> # The following lines are desirable for IPv6 capable hosts > >> >>> #::1 ip6-localhost ip6-loopback > >> >>> #fe00::0 ip6-localnet > >> >>> #ff00::0 ip6-mcastprefix > >> >>> #ff02::1 ip6-allnodes > >> >>> #ff02::2 ip6-allrouters > >> >>> > >> >>> I get this error: > >> >>> > >> >>> hostname: Name or service not known > >> >>> > >> >>> Or in the second step by this command: > >> >>> > >> >>> babak@ubuntu:~/Downloads/hadoop/bin$ start-hdfs.sh > >> >>> > >> >>> these lines of error: > >> >>> > >> >>> > >> >>> mkdir: kann Verzeichnis „/home/babak/Downloads/hadoop/bin/../logs“ > >> >>> nicht > >> >>> anlegen: Keine Berechtigung > >> >>> starting namenode, logging to > >> >>> > >> >>> > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out > >> >>> /home/babak/Downloads/hadoop/bin/hadoop-daemon.sh: Zeile 117: > >> >>> > >> >>> > /home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out: > >> >>> Datei oder Verzeichnis nicht gefunden > >> >>> head: > >> >>> > >> >>> > „/home/babak/Downloads/hadoop/bin/../logs/hadoop-babak-namenode-ubuntu.out“
-
Re: Error while Creating Table in HiveMohammad Tariq 2012-06-06, 21:43
follow this link -
http://hadoop.apache.org/common/docs/r0.20.203.0/single_node_setup.html..it worked for most of us without any prooblem. do all the things required to configure hadoop on linux in pseudo distributed mode as given in this link..start with a simple setup as shown there..then we'll add more properties if you need detailed help you can also visit - http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/ Regards, Mohammad Tariq On Thu, Jun 7, 2012 at 3:04 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: > I try to install another one in blog,most of them was performed without > problem but in this step > > udo mkdir /hadoop && sudo chown hdfs:hdfs /hadoop && sudo chmod 777 /hadoop > > I get this error: > > Error: 0: couldn't open source file </hadoop.ui> > > and in this step: > mkdir /usr/lib/hadoop-0.20/.ssh > this error: > mkdir: kann Verzeichnis „/usr/lib/hadoop-0.20/.ssh“ nicht anlegen: Keine > Berechtigung > ---> no permission to make a directory > > On Wed, Jun 6, 2012 at 11:21 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: >> >> ok..we'll give it a final shot..then i'll email configured hadoop to >> your email address..delete the hdfs directory which contains tmp, data >> and name..recreate it..format hdfs again and then start the processes. >> >> Regards, >> Mohammad Tariq >> >> >> On Thu, Jun 7, 2012 at 2:22 AM, Babak Bastan <[EMAIL PROTECTED]> wrote: >> > I 've performed the steps but the same error in this step as before: >> > bin/start-dfs.sh >> > It is about my permission to make directory >> > >> > On Wed, Jun 6, 2012 at 10:33 PM, Mohammad Tariq <[EMAIL PROTECTED]> >> > wrote: >> >> >> >> actually this blog post explains how to install cloudera's hadoop >> >> distribution...if you have followed this post and installed cloudera's >> >> distribution then your logs should ideally be inside >> >> /usr/lib/hadoop/logs (if everything was fine)..anyway try the steps I >> >> have given and let me know. >> >> >> >> Regards, >> >> Mohammad Tariq >> >> >> >> >> >> On Thu, Jun 7, 2012 at 1:52 AM, Babak Bastan <[EMAIL PROTECTED]> >> >> wrote: >> >> > by the way,you are a very nice man my friend:Thank you so much :) >> >> > >> >> > what do you mean aboat this post in stackoverflow? >> >> > >> >> > I am assuming that is your first installation of hadoop. >> >> > >> >> > At the beginning please check if your daemons are working. To do that >> >> > use >> >> > (in terminal): >> >> > >> >> > jps >> >> > >> >> > If only jps appears that means all daemons are down. Please check the >> >> > log >> >> > files. Especially the namenode. Log folder is probably somewhere >> >> > there >> >> > /usr/lib/hadoop/logs >> >> > >> >> > If you have some permission problems. Use this guide during the >> >> > installation. >> >> > >> >> > Good installation guide >> >> > >> >> > I am shooting with this explanations but these are most common >> >> > problems. >> >> > >> >> > >> >> > On Wed, Jun 6, 2012 at 10:15 PM, Babak Bastan <[EMAIL PROTECTED]> >> >> > wrote: >> >> >> >> >> >> I checked it but no hadoop folder :( >> >> >> yes you are right.I'm a student and I want to make a very very >> >> >> simple >> >> >> programm hive but untill now hmmmmmmmmm >> >> >> >> >> >> >> >> >> On Wed, Jun 6, 2012 at 10:12 PM, Babak Bastan <[EMAIL PROTECTED]> >> >> >> wrote: >> >> >>> >> >> >>> no one error: >> >> >>> i.e if I run this one >> >> >>> >> >> >>> hostname --fqdn >> >> >>> >> >> >>> with the condition that I send to you : >> >> >>> >> >> >>> 127.0.0.1 localhost >> >> >>> #127.0.0.1 ubuntu.ubuntu-domain ubuntu >> >> >>> # The following lines are desirable for IPv6 capable hosts >> >> >>> #::1 ip6-localhost ip6-loopback >> >> >>> #fe00::0 ip6-localnet >> >> >>> #ff00::0 ip6-mcastprefix >> >> >>> #ff02::1 ip6-allnodes >> >> >>> #ff02::2 ip6-allrouters >> >> >>> >> >> >>> I get this error: >> >> >>> >> >> >>> hostname: Name or service not known >> >> >>> >> >> >>> Or in the second step by this command: |