|
|
+
JSaravanaKumar 2011-08-09, 10:13
-
Re: Architectural Questions
Uma Maheswara Rao G 72686... 2011-08-09, 11:48
Hi, AFAIK, HIVE will use the derby for storing the metadata. I am not expert in HIVE, but i can give the some info. HIVE will store the table and hdfs path mappings ralated information in Derby. I think you can configure other DBs as well but by default Hive supports derby Regards, Uma ----- Original Message ----- From: JSaravanaKumar <[EMAIL PROTECTED]> Date: Tuesday, August 9, 2011 3:44 pm Subject: Architectural Questions To: [EMAIL PROTECTED] > > can you please help me in understanding Why Derby is used along > with Hadoop ? > -- > View this message in context: http://old.nabble.com/Architectural-> Questions-tp32224940p32224940.html > Sent from the Hadoop core-dev mailing list archive at Nabble.com. > >
+
Uma Maheswara Rao G 72686... 2011-08-09, 11:48
-
Re: Architectural Questions
Harsh J 2011-08-09, 19:12
Hadoop doesn't use derby. It does, however, use HSQLDB for its external DB I/O and example components. On Tue, Aug 9, 2011 at 3:43 PM, JSaravanaKumar <[EMAIL PROTECTED]> wrote: > > can you please help me in understanding Why Derby is used along with Hadoop ? > -- > View this message in context: http://old.nabble.com/Architectural-Questions-tp32224940p32224940.html> Sent from the Hadoop core-dev mailing list archive at Nabble.com. > > -- Harsh J
+
Harsh J 2011-08-09, 19:12
-
RE: Architectural Questions
Segel, Mike 2011-08-09, 20:38
Uhm... Ok... I just did a quick Google search on Hadoop and Derby... https://issues.apache.org/jira/browse/HADOOP-4133Then there's this subproject called Hive... :-) Oh and then there's this other subproject called Oozie... :-) Now Cloudera and other support MySQL in the role of Derby aka Cloudscape aka JavaDB. Here's a link to a blog on setting up MySQL... http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx:-) -----Original Message----- From: Harsh J [mailto:[EMAIL PROTECTED]] Sent: Tuesday, August 09, 2011 2:12 PM To: [EMAIL PROTECTED] Subject: Re: Architectural Questions Hadoop doesn't use derby. It does, however, use HSQLDB for its external DB I/O and example components. On Tue, Aug 9, 2011 at 3:43 PM, JSaravanaKumar <[EMAIL PROTECTED]> wrote: > > can you please help me in understanding Why Derby is used along with Hadoop ? > -- > View this message in context: > http://old.nabble.com/Architectural-Questions-tp32224940p32224940.html> Sent from the Hadoop core-dev mailing list archive at Nabble.com. > > -- Harsh J The information contained in this communication may be CONFIDENTIAL and is intended only for the use of the recipient(s) named above. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited. If you have received this communication in error, please notify the sender and delete/destroy the original message and any copy of it from your computer or paper files.
+
Segel, Mike 2011-08-09, 20:38
-
Re: Architectural Questions
Harsh J 2011-08-09, 20:43
Hey Mike, On Wed, Aug 10, 2011 at 2:08 AM, Segel, Mike <[EMAIL PROTECTED]> wrote: > Uhm... > Ok... I just did a quick Google search on Hadoop and Derby... > https://issues.apache.org/jira/browse/HADOOP-4133That was for once-sub-project Hive (now TLP) :) -- Harsh J
+
Harsh J 2011-08-09, 20:43
-
RE: Architectural Questions
Segel, Mike 2011-08-09, 20:48
Right. The problem is how do you distinguish when someone is asking about the Hadoop (HDFS, MapReduce) And the Hadoop ecosystem. (HDFS, MapReduce, HBase, Hive, Pig, Oozie, Flume, etc ...) I interpreted the question to mean why are you using Derby in Oozie and Hive... :-) -----Original Message----- From: Harsh J [mailto:[EMAIL PROTECTED]] Sent: Tuesday, August 09, 2011 3:43 PM To: [EMAIL PROTECTED] Subject: Re: Architectural Questions Hey Mike, On Wed, Aug 10, 2011 at 2:08 AM, Segel, Mike <[EMAIL PROTECTED]> wrote: > Uhm... > Ok... I just did a quick Google search on Hadoop and Derby... > https://issues.apache.org/jira/browse/HADOOP-4133That was for once-sub-project Hive (now TLP) :) -- Harsh J The information contained in this communication may be CONFIDENTIAL and is intended only for the use of the recipient(s) named above. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited. If you have received this communication in error, please notify the sender and delete/destroy the original message and any copy of it from your computer or paper files.
+
Segel, Mike 2011-08-09, 20:48
-
Re: Architectural Questions
Alejandro Abdelnur 2011-08-09, 20:53
Oozie uses a SQL DB (it can be HSQLDB, DERBY, MYSQL, ORACLE) to persist the state of Oozie jobs. Thanks. Alejandro On Tue, Aug 9, 2011 at 1:48 PM, Segel, Mike <[EMAIL PROTECTED]> wrote: > Right. > The problem is how do you distinguish when someone is asking about the > Hadoop (HDFS, MapReduce) > And the Hadoop ecosystem. (HDFS, MapReduce, HBase, Hive, Pig, Oozie, Flume, > etc ...) > > I interpreted the question to mean why are you using Derby in Oozie and > Hive... > > :-) > > -----Original Message----- > From: Harsh J [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, August 09, 2011 3:43 PM > To: [EMAIL PROTECTED] > Subject: Re: Architectural Questions > > Hey Mike, > > On Wed, Aug 10, 2011 at 2:08 AM, Segel, Mike <[EMAIL PROTECTED]> wrote: > > Uhm... > > Ok... I just did a quick Google search on Hadoop and Derby... > > https://issues.apache.org/jira/browse/HADOOP-4133> > That was for once-sub-project Hive (now TLP) :) > > -- > Harsh J > > > The information contained in this communication may be CONFIDENTIAL and is > intended only for the use of the recipient(s) named above. If you are not > the intended recipient, you are hereby notified that any dissemination, > distribution, or copying of this communication, or any of its contents, is > strictly prohibited. If you have received this communication in error, > please notify the sender and delete/destroy the original message and any > copy of it from your computer or paper files. >
+
Alejandro Abdelnur 2011-08-09, 20:53
-
Re: Architectural Questions
Harsh J 2011-08-09, 21:28
Mike,
On Wed, Aug 10, 2011 at 2:18 AM, Segel, Mike <[EMAIL PROTECTED]> wrote:
> Right.
> The problem is how do you distinguish when someone is asking about the Hadoop (HDFS, MapReduce)
> And the Hadoop ecosystem. (HDFS, MapReduce, HBase, Hive, Pig, Oozie, Flume, etc ...)
Good question. I assumed it was just Hadoop cause it was mailed to
common-dev@. But looks like the OP mailed it to general@ as well, so
he is probably talking of the ecosystem (and thereby Hive/Oozie/etc.).
--
Harsh J
+
Harsh J 2011-08-09, 21:28
-
Re: Architectural Questions
Allen Wittenauer 2011-08-10, 03:30
On Aug 9, 2011, at 2:28 PM, Harsh J wrote:
> Mike,
>
> On Wed, Aug 10, 2011 at 2:18 AM, Segel, Mike <[EMAIL PROTECTED]> wrote:
>> Right.
>> The problem is how do you distinguish when someone is asking about the Hadoop (HDFS, MapReduce)
>> And the Hadoop ecosystem. (HDFS, MapReduce, HBase, Hive, Pig, Oozie, Flume, etc ...)
>
> Good question. I assumed it was just Hadoop cause it was mailed to
> common-dev@. But looks like the OP mailed it to general@ as well, so
> he is probably talking of the ecosystem (and thereby Hive/Oozie/etc.).
general@ is still just Hadoop.
+
Allen Wittenauer 2011-08-10, 03:30
-
Re: Architectural Questions
Alejandro Abdelnur 2011-08-09, 20:47
Mike, Hive and Oozie are projects that build on top of Hadoop. Hadoop proper does not use Derby. Hope this clarifies. Thxs. Alejandro On Tue, Aug 9, 2011 at 1:38 PM, Segel, Mike <[EMAIL PROTECTED]> wrote: > Uhm... > Ok... I just did a quick Google search on Hadoop and Derby... > https://issues.apache.org/jira/browse/HADOOP-4133> > Then there's this subproject called Hive... :-) > Oh and then there's this other subproject called Oozie... :-) > > Now Cloudera and other support MySQL in the role of Derby aka Cloudscape > aka JavaDB. > Here's a link to a blog on setting up MySQL... > > http://www.mazsoft.com/blog/post/2010/02/01/Setting-up-HadoopHive-to-use-MySQL-as-metastore.aspx> > :-) > > > -----Original Message----- > From: Harsh J [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, August 09, 2011 2:12 PM > To: [EMAIL PROTECTED] > Subject: Re: Architectural Questions > > Hadoop doesn't use derby. It does, however, use HSQLDB for its external DB > I/O and example components. > > On Tue, Aug 9, 2011 at 3:43 PM, JSaravanaKumar <[EMAIL PROTECTED]> > wrote: > > > > can you please help me in understanding Why Derby is used along with > Hadoop ? > > -- > > View this message in context: > > http://old.nabble.com/Architectural-Questions-tp32224940p32224940.html> > Sent from the Hadoop core-dev mailing list archive at Nabble.com. > > > > > > > > -- > Harsh J > > > The information contained in this communication may be CONFIDENTIAL and is > intended only for the use of the recipient(s) named above. If you are not > the intended recipient, you are hereby notified that any dissemination, > distribution, or copying of this communication, or any of its contents, is > strictly prohibited. If you have received this communication in error, > please notify the sender and delete/destroy the original message and any > copy of it from your computer or paper files. >
+
Alejandro Abdelnur 2011-08-09, 20:47
|
|
