Does hive currently support multiple SerDe s to be defined per table name?
Looking through the code and documentation, it seems like it doesn't as
only one could be specified through the ROW FORMAT SERDE but just wanted to
be sure.

--
Swarnim

Hi Swarnim,
What's your use case?
If you use multiple SerDe's, when you are writing to the table, how would you want Hive to decide which one to use?

Mark

Mark Grover, Business Intelligence Analyst
OANDA Corporation

www: oanda.com www: fxtrade.com

----- Original Message -----
From: "kulkarni swarnim" <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: Thursday, May 17, 2012 11:29:26 AM
Subject: Multiple SerDe per table name

Does hive currently support multiple SerDe s to be defined per table name? Looking through the code and documentation, it seems like it doesn't as only one could be specified through the ROW FORMAT SERDE but just wanted to be sure.
--
Swarnim

I was thinking more from a perspective of specifying a SerDe per column
name.

On Thu, May 17, 2012 at 10:38 AM, Mark Grover <[EMAIL PROTECTED]> wrote:

> Hi Swarnim,
> What's your use case?
> If you use multiple SerDe's, when you are writing to the table, how would
> you want Hive to decide which one to use?
>
> Mark
>
> Mark Grover, Business Intelligence Analyst
> OANDA Corporation
>
> www: oanda.com www: fxtrade.com
>
> ----- Original Message -----
> From: "kulkarni swarnim" <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Sent: Thursday, May 17, 2012 11:29:26 AM
> Subject: Multiple SerDe per table name
>
> Does hive currently support multiple SerDe s to be defined per table name?
> Looking through the code and documentation, it seems like it doesn't as
> only one could be specified through the ROW FORMAT SERDE but just wanted to
> be sure.
>
>
> --
> Swarnim
>

--
Swarnim

In Hive 0.8 and later versions you have the ability to specify the SerDe on
a per-partition basis, but that's as granular as it gets.

Thanks.

Carl

On Thu, May 17, 2012 at 8:53 AM, [EMAIL PROTECTED] <
[EMAIL PROTECTED]> wrote:

> I was thinking more from a perspective of specifying a SerDe per column
> name.
>
>
> On Thu, May 17, 2012 at 10:38 AM, Mark Grover <[EMAIL PROTECTED]> wrote:
>
>> Hi Swarnim,
>> What's your use case?
>> If you use multiple SerDe's, when you are writing to the table, how would
>> you want Hive to decide which one to use?
>>
>> Mark
>>
>> Mark Grover, Business Intelligence Analyst
>> OANDA Corporation
>>
>> www: oanda.com www: fxtrade.com
>>
>> ----- Original Message -----
>> From: "kulkarni swarnim" <[EMAIL PROTECTED]>
>> To: [EMAIL PROTECTED]
>> Sent: Thursday, May 17, 2012 11:29:26 AM
>> Subject: Multiple SerDe per table name
>>
>> Does hive currently support multiple SerDe s to be defined per table
>> name? Looking through the code and documentation, it seems like it doesn't
>> as only one could be specified through the ROW FORMAT SERDE but just wanted
>> to be sure.
>>
>>
>> --
>> Swarnim
>>
>
>
>
> --
> Swarnim
>

This does not work. A Deserializer's role is to turn the value which
came form the InputFormat into something hive can use as column data.
In essence the Deserializer creates the columns so I do not see a
logical way to have more then one.

On Thu, May 17, 2012 at 11:53 AM, [EMAIL PROTECTED]
<[EMAIL PROTECTED]> wrote:
> I was thinking more from a perspective of specifying a SerDe per column
> name.
>
> On Thu, May 17, 2012 at 10:38 AM, Mark Grover <[EMAIL PROTECTED]> wrote:
>>
>> Hi Swarnim,
>> What's your use case?
>> If you use multiple SerDe's, when you are writing to the table, how would
>> you want Hive to decide which one to use?
>>
>> Mark
>>
>> Mark Grover, Business Intelligence Analyst
>> OANDA Corporation
>>
>> www: oanda.com www: fxtrade.com
>>
>> ----- Original Message -----
>> From: "kulkarni swarnim" <[EMAIL PROTECTED]>
>> To: [EMAIL PROTECTED]
>> Sent: Thursday, May 17, 2012 11:29:26 AM
>> Subject: Multiple SerDe per table name
>>
>> Does hive currently support multiple SerDe s to be defined per table name?
>> Looking through the code and documentation, it seems like it doesn't as only
>> one could be specified through the ROW FORMAT SERDE but just wanted to be
>> sure.
>>
>>
>> --
>> Swarnim
>
>
>
>
> --
> Swarnim

Considering a case where we have multi HBase columns in an HBase table,
each containing data of a different structure would warrant a need for
multiple SerDe to map them to a single Hive table. Correct?

On Thu, May 17, 2012 at 11:45 AM, Edward Capriolo <[EMAIL PROTECTED]>wrote:

> This does not work. A Deserializer's role is to turn the value which
> came form the InputFormat into something hive can use as column data.
> In essence the Deserializer creates the columns so I do not see a
> logical way to have more then one.
>
> On Thu, May 17, 2012 at 11:53 AM, [EMAIL PROTECTED]
> <[EMAIL PROTECTED]> wrote:
> > I was thinking more from a perspective of specifying a SerDe per column
> > name.
> >
> > On Thu, May 17, 2012 at 10:38 AM, Mark Grover <[EMAIL PROTECTED]> wrote:
> >>
> >> Hi Swarnim,
> >> What's your use case?
> >> If you use multiple SerDe's, when you are writing to the table, how
> would
> >> you want Hive to decide which one to use?
> >>
> >> Mark
> >>
> >> Mark Grover, Business Intelligence Analyst
> >> OANDA Corporation
> >>
> >> www: oanda.com www: fxtrade.com
> >>
> >> ----- Original Message -----
> >> From: "kulkarni swarnim" <[EMAIL PROTECTED]>
> >> To: [EMAIL PROTECTED]
> >> Sent: Thursday, May 17, 2012 11:29:26 AM
> >> Subject: Multiple SerDe per table name
> >>
> >> Does hive currently support multiple SerDe s to be defined per table
> name?
> >> Looking through the code and documentation, it seems like it doesn't as
> only
> >> one could be specified through the ROW FORMAT SERDE but just wanted to
> be
> >> sure.
> >>
> >>
> >> --
> >> Swarnim
> >
> >
> >
> >
> > --
> > Swarnim
>

--
Swarnim

No. The common approach is Serde's can take parameters (or you can use
table parameters) or they could discover the schema themselves
programatically (reflection, parsing) and act appropriately.

On 5/18/12, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
> Considering a case where we have multi HBase columns in an HBase table,
> each containing data of a different structure would warrant a need for
> multiple SerDe to map them to a single Hive table. Correct?
>
> On Thu, May 17, 2012 at 11:45 AM, Edward Capriolo
> <[EMAIL PROTECTED]>wrote:
>
>> This does not work. A Deserializer's role is to turn the value which
>> came form the InputFormat into something hive can use as column data.
>> In essence the Deserializer creates the columns so I do not see a
>> logical way to have more then one.
>>
>> On Thu, May 17, 2012 at 11:53 AM, [EMAIL PROTECTED]
>> <[EMAIL PROTECTED]> wrote:
>> > I was thinking more from a perspective of specifying a SerDe per column
>> > name.
>> >
>> > On Thu, May 17, 2012 at 10:38 AM, Mark Grover <[EMAIL PROTECTED]>
>> > wrote:
>> >>
>> >> Hi Swarnim,
>> >> What's your use case?
>> >> If you use multiple SerDe's, when you are writing to the table, how
>> would
>> >> you want Hive to decide which one to use?
>> >>
>> >> Mark
>> >>
>> >> Mark Grover, Business Intelligence Analyst
>> >> OANDA Corporation
>> >>
>> >> www: oanda.com www: fxtrade.com
>> >>
>> >> ----- Original Message -----
>> >> From: "kulkarni swarnim" <[EMAIL PROTECTED]>
>> >> To: [EMAIL PROTECTED]
>> >> Sent: Thursday, May 17, 2012 11:29:26 AM
>> >> Subject: Multiple SerDe per table name
>> >>
>> >> Does hive currently support multiple SerDe s to be defined per table
>> name?
>> >> Looking through the code and documentation, it seems like it doesn't
>> >> as
>> only
>> >> one could be specified through the ROW FORMAT SERDE but just wanted to
>> be
>> >> sure.
>> >>
>> >>
>> >> --
>> >> Swarnim
>> >
>> >
>> >
>> >
>> > --
>> > Swarnim
>>
>
>
>
> --
> Swarnim
>