|
|
-
Text file with ctrl chat as delimiter
Sam William 2012-06-19, 23:15
Hi, I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ?
For instance .
create table ... blah .blah ... row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc';
did not work .
Thanks Sam William [EMAIL PROTECTED]
+
Sam William 2012-06-19, 23:15
-
Re: Text file with ctrl chat as delimiter
Mapred Learn 2012-06-20, 00:34
Did you add the word external in create table I.e.
Create external table(...blah...blah...)
Sent from my iPhone
On Jun 19, 2012, at 4:15 PM, Sam William <[EMAIL PROTECTED]> wrote:
> Hi, > I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ? > > For instance . > > create table ... blah .blah ... > row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc'; > > did not work . > > Thanks > > > Sam William > [EMAIL PROTECTED] > > >
+
Mapred Learn 2012-06-20, 00:34
-
Re: Text file with ctrl chat as delimiter
Mark Grover 2012-06-20, 13:24
Sam, If you can please post a row or two of your data along with any errors you are getting, that would be helpful.
Mark ----- Original Message ----- From: "Mapred Learn" <[EMAIL PROTECTED]> To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Sent: Tuesday, June 19, 2012 8:34:22 PM Subject: Re: Text file with ctrl chat as delimiter Did you add the word external in create table I.e. Create external table(...blah...blah...)
Sent from my iPhone
On Jun 19, 2012, at 4:15 PM, Sam William < [EMAIL PROTECTED] > wrote: Hi, I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ? For instance . create table ... blah .blah ... row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc'; did not work . Thanks Sam William [EMAIL PROTECTED]
+
Mark Grover 2012-06-20, 13:24
-
Re: Text file with ctrl chat as delimiter
Sam William 2012-06-20, 22:57
Mark, I did not get any errors, but it seemed like the splitting was happening with u,0,1 as delimiters. My temporary fix is to define a table with one field and create a view split function on top . I dont want this additional overheard, if I can make the input format work with the ctrl char as the delimiter. Mapred Learn,
Yes I did have the word 'external' in the create table statement. Thanks, Sam
On Jun 20, 2012, at 6:24 AM, Mark Grover wrote:
> Sam, > If you can please post a row or two of your data along with any errors you are getting, that would be helpful. > > Mark > ----- Original Message ----- > From: "Mapred Learn" <[EMAIL PROTECTED]> > To: [EMAIL PROTECTED] > Cc: [EMAIL PROTECTED] > Sent: Tuesday, June 19, 2012 8:34:22 PM > Subject: Re: Text file with ctrl chat as delimiter > > > Did you add the word external in create table I.e. > > > Create external table(...blah...blah...) > > Sent from my iPhone > > On Jun 19, 2012, at 4:15 PM, Sam William < [EMAIL PROTECTED] > wrote: > > > > > > > Hi, > I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ? > > > For instance . > > > create table ... blah .blah ... > row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc'; > > > did not work . > > > Thanks > > > > > Sam William > [EMAIL PROTECTED] > > >
Sam William [EMAIL PROTECTED]
+
Sam William 2012-06-20, 22:57
-
Re: Text file with ctrl chat as delimiter
Mapred Learn 2012-06-21, 00:01
Hi Sam, Could you try '\001' instead of '\u0001' ?
Sent from my iPhone
On Jun 20, 2012, at 3:57 PM, Sam William <[EMAIL PROTECTED]> wrote:
> > > Mark, > I did not get any errors, but it seemed like the splitting was happening with u,0,1 as delimiters. My temporary fix is to define a table with one field and create a view split function on top . I dont want this additional overheard, if I can make the input format work with the ctrl char as the delimiter. > > Mapred Learn, > > Yes I did have the word 'external' in the create table statement. > > > Thanks, > Sam > > On Jun 20, 2012, at 6:24 AM, Mark Grover wrote: > >> Sam, >> If you can please post a row or two of your data along with any errors you are getting, that would be helpful. >> >> Mark >> ----- Original Message ----- >> From: "Mapred Learn" <[EMAIL PROTECTED]> >> To: [EMAIL PROTECTED] >> Cc: [EMAIL PROTECTED] >> Sent: Tuesday, June 19, 2012 8:34:22 PM >> Subject: Re: Text file with ctrl chat as delimiter >> >> >> Did you add the word external in create table I.e. >> >> >> Create external table(...blah...blah...) >> >> Sent from my iPhone >> >> On Jun 19, 2012, at 4:15 PM, Sam William < [EMAIL PROTECTED] > wrote: >> >> >> >> >> >> >> Hi, >> I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ? >> >> >> For instance . >> >> >> create table ... blah .blah ... >> row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc'; >> >> >> did not work . >> >> >> Thanks >> >> >> >> >> Sam William >> [EMAIL PROTECTED] >> >> >> > > Sam William > [EMAIL PROTECTED] > > >
+
Mapred Learn 2012-06-21, 00:01
-
Re: Text file with ctrl chat as delimiter
Sam William 2012-06-21, 19:01
Wow .. This works thanks.. Sam On Jun 20, 2012, at 5:01 PM, Mapred Learn wrote:
> Hi Sam, > Could you try '\001' instead of '\u0001' ? > > Sent from my iPhone > > On Jun 20, 2012, at 3:57 PM, Sam William <[EMAIL PROTECTED]> wrote: > >> >> >> Mark, >> I did not get any errors, but it seemed like the splitting was happening with u,0,1 as delimiters. My temporary fix is to define a table with one field and create a view split function on top . I dont want this additional overheard, if I can make the input format work with the ctrl char as the delimiter. >> >> Mapred Learn, >> >> Yes I did have the word 'external' in the create table statement. >> >> >> Thanks, >> Sam >> >> On Jun 20, 2012, at 6:24 AM, Mark Grover wrote: >> >>> Sam, >>> If you can please post a row or two of your data along with any errors you are getting, that would be helpful. >>> >>> Mark >>> ----- Original Message ----- >>> From: "Mapred Learn" <[EMAIL PROTECTED]> >>> To: [EMAIL PROTECTED] >>> Cc: [EMAIL PROTECTED] >>> Sent: Tuesday, June 19, 2012 8:34:22 PM >>> Subject: Re: Text file with ctrl chat as delimiter >>> >>> >>> Did you add the word external in create table I.e. >>> >>> >>> Create external table(...blah...blah...) >>> >>> Sent from my iPhone >>> >>> On Jun 19, 2012, at 4:15 PM, Sam William < [EMAIL PROTECTED] > wrote: >>> >>> >>> >>> >>> >>> >>> Hi, >>> I have a data file that is exactly equivalent to a CSV , except that the field delimiter is a control character specifically '\u0001' . How can I create an external table in hive for this data ? >>> >>> >>> For instance . >>> >>> >>> create table ... blah .blah ... >>> row format delimited fields terminated by '\u0001' stored as textfile location '/tmp/myloc'; >>> >>> >>> did not work . >>> >>> >>> Thanks >>> >>> >>> >>> >>> Sam William >>> [EMAIL PROTECTED] >>> >>> >>> >> >> Sam William >> [EMAIL PROTECTED] >> >> >>
Sam William [EMAIL PROTECTED]
+
Sam William 2012-06-21, 19:01
|
|