|
yogesh dhari
2012-10-11, 17:48
Bejoy KS
2012-10-11, 17:53
yogesh dhari
2012-10-12, 09:27
MiaoMiao
2012-10-12, 09:50
Abhishek
2012-10-12, 12:47
yogesh dhari
2012-10-12, 13:02
|
-
Need Help in Hive storage formatyogesh dhari 2012-10-11, 17:48
Hi all, If we run this query insert overwrite local directory '/home/yogesh/Downloads/demoyy' select * from NYSE_LOCAL; { ( describe NYSE_LOCAL ; exchange string symbol string ddate string open float high float low float ) } ls /home/yogesh/Downloads/demoyy/ it shows the file name 000000_0 my Question is: 1) In which format does file 000000_0 is? 2) what is the delimiter between columns? Please help Thanks & Regards Yogesh Kumar
-
Re: Need Help in Hive storage formatBejoy KS 2012-10-11, 17:53
Hi Yogesh.
It should be a simple delimited file with ^A character as the field delimiter. Regards Bejoy KS Sent from handheld, please excuse typos. -----Original Message----- From: yogesh dhari <[EMAIL PROTECTED]> Date: Thu, 11 Oct 2012 23:18:35 To: hive request<[EMAIL PROTECTED]> Reply-To: [EMAIL PROTECTED] Subject: Need Help in Hive storage format Hi all, If we run this query insert overwrite local directory '/home/yogesh/Downloads/demoyy' select * from NYSE_LOCAL; { ( describe NYSE_LOCAL ; exchange string symbol string ddate string open float high float low float ) } ls /home/yogesh/Downloads/demoyy/ it shows the file name 000000_0 my Question is: 1) In which format does file 000000_0 is? 2) what is the delimiter between columns? Please help Thanks & Regards Yogesh Kumar
-
RE: Need Help in Hive storage formatyogesh dhari 2012-10-12, 09:27
Thanks Bejoy, Now I want to store theses rows in Pig. like A = load '/Pig/000000_0' using PigStorage() as (id:INT, name:chararray, ddate, prim, ignore, ignorecase, activat); What should be in the delimiter into PigStorage( )? I have tried PigStorage('/001') but its showing errors. What delimiter should we use. Please help and Suggest. Thanks & Regards Yogesh Kumar Subject: Re: Need Help in Hive storage format To: [EMAIL PROTECTED] From: [EMAIL PROTECTED] Date: Thu, 11 Oct 2012 17:53:12 +0000 Hi Yogesh. It should be a simple delimited file with ^A character as the field delimiter. Regards Bejoy KS Sent from handheld, please excuse typos.From: yogesh dhari <[EMAIL PROTECTED]> Date: Thu, 11 Oct 2012 23:18:35 +0530To: hive request<[EMAIL PROTECTED]>ReplyTo: [EMAIL PROTECTED] Subject: Need Help in Hive storage format Hi all, If we run this query insert overwrite local directory '/home/yogesh/Downloads/demoyy' select * from NYSE_LOCAL; { ( describe NYSE_LOCAL ; exchange string symbol string ddate string open float high float low float ) } ls /home/yogesh/Downloads/demoyy/ it shows the file name 000000_0 my Question is: 1) In which format does file 000000_0 is? 2) what is the delimiter between columns? Please help Thanks & Regards Yogesh Kumar
-
Re: Need Help in Hive storage formatMiaoMiao 2012-10-12, 09:50
Hi Yogesh:
I think this may help. https://pig.apache.org/docs/r0.10.0/api/org/apache/pig/builtin/PigStorage.html Miao On Fri, Oct 12, 2012 at 5:27 PM, yogesh dhari <[EMAIL PROTECTED]> wrote: > Thanks Bejoy, > > Now I want to store theses rows in Pig. > > like > > A = load '/Pig/000000_0' using PigStorage() > as > (id:INT, name:chararray, ddate, prim, ignore, ignorecase, activat); > > What should be in the delimiter into PigStorage( )? > I have tried PigStorage('/001') but its showing errors. > What delimiter should we use. > > Please help and Suggest. > > > Thanks & Regards > Yogesh Kumar > > > > > > ________________________________ > Subject: Re: Need Help in Hive storage format > To: [EMAIL PROTECTED] > From: [EMAIL PROTECTED] > Date: Thu, 11 Oct 2012 17:53:12 +0000 > > > Hi Yogesh. > > It should be a simple delimited file with ^A character as the field > delimiter. > Regards > Bejoy KS > > Sent from handheld, please excuse typos. > ________________________________ > From: yogesh dhari <[EMAIL PROTECTED]> > Date: Thu, 11 Oct 2012 23:18:35 +0530 > To: hive request<[EMAIL PROTECTED]> > ReplyTo: [EMAIL PROTECTED] > Subject: Need Help in Hive storage format > > Hi all, > > If we run this query > > insert overwrite local directory '/home/yogesh/Downloads/demoyy' select * > from NYSE_LOCAL; > > { > ( describe NYSE_LOCAL ; > > exchange string > symbol string > ddate string > open float > high float > low float > ) } > > ls /home/yogesh/Downloads/demoyy/ > > it shows the file name 000000_0 > > my Question is: > > 1) In which format does file 000000_0 is? > 2) what is the delimiter between columns? > > Please help > > Thanks & Regards > Yogesh Kumar > >
-
Re: Need Help in Hive storage formatAbhishek 2012-10-12, 12:47
Hi Yogesh,
Try this PigStorage(' \u0001'); Thanks Abhi Sent from my iPhone On Oct 12, 2012, at 5:50 AM, MiaoMiao <[EMAIL PROTECTED]> wrote: > Hi Yogesh: > > I think this may help. > > https://pig.apache.org/docs/r0.10.0/api/org/apache/pig/builtin/PigStorage.html > > Miao > > On Fri, Oct 12, 2012 at 5:27 PM, yogesh dhari <[EMAIL PROTECTED]> wrote: >> Thanks Bejoy, >> >> Now I want to store theses rows in Pig. >> >> like >> >> A = load '/Pig/000000_0' using PigStorage() >> as >> (id:INT, name:chararray, ddate, prim, ignore, ignorecase, activat); >> >> What should be in the delimiter into PigStorage( )? >> I have tried PigStorage('/001') but its showing errors. >> What delimiter should we use. >> >> Please help and Suggest. >> >> >> Thanks & Regards >> Yogesh Kumar >> >> >> >> >> >> ________________________________ >> Subject: Re: Need Help in Hive storage format >> To: [EMAIL PROTECTED] >> From: [EMAIL PROTECTED] >> Date: Thu, 11 Oct 2012 17:53:12 +0000 >> >> >> Hi Yogesh. >> >> It should be a simple delimited file with ^A character as the field >> delimiter. >> Regards >> Bejoy KS >> >> Sent from handheld, please excuse typos. >> ________________________________ >> From: yogesh dhari <[EMAIL PROTECTED]> >> Date: Thu, 11 Oct 2012 23:18:35 +0530 >> To: hive request<[EMAIL PROTECTED]> >> ReplyTo: [EMAIL PROTECTED] >> Subject: Need Help in Hive storage format >> >> Hi all, >> >> If we run this query >> >> insert overwrite local directory '/home/yogesh/Downloads/demoyy' select * >> from NYSE_LOCAL; >> >> { >> ( describe NYSE_LOCAL ; >> >> exchange string >> symbol string >> ddate string >> open float >> high float >> low float >> ) } >> >> ls /home/yogesh/Downloads/demoyy/ >> >> it shows the file name 000000_0 >> >> my Question is: >> >> 1) In which format does file 000000_0 is? >> 2) what is the delimiter between columns? >> >> Please help >> >> Thanks & Regards >> Yogesh Kumar >> >>
-
RE: Need Help in Hive storage formatyogesh dhari 2012-10-12, 13:02
Thanks All :-) Its working now :-) Regards Yogesh Kumar > CC: [EMAIL PROTECTED] > From: [EMAIL PROTECTED] > Subject: Re: Need Help in Hive storage format > Date: Fri, 12 Oct 2012 08:47:41 -0400 > To: [EMAIL PROTECTED] > > Hi Yogesh, > > Try this PigStorage(' \u0001'); > > Thanks > Abhi > > > Sent from my iPhone > > On Oct 12, 2012, at 5:50 AM, MiaoMiao <[EMAIL PROTECTED]> wrote: > > > Hi Yogesh: > > > > I think this may help. > > > > https://pig.apache.org/docs/r0.10.0/api/org/apache/pig/builtin/PigStorage.html > > > > Miao > > > > On Fri, Oct 12, 2012 at 5:27 PM, yogesh dhari <[EMAIL PROTECTED]> wrote: > >> Thanks Bejoy, > >> > >> Now I want to store theses rows in Pig. > >> > >> like > >> > >> A = load '/Pig/000000_0' using PigStorage() > >> as > >> (id:INT, name:chararray, ddate, prim, ignore, ignorecase, activat); > >> > >> What should be in the delimiter into PigStorage( )? > >> I have tried PigStorage('/001') but its showing errors. > >> What delimiter should we use. > >> > >> Please help and Suggest. > >> > >> > >> Thanks & Regards > >> Yogesh Kumar > >> > >> > >> > >> > >> > >> ________________________________ > >> Subject: Re: Need Help in Hive storage format > >> To: [EMAIL PROTECTED] > >> From: [EMAIL PROTECTED] > >> Date: Thu, 11 Oct 2012 17:53:12 +0000 > >> > >> > >> Hi Yogesh. > >> > >> It should be a simple delimited file with ^A character as the field > >> delimiter. > >> Regards > >> Bejoy KS > >> > >> Sent from handheld, please excuse typos. > >> ________________________________ > >> From: yogesh dhari <[EMAIL PROTECTED]> > >> Date: Thu, 11 Oct 2012 23:18:35 +0530 > >> To: hive request<[EMAIL PROTECTED]> > >> ReplyTo: [EMAIL PROTECTED] > >> Subject: Need Help in Hive storage format > >> > >> Hi all, > >> > >> If we run this query > >> > >> insert overwrite local directory '/home/yogesh/Downloads/demoyy' select * > >> from NYSE_LOCAL; > >> > >> { > >> ( describe NYSE_LOCAL ; > >> > >> exchange string > >> symbol string > >> ddate string > >> open float > >> high float > >> low float > >> ) } > >> > >> ls /home/yogesh/Downloads/demoyy/ > >> > >> it shows the file name 000000_0 > >> > >> my Question is: > >> > >> 1) In which format does file 000000_0 is? > >> 2) what is the delimiter between columns? > >> > >> Please help > >> > >> Thanks & Regards > >> Yogesh Kumar > >> > >> |