-Re: issue about read file from HDFS
Azuryy Yu 2013-12-04, 04:24
Ok, so you go for yourself.
On Wed, Dec 4, 2013 at 12:15 PM, ch huang <[EMAIL PROTECTED]> wrote:
> it seems not a good suggestion,get lot of partition dir and data file will
> be a big compact to NN
> On Wed, Dec 4, 2013 at 12:08 PM, Azuryy Yu <[EMAIL PROTECTED]> wrote:
>> One suggestion is change your hive partition, add a hive partition every
>> five minutes, and your HDFS file also roller every five minutes.
>> On Wed, Dec 4, 2013 at 11:56 AM, ch huang <[EMAIL PROTECTED]> wrote:
>>> when HDFS 's file is in appending ,no other reader can
>>> get data from this file,so when i do some statistics action every five
>>> minuters use hive read hdfs file ,i can not read data ,any good way can
>>> offer? thanks