Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> issue about read file from HDFS


Copy link to this message
-
Re: issue about read file from HDFS
Ok, so you go for yourself.
On Wed, Dec 4, 2013 at 12:15 PM, ch huang <[EMAIL PROTECTED]> wrote:

> it seems not a good suggestion,get lot of partition dir and data file will
> be a big compact to NN
>
>
> On Wed, Dec 4, 2013 at 12:08 PM, Azuryy Yu <[EMAIL PROTECTED]> wrote:
>
>> One suggestion is change your hive partition, add a hive partition  every
>> five minutes, and your HDFS file also roller every five minutes.
>>
>>
>> On Wed, Dec 4, 2013 at 11:56 AM, ch huang <[EMAIL PROTECTED]> wrote:
>>
>>> hi,mailist:
>>>                when HDFS 's file is in appending ,no other reader can
>>> get data from this file,so when i do some statistics action every five
>>> minuters use hive read hdfs file ,i can not read data ,any good way can
>>> offer? thanks
>>>
>>
>>
>