Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - issue about read file from HDFS

Copy link to this message
Re: issue about read file from HDFS
Azuryy Yu 2013-12-04, 04:24
Ok, so you go for yourself.
On Wed, Dec 4, 2013 at 12:15 PM, ch huang <[EMAIL PROTECTED]> wrote:

> it seems not a good suggestion,get lot of partition dir and data file will
> be a big compact to NN
> On Wed, Dec 4, 2013 at 12:08 PM, Azuryy Yu <[EMAIL PROTECTED]> wrote:
>> One suggestion is change your hive partition, add a hive partition  every
>> five minutes, and your HDFS file also roller every five minutes.
>> On Wed, Dec 4, 2013 at 11:56 AM, ch huang <[EMAIL PROTECTED]> wrote:
>>> hi,mailist:
>>>                when HDFS 's file is in appending ,no other reader can
>>> get data from this file,so when i do some statistics action every five
>>> minuters use hive read hdfs file ,i can not read data ,any good way can
>>> offer? thanks