Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> issue about read file from HDFS


Copy link to this message
-
Re: issue about read file from HDFS
Ok, so you go for yourself.
On Wed, Dec 4, 2013 at 12:15 PM, ch huang <[EMAIL PROTECTED]> wrote:

> it seems not a good suggestion,get lot of partition dir and data file will
> be a big compact to NN
>
>
> On Wed, Dec 4, 2013 at 12:08 PM, Azuryy Yu <[EMAIL PROTECTED]> wrote:
>
>> One suggestion is change your hive partition, add a hive partition  every
>> five minutes, and your HDFS file also roller every five minutes.
>>
>>
>> On Wed, Dec 4, 2013 at 11:56 AM, ch huang <[EMAIL PROTECTED]> wrote:
>>
>>> hi,mailist:
>>>                when HDFS 's file is in appending ,no other reader can
>>> get data from this file,so when i do some statistics action every five
>>> minuters use hive read hdfs file ,i can not read data ,any good way can
>>> offer? thanks
>>>
>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB