Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> hflush not working for me?


Copy link to this message
-
Re: hflush not working for me?
I just tried opening Reader as another user but that made no difference.
St.Ack

On Fri, Oct 9, 2009 at 1:13 PM, stack <[EMAIL PROTECTED]> wrote:

> I'm putting together some unit tests up in our application that exercise
> hflush.  I'm using minidfscluster and a jar made by building head of the
> 0.21 branch of hdfs (from about a minute ago).
>
> Code opens a file, writes a bunch of edits, invokes hflush (by calling sync
> on DFSDataOutputStream instance) and then, without closing the Writer, opens
> a Reader on same file.  This Reader does not see any edits not to mind edits
> up to the sync invocation.
>
> I can trace the code and see how on hflush it sends the queued packets of
> edits.
>
> I studied TestReadWhileWriting.  I've set setBoolean("dfs.support.append",
> true) before minidfscluster spins up.  I can't set soft lease to 1 second
> because not in same package so I just wait out the default minute.  It
> doesn't seem to make a difference.
>
> Do I have to do open as another user?
>
> Thanks for any pointers,
> St.Ack
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB