Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> append operations


Copy link to this message
-
Re: append operations
Check HDFS-265. Append has been implemeted in the trunk (i.e. 0.22) so you can
grab it, deploy, and start using it.

Cos

On Wed, Apr 07, 2010 at 06:24AM, Alan Miller wrote:
>    Hi,
>
>    
>
>    I'm just getting started with HDFS and I'm using the java API.
>
>    What's the best way to synchronize files between my local and hdfs file
>    systems.
>
>    I.e. if a 10G file only grows by 1G, I'd rather just append the 1G instead
>    or copying the full 11G.
>
>    
>
>    From my understanding append operations haven't been implemented in HDFS
>    yet.
>
>    Is there  any news or the status on this?
>
>    
>
>    I was hoping to implement something  myself (using a FileInputStream and
>
>    FSDataOutputStream) but  FSDataOutputStream is not seekable.
>
>    
>
>    Any suggestions?
>
>    
>
>    Regards,
>
>    Alan
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB