Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - append operations


Copy link to this message
-
Re: append operations
Konstantin Boudnik 2010-04-07, 16:34
Check HDFS-265. Append has been implemeted in the trunk (i.e. 0.22) so you can
grab it, deploy, and start using it.

Cos

On Wed, Apr 07, 2010 at 06:24AM, Alan Miller wrote:
>    Hi,
>
>    
>
>    I'm just getting started with HDFS and I'm using the java API.
>
>    What's the best way to synchronize files between my local and hdfs file
>    systems.
>
>    I.e. if a 10G file only grows by 1G, I'd rather just append the 1G instead
>    or copying the full 11G.
>
>    
>
>    From my understanding append operations haven't been implemented in HDFS
>    yet.
>
>    Is there  any news or the status on this?
>
>    
>
>    I was hoping to implement something  myself (using a FileInputStream and
>
>    FSDataOutputStream) but  FSDataOutputStream is not seekable.
>
>    
>
>    Any suggestions?
>
>    
>
>    Regards,
>
>    Alan