Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> updates in hdfs

Copy link to this message
Re: updates in hdfs

It is not supported on the 1.x maintenance line where the focus of the
initial implementation work was to get syncs working for HBase alone
(which work perfectly well), and the append functionality is known to
have some rough edges, but the 2.x line has it - in a rewritten form,
and is supported last I checked.

On Wed, Oct 31, 2012 at 9:39 PM, M. C. Srivas <[EMAIL PROTECTED]> wrote:
> I was under the impression that file-append was deprecated in HDFS.
> On Tue, Oct 30, 2012 at 10:13 PM, Harsh J <[EMAIL PROTECTED]> wrote:
>> Shiv,
>> HDFS does have file-append support (i.e. add data at end of a
>> previously closed file). HDFS does not have random-write support (i.e.
>> writing data at a selected offset in the file).
>> What is your use-case though, that you seek to do updates over files
>> on HDFS? Perhaps you are instead looking for HBase, which has a
>> slightly different way of storing things but provides updates+versions
>> in a way over HDFS.
>> On Wed, Oct 31, 2012 at 10:28 AM, Siva Gudavalli
>> <[EMAIL PROTECTED]> wrote:
>> > Hi,
>> >
>> > Is there any mechanism on how to do updates to a files on hdfs?
>> >
>> > Regards
>> > shiv
>> --
>> Harsh J

Harsh J