Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo >> mail # user >> What happens when tablet is 'lost'?

Copy link to this message
Re: What happens when tablet is 'lost'?
On Thu, Aug 9, 2012 at 9:01 AM, Hugh Xedni <[EMAIL PROTECTED]> wrote:
> Keith,
> From your response...
> "A tablets persistent data is composed of a set of files in HDFS and a set
> of write ahead logs."
> "As long as the other tablet server can read the write ahead logs and HDFS
> files, no data is lost."
> Question.
> I understand when a write arrives at a TabletServer it is written to a
> Write-Ahead Log and then stored in the MemTable until flusing to HDFS via
> minor compaction.
> 1) Are write ahead logs even used when data is bulk inserted into hdfs then
> handed to Accumulo?

No write ahead logs are used directly.  Bulk import moves a file into
the tables dir in HDFS. Then an entry is written to the metadata table
for the tablet.  This write to the metadata table ends up in the write
ahead log of the tablet server serving the metadata tablet.

> 2) If not, how is data replication achieved when using bulk insert methods?

Bulk import just moves file already in hdfs.  So the file retains the
hdfs replication it had before bulk import.

> --
> Thank you,
> Hugh Xedni
> On Thu, Jul 26, 2012 at 12:31 PM, David Medinets <[EMAIL PROTECTED]>
> wrote:
>> Thanks, Keith. That explanation is just what I wanted.