Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - Trailer 'header' is wrong; does the trailer size match content
Ted Yu
2012-05-17, 23:55
Something Something
2012-05-18, 00:06
Something Something
2012-05-18, 20:39
Copy link to this message
-
Trailer 'header' is wrong; does the trailer size match content
Something Something 2012-05-17, 23:48
Hello,

I keep getting this message while running the 'completebulkload' process.
I tried the following solutions that I came across while Googling for this
error:

1)  setReduceSpeculativeExecution(true)

2)  Made sure that none of the tasks are failing.

3)  The HFileOutput job runs successfully.

4)  The first 2 lines in the output from HFileOutput look like this:

2b 39 4c 39 39 2f 2b 2b 4d 57 54 37 66 32 2b 32 2a 31 2a 31 35 33 33 34 37
2a 34 39 39 39       row=+9L99/++MWT7f2+2*1*153347*4999,
families={(family=info,
keyvalues=(+9L99/++MWT7f2+2*1*153347*4999/info:frequency/9223372036854775807/Put/vlen=1)}
2b 39 4c 39 39 2f 2b 2b 4d 57 54 37 66 32 2b 32 2a 31 2a 31 35 33 33 34 38
2a 34 39 39 39       row=+9L99/++MWT7f2+2*1*153348*4999,
families={(family=info,
keyvalues=(+9L99/++MWT7f2+2*1*153348*4999/info:frequency/9223372036854775807/Put/vlen=1)}
5)  My Mapper for HFileOutput looks like this:

    public static class MyMapper extends MapReduceBase implements
Mapper<LongWritable, Text, ImmutableBytesWritable, Put> {

        @Override
        public void map(LongWritable key, Text value,
OutputCollector<ImmutableBytesWritable, Put> output, Reporter reporter)
                throws IOException {
            String[] values = value.toString().split("\t");
            String key1 = values[0];
            String value1 = values[1];

            ImmutableBytesWritable ibw = new
ImmutableBytesWritable(key1.getBytes());
            Put put = new Put(Bytes.toBytes(key1));
            put.add(Bytes.toBytes("info"), Bytes.toBytes("frequency"),
Bytes.toBytes(value1));
            output.collect(ibw, put);
        }

    }
Any ideas what could be wrong?  Thanks for your help.
+
Ted Yu 2012-05-17, 23:55
+
Something Something 2012-05-18, 00:06
+
Something Something 2012-05-18, 20:39