Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Trailer 'header' is wrong; does the trailer size match content


Copy link to this message
-
Trailer 'header' is wrong; does the trailer size match content
Hello,

I keep getting this message while running the 'completebulkload' process.
I tried the following solutions that I came across while Googling for this
error:

1)  setReduceSpeculativeExecution(true)

2)  Made sure that none of the tasks are failing.

3)  The HFileOutput job runs successfully.

4)  The first 2 lines in the output from HFileOutput look like this:

2b 39 4c 39 39 2f 2b 2b 4d 57 54 37 66 32 2b 32 2a 31 2a 31 35 33 33 34 37
2a 34 39 39 39       row=+9L99/++MWT7f2+2*1*153347*4999,
families={(family=info,
keyvalues=(+9L99/++MWT7f2+2*1*153347*4999/info:frequency/9223372036854775807/Put/vlen=1)}
2b 39 4c 39 39 2f 2b 2b 4d 57 54 37 66 32 2b 32 2a 31 2a 31 35 33 33 34 38
2a 34 39 39 39       row=+9L99/++MWT7f2+2*1*153348*4999,
families={(family=info,
keyvalues=(+9L99/++MWT7f2+2*1*153348*4999/info:frequency/9223372036854775807/Put/vlen=1)}
5)  My Mapper for HFileOutput looks like this:

    public static class MyMapper extends MapReduceBase implements
Mapper<LongWritable, Text, ImmutableBytesWritable, Put> {

        @Override
        public void map(LongWritable key, Text value,
OutputCollector<ImmutableBytesWritable, Put> output, Reporter reporter)
                throws IOException {
            String[] values = value.toString().split("\t");
            String key1 = values[0];
            String value1 = values[1];

            ImmutableBytesWritable ibw = new
ImmutableBytesWritable(key1.getBytes());
            Put put = new Put(Bytes.toBytes(key1));
            put.add(Bytes.toBytes("info"), Bytes.toBytes("frequency"),
Bytes.toBytes(value1));
            output.collect(ibw, put);
        }

    }
Any ideas what could be wrong?  Thanks for your help.
+
Ted Yu 2012-05-17, 23:55
+
Something Something 2012-05-18, 00:06
+
Something Something 2012-05-18, 20:39
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB