Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> HBase replication - EOF while reading


Copy link to this message
-
HBase replication - EOF while reading
I've just enabled replication (to 1 peer), and I'm seeing a bunch of
errors, along the lines of [1]. Replication does seem to work, though (data
is showing up in the standby cluster).

The file exists (I can see it in the HDFS web GUI), but it seems be empty.

Is this an error I need to worry about?

Thanks,
Patrick

[1] 2013-07-02 16:50:36,275 WARN
org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: 1 Got
EOF while reading, looks like this file is broken? hdfs://
name-node.domain.com:8020/hbase/.logs/data-xbt.domain.com,60020,1372796067408/data-xbt.domain.com%2C60020%2C1372796067408.1372799669085
2013-07-02 16:50:36,275 DEBUG
org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Nothing
to replicate, sleeping 1000 times 10
2013-07-02 16:50:46,275 DEBUG
org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Opening
log for replication data-xbt.domain.com%2C60020%2C1372796067408.1372799669085
at 50573824
2013-07-02 16:50:46,325 WARN
org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: 1 Got:
java.io.EOFException: hdfs://
name-node.domain.com:8020/hbase/.logs/data-xbt.domain.com,60020,1372796067408/data-xbt.domain.com%2C60020%2C1372796067408.1372799669085,
entryStart=52524475, pos=52524544, end=52524544, edit=11033
        at sun.reflect.GeneratedConstructorAccessor34.newInstance(Unknown
Source)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
        at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.addFileInfoToException(SequenceFileLogReader.java:252)
        at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.next(SequenceFileLogReader.java:208)
        at
org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.readAllEntriesToReplicateOrNextFile(ReplicationSource.java:427)
        at
org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.run(ReplicationSource.java:306)
Caused by: java.io.EOFException
        at java.io.DataInputStream.readFully(DataInputStream.java:197)
        at
org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:68)
        at
org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:106)
        at
org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2294)
        at
org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2193)
        at
org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2239)
        at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.next(SequenceFileLogReader.java:206)
        ... 2 more
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB