Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> question about clienttrace logs in hdfs and shortcircuit read

Copy link to this message
Re: question about clienttrace logs in hdfs and shortcircuit read
             DFS client uses org.apache.hadoop.hdfs.BlockReaderLocal  for
SCR..  I can see some debug level logs in this


LOG*.debug("New BlockReaderLocal for file " + blkfile + " of size "

+ blkfile.length() + " startOffset " + startOffset + " length "

+ length + " short circuit checksum " + !skipChecksumCheck);

If debug is enabled u can check for this in ur DFS client side (ie RS
logs).. I hope u have enabled debug level for hadoop.. Some metric from the
DFS client side would be useful..
On Fri, Jul 5, 2013 at 1:08 PM, Viral Bajaria <[EMAIL PROTECTED]>wrote:

> Yes I was checking 0.94 code.
> And sorry for the brain fart, I just spotted the metric in ganglia. There
> are just too many metrics in ganglia and skipped this one! It was under the
> group "hbase.regionserver", while I was expected it to be
> "hbase.regionserver.RegionServerStatistics".
> The chart shows no failures (i.e. it has no data to show). So now I need to
> figure out if shortcircuit is on or not. Is there an easier way to do via
> JMX if not by logs ? I tried to grep the logs for "shortcircuit", "circuit"
> and didn't find anything in the last 2 days. I restarted a region server
> yesterday and would have expected it to show up on that one atleast.
> On Fri, Jul 5, 2013 at 12:30 AM, ramkrishna vasudevan <
> > Are you checking with 0.94 code? I believe so.