Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> dump HLog content!


Copy link to this message
-
Re: dump HLog content!
Thanks for your important information. I have found this information
in the hbase-default.xml file.

Regards!

Yong

On Sun, Apr 15, 2012 at 8:36 PM, Manish Bhoge
<[EMAIL PROTECTED]> wrote:
> Yong,
>
> It is a Hlog log roll property that keep the log size 0 until the complete block is written OR until it completes the log roll duration mentioned in configuration (default 60 min). However it still persists the edits in .edit files and once it reaches to the interval defined for log roll it writes back to log. That is the reason you can see the logs(size) more than zero byte.eventually it moves the log into .oldlogs also.
>
> Thanks
> Manish
> Sent from my BlackBerry, pls excuse typo
>
> -----Original Message-----
> From: yonghu <[EMAIL PROTECTED]>
> Date: Sun, 15 Apr 2012 18:58:45
> To: <[EMAIL PROTECTED]>
> Reply-To: [EMAIL PROTECTED]
> Subject: Re: dump HLog content!
>
> Thanks for your reply. After nearly 60minutes, I can see the Hlog volume.
>
> -rw-r--r--   3 yonghu supergroup       2125 2012-04-15 17:34
> /hbase/.logs/yonghu-laptop,60020,1334504008467/yonghu-laptop%2C60020%2C1334504008467.1334504048854
>
> I have no idea why it takes so long time.
>
> Yong
>
> On Sun, Apr 15, 2012 at 6:34 PM, yonghu <[EMAIL PROTECTED]> wrote:
>> yes
>>
>> On Sun, Apr 15, 2012 at 6:30 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>>> Did 'HLog --dump' show real contents for a 0-sized file ?
>>>
>>> Cheers
>>>
>>> On Sun, Apr 15, 2012 at 8:58 AM, yonghu <[EMAIL PROTECTED]> wrote:
>>>
>>>> Hello,
>>>>
>>>> My hbase version is 0.92.0 and is installed in pseudo-mode. I found a
>>>> strange situation of HLog. After I inserted new data value into table,
>>>> the volume of HLog is 0. I checked in HDFS.
>>>>
>>>> drwxr-xr-x   - yonghu supergroup          0 2012-04-15 17:34 /hbase/.logs
>>>> drwxr-xr-x   - yonghu supergroup          0 2012-04-15 17:34
>>>> /hbase/.logs/yonghu-laptop,60020,1334504008467
>>>> -rw-r--r--   3 yonghu supergroup          0 2012-04-15 17:34
>>>>
>>>> /hbase/.logs/yonghu-laptop,60020,1334504008467/yonghu-laptop%2C60020%2C1334504008467.1334504048854
>>>>
>>>> But I can use hbase org.apache.hadoop.hbase.regionserver.wal.HLog
>>>> --dump to see the content of log information. However, if I write java
>>>> program to extract the log information. The output is null! Somebody
>>>> knows why?
>>>>
>>>> Thanks!
>>>>
>>>> Yong
>>>>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB