Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> You Are Dead Exception due to promotion failure


+
prakash kadel 2013-10-07, 15:32
+
prakash kadel 2013-10-07, 15:34
+
Jean-Daniel Cryans 2013-10-07, 18:00
+
prakash kadel 2013-10-07, 22:09
+
prakash kadel 2013-10-07, 22:13
+
Jean-Daniel Cryans 2013-10-07, 22:23
Copy link to this message
-
答复: You Are Dead Exception due to promotion failure
The OS will pick up a process to kill according to an internal oom score,weight...(very likely is HBase if it ran long time and consumed lots of memory)
________________________________________
发件人: prakash kadel [[EMAIL PROTECTED]]
发送时间: 2013年10月8日 6:13
收件人: [EMAIL PROTECTED]
主题: Re: You Are Dead Exception due to promotion failure

BTW,
  if i disable the swap at all. What will happen in the above situation?
currently it starts swapping at 90%

Sincerely
On Tue, Oct 8, 2013 at 7:09 AM, prakash kadel <[EMAIL PROTECTED]>wrote:

> thanks,
>
> yup, it seems so. I have 48 gb memory. i see it swaps at that point.
>
> btw, why is the CMS not kicking in early? do you have any idea?
>
> sincerely
>
>
>
> On Tue, Oct 8, 2013 at 3:00 AM, Jean-Daniel Cryans <[EMAIL PROTECTED]>wrote:
>
>> This line:
>>
>> [CMS-concurrent-mark: 12.929/88.767 secs] [Times: user=14.30 sys=3.74,
>> real=88.77
>> secs]
>>
>> Is suspicious. Are you swapping?
>>
>> J-D
>>
>>
>> On Mon, Oct 7, 2013 at 8:34 AM, prakash kadel <[EMAIL PROTECTED]
>> >wrote:
>>
>> > Also,
>> >    why is the CMS not kicking in early, i have set XX:+
>> > UseCMSInitiatingOccupancyOnly???
>> >
>> > Sincerely,
>> > Prakash
>> >
>> >
>> > On Tue, Oct 8, 2013 at 12:32 AM, prakash kadel <[EMAIL PROTECTED]
>> > >wrote:
>> >
>> > > Hello,
>> > >   I am getting this YADE all the time
>> > >
>> > > HBASE_HEAPSIZE=8000
>> > >
>> > > Settings: -ea -XX:+UseConcMarkSweepGC -XX:MaxGCPauseMillis=200
>> > > -XX:+HeapDumpOnOutOfMemoryError -XX:+CMSIncrementalMode
>> -XX:+UseParNewGC
>> > > -XX:CMSInitiatingOccupancyFraction=50
>> -XX:+UseCMSInitiatingOccupancyOnly
>> > > -XX:NewSize=256m -XX:MaxNewSize=256m
>> > >
>> > > it seems there is promotion failure and the CMS take too long
>> > >
>> > > 2013-10-07T01:22:55.784+0900: [GC [ParNew: 235968K->26176K(235968K),
>> > > 0.3219980 secs] 7709485K->7538063K(8165824K) icms_dc=0 , 0.3221100
>> secs]
>> > > [Times: user=0.27 sys=0.01, real=0.33 secs]
>> > > 2013-10-07T01:23:07.361+0900: [GC [ParNew: 235842K->26176K(235968K),
>> > > 0.1899680 secs] 7747729K->7578713K(8165824K) icms_dc=0 , 0.1900700
>> secs]
>> > > [Times: user=0.26 sys=0.02, real=0.19 secs]
>> > > 2013-10-07T01:23:20.154+0900: [GC [ParNew: 235803K->26176K(235968K),
>> > > 0.2428200 secs] 7788341K->7615284K(8165824K) icms_dc=0 , 0.2429570
>> secs]
>> > > [Times: user=0.25 sys=0.02, real=0.24 secs]
>> > > 2013-10-07T01:23:34.594+0900: [GC [ParNew: 235889K->26176K(235968K),
>> > > 0.2440980 secs] 7824998K->7651179K(8165824K) icms_dc=0 , 0.2442130
>> secs]
>> > > [Times: user=0.20 sys=0.03, real=0.25 secs]
>> > > 2013-10-07T01:23:47.666+0900: [GC [ParNew: 235906K->26176K(235968K),
>> > > 0.2998100 secs] 7860909K->7686832K(8165824K) icms_dc=3 , 0.3020280
>> secs]
>> > > [Times: user=0.23 sys=0.04, real=0.30 secs]
>> > > 2013-10-07T01:23:57.216+0900: [GC [1 CMS-initial-mark:
>> > 7660656K(7929856K)]
>> > > 7788778K(8165824K), 3.7665320 secs] [Times: user=0.07 sys=0.06,
>> real=3.77
>> > > secs]
>> > > 2013-10-07T01:24:05.508+0900: [GC [ParNew: 235811K->26176K(235968K),
>> > > 0.4632860 secs] 7896468K->7721167K(8165824K) icms_dc=3 , 0.4634100
>> secs]
>> > > [Times: user=0.21 sys=0.03, real=0.46 secs]
>> > > 2013-10-07T01:24:19.889+0900: [GC [ParNew: 235812K->26176K(235968K),
>> > > 0.3531980 secs] 7930804K->7755633K(8165824K) icms_dc=3 , 0.3533230
>> secs]
>> > > [Times: user=0.24 sys=0.06, real=0.35 secs]
>> > > 2013-10-07T01:24:32.832+0900: [GC [ParNew: 235968K->26176K(235968K),
>> > > 0.6298370 secs] 7965425K->7790643K(8165824K) icms_dc=3 , 0.6299530
>> secs]
>> > > [Times: user=0.23 sys=0.03, real=0.63 secs]
>> > > 2013-10-07T01:24:43.629+0900: [GC [ParNew: 235800K->26176K(235968K),
>> > > 0.3190580 secs] 8000268K->7825555K(8165824K) icms_dc=3 , 0.3191840
>> secs]
>> > > [Times: user=0.24 sys=0.02, real=0.32 secs]
>> > > 2013-10-07T01:24:56.005+0900: [GC [ParNew: 235848K->26176K(235968K),
>> > > 0.4839400 secs] 8035228K->7860300K(8165824K) icms_dc=3 , 0.4840480
>> secs]
+
Asaf Mesika 2013-11-01, 08:40
+
Jean-Daniel Cryans 2013-11-01, 15:27
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB