| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
328 (0.076s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: NN Memory Jumps every 1 1/2 hours - Hadoop - [mail # user]
|
|
...I tried your suggested setting and forced GC from Jconsole and once it crept up nothing was freeing up. So just food for thought: You said "average file name size is 32 bytes". W...
|
|
|
Author: Edward Capriolo,
2012-12-27, 22:58
|
|
|
Re: NN Memory Jumps every 1 1/2 hours - Hadoop - [mail # user]
|
|
...I am not sure GC had a factor. Even when I forced a GC it cleared 0% memory. One would think that since the entire NameNode image is stored in memory that the heap would not need to grow bey...
|
|
|
Author: Edward Capriolo,
2012-12-27, 22:22
|
|
|
Re: NN Memory Jumps every 1 1/2 hours - Hadoop - [mail # user]
|
|
...So it turns out the issue was just the size of the filesystem. 2012-12-27 16:37:22,390 WARN org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Checkpoint done. New Image Size: 4,354,3...
|
|
|
Author: Edward Capriolo,
2012-12-27, 21:48
|
|
|
Re: NN Memory Jumps every 1 1/2 hours - Hadoop - [mail # user]
|
|
...Tried this.. NameNode is still Ruining my Xmas on its slow death march to OOM. http://imagebin.org/240453 On Sat, Dec 22, 2012 at 10:23 PM, Suresh Srinivas wrote: ...
|
|
|
Author: Edward Capriolo,
2012-12-23, 18:34
|
|
|
Re: NN Memory Jumps every 1 1/2 hours - Hadoop - [mail # user]
|
|
...Ok so here is the latest. http://imagebin.org/240392 I took a jmap on startup and one an hour after. http://pastebin.com/xEkWid4f I think the biggest deal is [B which...
|
|
|
Author: Edward Capriolo,
2012-12-23, 01:59
|
|
|
Re: NN Memory Jumps every 1 1/2 hours - Hadoop - [mail # user]
|
|
...Blocks is ~26,000,000 Files is a bit higher ~27,000,000 Currently running: [root@hnn217 ~]# java -version java version "1.7.0_09" Was running 1.6.0_23 export JVM_OPTIONS="-XX:+Us...
|
|
|
Author: Edward Capriolo,
2012-12-23, 00:03
|
|
|
Re: NN Memory Jumps every 1 1/2 hours - Hadoop - [mail # user]
|
|
...Newer 1.6 are getting close to 1.7 so I am not going to fear a number and fight the future. I have been aat around 27 million files for a while been as high as 30 million I do not thin...
|
|
|
Author: Edward Capriolo,
2012-12-22, 17:51
|
|
|
Re: NN Memory Jumps every 1 1/2 hours - Hadoop - [mail # user]
|
|
...I will give this a go. I have actually went in JMX and manually triggered GC no memory is returned. So I assumed something was leaking. On Fri, Dec 21, 2012 at 11:59 PM, Adam Faris &nb...
|
|
|
Author: Edward Capriolo,
2012-12-22, 12:54
|
|
|
NN Memory Jumps every 1 1/2 hours - Hadoop - [mail # user]
|
|
...I have an old hadoop 0.20.2 cluster. Have not had any issues for a while. (which is why I never bothered an upgrade) Suddenly it OOMed last week. Now the OOMs happen periodically. We h...
|
|
|
Author: Edward Capriolo,
2012-12-22, 04:24
|
|
|
Re: Regarding DataJoin contrib jar for 1.0.3 - Hadoop - [mail # user]
|
|
...DataJoin is an example. Most people doing joins use Hive or Pig rather then code them up themselves. On Tue, Jul 24, 2012 at 5:19 PM, Abhinav M Kulkarni wrote:...
|
|
|
Author: Edward Capriolo,
2012-07-25, 20:27
|
|
|
|
