Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> avro object reuse


Copy link to this message
-
RE: avro object reuse

What follows is the whole output of our jmap.  Hope this can help you identify the problem.

num  #instances #bytes Class description--------------------------------------------------------------------------1: 24405 291733256 byte[]2: 6056 40228984 int[]3: 388799 19966776 char[]4: 101779 16284640 org.codehaus.jackson.impl.ReaderBasedParser5: 369623 11827936 java.lang.String6: 111059 8769424 java.util.HashMap$Entry[]7: 204083 8163320 org.codehaus.jackson.impl.JsonReadContext8: 211374 6763968 java.util.HashMap$Entry9: 102551 5742856 org.codehaus.jackson.util.TextBuffer10: 105854 5080992 java.nio.HeapByteBuffer11: 105821 5079408 java.nio.HeapCharBuffer12: 104578 5019744 java.util.HashMap13: 102551 4922448 org.codehaus.jackson.io.IOContext14: 101782 4885536 org.codehaus.jackson.map.DeserializationConfig15: 101783 4071320 org.codehaus.jackson.sym.CharsToNameCanonicalizer16: 101779 4071160 org.codehaus.jackson.map.deser.StdDeserializationContext17: 101779 4071160 java.io.StringReader18: 101754 4070160 java.util.HashMap$KeyIterator19: 24001 3429704 * ConstMethodKlass20: 139087 3338088 java.lang.Long21: 115338 3215280 java.lang.Object[]22: 24001 2887768 * MethodKlass23: 2147 2414896 * ConstantPoolKlass24: 39532 2017320 * SymbolKlass25: 102735 1643760 java.util.HashMap$KeySet26: 2147 1596304 * InstanceKlassKlass27: 1865 1482184 * ConstantPoolCacheKlass28: 15780 1136160 com.sun.org.apache.xerces.internal.dom.DeferredElementNSImpl29: 27860 1114400 java.util.HashMap$EntryIterator30: 27585 1103400 com.sun.org.apache.xerces.internal.dom.DeferredTextImpl31: 1025 535536 * MethodDataKlass32: 5140 331816 short[]33: 5814 316424 java.lang.String[]34: 13135 315240 java.lang.StringBuilder35: 7723 247136 java.util.AbstractList$ListItr36: 1321 245632 org.apache.avro.io.parsing.Symbol[]37: 2332 242528 java.lang.Class38: 4712 226176 org.apache.avro.Schema$Props39: 6848 219136 java.util.AbstractList$Itr40: 12793 204688 java.lang.Integer41: 6033 193056 com.sun.org.apache.xerces.internal.xni.QName42: 4710 188400 java.util.LinkedHashMap$Entry43: 3190 171896 * System ObjArray44: 5228 167296 java.util.Hashtable$Entry45: 1789 114496 java.net.URL46: 777 100592 java.util.Hashtable$Entry[]47: 156 91104 * ObjArrayKlassKlass48: 3408 81792 java.util.ArrayList49: 450 64800 int[][]50: 90 64080 com.sun.org.apache.xerces.internal.util.SymbolTable$Entry[]51: 2513 60312 org.apache.avro.util.Utf852: 681 59928 java.lang.reflect.Method53: 1060 59360 java.util.LinkedHashMap54: 2160 51840 com.sun.org.apache.xerces.internal.util.XMLStringBuffer55: 1034 49632 org.apache.avro.Schema$Field56: 772 49408 org.codehaus.jackson.impl.WriterBasedGenerator57: 1980 47520 com.sun.org.apache.xerces.internal.xni.XMLString58: 775 43400 org.codehaus.jackson.map.ser.StdSerializerProvider59: 775 43400 org.codehaus.jackson.map.SerializationConfig60: 2596 41536 org.codehaus.jackson.node.TextNode61: 271 39128 java.lang.Object[][]62: 1564 37536 org.apache.avro.generic.GenericData$Record63: 900 36000 com.sun.org.apache.xerces.internal.xni.parser.XMLConfigurationException64: 360 34560 com.sun.org.apache.xerces.internal.xni.QName[]65: 720 34560 com.sun.org.apache.xerces.internal.util.XMLAttributesImpl$Attribute66: 1035 33120 java.util.LinkedHashMap$KeyIterator67: 2064 33024 java.util.HashMap$EntrySet68: 673 32304 java.util.Hashtable69: 90 30960 com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl70: 772 30880 org.codehaus.jackson.impl.ObjectWContext71: 949 30368 org.apache.avro.Schema$LockableArrayList72: 462 29568 java.util.regex.Matcher73: 1217 29208 java.lang.Double74: 900 28800 com.sun.org.apache.xerces.internal.util.AugmentationsImpl$SmallContainer75: 1077 25848 java.io.File76: 1035 24840 org.codehaus.jackson.node.ObjectNode77: 773 24736 org.codehaus.jackson.map.ser.ReadOnlyClassToSerializerMap78: 772 24704 org.codehaus.jackson.io.SegmentedStringWriter79: 772 24704 org.apache.avro.generic.GenericData$Array80: 772 24704 org.codehaus.jackson.impl.RootWContext81: 916 21984 org.apache.avro.Schema$ArraySchema82: 838 20112 org.apache.avro.Schema$StringSchema83: 620 19840 java.util.Vector84: 619 19808 org.apache.avro.io.parsing.Symbol$UnionAdjustAction85: 615 19680 com.sun.org.apache.xerces.internal.util.SymbolTable$Entry86: 180 18720 sun.net.www.protocol.file.FileURLConnection87: 776 18624 org.codehaus.jackson.map.ser.SerializerCache$UntypedKeyRaw88: 774 18576 org.apache.avro.Schema$UnionSchema89: 774 18576 org.codehaus.jackson.map.ser.SerializerCache$TypedKeyRaw90: 772 18528 org.apache.avro.mapred.Pair91: 772 18528 org.apache.avro.io.parsing.Symbol$Sequence92: 772 18528 org.apache.avro.Schema$SeenPair93: 770 18480 org.apache.avro.Schema$NullSchema94: 90 18000 com.sun.org.apache.xerces.internal.dom.DeferredDocumentImpl95: 544 17408 java.util.Stack96: 720 17280 com.sun.org.apache.xerces.internal.dom.DeferredDocumentImpl$RefCount97: 90 17280 com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl98: 90 17280 com.sun.org.apache.xerces.internal.parsers.XIncludeAwareParserConfiguration99: 707 16968 org.codehaus.jackson.sym.CharsToNameCanonicalizer$Bucket100: 690 16560 org.codehaus.jackson.node.ArrayNode101: 754 16192 java.lang.Class[]102: 90 15840 com.sun.org.apache.xerces.internal.impl.dtd.XMLNSDTDValidator103: 90 15120 com.sun.org.apache.xerces.internal.xinclude.XIncludeHandler104: 605 14520 java.lang.StringBuffer105: 389 14472 boolean[]106: 450 14400 com.sun.org.apache.xerces.internal.util.XMLResourceIdentifierImpl107: 900 14400 com.sun.org.apache.xerces.internal.util.AugmentationsImpl108: 570 13680 java.net.URLClassLoader$2109: 184 13248 java.lang.reflect.Field110: 92 13248 org.codehaus.jackson.sym.CharsToNameCanonicalizer$Bucket[]111: 90 12960 com.sun.org.apache.xerces.internal.parsers.DOMParser112: 773 12368 org.codehaus.jackson.map.ser.SerializerCache$TypedKeyFull113: 171 12312 java.lang.reflect.Constructor114: 307 12280 java.lang.re
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB