Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> avro object reuse


Copy link to this message
-
RE: avro object reuse

What follows is the whole output of our jmap.  Hope this can help you identify the problem.

num  #instances #bytes Class description--------------------------------------------------------------------------1: 24405 291733256 byte[]2: 6056 40228984 int[]3: 388799 19966776 char[]4: 101779 16284640 org.codehaus.jackson.impl.ReaderBasedParser5: 369623 11827936 java.lang.String6: 111059 8769424 java.util.HashMap$Entry[]7: 204083 8163320 org.codehaus.jackson.impl.JsonReadContext8: 211374 6763968 java.util.HashMap$Entry9: 102551 5742856 org.codehaus.jackson.util.TextBuffer10: 105854 5080992 java.nio.HeapByteBuffer11: 105821 5079408 java.nio.HeapCharBuffer12: 104578 5019744 java.util.HashMap13: 102551 4922448 org.codehaus.jackson.io.IOContext14: 101782 4885536 org.codehaus.jackson.map.DeserializationConfig15: 101783 4071320 org.codehaus.jackson.sym.CharsToNameCanonicalizer16: 101779 4071160 org.codehaus.jackson.map.deser.StdDeserializationContext17: 101779 4071160 java.io.StringReader18: 101754 4070160 java.util.HashMap$KeyIterator19: 24001 3429704 * ConstMethodKlass20: 139087 3338088 java.lang.Long21: 115338 3215280 java.lang.Object[]22: 24001 2887768 * MethodKlass23: 2147 2414896 * ConstantPoolKlass24: 39532 2017320 * SymbolKlass25: 102735 1643760 java.util.HashMap$KeySet26: 2147 1596304 * InstanceKlassKlass27: 1865 1482184 * ConstantPoolCacheKlass28: 15780 1136160 com.sun.org.apache.xerces.internal.dom.DeferredElementNSImpl29: 27860 1114400 java.util.HashMap$EntryIterator30: 27585 1103400 com.sun.org.apache.xerces.internal.dom.DeferredTextImpl31: 1025 535536 * MethodDataKlass32: 5140 331816 short[]33: 5814 316424 java.lang.String[]34: 13135 315240 java.lang.StringBuilder35: 7723 247136 java.util.AbstractList$ListItr36: 1321 245632 org.apache.avro.io.parsing.Symbol[]37: 2332 242528 java.lang.Class38: 4712 226176 org.apache.avro.Schema$Props39: 6848 219136 java.util.AbstractList$Itr40: 12793 204688 java.lang.Integer41: 6033 193056 com.sun.org.apache.xerces.internal.xni.QName42: 4710 188400 java.util.LinkedHashMap$Entry43: 3190 171896 * System ObjArray44: 5228 167296 java.util.Hashtable$Entry45: 1789 114496 java.net.URL46: 777 100592 java.util.Hashtable$Entry[]47: 156 91104 * ObjArrayKlassKlass48: 3408 81792 java.util.ArrayList49: 450 64800 int[][]50: 90 64080 com.sun.org.apache.xerces.internal.util.SymbolTable$Entry[]51: 2513 60312 org.apache.avro.util.Utf852: 681 59928 java.lang.reflect.Method53: 1060 59360 java.util.LinkedHashMap54: 2160 51840 com.sun.org.apache.xerces.internal.util.XMLStringBuffer55: 1034 49632 org.apache.avro.Schema$Field56: 772 49408 org.codehaus.jackson.impl.WriterBasedGenerator57: 1980 47520 com.sun.org.apache.xerces.internal.xni.XMLString58: 775 43400 org.codehaus.jackson.map.ser.StdSerializerProvider59: 775 43400 org.codehaus.jackson.map.SerializationConfig60: 2596 41536 org.codehaus.jackson.node.TextNode61: 271 39128 java.lang.Object[][]62: 1564 37536 org.apache.avro.generic.GenericData$Record63: 900 36000 com.sun.org.apache.xerces.internal.xni.parser.XMLConfigurationException64: 360 34560 com.sun.org.apache.xerces.internal.xni.QName[]65: 720 34560 com.sun.org.apache.xerces.internal.util.XMLAttributesImpl$Attribute66: 1035 33120 java.util.LinkedHashMap$KeyIterator67: 2064 33024 java.util.HashMap$EntrySet68: 673 32304 java.util.Hashtable69: 90 30960 com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl70: 772 30880 org.codehaus.jackson.impl.ObjectWContext71: 949 30368 org.apache.avro.Schema$LockableArrayList72: 462 29568 java.util.regex.Matcher73: 1217 29208 java.lang.Double74: 900 28800 com.sun.org.apache.xerces.internal.util.AugmentationsImpl$SmallContainer75: 1077 25848 java.io.File76: 1035 24840 org.codehaus.jackson.node.ObjectNode77: 773 24736 org.codehaus.jackson.map.ser.ReadOnlyClassToSerializerMap78: 772 24704 org.codehaus.jackson.io.SegmentedStringWriter79: 772 24704 org.apache.avro.generic.GenericData$Array80: 772 24704 org.codehaus.jackson.impl.RootWContext81: 916 21984 org.apache.avro.Schema$ArraySchema82: 838 20112 org.apache.avro.Schema$StringSchema83: 620 19840 java.util.Vector84: 619 19808 org.apache.avro.io.parsing.Symbol$UnionAdjustAction85: 615 19680 com.sun.org.apache.xerces.internal.util.SymbolTable$Entry86: 180 18720 sun.net.www.protocol.file.FileURLConnection87: 776 18624 org.codehaus.jackson.map.ser.SerializerCache$UntypedKeyRaw88: 774 18576 org.apache.avro.Schema$UnionSchema89: 774 18576 org.codehaus.jackson.map.ser.SerializerCache$TypedKeyRaw90: 772 18528 org.apache.avro.mapred.Pair91: 772 18528 org.apache.avro.io.parsing.Symbol$Sequence92: 772 18528 org.apache.avro.Schema$SeenPair93: 770 18480 org.apache.avro.Schema$NullSchema94: 90 18000 com.sun.org.apache.xerces.internal.dom.DeferredDocumentImpl95: 544 17408 java.util.Stack96: 720 17280 com.sun.org.apache.xerces.internal.dom.DeferredDocumentImpl$RefCount97: 90 17280 com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl98: 90 17280 com.sun.org.apache.xerces.internal.parsers.XIncludeAwareParserConfiguration99: 707 16968 org.codehaus.jackson.sym.CharsToNameCanonicalizer$Bucket100: 690 16560 org.codehaus.jackson.node.ArrayNode101: 754 16192 java.lang.Class[]102: 90 15840 com.sun.org.apache.xerces.internal.impl.dtd.XMLNSDTDValidator103: 90 15120 com.sun.org.apache.xerces.internal.xinclude.XIncludeHandler104: 605 14520 java.lang.StringBuffer105: 389 14472 boolean[]106: 450 14400 com.sun.org.apache.xerces.internal.util.XMLResourceIdentifierImpl107: 900 14400 com.sun.org.apache.xerces.internal.util.AugmentationsImpl108: 570 13680 java.net.URLClassLoader$2109: 184 13248 java.lang.reflect.Field110: 92 13248 org.codehaus.jackson.sym.CharsToNameCanonicalizer$Bucket[]111: 90 12960 com.sun.org.apache.xerces.internal.parsers.DOMParser112: 773 12368 org.codehaus.jackson.map.ser.SerializerCache$TypedKeyFull113: 171 12312 java.lang.reflect.Constructor114: 307 12280 java.lang.re