-HiveMetastore server .... performance of hive without this service?
Manish Malhotra 2013-01-11, 19:04
We have seen few times Thrift Hive Metastore server (HMS) is failing when
it needs to deal with more number of partitions.
We are thinking to remove HMS from our architecture.
As far as my understanding there will not be any issue in running hive
queries without HMS but in that case every client ( CLI code) will be
connecting to MySQL metastore for metadata.
So, wondering what would be the performance hit if we avoid HMS as HMS
might be using connection pooling for resource optimization.
Will dig into code to get better idea as well.
Out technology stack is:
Oozie > HiveAction > Hive queries
Hive Shell > Hive Queries