-Re: How to load hive metadata from conf dir
Parag Sarda 2013-02-12, 17:31
Hive-thrift is definitely best option till now. That said, I am wondering
if its possible to load megastore in local mode to avoid dependency on
external service. Can I read the HIVE_CONF_DIR for javax.jdo.option.*
parameters and talk to sql server hosting hive metadata?
On 12/02/13 10:23 PM, "Edward Capriolo" <[EMAIL PROTECTED]> wrote:
>If you use hive-thrift/hive-service you can get the location of a
>table through the Table API (instead of Dean's horrid bash-isms)
>Table t = ....
>On Tue, Feb 12, 2013 at 9:41 AM, Dean Wampler
><[EMAIL PROTECTED]> wrote:
>> I'll mention another bash hack that I use all the time:
>> hive -e 'some_command' | grep for_what_i_want |
>> For example, the following command will print just the value of
>> hive.metastore.warehouse.dir, sending all the logging junk written to
>> to /dev/null and stripping off the leading
>> from the stdout output:
>> hive -e 'set hive.metastore.warehouse.dir;' 2> /dev/null | sed -e
>> (No grep subcommand required in this case...)
>> You could do something similar with DESCRIBE EXTENDED table PARTION(...)
>> Suppose you want a script that works for any property. Put the
>> a script file, say hive-prop.sh:
>> hive -e "set $1;" 2> /dev/null | sed -e "s/$1=//"
>> Make it executable (chmod +x /path/to/hive-prop.sh), then run it this
>> /path/to/hive-prop.sh hive.metastore.warehouse.dir
>> Back to asking for for metadata for a table. The following script will
>> determine the location of a particular partition for an external
>> "mydatabase.stocks" table:
>> hive -e "describe formatted mydatabase.stocks
>> symbol='AAPL');" 2> /dev/null | grep Location | sed -e "s/Location:[
>> On Mon, Feb 11, 2013 at 4:59 PM, Parag Sarda <[EMAIL PROTECTED]>
>>> Hello Hive Users,
>>> I am writing a program in java which is bundled as JAR and executed
>>> hadoop jar command. I would like to access hive metadata (read
>>> informations) in this program. I can ask user to set HIVE_CONF_DIR
>>> environment variable before calling my program or ask for any
>>> parameters to be passed. I do not want to force user to run hive
>>> service if possible to increase reliability of program by avoiding
>>> external dependencies.
>>> What is the recommended way to get partitions information? Here is my
>>> 1. Make sure my jar is bundled with hive-metastore library.
>>> 2. Use HiveMetastoreClient
>>> Is this correct? If yes, how to read the hive configuration from
>>>  http://mvnrepository.com/artifact/org.apache.hive/hive-metastore
>>> Thanks in advance,
>> Dean Wampler, Ph.D.