Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Passing date as command line arguments


Copy link to this message
-
Re: Passing date as command line arguments
Yes.

From the logs the query being executed is
select * from lip_data_quality where dt=20120709

But here the dt is not in quotes. It should be like
select * from lip_data_quality where dt='20120709';
 
Regards
Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: Techy Teck <[EMAIL PROTECTED]>
Date: Sat, 4 Aug 2012 00:07:07
To: <[EMAIL PROTECTED]>; Bejoy Ks<[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Re: Passing date as command line arguments

I found this thing from the Hive log. This is what you are looking for?-

*SessionStart SESSION_ID="rjamal_201208041359" TIME="1344063565655"*
*QueryStart QUERY_STRING="select * from lip_data_quality where dt=20120709"
QUERY_ID="rjamal_20120804135959_58e245e8-086a-47c2-9ed3-6b952e4a5486"
TIME="1344063597488"*
*Counters
plan="{"queryId":"rjamal_20120804135959_58e245e8-086a-47c2-9ed3-6b952e4a5486","queryType":null,"queryAttributes":{"queryString":"select
* from lip_data_quality where dt=20120709"},"queryCo*
*unters":"null","stageGraph":{"nodeType":"1","roots":"null","adjacencyList":"]"},"stageList":"]","done":"false","started":"true"}"
TIME="1344063597501"*
*QueryEnd QUERY_STRING="select * from lip_data_quality where dt=20120709"
QUERY_ID="rjamal_20120804135959_58e245e8-086a-47c2-9ed3-6b952e4a5486"
QUERY_RET_CODE="0" QUERY_NUM_TASKS="0" TIME="134406359*
*7503"*
*Counters
plan="{"queryId":"rjamal_20120804135959_58e245e8-086a-47c2-9ed3-6b952e4a5486","queryType":null,"queryAttributes":{"queryString":"select
* from lip_data_quality where dt=20120709"},"queryCo*
*unters":"null","stageGraph":{"nodeType":"1","roots":"null","adjacencyList":"]"},"stageList":"]","done":"true","started":"true"}"
TIME="1344063597504"*
*
*
*
*

On Fri, Aug 3, 2012 at 11:58 PM, Techy Teck <[EMAIL PROTECTED]> wrote:

> Yes that query gives me the result back correctly.
>
> How can I see the hive log Bejoy?  Basically I am not sure which hive log
> and what is the path where I can see that thing?
>
>
>
>
>
>
> On Fri, Aug 3, 2012 at 11:52 PM, Bejoy Ks <[EMAIL PROTECTED]> wrote:
>
>>  Hi Techy
>>
>> Are you getting the results for the same query directly from CLI, I mean
>> does the below query return correct results
>> select * from lip_data_quality where dt = '20120709';
>>
>> If the above query returns results, can you check the hive logs and see
>> what is the actual query being executed?
>>
>> Regards,
>> Bejoy KS
>>
>>   ------------------------------
>> *From:* Techy Teck <[EMAIL PROTECTED]>
>> *To:* [EMAIL PROTECTED]
>> *Cc:* Vijay Dirisala <[EMAIL PROTECTED]>
>> *Sent:* Saturday, August 4, 2012 12:11 PM
>> *Subject:* Re: Passing date as command line arguments
>>
>> Thanks Vijay for the suggestion. I also tried that and it still didn't
>> worked for me.
>>
>> Any thoughts why it is not working?
>>
>>
>>
>>
>> On Fri, Aug 3, 2012 at 11:32 PM, Vijay <[EMAIL PROTECTED]> wrote:
>>
>> There can't be a space in the variable name. Try this:
>> ${hiveconf:start_date}
>>
>> On Fri, Aug 3, 2012 at 11:06 PM, Techy Teck <[EMAIL PROTECTED]>
>> wrote:
>> > Can anyone help me out on this?
>> >
>> > I am stuck on this and I have no clue what wrong I am doing?
>> >
>> >
>> >
>> >
>> > On Fri, Aug 3, 2012 at 3:48 PM, Techy Teck <[EMAIL PROTECTED]>
>> wrote:
>> >>
>> >> I have my below query in test1.hql file. I am trying to pass the date
>> (dt)
>> >> as the command line argument.
>> >>
>> >>
>> >> select * from lip_data_quality where dt = '${hiveconf: start_date}';
>> >>
>> >>
>> >> So whenever I try to run the above test1.hql file like this-
>> >>
>> >>  hive -f hivetest1.hql -hiveconf start_date=20120709
>> >>
>> >> I get zero records back. But the data is there in that table for that
>> >> date. Why is it so? Something wrong I am doing?
>> >>
>> >> Can anyone help me out here? I was following Bejoy's Article here
>> >>
>> http://kickstarthadoop.blogspot.com/2011/10/include-values-during-execution-time-in.html
>> >>
>> >>
>> >
>>
>>
>>
>>
>>
>