Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Set JobClient properties from hive CLI


Copy link to this message
-
Set JobClient properties from hive CLI
Hi,
 
I am trying to set the property to change the logging interval to more than 5 seconds. Hence I am using the following parameter: jobclient.progress.monitor.poll.interval=5000
 
It works fine when I use it on an Map Reduce -
$ hadoop jar /usr/lib/hadoop-0.20-mapreduce/hadoop-2.0.0-mr1-cdh4.1.3-examples.jar wordcount -Djobclient.progress.monitor.poll.interval=5000  Input wc
13/04/20 03:23:59 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
13/04/20 03:24:00 INFO input.FileInputFormat: Total input paths to process : 1
13/04/20 03:24:00 INFO mapred.JobClient: Running job: job_201304012052_0616
13/04/20 03:24:05 INFO mapred.JobClient:  map 0% reduce 0%
13/04/20 03:24:15 INFO mapred.JobClient:  map 18% reduce 0%
13/04/20 03:24:20 INFO mapred.JobClient:  map 24% reduce 0%
13/04/20 03:24:25 INFO mapred.JobClient:  map 25% reduce 0%
13/04/20 03:24:30 INFO mapred.JobClient:  map 32% reduce 0%
13/04/20 03:24:35 INFO mapred.JobClient:  map 40% reduce 8%
13/04/20 03:24:40 INFO mapred.JobClient:  map 50% reduce 8%
13/04/20 03:24:45 INFO mapred.JobClient:  map 50% reduce 14%
13/04/20 03:24:50 INFO mapred.JobClient:  map 55% reduce 16%

But this property is not working for hive CLI using set or using -hiveconf
 
hive -e "set jobclient.progress.monitor.poll.interval=5000; select count(*) from Table"
OR
hive -hiveconf jobclient.progress.monitor.poll.interval=5000 -e "select count(*) from Table"
 
What am I doing wrong?
 
Thanks,
Sumit.