Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> How Can I store the Hive query result in one file ?


Copy link to this message
-
Re: How Can I store the Hive query result in one file ?
 

 hive > set hive.io.output.fileformat=CSVTextFile;
 hive > insert overwrite local directory '/usr/home/hadoop/da1/' select * from customers

*** customers is a Hive table
________________________________
 From: Edward Capriolo <[EMAIL PROTECTED]>
To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
Sent: Friday, July 5, 2013 12:10 AM
Subject: Re: How Can I store the Hive query result in one file ?
 
Normally if use set mapred.reduce.tasks=1 you get one output file. You can also look at
hive.merge.mapfiles, mapred.reduce.tasks, hive.merge.reducefiles also you can use a separate tool https://github.com/edwardcapriolo/filecrush
On Thu, Jul 4, 2013 at 6:38 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote:

will hive -e "query" > filename  or hive -f query.q > filename will do ? 
>
>
>you specially want it to write into a named file on hdfs only? 
>
>
>
>On Thu, Jul 4, 2013 at 3:12 PM, Matouk IFTISSEN <[EMAIL PROTECTED]> wrote:
>
>Hello Hive users,
>>Is there a manner to store the Hive  query result (SELECT *.....) in a specfique  and alone file (given the file name) like (INSERT OVERWRITE LOCAL DIRECTORY '/directory_path_name/')?
>>Thanks for your answers
>>
>>
>>
>
>
>
>--
>Nitin Pawar
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB