Hive, mail # user - Re: Issue with Hive and table with lots of column - 2014-01-31, 19:50
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
Re: Issue with Hive and table with lots of column
Excellent progress David.   So.  What the most important thing here we
learned was that it works (!) by running hive in local mode and that this
error is a limitation in the HiveServer2.  That's important.

so textfile storage handler and having issues converting it to ORC. hmmm.

follow-ups.

1. what is your query that fails?

2. can you add a "limit 1" to the end of your query and tell us if that
works? this'll tell us if it's column or row bound.

3. bonus points. run these in local mode:
      > set hive.exec.compress.output=true;
      > set mapred.output.compression.type=BLOCK;
      > set
mapred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec;
      > create table blah stored as ORC as select * from <your table>;
#i'm curious if this'll work.
      > show create table blah;  #send output back if previous step worked.

4. extra bonus.  change ORC to SEQUENCEFILE in #3 see if that works any
differently.

I'm wondering if compression would have any effect on the size of the
internal ArrayList the thrift server uses.

On Fri, Jan 31, 2014 at 9:21 AM, David Gayou <[EMAIL PROTECTED]> wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB