Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # dev - Review Request 18200: HIVE-860 - Persistent distributed cache


Copy link to this message
-
Re: Review Request 18200: HIVE-860 - Persistent distributed cache
Brock Noland 2014-02-20, 22:05

This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18200/

(Updated Feb. 20, 2014, 10:05 p.m.)
Review request for hive.
Changes

Updated based on review.
Bugs: HIVE-860
    https://issues.apache.org/jira/browse/HIVE-860
Repository: hive-git
Description

Caches auxiliary jars and remote runtime jars in /user/$user/.hiveJars by their sha1 hash. This results in:

1) faster queries
2) less distributed cache churn
3) a smaller/cleaner hive-exec jar
Diffs (updated)

  bin/hive 3bd949f
  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java a182cd7
  conf/hive-default.xml.template 0d08aa2
  packaging/src/main/assembly/bin.xml a97ef7d
  ql/pom.xml 53d0b9e
  ql/src/java/org/apache/hadoop/hive/ql/exec/HiveAuxClasspathBuilder.java PRE-CREATION
  ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java 288da8e
  ql/src/java/org/apache/hadoop/hive/ql/exec/mr/JarCache.java PRE-CREATION
  ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapRedTask.java 326654f
  shims/aggregator/pom.xml 7aa8c4c

Diff: https://reviews.apache.org/r/18200/diff/
Testing

Tested manually on a cluster.
Thanks,

Brock Noland