Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # dev >> Review Request 14964: PIG-3047 Check the size of a relation before adding it to distributed cache in Replicated join


Copy link to this message
-
Re: Review Request 14964: PIG-3047 Check the size of a relation before adding it to distributed cache in Replicated join

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14964/
-----------------------------------------------------------

(Updated Oct. 28, 2013, 10:28 p.m.)
Review request for pig, Cheolsoo Park, Daniel Dai, Dmitriy Ryaboy, and Julien Le Dem.
Changes
-------

added documentation.
Bugs: PIG-3047
    https://issues.apache.org/jira/browse/PIG-3047
Repository: pig
Description
-------

-Check the size of a relation before adding it to distributed cache in Replicated join - 1G by default
Diffs (updated)
-----

  trunk/conf/pig.properties 1536246
  trunk/src/docs/src/documentation/content/xdocs/perf.xml 1536246
  trunk/src/org/apache/pig/PigConfiguration.java 1536246
  trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/InputSizeReducerEstimator.java 1536246
  trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java 1536246
  trunk/src/org/apache/pig/backend/hadoop/executionengine/util/MapRedUtil.java 1536246
  trunk/src/org/apache/pig/impl/util/Utils.java 1536246
  trunk/test/org/apache/pig/test/PigStorageWithStatistics.java 1536246
  trunk/test/org/apache/pig/test/TestFRJoin2.java 1536246

Diff: https://reviews.apache.org/r/14964/diff/
Testing
-------
Thanks,

Aniket Mokashi