Pedro Sá da Costa 2013-02-21, 20:11
-Re: who runs the map and reduce tasks in the unit tests
Vinod Kumar Vavilapalli 2013-02-21, 21:07
Not sure which specific tests you are talking about. There are two types of them:
- Real unit tests which unit test code, shouldn't run any MR jobs
- The remaining 'unit' tests are really integration tests. They start MiniMRCluster and MiniDFSCluster (which are basically in-JVM MR and DFS) and submit jobs to them.
+Vinod Kumar Vavilapalli
On Feb 21, 2013, at 12:11 PM, Pedro Sá da Costa wrote:
> In Hadoop MR unit tests, the classes uses the
> ./core/org/apache/hadoop/util/Tool.java, and
> ./core/org/apache/hadoop/util/ToolRunner.java tosubmit the job. But to
> run the unit tests it seems that it's not needed the MR be running. If
> so, who runs the map and reduce tasks?
> Best regards,