Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Debug MR tasks impossible.


Copy link to this message
-
Re: Debug MR tasks impossible.
Can I suggest unit testing with MRUnit:

https://cwiki.apache.org/confluence/display/MRUNIT/Index
https://cwiki.apache.org/confluence/display/MRUNIT/MRUnit+Tutorial

Brock

On Thu, Mar 29, 2012 at 10:33 AM, Pedro Costa <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I'm trying to debug map and reduce tasks for a quite long time, and it seems
> that it's impossible. MR are launched in new process and there's no way to
> debug them. Even with IsolationRunner class it's impossible. This isn't good
> because I really need to debug the class, to understand some changes that I
> made to the code.
>
> I wonder how MapReduce programmers could debug the code that they
> implemented?
>
> --
> Best regards,
>

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB