Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Debugging Map-Reduce programs


Copy link to this message
-
Re: Debugging Map-Reduce programs
bharath vissapragada 2009-06-16, 01:49
I am running in a local mode . Can you tell me how to set those breakpoints
or how to access those files so that i can debug the program.

The program is generating  => java.lang.NumberFormatException: For input
string: ""

But that particular string is the one which is the input to the mapclass .
So I think that it is not reading my input correctly .. But when i try to
print the same .. it isn't printing to the STDOUT ..
Iam using the FileInputFormat class

 FileInputFormat.addInputPath(conf, new
Path("/home/rip/Desktop/hadoop-0.18.3/input"));
FileOutputFormat.setOutputPath(conf, new
Path("/home/rip/Desktop/hadoop-0.18.3/output"));

input and output are folders for inp and outpt.

It is generating these warnings also

09/06/16 12:38:32 WARN fs.FileSystem: "local" is a deprecated filesystem
name. Use "file:///" instead.

Thanks in advance
On Tue, Jun 16, 2009 at 3:50 AM, Aaron Kimball <[EMAIL PROTECTED]> wrote:

> On Mon, Jun 15, 2009 at 10:01 AM, bharath vissapragada <
> [EMAIL PROTECTED]> wrote:
>
> > Hi all ,
> >
> > When running hadoop in local mode .. can we use "print" statements to
> print
> > something to the terminal ...
>
>
> Yes. In distributed mode, each task will write its stdout/stderr to files
> which you can access through the web-based interface.
>
>
> >
> > Also iam not sure whether the program is reading my input files ... If i
> > keep print statements it isn't displaying any .. can anyone tell me how
> to
> > solve this problem.
>
>
> Is it generating exceptions? Are the files present? If you're running in
> local mode, you can use a debugger; set a breakpoint in your map() method
> and see if it gets there. How are you configuring the input files for your
> job?
>
>
> >
> >
> > Thanks in adance,
> >
>