Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Debuging hadoop core


Copy link to this message
-
Re: Debuging hadoop core
Find hadoop-site.xml which Eclipse claimed was in your classpath.
In the same directory, look for core-site.xml and add the following:
<property>
  <name>fs.default.name</name>
  <value>hdfs://sjc9-flash-grid04.ciq.com:9000</value>

On Tue, Jul 13, 2010 at 3:07 PM, Pramy Bhats <[EMAIL PROTECTED]>wrote:

> Hi,
>
> I am trying to debug the new built hadoop-core-dev.jar in Eclipse. To
> simplify the debug process, firstly I setup the Hadoop in single-node mode
> on my localhost.
>
>
> a)  configure debug in eclipse,
>
>    under tab main:
>      project : hadoop-all
>      main-class: org.apache.hadoop.util.RunJar
>
>   under tab arguments:
>
>   program arguments: <absolute path for wordcount jar file>/wordcount.jar
>  org.wordcount.WordCount   <input-text-file-already-in-hdfs> (text)
>  <desired-output-file> (output)
>   VM arguments: -Xmx256M
>
>
>  under tab classpath:
>
>  user entries :  add external jar  ( hadoop-0.20.3-core-dev.jar ) ==> so
> that I can debug my new built hadoop core jar.
>
>
> under tab source:
>
>  I add the source file folder for the wordcount example ( in order lookup
> for the debug process).
>
>
> I apply these configuration and start debug process.
>
>
> b)  the debugging works fine, and i can perform all operations for debug.
> However, i get following problem
>
> 2010-07-14 00:02:15,816 WARN  conf.Configuration
> (Configuration.java:<clinit>(176)) - DEPRECATED: hadoop-site.xml found in
> the classpath. Usage of hadoop-site.xml is deprecated. Instead use
> core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of
> core-default.xml, mapred-default.xml and hdfs-default.xml respectively
> 2010-07-14 00:02:16,535 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) -
> Initializing JVM Metrics with processName=JobTracker, sessionId> Exception in thread "main"
> org.apache.hadoop.mapreduce.lib.input.InvalidInputException: *Input path
> does not exist: file:/home/hadoop/code/hadoop-0.20.2/text*
> at
>
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:224)
> at
>
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.selfadjust.wordcount.WordCount.run(WordCount.java:32)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.selfadjust.wordcount.WordCount.main(WordCount.java:43)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
>
> However, the file named "text" is the file already stored in the hdfs.
>
>
> Could you please help me with debugging process here, any pointers to the
> debugging environment would be very helpful.
>
>
> thanks,
>
> --PB
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB