Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: hadoop rumen question


Copy link to this message
-
Re: hadoop rumen question
The usage of Tracebuilder has 3 parameters. I believe you are only putting in 2 and its expecting the second parameter to be a file not a directory.
java org.apache.hadoop.tools.rumen.TraceBuilder [options] <jobtrace-output> <topology-output> <inputs>

See http://hadoop.apache.org/docs/r1.1.1/rumen.html.

Tom

From: 张伟 <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Reply-To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Date: Monday, August 19, 2013 7:15 AM
To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Subject: hadoop rumen question

Now I want to use Gridmix to do some tests. Firstly I should use rumen to generate a job trace file.

I use hadoop 1.0.4. However, when I use the command
hadoop@mastertest:~/hadoop-scheduler/hadoop-1.0.4$ ./bin/hadoop jar hadoop-tools-1.0.4.jar org.apache.hadoop.tools.rumen.TraceBuilder file:///home/hadoop/job-trace.json file:///home/hadoop/hadoop-scheduler/hadoop-1.0.4/logs/history/done

I got the following errors. Can some! one give me some guidance which part brings this problem?

13/08/18 04:03:49 INFO util.NativeCodeLoader: Loaded the native-hadoop library
13/08/18 04:03:49 WARN snappy.LoadSnappy: Snappy native library not loaded
java.io.FileNotFoundException: /home/hadoop/hadoop-scheduler/hadoop-1.0.4/logs/history/done (Is a directory)
        at java.io.FileOutputStream.open(Native Method)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:212)
        at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:188)
        at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:184)
        at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:255! )
        at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:236)
        at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:335)
        at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:381)
        at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:364)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:555)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:536)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:443)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:435)
        at org.apache.hadoop.tools.rumen.DefaultOutputter.init(D! efaultOut putter.java:48)
        at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:194)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:120)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

!
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB