Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Re: Argumments to Hadoop Command


Copy link to this message
-
Re: Argumments to Hadoop Command
Can you please share your "same error" again? There are two errors on
your original post - the latter should no longer occur at the very
least.

On Tue, Nov 27, 2012 at 2:17 AM, L N <[EMAIL PROTECTED]> wrote:
> Hi Harsh,
>
> Still I get the same error with your modified code.
>
> Hi Andy,
>
> It says  output directory "input" does not exist. It is  not properly taking
> the arguments
>
>
> Thanks
> Lakshmi
>
> On Mon, Nov 26, 2012 at 10:42 AM, Harsh J <[EMAIL PROTECTED]> wrote:
>>
>> I remember responding with a proper answer earlier, but here it goes
>> again anyway:
>>
>> """
>> Hi,
>>
>> Please check http://pastebin.com/phFZgkrQ for a proper version. When
>> using Tool/Configured, reuse the already prepared configuration (i.e.
>> getConf()) rather than constructing a new one, otherwise all CLI
>> parsed options are lost.
>> """
>>
>> On Sun, Nov 25, 2012 at 11:30 PM, L N <[EMAIL PROTECTED]> wrote:
>> >
>> > Hi,
>> >
>> >  I am trying to run a hadoop command
>> >
>> >  hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queue-name> input
>> > output
>> >
>> >  where input and output are directories.But I get the following error.
>> >
>> >  WARN mapred.JobClient: Use GenericOptionsParser for parsing the
>> >  arguments. Applications should implement Tool for the same.
>> >  Exception in thread "main"
>> >  org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory
>> >  hdfs://.com/user/krishna/input already exists
>> >
>> >  If you see it is taking input directory  as output and throwing output
>> >  directory already exists.
>> >
>> >  if I give below command
>> >
>> >  hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queuename> output
>> >
>> >  I get below error.
>> >
>> >  WARN mapred.JobClient: Use GenericOptionsParser for parsing the
>> >  arguments. Applications should implement Tool for the same.
>> >  Exception in thread "main"
>> >  org.apache.hadoop.mapred.InvalidInputException: Input path does not
>> >  exist: hdfs://com/user/krishna/-Dmapred.job.queue.name=<queuename>
>> >
>> >  Looks like it is taking -Dmapred.job.queue.name=<queuename> as the
>> >  input directory.
>> >
>> >  Where am I doing wrong.
>> >  I have implemented tool interface in main class.
>> >
>> > I pasted the code in pastbin.com. Link is below.
>> >
>> > http://pastebin.com/eN1BXuWh
>> >
>> >
>> >  Thanks
>> >  Lakshmi
>> >
>>
>>
>>
>> --
>> Harsh J
>
>

--
Harsh J
+
Harsh J 2012-11-24, 11:02
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB