Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Re: Argumments to Hadoop Command


+
Harsh J 2012-11-26, 14:32
Copy link to this message
-
RE: Argumments to Hadoop Command
With the Error: " Output directory hdfs://.com/user/krishna/input already exists" simply delete the output directory perior to runnign the job.

$hadoop fs -rm  "output/file"
-----Original Message-----
From: Harsh J [mailto:[EMAIL PROTECTED]]
Sent: Saturday, November 24, 2012 6:02 AM
To: [EMAIL PROTECTED]; <[EMAIL PROTECTED]>
Subject: Re: Argumments to Hadoop Command

Can you please share your code over pastebin.com or GH gists so?

Also, the mapreduce-dev@ address is for MR project development, not user help. I've moved your question to the proper users list. Please use that going forward :)

On Sat, Nov 24, 2012 at 11:45 AM, L N <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I am trying to run a hadoop command
>
> hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queue-name> input
> output
>
> where input and output are directories.But I get the following error.
>
> WARN mapred.JobClient: Use GenericOptionsParser for parsing the
> arguments. Applications should implement Tool for the same.
> Exception in thread "main"
> org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory
> hdfs://.com/user/krishna/input already exists
>
> If you see it is taking input directory  as output and throwing output
> directory already exists.
>
> if I give below command
>
> hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queuename> output
>
> I get below error.
>
> WARN mapred.JobClient: Use GenericOptionsParser for parsing the
> arguments. Applications should implement Tool for the same.
> Exception in thread "main"
> org.apache.hadoop.mapred.InvalidInputException: Input path does not
> exist: hdfs://com/user/krishna/-Dmapred.job.queue.name=<queuename>
>
> Looks like it is taking -Dmapred.job.queue.name=<queuename> as the
> input directory.
>
> Where am I doing wrong.
> I have implemented tool interface in main class.
>
>
> Thanks
> Lakshmi

--
Harsh J
NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le présent courriel et toute pièce jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur et peuvent être couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le destinataire prévu de ce courriel, supprimez-le et contactez immédiatement l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent courriel
+
L N 2012-11-25, 18:00
+
Harsh J 2012-11-26, 18:42