Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: Argumments to Hadoop Command


Copy link to this message
-
Re: Argumments to Hadoop Command
Can you please share your "same error" again? There are two errors on
your original post - the latter should no longer occur at the very
least.

On Tue, Nov 27, 2012 at 2:17 AM, L N <[EMAIL PROTECTED]> wrote:
> Hi Harsh,
>
> Still I get the same error with your modified code.
>
> Hi Andy,
>
> It says  output directory "input" does not exist. It is  not properly taking
> the arguments
>
>
> Thanks
> Lakshmi
>
> On Mon, Nov 26, 2012 at 10:42 AM, Harsh J <[EMAIL PROTECTED]> wrote:
>>
>> I remember responding with a proper answer earlier, but here it goes
>> again anyway:
>>
>> """
>> Hi,
>>
>> Please check http://pastebin.com/phFZgkrQ for a proper version. When
>> using Tool/Configured, reuse the already prepared configuration (i.e.
>> getConf()) rather than constructing a new one, otherwise all CLI
>> parsed options are lost.
>> """
>>
>> On Sun, Nov 25, 2012 at 11:30 PM, L N <[EMAIL PROTECTED]> wrote:
>> >
>> > Hi,
>> >
>> >  I am trying to run a hadoop command
>> >
>> >  hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queue-name> input
>> > output
>> >
>> >  where input and output are directories.But I get the following error.
>> >
>> >  WARN mapred.JobClient: Use GenericOptionsParser for parsing the
>> >  arguments. Applications should implement Tool for the same.
>> >  Exception in thread "main"
>> >  org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory
>> >  hdfs://.com/user/krishna/input already exists
>> >
>> >  If you see it is taking input directory  as output and throwing output
>> >  directory already exists.
>> >
>> >  if I give below command
>> >
>> >  hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queuename> output
>> >
>> >  I get below error.
>> >
>> >  WARN mapred.JobClient: Use GenericOptionsParser for parsing the
>> >  arguments. Applications should implement Tool for the same.
>> >  Exception in thread "main"
>> >  org.apache.hadoop.mapred.InvalidInputException: Input path does not
>> >  exist: hdfs://com/user/krishna/-Dmapred.job.queue.name=<queuename>
>> >
>> >  Looks like it is taking -Dmapred.job.queue.name=<queuename> as the
>> >  input directory.
>> >
>> >  Where am I doing wrong.
>> >  I have implemented tool interface in main class.
>> >
>> > I pasted the code in pastbin.com. Link is below.
>> >
>> > http://pastebin.com/eN1BXuWh
>> >
>> >
>> >  Thanks
>> >  Lakshmi
>> >
>>
>>
>>
>> --
>> Harsh J
>
>

--
Harsh J