Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Re: Argumments to Hadoop Command


Copy link to this message
-
Re: Argumments to Hadoop Command
Hi,

Please check http://pastebin.com/phFZgkrQ for a proper version. When
using Tool/Configured, reuse the already prepared configuration (i.e.
getConf()) rather than constructing a new one, otherwise all CLI
parsed options are lost.

On Sun, Nov 25, 2012 at 12:43 AM, L N <[EMAIL PROTECTED]> wrote:
> Hi Harsh,
>
> I pasted the code in pastbin.com. Link is below.
>
> http://pastebin.com/eN1BXuWh
>
> To which DL , do I need to send these questions. Also, please let me
> know to which user list, my post is moved.  I could not find it.
>
> Thanks
> Lakshmi
>
> On Sat, Nov 24, 2012 at 3:02 AM, Harsh J <[EMAIL PROTECTED]> wrote:
>> Can you please share your code over pastebin.com or GH gists so?
>>
>> Also, the mapreduce-dev@ address is for MR project development, not
>> user help. I've moved your question to the proper users list. Please
>> use that going forward :)
>>
>> On Sat, Nov 24, 2012 at 11:45 AM, L N <[EMAIL PROTECTED]> wrote:
>>> Hi,
>>>
>>> I am trying to run a hadoop command
>>>
>>> hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queue-name> input output
>>>
>>> where input and output are directories.But I get the following error.
>>>
>>> WARN mapred.JobClient: Use GenericOptionsParser for parsing the
>>> arguments. Applications should implement Tool for the same.
>>> Exception in thread "main"
>>> org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory
>>> hdfs://.com/user/krishna/input already exists
>>>
>>> If you see it is taking input directory  as output and throwing output
>>> directory already exists.
>>>
>>> if I give below command
>>>
>>> hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queuename> output
>>>
>>> I get below error.
>>>
>>> WARN mapred.JobClient: Use GenericOptionsParser for parsing the
>>> arguments. Applications should implement Tool for the same.
>>> Exception in thread "main"
>>> org.apache.hadoop.mapred.InvalidInputException: Input path does not
>>> exist: hdfs://com/user/krishna/-Dmapred.job.queue.name=<queuename>
>>>
>>> Looks like it is taking -Dmapred.job.queue.name=<queuename> as the
>>> input directory.
>>>
>>> Where am I doing wrong.
>>> I have implemented tool interface in main class.
>>>
>>>
>>> Thanks
>>> Lakshmi
>>
>>
>>
>> --
>> Harsh J

--
Harsh J
+
Kartashov, Andy 2012-11-26, 14:29
+
L N 2012-11-25, 18:00
+
Harsh J 2012-11-26, 18:42