|
|
-
Re: Argumments to Hadoop CommandHarsh J 2012-11-26, 20:49
Can you please share your "same error" again? There are two errors on
your original post - the latter should no longer occur at the very least. On Tue, Nov 27, 2012 at 2:17 AM, L N <[EMAIL PROTECTED]> wrote: > Hi Harsh, > > Still I get the same error with your modified code. > > Hi Andy, > > It says output directory "input" does not exist. It is not properly taking > the arguments > > > Thanks > Lakshmi > > On Mon, Nov 26, 2012 at 10:42 AM, Harsh J <[EMAIL PROTECTED]> wrote: >> >> I remember responding with a proper answer earlier, but here it goes >> again anyway: >> >> """ >> Hi, >> >> Please check http://pastebin.com/phFZgkrQ for a proper version. When >> using Tool/Configured, reuse the already prepared configuration (i.e. >> getConf()) rather than constructing a new one, otherwise all CLI >> parsed options are lost. >> """ >> >> On Sun, Nov 25, 2012 at 11:30 PM, L N <[EMAIL PROTECTED]> wrote: >> > >> > Hi, >> > >> > I am trying to run a hadoop command >> > >> > hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queue-name> input >> > output >> > >> > where input and output are directories.But I get the following error. >> > >> > WARN mapred.JobClient: Use GenericOptionsParser for parsing the >> > arguments. Applications should implement Tool for the same. >> > Exception in thread "main" >> > org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory >> > hdfs://.com/user/krishna/input already exists >> > >> > If you see it is taking input directory as output and throwing output >> > directory already exists. >> > >> > if I give below command >> > >> > hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queuename> output >> > >> > I get below error. >> > >> > WARN mapred.JobClient: Use GenericOptionsParser for parsing the >> > arguments. Applications should implement Tool for the same. >> > Exception in thread "main" >> > org.apache.hadoop.mapred.InvalidInputException: Input path does not >> > exist: hdfs://com/user/krishna/-Dmapred.job.queue.name=<queuename> >> > >> > Looks like it is taking -Dmapred.job.queue.name=<queuename> as the >> > input directory. >> > >> > Where am I doing wrong. >> > I have implemented tool interface in main class. >> > >> > I pasted the code in pastbin.com. Link is below. >> > >> > http://pastebin.com/eN1BXuWh >> > >> > >> > Thanks >> > Lakshmi >> > >> >> >> >> -- >> Harsh J > > -- Harsh J |