Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> order by throwing exception in cluster


+
Irooniam 2011-05-13, 19:37
Copy link to this message
-
Re: order by throwing exception in cluster
The exception stack has LocalJobRunner, that is strange.
Have you specified the cmd line option "-x mapreduce" ? Is the hadoop conf dir in class path?
-Thejas

On 5/13/11 12:37 PM, "Irooniam" <[EMAIL PROTECTED]> wrote:

Hello,

I'm running into a weird problem that I'm hoping you can help me with.

I'm basically just loading a access log, grouping,  ordering and then
dumping the data.

I can load the log, group and order when I'm in local mode, but when I try
to do the same in the hadoop cluster I always get a error with the 'order
by' clause.

..

.java:117)
    at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:559)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:638)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322)
    at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException:
Input path does not exist:
--