| clear query|facets|time |
Search criteria: .
Results from 71 to 80 from
148 (0.089s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Adding nodes - Hadoop - [mail # user]
|
|
...On Thu, Mar 1, 2012 at 4:46 PM, Joey Echeverria wrote: communicates with namenode using master file? Sent from my iPhone...
|
|
|
Author: Mohit Anchlia,
2012-03-02, 00:49
|
|
|
Adding nodes - Hadoop - [mail # user]
|
|
...Is this the right procedure to add nodes? I took some from hadoop wiki FAQ: http://wiki.apache.org/hadoop/FAQ 1. Update conf/slave 2. on the slave nodes start datanode and tasktr...
|
|
|
Author: Mohit Anchlia,
2012-03-02, 00:29
|
|
|
kill -QUIT - Hadoop - [mail # user]
|
|
...When I try kill -QUIT for a job it doesn't send the stacktrace to the log files. Does anyone know why or if I am doing something wrong? I find the job using ps -ef|grep "attempt". I th...
|
|
|
Author: Mohit Anchlia,
2012-03-01, 20:50
|
|
|
Re: Invocation exception - Hadoop - [mail # user]
|
|
...Thanks for the example. I did look at the logs and also at the admin page and all I see is the exception that I posted initially. I am not sure why adding an extra jar to the classpath...
|
|
|
Author: Mohit Anchlia,
2012-02-29, 23:49
|
|
|
Re: 100x slower mapreduce compared to pig - Hadoop - [mail # user]
|
|
...I think I've found the problem. There was one line of code that caused this issue :) that was output.collect(key, value); I had to add more logging to the code to get to it. For ...
|
|
|
Author: Mohit Anchlia,
2012-02-29, 21:49
|
|
|
Re: 100x slower mapreduce compared to pig - Hadoop - [mail # user]
|
|
...I can't seem to find what's causing this slowness. Nothing in the logs. It's just painfuly slow. However, pig job is awesome in performance that has the same logic. Here is the mapper code a...
|
|
|
Author: Mohit Anchlia,
2012-02-29, 21:08
|
|
|
Re: 100x slower mapreduce compared to pig - Hadoop - [mail # user]
|
|
...I am going to try few things today. I have a JAXBContext object that marshals the xml, this is static instance but my guess at this point is that since this is in separate jar then the one w...
|
|
|
Author: Mohit Anchlia,
2012-02-29, 17:27
|
|
|
100x slower mapreduce compared to pig - Hadoop - [mail # user]
|
|
...I am comparing runtime of similar logic. The entire logic is exactly same but surprisingly map reduce job that I submit is 100x slow. For pig I use udf and for hadoop I use mapper only and t...
|
|
|
Author: Mohit Anchlia,
2012-02-29, 00:11
|
|
|
Re: Invocation exception - Hadoop - [mail # user]
|
|
...It looks like adding this line causes invocation exception. I looked in hdfs and I see that file in that path DistributedCache.*addFileToClassPath*(*new* Path("/jars/common.jar"), conf...
|
|
|
Author: Mohit Anchlia,
2012-02-28, 20:10
|
|
|
Re: Invocation exception - Hadoop - [mail # user]
|
|
...I commented reducer and combiner both and still I see the same exception. Could it be because I have 2 jars being added? On Mon, Feb 27, 2012 at 8:23 PM, Subir S wrote: ...
|
|
|
Author: Mohit Anchlia,
2012-02-28, 19:44
|
|
|
|
