| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
12 (0.117s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Child Error - MapReduce - [mail # user]
|
|
...Hi Jean, thanks for replying. I'm using java 1.7.0_21 on ubuntu. Here is the output: $ java -version java version "1.7.0_21" OpenJDK Runtime Environment (IcedTea 2.3.9) (7u21-2.3.9-0ub...
|
|
|
Author: Jim Twensky,
2013-05-25, 16:32
|
|
|
Re: Child Error - MapReduce - [mail # user]
|
|
...Hi again, in addition to my previous post, I was able to get some error logs from the task tracker/data node this morning and looks like it might be a jetty issue: 2013-05-23 19:59:20,...
|
|
|
Author: Jim Twensky,
2013-05-24, 17:00
|
|
|
Child Error - MapReduce - [mail # user]
|
|
...Hello, I have a 20 node Hadoop cluster where each node has 8GB memory and an 8-core processor. I sometimes get the following error on a random basis: Exception in thread "main" ...
|
|
|
Author: Jim Twensky,
2013-05-24, 00:14
|
|
|
Re: Question on HDFS_BYTES_READ and HDFS_BYTES_WRITTEN - MapReduce - [mail # user]
|
|
...Hello Harsh, Thanks for the useful feedback. You were right. My map tasks open additional files from hdfs. The catch was that I had thousands of map tasks being created and each of the...
|
|
|
Author: Jim Twensky,
2013-05-17, 21:50
|
|
|
Question on HDFS_BYTES_READ and HDFS_BYTES_WRITTEN - MapReduce - [mail # user]
|
|
...I have an iterative MapReduce job that I run over 35 GB of data repeatedly. The output of the first job is the input to the second one and it goes on like that until convergence. I am ...
|
|
|
Author: Jim Twensky,
2013-05-14, 17:11
|
|
|
Re: Wrapping around BitSet with the Writable interface - MapReduce - [mail # user]
|
|
...Thanks for the suggestions. I ended up switching to jdk 1.7+ just to make the code more readable. I will take a look at the EWAH implementation as well. Jim On Sun, May 12, 2013...
|
|
|
Author: Jim Twensky,
2013-05-13, 15:51
|
|
|
Wrapping around BitSet with the Writable interface - MapReduce - [mail # user]
|
|
...I have large java.util.BitSet objects that I want to bitwise-OR using a MapReduce job. I decided to wrap around each object using the Writable interface. Right now I convert each BitSet to a...
|
|
|
Author: Jim Twensky,
2013-05-12, 18:24
|
|
|
Redundant synchronization in ReduceTask.java - MapReduce - [mail # dev]
|
|
...Hi, I have recently been reading Hadoop 1.1.0 source code to better understand the internals and learned a lot from it, so far. When I was looking at ReduceTask.java, I saw some synchr...
|
|
|
Author: Jim Twensky,
2012-12-08, 20:58
|
|
|
Re: Chaning Multiple Reducers: Reduce -> Reduce -> Reduce - MapReduce - [mail # user]
|
|
...Thank you for the comments. Some similar frameworks I looked at include Haloop, Twister, Hama, Giraph and Cascading. I am also doing large scale graph processing so I assumed one of them cou...
|
|
|
Author: Jim Twensky,
2012-10-08, 19:09
|
|
|
Re: Chaning Multiple Reducers: Reduce -> Reduce -> Reduce - MapReduce - [mail # user]
|
|
...Hi Harsh, The hidden map operation which is applied to the reduced partition at one stage can generate keys that are outside of the range covered by that particular reducer. I still ne...
|
|
|
Author: Jim Twensky,
2012-10-05, 18:02
|
|
|
|
