| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
18 (0.169s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Naïve k-means using hadoop - MapReduce - [mail # user]
|
|
...Thanks! *Bertrand*: I don't like the idea of using a single reducer. A better way for me is to write all the output of all the reducers to the same directory, and then distribute all the fil...
|
|
|
Author: Yaron Gonen,
2013-03-27, 13:04
|
|
|
Re: InputFormat for some REST api - MapReduce - [mail # user]
|
|
...Thanks, and excellent points. I just wanted to know if someone is working this way and if it is a common use-case. On Tue, Feb 19, 2013 at 7:39 PM, Mohammad Tariq wrote: ...
|
|
|
Author: Yaron Gonen,
2013-02-19, 19:28
|
|
|
InputFormat for some REST api - MapReduce - [mail # user]
|
|
...Hi, Do you know of any InputFormat implemented for some REST api provider? Usually when one needs to process data that is accessible only by REST, one should try to download the data first s...
|
|
|
Author: Yaron Gonen,
2013-02-19, 10:49
|
|
|
RE: Profiling the Mapper using hprof on Hadoop 0.20.205 - MapReduce - [mail # user]
|
|
...I tried various range values. I'm not even seeing the map method and the recordreader methods. On Feb 7, 2013 3:58 AM, "java8964 java8964" wrote: ...
|
|
|
Author: Yaron Gonen,
2013-02-07, 04:47
|
|
|
Profiling the Mapper using hprof on Hadoop 0.20.205 - MapReduce - [mail # user]
|
|
...Hi, I wish to profile my mapper, so I've set the properties mapred.task.profileand mapred.task.profile.maps in mapred-site.xml. At the end of the job I'm getting a profile.out file, however ...
|
|
|
Author: Yaron Gonen,
2013-02-06, 21:50
|
|
|
Re: Some general questions about DBInputFormat - MapReduce - [mail # user]
|
|
...Hi again Nick, DBInputFormat does use Connection.TRANSACTION_SERIALIZABLE, but this a per connection attribute. Since every mapper has its own connection, and every connection is opened in a...
|
|
|
Author: Yaron Gonen,
2012-09-12, 13:54
|
|
|
Some general questions about DBInputFormat - MapReduce - [mail # user]
|
|
...Hi, After reviewing the class's (not very complicated) code, I have some questions I hope someone can answer: - (more general question) Are there many use-cases for using ...
|
|
|
Author: Yaron Gonen,
2012-09-11, 12:41
|
|
|
Re: How to debug - MapReduce - [mail # user]
|
|
...Hi, First, add the following to mapred-site.xml : mapred.child.java.opts -Xmx512m -Xdebug -Xrunjdwp:transport=dt_socket,address 127.0.0.1:9987,suspend=y Now. add a ...
|
|
|
Author: Yaron Gonen,
2012-08-26, 07:06
|
|
|
Re: Keeping Map-Tasks alive - MapReduce - [mail # user]
|
|
...Thanks. As I see it, it cannot be done in the MapReduce 1 framework without changing TaskTracker and JobTracker. Problem is I'm not familiar at all with YARN... it might be possible there. T...
|
|
|
Author: Yaron Gonen,
2012-08-06, 07:23
|
|
|
Re: Keeping Map-Tasks alive - MapReduce - [mail # user]
|
|
...Thanks for the fast reply, but I don't see how a custom record reader will help. Consider again the k-means: the mappers need to stand-by until all the reducers finish to calculate the new c...
|
|
|
Author: Yaron Gonen,
2012-08-05, 18:41
|
|
|
|
