| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
26 (0.121s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Mapreduce - HDFS - [mail # user]
|
|
...As this is a HBase specific question, it will be better to ask this question on the HBase user mailing list. Thanks Hemanth On Fri, Apr 19, 2013 at 10:46 PM, Adrian Acosta Mitja...
|
|
|
Author: Hemanth Yamijala,
2013-04-20, 10:24
|
|
|
Re: Find reducer for a key - HDFS - [mail # user]
|
|
...Hi, The way I understand your requirement - you have a file that contains a set of keys. You want to read this file on every reducer and take only those entries of the set, whose keys ...
|
|
|
Author: Hemanth Yamijala,
2013-03-29, 03:47
|
|
|
Re: Find reducer for a key - HDFS - [mail # user]
|
|
...Hmm. That feels like a join. Can't you read the input file on the map side and output those keys along with the original map output keys.. That way the reducer would automatically get both t...
|
|
|
Author: Hemanth Yamijala,
2013-03-28, 12:12
|
|
|
Re: Find reducer for a key - HDFS - [mail # user]
|
|
...Hi, Not sure if I am answering your question, but this is the background. Every MapReduce job has a partitioner associated to it. The default partitioner is a HashPartitioner. You can ...
|
|
|
Author: Hemanth Yamijala,
2013-03-28, 10:01
|
|
|
Re: Child JVM memory allocation / Usage - HDFS - [mail # user]
|
|
...Couple of things to check: Does your class com.hadoop.publicationMrPOC.Launcher implement the Tool interface ? You can look at an example at ( http://hadoop.apache.org/docs/r1.0.4/mapr...
|
|
|
Author: Hemanth Yamijala,
2013-03-27, 08:59
|
|
|
Re: Child JVM memory allocation / Usage - HDFS - [mail # user]
|
|
...Hi, I tried to use the -XX:+HeapDumpOnOutOfMemoryError. Unfortunately, like I suspected, the dump goes to the current work directory of the task attempt as it executes on the cluster. ...
|
|
|
Author: Hemanth Yamijala,
2013-03-26, 15:53
|
|
|
Re: Child JVM memory allocation / Usage - HDFS - [mail # user]
|
|
...Hi, One option to find what could be taking the memory is to use jmap on the running task. The steps I followed are: - I ran a sleep job (which comes in the examples jar of the d...
|
|
|
Author: Hemanth Yamijala,
2013-03-26, 04:42
|
|
|
Re: Too many open files error with YARN - HDFS - [mail # user]
|
|
...There was an issue related to hung connections (HDFS-3357). But the JIRA indicates the fix is available in Hadoop-2.0.0-alpha. Still, would be worth checking on Sandy's suggestion On ...
|
|
|
Author: Hemanth Yamijala,
2013-03-21, 04:27
|
|
|
Re: hadoop cluster not working - HDFS - [mail # user]
|
|
...Hi, This line in your exception message: "Exception in thread "main" java.io.IOException: Call to localhost/ 127.0.0.1:54311 failed on local exception: java.io.IOException: Connection ...
|
|
|
Author: Hemanth Yamijala,
2013-03-12, 11:14
|
|
|
Re: Hadoop efficient resource isolation - HDFS - [mail # user]
|
|
...Supporting a multiuser scenario like this is always hard under Hadoop. There are a few configuration knobs that offer some administrative control and protection. Specifically for the p...
|
|
|
Author: Hemanth Yamijala,
2013-02-21, 16:51
|
|
|
|
