| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
12 (0.513s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Is there a way to limit # of hadoop tasks per user at runtime? - HDFS - [mail # user]
|
|
...Hi Mehmet, Are you using MR1 or MR2? The fair scheduler, present in both versions, but configured slightly differently, allows you to limit the number of map and reduce tasks in ...
|
|
|
Author: Sandy Ryza,
2013-05-21, 21:57
|
|
|
Re: Automatically mapping a job submitted by a particular user to a specific hadoop map-reduce queue - HDFS - [mail # user]
|
|
...Sagar, I'm glad to hear that it would help. Unfortunately, we are no longer adding features to CDH3, so you would have to upgrade to CDH4 or backport it yourself to use it. ...
|
|
|
Author: Sandy Ryza,
2013-04-26, 18:38
|
|
|
Re: Streaming value of (200MB) from a SequenceFile - HDFS - [mail # user]
|
|
...Hi Rahul, I don't think saving the stream for later use would work - I was just suggesting that if only some aggregate statistics needed to be calculated, they could be calculated at r...
|
|
|
Author: Sandy Ryza,
2013-04-01, 05:59
|
|
|
Re: Yarn communication between containers - HDFS - [mail # user]
|
|
...Hi tmp, YARN doesn't provide an explicit protocol for doing this. Applications are expected to have their own mechanism for communication between task containers, other task cont...
|
|
|
Author: Sandy Ryza,
2013-03-27, 18:52
|
|
|
[HDFS-4620] Documentation for dfs.namenode.rpc-address specifies wrong format - HDFS - [issue]
|
|
...The doc says it's supposed to look like hdfs://nn-host1:rpc-port, when it fact is' supposed to just look like nn-host1:rpc-port...
|
|
|
http://issues.apache.org/jira/browse/HDFS-4620
Author: Sandy Ryza,
2013-03-22, 14:05
|
|
|
Re: Too many open files error with YARN - HDFS - [mail # user]
|
|
...Hi Kishore, 50010 is the datanode port. Does your lsof indicate that the sockets are in CLOSE_WAIT? I had come across an issue like this where that was a symptom. -Sandy &n...
|
|
|
Author: Sandy Ryza,
2013-03-20, 17:39
|
|
|
Re: Question regarding hadoop jar command usage - HDFS - [mail # user]
|
|
...Hi Kay, Yeah, that line does set your jar as the job jar. "hadoop jar" expects java code to configure and submit your job. "mapred job" takes in a job.xml configuration fil...
|
|
|
Author: Sandy Ryza,
2013-03-13, 18:34
|
|
|
Re: Question regarding hadoop jar command usage - HDFS - [mail # user]
|
|
...Hi Kay, The jar is just executed locally. If the jar fires up a mapreduce job and sets itself as the job jar, then mapreduce will handle copying it to the nodes that will use it....
|
|
|
Author: Sandy Ryza,
2013-03-13, 17:14
|
|
|
Re: Transpose - HDFS - [mail # user]
|
|
...Hi, Essentially what you want to do is group your data points by their position in the column, and have each reduce call construct the data for each row into a row. To have each ...
|
|
|
Author: Sandy Ryza,
2013-03-05, 17:27
|
|
|
Re: Accumulo and Mapreduce - HDFS - [mail # user]
|
|
...Hi Aji, Oozie is a mature project for managing MapReduce workflows. http://oozie.apache.org/ -Sandy On Mon, Mar 4, 2013 at 8:17 AM, Justin Woody wrote: ...
|
|
|
Author: Sandy Ryza,
2013-03-04, 18:14
|
|
|
|
