| clear query|facets|time |
Search criteria: .
Results from 91 to 100 from
275 (0.093s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Easiest way to pass dynamic variable to Map Class - Hadoop - [mail # user]
|
|
...You can set these in the JobConf when you're creating the MapReduce job, and then read them back in the configure() method of the Mapper class. - Aaron On Mon, Oct 5, 2009 at 4:5...
|
|
|
Author: Aaron Kimball,
2009-10-05, 23:52
|
|
|
Re: Is it OK to run with no secondary namenode? - Hadoop - [mail # user]
|
|
...Quite possible. :\ - A On Thu, Oct 1, 2009 at 5:17 PM, Mayuran Yogarajah wrote: ...
|
|
|
Author: Aaron Kimball,
2009-10-05, 19:23
|
|
|
Re: Is it OK to run with no secondary namenode? - Hadoop - [mail # user]
|
|
...If you want to run the 2NN on a different node than the NN, then you need to set dfs.http.address on the 2NN to point to the namenode's http server address. See http://www.cloudera.com/blog/...
|
|
|
Author: Aaron Kimball,
2009-10-01, 20:34
|
|
|
Re: Prepare input data for Hadoop - Hadoop - [mail # user]
|
|
...Use an external database (e.g., mysql) or some other transactional bookkeeping system to record the state of all your datasets (STAGING, UPLOADED, PROCESSED) - Aaron On Thu, Sep...
|
|
|
Author: Aaron Kimball,
2009-09-22, 22:53
|
|
|
Re: SequenceFileAsBinaryOutputFormat for M/R - Hadoop - [mail # user]
|
|
...In the 0.20 branch, the common best-practice is to use the old API and ignore deprecation warnings. When you get to 0.22, you'll need to convert all your code to use the new API. There...
|
|
|
Author: Aaron Kimball,
2009-09-22, 22:52
|
|
|
Re: RandomAccessFile with HDFS - Hadoop - [mail # user]
|
|
...Or maybe more pessimistically, the second "stable" append implementation. It's not like HADOOP-1700 wasn't intended to work. It was just found not to after the fact. Hopefully this rei...
|
|
|
Author: Aaron Kimball,
2009-09-22, 22:50
|
|
|
Re: copy data (distcp) from local cluster to the EC2 cluster - Hadoop - [mail # user]
|
|
...That's 99% correct. If you want/need to run different versions of HDFS on the two different clusters, then you can't use hdfs:// protocol to access both of them in the same command. In this ...
|
|
|
Author: Aaron Kimball,
2009-09-11, 00:31
|
|
|
Re: Testing Hadoop job - Hadoop - [mail # user]
|
|
...Hi Nikhil, MRUnit now supports the 0.20 API as of https://issues.apache.org/jira/browse/MAPREDUCE-800. There are no plans to involve partitioners in MRUnit; it is for mappers and reduc...
|
|
|
Author: Aaron Kimball,
2009-08-29, 00:50
|
|
|
Re: Help. - Hadoop - [mail # user]
|
|
...Are you trying to serve blocks from a shared directory e.g. NFS? The storageID for a node is recorded in a file named "VERSION" in ${dfs.data.dir}/current. If one node claims that the ...
|
|
|
Author: Aaron Kimball,
2009-08-25, 08:26
|
|
|
Re: localhost:9000 and ip:9000 is not the same ? - Hadoop - [mail # user]
|
|
...Jeff, Hadoop (HDFS in particular) is overly strict about machine names. The filesystem's id is based on the DNS name used to access it. This needs to b e consistent across all nodes an...
|
|
|
Author: Aaron Kimball,
2009-08-25, 00:52
|
|
|
|
