| clear query|facets|time |
Search criteria: .
Results from 1 to 7 from
7 (0.06s).
|
|
|
Loading phrases to help you refine your search...
|
|
Re: basic question about rack awareness and computation migration - HDFS - [mail # user]
|
|
...Yes, I agree with Bertrand. Hadoop can take a whole file as input and you just put your compression code into the map method, and use the identity reduce function that simply writes your com...
|
|
|
Author: Shumin Guo,
2013-03-07, 16:05
|
|
|
Re: Execution handover in map/reduce pipeline - HDFS - [mail # user]
|
|
...Oozie for mapreduce job flow management can be a good choice. It can be too heavy weight for your problem. Based on your description. I am simply assuming that you are processing some ...
|
|
|
Author: Shumin Guo,
2013-03-06, 17:04
|
|
|
Re: For Hadoop 2.0.3; setting CLASSPATH=$(hadoop classpath) does not work, as opposed to 1.x versions - HDFS - [mail # user]
|
|
...You can always print out the hadoop classpath before running the hadoop command, for example by editing the $HADOOP_HOME/bin/hadoop file. HTH. On Wed, Mar 6, 2013 at 5:01 AM, shu...
|
|
|
Author: Shumin Guo,
2013-03-06, 16:40
|
|
|
Re: Issue: Namenode is in safe mode - HDFS - [mail # user]
|
|
...To decommission a live datanode from the cluster, you can do the following steps: 1, edit configuration file $HADOOP_HOME/conf/hdfs-site.xml, and add the following property: dfs....
|
|
|
Author: Shumin Guo,
2013-03-06, 16:30
|
|
|
Re: S3N copy creating recursive folders - HDFS - [mail # user]
|
|
...I used to have similar problem. Looks like there is a recursive folder creation bug. How about you try remove the srcData from the , for example use the following command: *hadoop fs -...
|
|
|
Author: Shumin Guo,
2013-03-06, 16:20
|
|
|
Re: store file gives exception - HDFS - [mail # user]
|
|
...Nitin is right. The hadoop Job tracker will schedule a job based on the data block location and the computing power of the node. Based on the number of data blocks, the job tracker wil...
|
|
|
Author: Shumin Guo,
2013-03-06, 15:34
|
|
|
Re: each stage's time in hadoop - HDFS - [mail # user]
|
|
...You can also try the following two commands: 1, hadoop job -status For example: hadoop job -status job_201303021057_0004 I will get the following output: Job: job_201303021...
|
|
|
Author: Shumin Guo,
2013-03-06, 14:52
|
|
|
|