Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 64 (0.526s).
Loading phrases to help you
refine your search...
Re: hadoop streaming using a java program as mapper - Hadoop - [mail # user]
...Yes, I did, the myMapper.sh is executed, the problem is inside this myMapper.sh, it calls a java program named myJava, the myJava did not get executed on slaves, and I shipped myJava.class t...
   Author: Boyu Zhang, 2012-05-02, 05:25
hadoop streaming using a java program as mapper - Hadoop - [mail # user]
...Hi All,  I am in a little bit strange situation, I am using Hadoop streaming to run a bash shell program myMapper.sh, and in the myMapper.sh, it calls a java program, then a R program, ...
   Author: Boyu Zhang, 2012-05-02, 05:17
the time format of the log files - Hadoop - [mail # user]
...Hi all,  I need to parse the _log/history file to get the running time for map and reduce phases. And the log is in this format:  Task TASKID="task_201109071413_0001_m_000000" TASK...
   Author: Boyu Zhang, 2011-09-07, 21:30
Re: HOD exception: java.io.IOException: No valid local directories in property: mapred.local.dir - Hadoop - [mail # user]
...Thanks a lot for the comments, but I set the mapred.local.dir to /tmp which is a dir on every local machies.  Still I got the same error, and I use the same conf file, with 3 nodes (I h...
   Author: Boyu Zhang, 2011-04-13, 17:51
HOD exception: java.io.IOException: No valid local directories in property: mapred.local.dir - Hadoop - [mail # user]
...Hi All,  I was trying to run the program using HOD on a cluster, when I allocate using 5 nodes, it runs fine, but when I allocate using 6 nodes, everytime I tried to run a program, I ge...
   Author: Boyu Zhang, 2011-04-11, 23:48
Corrupted input data to map - Hadoop - [mail # user]
...Hi all,  I am running a program with input 1 million lines of data, among the 1 million, 5 or 6 lines data are corrupted. The way the are corrupted is: in the position which a float num...
   Author: Boyu Zhang, 2010-10-15, 21:02
Re: nodes with different memory sizes - Hadoop - [mail # user]
...Hi Hemanth,  Thank you for the hints and my apology for the late reply.  I the map/reduce program when I said process. Since the application is memory bounded, so I want the MR pro...
   Author: Boyu Zhang, 2010-10-15, 20:58
Re: nodes with different memory sizes - Hadoop - [mail # user]
...Hi Pablo,  thank you for the reply. Actually I forgot to mention that I am using HOD to provision a hadoop and hdfs on the cluster. There is only one configuration file when I tried to ...
   Author: Boyu Zhang, 2010-10-08, 18:41
nodes with different memory sizes - Hadoop - [mail # user]
...Dear All,  I am trying to run a memory hungry program in a cluster with 6 nodes, among the 6 nodes, 2 of them have 32 G memory, and the rest have 16 G memory. I am wondering is there a ...
   Author: Boyu Zhang, 2010-10-08, 16:17
Re: Passing information to Map Reduce - Hadoop - [mail # user]
...Hi Pete,  Maybe you can set a job configuration entry to the value you want, and get that entry value in the map program.  Boyu  On Fri, Aug 13, 2010 at 3:55 PM, Pete Tyler wr...
   Author: Boyu Zhang, 2010-08-13, 20:22
Sort:
project
Hadoop (64)
type
mail # user (62)
mail # general (2)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (64)
author
Harsh J (1375)
Steve Loughran (931)
Owen O'Malley (816)
Todd Lipcon (756)
Arun C Murthy (575)
Eli Collins (513)
Allen Wittenauer (461)
Doug Cutting (344)
Konstantin Boudnik (335)
Mark Kerzner (334)
Edward Capriolo (328)
Ted Dunning (321)
Brian Bockelman (305)
Tom White (303)
jason hadoop (279)
Boyu Zhang