| clear query|facets|time |
Search criteria: .
Results from 51 to 60 from
65 (0.098s).
|
|
|
Loading phrases to help you refine your search...
|
|
Re: How to control the number of map tasks for each nodes? - Hadoop - [mail # user]
|
|
...Thanks you all for the info. I have successfully configured my cluster. Thanks again. 2010/7/8 edward choi ...
|
|
|
Author: edward choi,
2010-07-09, 01:14
|
|
|
How to control the number of map tasks for each nodes? - Hadoop - [mail # user]
|
|
...Hi, I have a cluster consisting of 11 slaves and a single master. The thing is that 3 of my slaves have i7 cpu which means that they can have up to 8 simultaneous processes. But ...
|
|
|
Author: edward choi,
2010-07-08, 09:07
|
|
|
Re: How do I remove "Non DFS Used"? - Hadoop - [mail # user]
|
|
...Thank you for the responses. But I think I figured out the reason for 800GB of "Non DFS Used" The space was being used by another user who has about 750GB of data files. So after all, ...
|
|
|
Author: edward choi,
2010-07-08, 00:21
|
|
|
How do I remove "Non DFS Used"? - Hadoop - [mail # user]
|
|
...I was looking at the web interface and found that some of my nodes have enormous amount of "Non DFS Used". There is even a node with 800GB of "Non DFS Used" which is just ridiculous. &...
|
|
|
Author: edward choi,
2010-07-07, 08:11
|
|
|
Re: how to figure out the range of a split that failed? - Hadoop - [mail # user]
|
|
...Thanks for the tip. I actually already have tried your method. The command I wrote is like below cerr Y�i��#8;�璽#6;��Fb賃$x좃_�W�L �\F#12;�g#7;i�Ix8#22;#25;���廟別HywK�\Dz觴���U��(����/����...
|
|
|
Author: edward choi,
2010-07-06, 05:07
|
|
|
Re: how to figure out the range of a split that failed? - Hadoop - [mail # user]
|
|
...Thanks for the response. I went to the web page you told me and several other pages that I found. I am still not sure if I got it right. If I am trying to increment COUNTER_MAP_PROCESS_RECOR...
|
|
|
Author: edward choi,
2010-07-05, 04:30
|
|
|
Re: how to figure out the range of a split that failed? - Hadoop - [mail # user]
|
|
...Dear Sharad, I have come across another problem. I hope you can help me with this too. I am trying to use SkipBadRecords feature on Hadoop Streaming. The streaming method I use is: "ha...
|
|
|
Author: edward choi,
2010-07-01, 05:15
|
|
|
Re: how to figure out the range of a split that failed? - Hadoop - [mail # user]
|
|
...Dear Sharad, Oh my God, thank you Sharad. You are my savior. Though the example you've given me is not the exact Hadoop Stream I was looking for, it sure shed light on my problem. Than...
|
|
|
Author: edward choi,
2010-06-30, 11:35
|
|
|
Re: how to figure out the range of a split that failed? - Hadoop - [mail # user]
|
|
...Thanks for the quick response. I know the SkipBadRecords feature but unfortunately I cannot use it since I am running my job on Hadoop Streaming. I had asked if there were any way to use Ski...
|
|
|
Author: edward choi,
2010-06-30, 05:20
|
|
|
how to figure out the range of a split that failed? - Hadoop - [mail # user]
|
|
...hi, I am running a mapreduce job on my hadoop cluster. I am running a 10 gigabytes data and one tiny failed task crashes the whole operation. I am up to 98% complete and throwing...
|
|
|
Author: edward choi,
2010-06-30, 00:30
|
|
|
|