| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
11 (0.227s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Lost tasktracker errors - Hadoop - [mail # general]
|
|
...Hi, I think this issue looks like the jobtracker is running out of RAM, too. "Lost task tracker" is indicative of what I call the "million mapper march". Lots of tasks running per user...
|
|
|
Author: Jeff Bean,
2013-01-07, 21:03
|
|
|
Re: Fixing Mis-replicated blocks - Hadoop - [mail # user]
|
|
...Do setrep -w on the increase to force the new replica before decreasing again. Of course, the little script only works if the replication factor is 3 on all the files. If it's a variab...
|
|
|
Author: Jeff Bean,
2011-10-21, 00:26
|
|
|
Re: [VOTE] Powered by Logo - Hadoop - [mail # general]
|
|
...5,6,2,4,3,1 On Thu, Jun 16, 2011 at 1:27 PM, Eric Baldeschwieler wrote: ...
|
|
|
Author: Jeff Bean,
2011-06-16, 21:12
|
|
|
Re: When does Reduce job start - Hadoop - [mail # user]
|
|
...It's part of the design that reduce() does not get called until the map phase is complete. You're seeing reduce report as started when map is at 90% complete because hadoop is shuffling data...
|
|
|
Author: Jeff Bean,
2011-01-04, 23:14
|
|
|
Re: MapFiles error "Could not obtain block" - Hadoop - [mail # user]
|
|
...Hi Kim, I saw this problem once, turned out the block was getting deleted before it was read. Check namenode for blk_-7027776556206952935_61338. What's the story there? Jeff &nbs...
|
|
|
Author: Jeff Bean,
2010-11-19, 00:14
|
|
|
Re: Hadoop and XML - Hadoop - [mail # general]
|
|
...data.length is the length of the byte array. Text.getLength() most likely returns a different value than getBytes.length. Hadoop reuses box class objects like Text, so what it's ...
|
|
|
Author: Jeff Bean,
2010-07-20, 16:23
|
|
|
Re: Hadoop and XML - Hadoop - [mail # general]
|
|
...I think the problem is here: String valueString = new String(valueText.getBytes(), "UTF-8"); Javadoc for Text says: *getBytes *() Returns...
|
|
|
Author: Jeff Bean,
2010-07-20, 13:01
|
|
|
Re: string conversion problems - Hadoop - [mail # user]
|
|
...Whitespace characters are funny. You showed me this code in the mapper: String [] tokens = line.split(" "); Which doesn't actually match for tab, which would be line...
|
|
|
Author: Jeff Bean,
2010-07-16, 20:33
|
|
|
Re: string conversion problems - Hadoop - [mail # user]
|
|
...Is the tab the delimiter between records or between keys and values on the input? in other words does the input file look like this: a\tb b\tc c\ta or does it look like thi...
|
|
|
Author: Jeff Bean,
2010-07-16, 16:16
|
|
|
Re: calling C programs from Hadoop - Hadoop - [mail # user]
|
|
...Hi Michael, Why did you determine that Hadoop streaming was insufficient for you? Jeff On Mon, May 31, 2010 at 9:17 AM, Michael Robinson wrote: ...
|
|
|
Author: Jeff Bean,
2010-05-31, 16:24
|
|
|
|
