| clear query|facets|time |
Search criteria: .
Results from 1 to 5 from
5 (0.077s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: map reduce and sync - MapReduce - [mail # user]
|
|
...Ok, so I found a workaround for this issue, I share it here for others: So the key problem is that hadoop won't update the file size until the file is closed, then the FileInputFormat will s...
|
|
|
Author: Lucas Bernardi,
2013-03-04, 16:09
|
|
|
Re: map reduce and sync - MapReduce - [mail # user]
|
|
...It looks like getSplits in FileInputFormat is ignoring 0 lenght files.... That also would explain the weird behavior of tail, which seems to always jump to the start since file length is 0. ...
|
|
|
Author: Lucas Bernardi,
2013-02-25, 22:03
|
|
|
Re: map reduce and sync - MapReduce - [mail # user]
|
|
...Yeah I looked at scribe, looks good but sounds like too much for my problem. I'd rather make it work the simple way. Could you pleas post your code, may be I'm doing something wrong on the s...
|
|
|
Author: Lucas Bernardi,
2013-02-25, 01:46
|
|
|
Re: map reduce and sync - MapReduce - [mail # user]
|
|
...Helo Hemanth, thanks for answering. The file is open by a separate process not map reduce related at all. You can think of it as a servlet, receiving requests, and writing them to this file,...
|
|
|
Author: Lucas Bernardi,
2013-02-23, 13:45
|
|
|
map reduce and sync - MapReduce - [mail # user]
|
|
...Hello there, I'm trying to use hadoop map reduce to process an open file. The writing process, writes a line to the file and syncs the file to readers. (org.apache.hadoop.fs.FSDataOutputStre...
|
|
|
Author: Lucas Bernardi,
2013-02-21, 21:17
|
|
|
|
