Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - map reduce and sync


+
Lucas Bernardi 2013-02-21, 21:17
Copy link to this message
-
Re: map reduce and sync
Hemanth Yamijala 2013-02-23, 07:37
Could you please clarify, are you opening the file in your mapper code and
reading from there ?

Thanks
Hemanth

On Friday, February 22, 2013, Lucas Bernardi wrote:

> Hello there, I'm trying to use hadoop map reduce to process an open file. The
> writing process, writes a line to the file and syncs the file to readers.
> (org.apache.hadoop.fs.FSDataOutputStream.sync()).
>
> If I try to read the file from another process, it works fine, at least
> using
> org.apache.hadoop.fs.FSDataInputStream.
>
> hadoop -fs -tail also works just fine
>
> But it looks like map reduce doesn't read any data. I tried using the word
> count example, same thing, it is like if the file were empty for the map
> reduce framework.
>
> I'm using hadoop 1.0.3. and pig 0.10.0
>
> I need some help around this.
>
> Thanks!
>
> Lucas
>
+
Lucas Bernardi 2013-02-23, 13:45
+
Hemanth Yamijala 2013-02-23, 14:54
+
Hemanth Yamijala 2013-02-25, 01:31
+
Lucas Bernardi 2013-02-25, 01:46
+
Harsh J 2013-02-25, 07:31
+
Lucas Bernardi 2013-02-25, 22:03
+
Lucas Bernardi 2013-03-04, 16:09