Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> map reduce and sync


Copy link to this message
-
map reduce and sync
Hello there, I'm trying to use hadoop map reduce to process an open file. The
writing process, writes a line to the file and syncs the file to readers.
(org.apache.hadoop.fs.FSDataOutputStream.sync()).

If I try to read the file from another process, it works fine, at least
using
org.apache.hadoop.fs.FSDataInputStream.

hadoop -fs -tail also works just fine

But it looks like map reduce doesn't read any data. I tried using the word
count example, same thing, it is like if the file were empty for the map
reduce framework.

I'm using hadoop 1.0.3. and pig 0.10.0

I need some help around this.

Thanks!

Lucas
+
Hemanth Yamijala 2013-02-23, 07:37
+
Lucas Bernardi 2013-02-23, 13:45
+
Hemanth Yamijala 2013-02-23, 14:54
+
Hemanth Yamijala 2013-02-25, 01:31
+
Lucas Bernardi 2013-02-25, 01:46
+
Harsh J 2013-02-25, 07:31
+
Lucas Bernardi 2013-02-25, 22:03
+
Lucas Bernardi 2013-03-04, 16:09