Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Read tmp files from hadoop

Copy link to this message
Re: Read tmp files from hadoop

Do these files start with a period "." or underscore "_" ? Pig/hadoop jobs
ignore these files by default. Is your question about how to read these in
a MR job through a pig script?
On Mon, Apr 8, 2013 at 1:55 AM, Bojan Kostić <[EMAIL PROTECTED]> wrote:

> Hallo, i have setup flume to write my logs on hadoop. But flume creates tmp
> files which i can cat and read using hdfs dfs -cat.
> But when i try to read that data i only get first line.
> Is there a way to read this tmp file?