Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - hadoop fs -tail

Copy link to this message
Re: hadoop fs -tail
Harsh J 2012-09-08, 19:34
We should be able to extend the Tail command to allow a size
specifier. Could you file a JIRA for this?

Although, I don't think the tail prints newlines at every gap unless
there's a newline in the data itself, so your "listener" can perhaps
wait for that?

On Tue, Jul 17, 2012 at 5:19 AM, Sukhendu Chakraborty
> Hi,
> Is there a way to get around the 1KB limitation of the hadoop fs -tail
> command (http://hadoop.apache.org/common/docs/r0.20.0/hdfs_shell.html#tail)?
> In my application some of the records can have length greater than 1KB
> before the newline and I would like to get the full records as part of
> 'tail' (not truncated versions).
> Thanks,
> -Sukhendu

Harsh J