-Re: hadoop fs -tail
Harsh J 2012-09-08, 19:34
We should be able to extend the Tail command to allow a size
specifier. Could you file a JIRA for this?
Although, I don't think the tail prints newlines at every gap unless
there's a newline in the data itself, so your "listener" can perhaps
wait for that?
On Tue, Jul 17, 2012 at 5:19 AM, Sukhendu Chakraborty
<[EMAIL PROTECTED]> wrote:
> Is there a way to get around the 1KB limitation of the hadoop fs -tail
> command (http://hadoop.apache.org/common/docs/r0.20.0/hdfs_shell.html#tail)?
> In my application some of the records can have length greater than 1KB
> before the newline and I would like to get the full records as part of
> 'tail' (not truncated versions).