Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> hadoop fs -tail


Copy link to this message
-
Re: hadoop fs -tail
We should be able to extend the Tail command to allow a size
specifier. Could you file a JIRA for this?

Although, I don't think the tail prints newlines at every gap unless
there's a newline in the data itself, so your "listener" can perhaps
wait for that?

On Tue, Jul 17, 2012 at 5:19 AM, Sukhendu Chakraborty
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> Is there a way to get around the 1KB limitation of the hadoop fs -tail
> command (http://hadoop.apache.org/common/docs/r0.20.0/hdfs_shell.html#tail)?
> In my application some of the records can have length greater than 1KB
> before the newline and I would like to get the full records as part of
> 'tail' (not truncated versions).
>
> Thanks,
> -Sukhendu

--
Harsh J