Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Re: Number of records in an HDFS file


Copy link to this message
-
Re: Number of records in an HDFS file
Rahul Bhattacharjee 2013-05-13, 18:04
few pointers.

what kind of files are we talking about. for text you can use wc , for avro
data files you can use avro-tools.

or get the job that pig is generating , get the counters for that job from
the jt of your hadoop cluster.

Thanks,
Rahul
On Mon, May 13, 2013 at 11:21 PM, Mix Nin <[EMAIL PROTECTED]> wrote:

> Hello,
>
> What is the bets way to get the count of records in an HDFS file generated
> by a PIG script.
>
> Thanks
>
>