Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> is there anyway to detect the file size as am i writing a sequence file?


Copy link to this message
-
Re: is there anyway to detect the file size as am i writing a sequence file?
I think you mean Writer.getLength(). It returns the current position
in the output stream in bytes (more or less the current size of the
file).

-Joey

On Tue, Mar 6, 2012 at 9:53 AM, Jane Wayne <[EMAIL PROTECTED]> wrote:
> hi,
>
> i am writing a little util class to recurse into a directory and add all
> *.txt files into a sequence file (key is the file name, value is the
> content of the corresponding text file). as i am writing (i.e.
> SequenceFile.Writer.append(key, value)), is there any way to detect how
> large the sequence file is?
>
> for example, i want to create a new sequence file as soon as the current
> one exceeds 64 MB.
>
> i notice there is a SequenceFile.Writer.getLong() which the javadocs says
> "returns the current length of the output file," but that is vague. what is
> this Writer.getLong() method? is it the number of bytes, kilobytes,
> megabytes, or something else?
>
> thanks,

--
Joseph Echeverria
Cloudera, Inc.
443.305.9434
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB