Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - is there anyway to detect the file size as am i writing a sequence file?


Copy link to this message
-
is there anyway to detect the file size as am i writing a sequence file?
Jane Wayne 2012-03-06, 14:53
hi,

i am writing a little util class to recurse into a directory and add all
*.txt files into a sequence file (key is the file name, value is the
content of the corresponding text file). as i am writing (i.e.
SequenceFile.Writer.append(key, value)), is there any way to detect how
large the sequence file is?

for example, i want to create a new sequence file as soon as the current
one exceeds 64 MB.

i notice there is a SequenceFile.Writer.getLong() which the javadocs says
"returns the current length of the output file," but that is vague. what is
this Writer.getLong() method? is it the number of bytes, kilobytes,
megabytes, or something else?

thanks,