|
|
-
is there anyway to detect the file size as am i writing a sequence file?
Jane Wayne 2012-03-06, 14:53
hi,
i am writing a little util class to recurse into a directory and add all *.txt files into a sequence file (key is the file name, value is the content of the corresponding text file). as i am writing (i.e. SequenceFile.Writer.append(key, value)), is there any way to detect how large the sequence file is?
for example, i want to create a new sequence file as soon as the current one exceeds 64 MB.
i notice there is a SequenceFile.Writer.getLong() which the javadocs says "returns the current length of the output file," but that is vague. what is this Writer.getLong() method? is it the number of bytes, kilobytes, megabytes, or something else?
thanks,
+
Jane Wayne 2012-03-06, 14:53
-
Re: is there anyway to detect the file size as am i writing a sequence file?
Joey Echeverria 2012-03-06, 15:00
I think you mean Writer.getLength(). It returns the current position in the output stream in bytes (more or less the current size of the file).
-Joey
On Tue, Mar 6, 2012 at 9:53 AM, Jane Wayne <[EMAIL PROTECTED]> wrote: > hi, > > i am writing a little util class to recurse into a directory and add all > *.txt files into a sequence file (key is the file name, value is the > content of the corresponding text file). as i am writing (i.e. > SequenceFile.Writer.append(key, value)), is there any way to detect how > large the sequence file is? > > for example, i want to create a new sequence file as soon as the current > one exceeds 64 MB. > > i notice there is a SequenceFile.Writer.getLong() which the javadocs says > "returns the current length of the output file," but that is vague. what is > this Writer.getLong() method? is it the number of bytes, kilobytes, > megabytes, or something else? > > thanks,
-- Joseph Echeverria Cloudera, Inc. 443.305.9434
+
Joey Echeverria 2012-03-06, 15:00
-
Re: is there anyway to detect the file size as am i writing a sequence file?
Jane Wayne 2012-03-06, 15:27
Thanks Joey. That's what I meant (I've been staring at the screen too long). :)
On Tue, Mar 6, 2012 at 10:00 AM, Joey Echeverria <[EMAIL PROTECTED]> wrote:
> I think you mean Writer.getLength(). It returns the current position > in the output stream in bytes (more or less the current size of the > file). > > -Joey > > On Tue, Mar 6, 2012 at 9:53 AM, Jane Wayne <[EMAIL PROTECTED]> > wrote: > > hi, > > > > i am writing a little util class to recurse into a directory and add all > > *.txt files into a sequence file (key is the file name, value is the > > content of the corresponding text file). as i am writing (i.e. > > SequenceFile.Writer.append(key, value)), is there any way to detect how > > large the sequence file is? > > > > for example, i want to create a new sequence file as soon as the current > > one exceeds 64 MB. > > > > i notice there is a SequenceFile.Writer.getLong() which the javadocs says > > "returns the current length of the output file," but that is vague. what > is > > this Writer.getLong() method? is it the number of bytes, kilobytes, > > megabytes, or something else? > > > > thanks, > > > > -- > Joseph Echeverria > Cloudera, Inc. > 443.305.9434 >
+
Jane Wayne 2012-03-06, 15:27
|
|