-Re: Writing intermediate key,value pairs to file and read it again
Vikas Jadhav 2013-04-23, 05:36
ya i looked @ chain reducer but it will not help in my case
Now i am able to write each key value pair received @ reducer(using
but when i try to read it using IFile.Reader it reads all data not single
key value pair
*IFile.Reader reader = new* IFile.Reader<KEYIN,
VALUEIN>(context.getConfiguration(), localFs, file, *null*, myReadCounter);
DataInputBuffer keyRead = new DataInputBuffer();
DataInputBuffer valueRead = new DataInputBuffer();
when i say keyRead.getData()
it print all key value pair in that buffer i want single key value pair.
On Sun, Apr 21, 2013 at 9:53 AM, Azuryy Yu <[EMAIL PROTECTED]> wrote:
> you would look at chain reducer java doc, which meet your requirement.
> --Send from my Sony mobile.
> On Apr 20, 2013 11:43 PM, "Vikas Jadhav" <[EMAIL PROTECTED]> wrote:
>> Can anyone help me in following issue
>> Writing intermediate key,value pairs to file and read it again
>> let us say i have to write each intermediate pair received @reducer to a
>> file and again read that as key value pair again and use it for processing
>> I found IFile.java file which has reader and writer but i am not able
>> understand how to use it for example. I dont understand Counter value as
>> last parameter "spilledRecordsCounter"
>> * Vikas *
* Vikas *