Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Writing intermediate key,value pairs to file and read it again


Copy link to this message
-
Writing intermediate key,value pairs to file and read it again
Hello,
Can anyone help me in following issue
Writing intermediate key,value pairs to file and read it again

let us say i have to write each intermediate pair received @reducer to a
file and again read that as key value pair again and use it for processing

I found IFile.java file which has reader and writer but i am not able
understand how to use it for example. I dont understand Counter value as
last parameter "spilledRecordsCounter"
Thanks.
--
*
*
*

  Regards,*
*   Vikas *
+
Azuryy Yu 2013-04-21, 04:23
+
Vikas Jadhav 2013-04-23, 05:36