Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Re: Writing intermediate key,value pairs to file and read it again


+
Jay Vyas 2013-04-20, 16:06
Copy link to this message
-
Re: Writing intermediate key,value pairs to file and read it again
Rishi Yadav 2013-04-20, 16:03
writing a map only job will do the trick for you.
On Sat, Apr 20, 2013 at 8:43 AM, Vikas Jadhav <[EMAIL PROTECTED]>wrote:

> Hello,
> Can anyone help me in following issue
> Writing intermediate key,value pairs to file and read it again
>
> let us say i have to write each intermediate pair received @reducer to a
> file and again read that as key value pair again and use it for processing
>
> I found IFile.java file which has reader and writer but i am not able
> understand how to use it for example. I dont understand Counter value as
> last parameter "spilledRecordsCounter"
>
>
> Thanks.
>
>
> --
> *
> *
> *
>
>   Regards,*
> *   Vikas *
>