Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # dev >> Loading intermediate data from multiple files


+
Vibhor Gupta 2012-05-05, 18:20
Copy link to this message
-
Re: Loading intermediate data from multiple files
Vibhor, how do you define intermediate data here? Is it the final
output from a certain pig job or the tmp files created between
multiple MR jobs created by the same pig script?

Sent from my iPhone

On May 5, 2012, at 7:53 PM, Vibhor Gupta <[EMAIL PROTECTED]> wrote:

> Hi ,
> We are working on a project where we are trying to reuse the intermediate
> data.
> We are splitting the file based on the equivilance class.
> Now we are stuck on a point where we need to read from these files.
>
> Can you please specify how to that.
>
> thanks !!
>
> --
> Thanks ,
> Vibhor Gupta
>
> Masters in Computer Science
> North Carolina State University