-Re: data in compression format affect mapreduce speed
Ted Yu 2010-08-26, 03:43
Compressed data would increase processing time in mapper/reducer but
decrease the amount of data transferred between tasktracker nodes.
Normally you should consider applying some form of compression.
On Wed, Aug 25, 2010 at 7:32 PM, shangan <[EMAIL PROTECTED]> wrote:
> will data stored in compression format affect mapreduce job speed?
> increase or decrease? or more complex relationship between these two ? can
> anybody give some explanation in detail?