-Request for suggestions
srinivasrajagopalan@... 2012-11-26, 18:54
We have a scenario where we want a single Hadoop job to create/manage multiple mapper tasks where each mapper task will query a subset of columns in a relational database table. We looked into DataDrivenDBInputFormat, but that only seems to facilitate partitioning where each mapper task can query a subset of rows in a relational database table.
I am not sure if Pig can help us in this case.
Appreciate any suggestions in this regard.