Sajid Raza 2013-08-16, 21:22
Prashant Kommireddi 2013-08-16, 21:44
-Re: Modify PigStorage to load schema from alternate location?
Prashant Kommireddi 2013-08-16, 21:47
Also, as Cheolsoo suggested on the other email - you have the option to
extend PigStorage and override storeSchema/getSchema
On Fri, Aug 16, 2013 at 2:44 PM, Prashant Kommireddi <[EMAIL PROTECTED]>wrote:
> Hi Sajid,
> I don't see any objections to that. This would probably have to be a
> config driven behavior. I remember having added a constructor to
> JsonMetadata that lets you specify different schema/header file names.
> Are you looking to change how the schema file is looked-up currently?
> On Fri, Aug 16, 2013 at 2:22 PM, Sajid Raza <[EMAIL PROTECTED]> wrote:
>> Would it be reasonable if I modified PigStorage to read a schema from a
>> user specified location? The default would be the same as it is today.
>> Having this feature would certainly help when I need to read a dataset
>> I don't own and whose schema is kept in a separate location.