Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - using multipe avro schemas in globbed files (schema merging)


Copy link to this message
-
Re: using multipe avro schemas in globbed files (schema merging)
Cheolsoo Park 2012-07-17, 17:03
Hi Markus,

Thank you for sharing your problem.

Looking at the PIG-2579
<https://issues.apache.org/jira/browse/PIG-2579>patch, it seems to try
to address two issues at the same time:
1) Globs support
2) Multiple Avro schemas support

I think that it's better to solve one issue at a time. In fact, there is
another jira PIG-2492 <https://issues.apache.org/jira/browse/PIG-2492> that
tries to address #1 particularly. Once
PIG-2492<https://issues.apache.org/jira/browse/PIG-2492>is resolved, I
think we can rebase/fix the
PIG-2579 <https://issues.apache.org/jira/browse/PIG-2579> patch on top of
that.

I am happy to work on both jiras. Please let me know what you think.

Thanks,
Cheolsoo

On Tue, Jul 17, 2012 at 4:26 AM, Markus Resch <[EMAIL PROTECTED]>wrote:

> Hey everyone,
>
> in the thread "Downgrade CDH4 to CDH3" of the cloudera mailing list I
> talked about issues we had with pig while testing cdh4 and that we had
> trouble in switching back to cdh3. After I figured out the reason of our
> pig issue I tried to apply the patch
> (https://issues.apache.org/jira/browse/PIG-2579 ) to the cdh4 version of
> pig. Sadly this was much harder then applying this particular patch to
> the cdh3 version of pig before. Does anyone have this or a similar patch
> in a way that is suitable for the cdh4 version of pig? I'm just asking
> because doing work twice doesn't help anyone. If this work is already
> done: could this patch be attached to the PIG-2579-ticket as well?
>
> Thanks
>
> Markus
>
>
>
> --
>
>
>
>