Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - nested JSON structures


Copy link to this message
-
Re: nested JSON structures
Roberto Congiu 2011-12-09, 17:29
I wrote a SerDe that can handle nested structures.

https://github.com/rcongiu

Roberto

On Fri, Dec 9, 2011 at 7:42 AM, Ibrahim Acet <[EMAIL PROTECTED]> wrote:

> Hi, ****
>
> are there any tutorials available for custom UDF creation ?****
>
> ** **
>
> thx****
>
> ** **
>
> *Von:* Edward Capriolo [mailto:[EMAIL PROTECTED]]
> *Gesendet:* Freitag, 9. Dezember 2011 16:22
> *An:* [EMAIL PROTECTED]
> *Betreff:* Re: nested JSON structures****
>
> ** **
>
> Hive does have some JSON capabilities. To handle nested structures like
> this I have wrtten custom UDFs that return structs and then use LATERAL
> VIEW and explode on them.****
>
> ** **
>
>
> http://www.slideshare.net/edwardcapriolo/breaking-firstnormal-form-with-hive
> ****
>
> ** **
>
> On Fri, Dec 9, 2011 at 10:06 AM, Ibrahim Acet <[EMAIL PROTECTED]>
> wrote:****
>
> Hi, ****
>
> with nested json I mean something like this:****
>
>  ****
>
> {"success": "true", "message": "", "total": "1", "data":****
>
> {****
>
>         "id": "0001",****
>
>         "type": "donut",****
>
>         "name": "Cake",****
>
>         "ppu": 0.55,****
>
>         "batters":****
>
>                {****
>
>                        "batter":****
>
>                                [****
>
>                                       { "id": "1001", "type": "Regular" },
> ****
>
>                                       { "id": "1002", "type": "Chocolate"
> },****
>
>                                       { "id": "1003", "type": "Blueberry"
> },****
>
>                                       { "id": "1004", "type": "Devil's
> Food" }****
>
>                                ]****
>
>                },****
>
>         "topping":****
>
>                [****
>
>                        { "id": "5001", "type": "None" },****
>
>                        { "id": "5002", "type": "Glazed" },****
>
>                        { "id": "5005", "type": "Sugar" },****
>
>                        { "id": "5007", "type": "Powdered Sugar" },****
>
>                        { "id": "5006", "type": "Chocolate with Sprinkles"
> },****
>
>                        { "id": "5003", "type": "Chocolate" },****
>
>                        { "id": "5004", "type": "Maple" }****
>
>                ]****
>
> }****
>
> }****
>
> I need to extract all the information.****
>
>  ****
>
> Thx ****
>
>  ****
>
> *Von:* Paul Mackles [mailto:[EMAIL PROTECTED]]
> *Gesendet:* Freitag, 9. Dezember 2011 15:43
> *An:* [EMAIL PROTECTED]
> *Betreff:* RE: nested JSON structures****
>
>  ****
>
> What exactly do you mean by “nested json structures”? If the built-ins
> don’t work you can always write a UDF.****
>
>  ****
>
> *From:* Ibrahim Acet [mailto:[EMAIL PROTECTED]]
> *Sent:* Friday, December 09, 2011 4:05 AM
> *To:* [EMAIL PROTECTED]
> *Subject:* nested JSON structures****
>
>  ****
>
> Hi, ****
>
> I was wondering if there is a possibility in HIVE to handle nested JSON
> structures.****
>
> I tried get_json_object and json_tuple but could not achieve any results.*
> ***
>
>  ****
>
> Thanks ****
>
>  ****
>
>  ****
>
>  ****
>
>  ****
>
> Regelung gemäß § 37a Absatz 4 HGB: WidasConcepts GmbH, Geschäftsführer:
> Thomas Widmann und Christian Kappert, Gerichtsstand Pforzheim,
> Registernummer: HRB 511442, Umsatzsteueridentifikationsnummer: DE205851091
> ****
>
>  ****
>
> Diese E-Mail enthaelt vertrauliche und/oder rechtlich geschuetzte
> Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail
> irrtuemlich erhalten haben, informieren Sie bitte sofort den Absender und
> vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte
> Weitergabe dieser Mail sind nicht gestattet.****
>
>  ****
>
> This e- mail may contain confidential and/or privileged information. If
> you are not the intended recipient (or have received this e-mail in error)
> please notify the sender immediately and destroy this e-mail. Any
> unauthorized copying, disclosure or distribution of the material in this
> e-mail is strictly forbidden.****