Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> reg : getting table values in inputFormat in serde


+
Mohit Chaudhary01 2012-12-21, 05:34
+
Nitin Pawar 2012-12-21, 09:46
+
Mohit Chaudhary01 2012-12-21, 11:39
+
Connell, Chuck 2012-12-21, 12:58
Copy link to this message
-
RE: reg : getting table values in inputFormat in serde

Actually I am backing up this question. In additional for that, I wonder if it is possible we can access the table properties from the UDF too.
I also have XML data, but with namespace into it. The XPATH UDF coming from HIVE doesn't support namespace. To support the namespace in XML is simple, just need a NamespaceContextImpl. But the trick part is to having a generic solution, we want some properties can passed to underline InputFormat or xpath_ns UDF, for example, the prefix/URI mapping, or the real class name who implements the NamespaceContext interface. But right now, it is not easy to pass this kind information, even if we define them into the table properties.
Right now, I have to kind of hard-coded into the UDF or InputFormat, instead of providing a generic solution.
Yong

From: [EMAIL PROTECTED]
To: [EMAIL PROTECTED]
Subject: RE: reg : getting table values in inputFormat in serde
Date: Fri, 21 Dec 2012 11:39:54 +0000

Actually I am storing data from xml file into hive table using serde.
Now I want table properties which I given during table creation  in inputformat .
 
 
From: Nitin Pawar [mailto:[EMAIL PROTECTED]]
Sent: Friday, December 21, 2012 3:16 PM

To: [EMAIL PROTECTED]

Subject: Re: reg : getting table values in inputFormat in serde
 

What kind of table properties you want to be accessed ? and what you want to achieve from  it in serde ?
 

On Fri, Dec 21, 2012 at 11:04 AM, Mohit Chaudhary01 <[EMAIL PROTECTED]> wrote:
Hi

In serde program I need table properties in inputformat file .

 So can anyone please tell me how can I do this?
 
 
thanks
**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are not
to copy, disclose, or distribute this e-mail or its contents to any other person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
every reasonable precaution to minimize this risk, but is not liable for any damage
you may sustain as a result of any virus in this e-mail. You should carry out your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***


 

--

Nitin Pawar

     
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB