Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Pig UDF: XPath


Copy link to this message
-
Pig UDF: XPath



Hi everyone,
I am using XPath for XML processing in my Java UDF. I get the following exception, I am not sure if it is a Hadoop issue or an XPath issue…...
I would greatly appreciate any help.
java.lang.Throwable

            at
myparser.XmlParserRicher.tokenIdToString(XmlParserRicher.java:327)

            at
myparser.XmlParserRicher.extractTokensFromSentences(XmlParserRicher.java:287)

            at
myparser.XmlParserRicher.parserhd(XmlParserRicher.java:154)

            at
myparser.XmlParserRicher.parseXMI(XmlParserRicher.java:107)

            at
myparser.XmiIdRicher.exec(XmiIdRicher.java:142)

            at
myparser.XmiIdRicher.exec(XmiIdRicher.java:54)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:337)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:381)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:334)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:372)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:297)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:308)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.getNext(POStore.java:141)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.runPipeline(POSplit.java:254)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.processPlan(POSplit.java:236)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.processPlan(POSplit.java:241)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.getNext(POSplit.java:228)

            at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:283)

            at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:278)

            at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:64)

            at
org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)

            at
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)

            at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)

            at
org.apache.hadoop.mapred.Child$4.run(Child.java:255)

            at
java.security.AccessController.doPrivileged(Native Method)

            at javax.security.auth.Subject.doAs(Subject.java:415)

            at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)

            at
org.apache.hadoop.mapred.Child.main(Child.java:249)

java.lang.Throwable

            at
myparser.XmlParserRicher.tokenIdToString(XmlParserRicher.java:327)

            at
myparser.XmlParserRicher.extractTokensFromSentences(XmlParserRicher.java:287)

            at
myparser.XmlParserRicher.parserhd(XmlParserRicher.java:154)

            at myparser.XmlParserRicher.parseXMI(XmlParserRicher.java:107)

            at
myparser.XmiIdRicher.exec(XmiIdRicher.java:142)

            at
myparser.XmiIdRicher.exec(XmiIdRicher.java:54)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:337)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:381)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:334)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:372)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:297)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:308)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.getNext(POStore.java:141)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.runPipeline(POSplit.java:254)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.processPlan(POSplit.java:236)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.processPlan(POSplit.java:241)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.getNext(POSplit.java:228)

            at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:283)

            at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:278)

            at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:64)

            at
org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)

            at
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)

            at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)

            at
org.apache.hadoop.mapred.Child$4.run(Child.java:255)

            at
java.security.AccessController.doPrivileged(Native Method)

            at
javax.security.auth.Subject.doAs(Subject.java:415)

            at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.
+
Yigitbasi, Nezih 2014-01-15, 20:22