Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Pig UDF: XPath


Copy link to this message
-
Pig UDF: XPath



Hi everyone,
I am using XPath for XML processing in my Java UDF. I get the following exception, I am not sure if it is a Hadoop issue or an XPath issue…...
I would greatly appreciate any help.
java.lang.Throwable

            at
myparser.XmlParserRicher.tokenIdToString(XmlParserRicher.java:327)

            at
myparser.XmlParserRicher.extractTokensFromSentences(XmlParserRicher.java:287)

            at
myparser.XmlParserRicher.parserhd(XmlParserRicher.java:154)

            at
myparser.XmlParserRicher.parseXMI(XmlParserRicher.java:107)

            at
myparser.XmiIdRicher.exec(XmiIdRicher.java:142)

            at
myparser.XmiIdRicher.exec(XmiIdRicher.java:54)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:337)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:381)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:334)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:372)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:297)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:308)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.getNext(POStore.java:141)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.runPipeline(POSplit.java:254)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.processPlan(POSplit.java:236)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.processPlan(POSplit.java:241)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.getNext(POSplit.java:228)

            at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:283)

            at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:278)

            at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:64)

            at
org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)

            at
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)

            at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)

            at
org.apache.hadoop.mapred.Child$4.run(Child.java:255)

            at
java.security.AccessController.doPrivileged(Native Method)

            at javax.security.auth.Subject.doAs(Subject.java:415)

            at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)

            at
org.apache.hadoop.mapred.Child.main(Child.java:249)

java.lang.Throwable

            at
myparser.XmlParserRicher.tokenIdToString(XmlParserRicher.java:327)

            at
myparser.XmlParserRicher.extractTokensFromSentences(XmlParserRicher.java:287)

            at
myparser.XmlParserRicher.parserhd(XmlParserRicher.java:154)

            at myparser.XmlParserRicher.parseXMI(XmlParserRicher.java:107)

            at
myparser.XmiIdRicher.exec(XmiIdRicher.java:142)

            at
myparser.XmiIdRicher.exec(XmiIdRicher.java:54)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:337)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:381)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:334)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:372)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:297)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:308)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.getNext(POStore.java:141)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.runPipeline(POSplit.java:254)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.processPlan(POSplit.java:236)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.processPlan(POSplit.java:241)

            at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.getNext(POSplit.java:228)

            at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:283)

            at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:278)

            at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:64)

            at
org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)

            at
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)

            at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)

            at
org.apache.hadoop.mapred.Child$4.run(Child.java:255)

            at
java.security.AccessController.doPrivileged(Native Method)

            at
javax.security.auth.Subject.doAs(Subject.java:415)

            at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.
+
Yigitbasi, Nezih 2014-01-15, 20:22
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB