Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Pig testing in maven projects

=?KOI8-U?B?96bUwcymyiD0yc... 2012-08-15, 10:49
Copy link to this message
Re: Pig testing in maven projects
Yeah, these should be published to maven.


On Wed, Aug 15, 2012 at 3:49 AM, Віталій Тимчишин <[EMAIL PROTECTED]> wrote:
> Hello.
> We are starting to use pig for our data analysis.
> To be exact, actual work will be performed by amazon elastic map reduce.
> That's why we are using 0.9.2 for now.
> Everything works more or less OK. I've fixed few things in piggybank
> XMLLoader (also made a JIRA ticket & pull request on github), also most
> times ILLUSTRATE is confused with my scripts :) (I hope to spend some time
> to make isolated tests & create Jiras later).
> Now I am going to test my scripts. I've encountered next problems doing
> this:
> 1) There is no pigunit in maven central. There is snapshot one at
> https://repository.apache.org and some builds from Cloudera. I think, I
> will take one from cloudera.
> 2) There is no org.apache.pig.test.MiniCluster in any jars, neither
> deployed to maven nor build with ant. It seems that I will have to make jar
> myself out of build/test/classes. It will contain both infrastructure I
> need and all pig tests I don't need.
> So, as for me, currently pigunit jar can be found (if one tries hard), but
> can't be used.
> Am I missing something? Should I create a jira with feature request to have
> this somehow handled in future?
> --
> Best regards,
>  Vitalii Tymchyshyn