Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # dev - Re: [jira] [Resolved] (PIG-2650) Convenience mock Loader and Storer to simplify unit testing of Pig scripts


+
Julien Le Dem 2012-04-26, 21:07
+
Daniel Dai 2012-04-26, 21:15
Copy link to this message
-
Re: [jira] [Resolved] (PIG-2650) Convenience mock Loader and Storer to simplify unit testing of Pig scripts
Bill Graham 2012-04-26, 21:32
What's fair game to commit to the the 0.10 branch? Just bug fixes, or are
new small features that didn't make it into 0.10 ok?

On Thu, Apr 26, 2012 at 2:15 PM, Daniel Dai <[EMAIL PROTECTED]> wrote:

> I am fine with it. Please also include the following tiny patch to fix
> hadoop 23 build after the patch.
>
> --- pig/trunk/ivy.xml (original)
> +++ pig/trunk/ivy.xml Thu Apr 26 21:11:36 2012
> @@ -178,7 +178,7 @@
>    <dependency org="net.java.dev.javacc" name="javacc"
> rev="${javacc.version}"
>      conf="compile->master"/>
>    <dependency org="junit" name="junit" rev="${junit.version}"
> -      conf="test->default"/>
> +      conf="compile->master"/>
>    <dependency org="com.google.code.p.arat" name="rat-lib"
> rev="${rats-lib.version}"
>      conf="releaseaudit->default"/>
>    <dependency org="org.codehaus.jackson" name="jackson-mapper-asl"
> rev="${jackson.version}"
>
> Daniel
>
> On Thu, Apr 26, 2012 at 2:07 PM, Julien Le Dem <[EMAIL PROTECTED]> wrote:
> > I'm planning to commit this in 0.10 branch as well
> > The patch has only new files so it will apply cleanly.
> > Any objection?
> > Julien
> >
> >
> > On Apr 26, 2012, at 1:30 PM, Julien Le Dem (JIRA) wrote:
> >
> >>
> >>     [
> https://issues.apache.org/jira/browse/PIG-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
> >>
> >> Julien Le Dem resolved PIG-2650.
> >> --------------------------------
> >>
> >>       Resolution: Fixed
> >>    Fix Version/s: 0.11
> >>
> >>> Convenience mock Loader and Storer to simplify unit testing of Pig
> scripts
> >>>
> --------------------------------------------------------------------------
> >>>
> >>>                Key: PIG-2650
> >>>                URL: https://issues.apache.org/jira/browse/PIG-2650
> >>>            Project: Pig
> >>>         Issue Type: New Feature
> >>>           Reporter: Julien Le Dem
> >>>           Assignee: Julien Le Dem
> >>>            Fix For: 0.11
> >>>
> >>>        Attachments: PIG-2650-a.patch, PIG-2650-b.patch,
> PIG-2650-c.patch, PIG-2650.patch
> >>>
> >>>
> >>> A test would look as follows:
> >>> {code}
> >>> PigServer pigServer = new PigServer(ExecType.LOCAL);
> >>> TupleFactory tf = TupleFactory.getInstance();
> >>> Data data = Storage.resetData(pigServer.getPigContext());
> >>> data.set("foo", Arrays.asList(
> >>>    tf.newTuple("a"),
> >>>    tf.newTuple("b"),
> >>>    tf.newTuple("c")
> >>>    ));
> >>> pigServer.registerQuery("A = LOAD 'foo' USING mock.Storage();");
> >>> // some complex script to test
> >>> pigServer.registerQuery("STORE A INTO 'bar' USING mock.Storage();");
> >>> Iterator<Tuple> out = data.get("bar").iterator();
> >>> assertEquals("a", out.next().get(0));
> >>> assertEquals("b", out.next().get(0));
> >>> assertEquals("c", out.next().get(0));
> >>> {code}
> >>
> >> --
> >> This message is automatically generated by JIRA.
> >> If you think it was sent incorrectly, please contact your JIRA
> administrators:
> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
> >> For more information on JIRA, see:
> http://www.atlassian.com/software/jira
> >>
> >>
> >
>

--
*Note that I'm no longer using my Yahoo! email address. Please email me at
[EMAIL PROTECTED] going forward.*
+
Thejas Nair 2012-04-26, 21:55
+
Daniel Dai 2012-04-26, 21:57
+
Alan Gates 2012-04-26, 22:02
+
Julien Le Dem 2012-04-26, 23:34
+
Alan Gates 2012-04-27, 00:06
+
Julien Le Dem 2012-04-26, 23:39
+
Daniel Dai 2012-04-26, 23:56
+
Julien Le Dem 2012-04-27, 00:10
+
Julien Le Dem 2012-04-27, 00:39