Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo >> mail # user >> Has anyone used mrunit to test Mutations produced from Mappers or Reducers?


Copy link to this message
-
Re: Has anyone used mrunit to test Mutations produced from Mappers or Reducers?
I am using mrunit like this:

Mutation expected = new Mutation();
expected.put(...);
expected.put(...);

MapDriver mapDriver = new MapDriver<....>();
mapDriver.withMapper(...);
mapDriver.withInput(...);
mapDriver.withConfiguration(...);
mapDriver.withOutput(null, expected);
mapDriver.runTest();

As such, mrunit is unable to correctly check the expected Mutation.
However, I seem to have a workaround:

Mutation expected = new TestableMutation();

The rest of the code is unchanged. My TestableMutation class is quite
simple:

public class TestableMutation extends Mutation {
  TestableMutation(Text row) {
    super(row);
  }
  @Override
  public boolean equals(Mutation other) {
    return true;
  }
}

I'll leave it as an exercise to the reader to create a better equals method.

On Tue, Sep 24, 2013 at 12:31 PM, Eric Newton <[EMAIL PROTECTED]> wrote:

> Created https://issues.apache.org/jira/browse/ACCUMULO-1734 in response.
>
> -Eric
>
>
>
> On Tue, Sep 24, 2013 at 12:19 PM, Tim Reardon <[EMAIL PROTECTED]> wrote:
>
>> The problem is that Mutation.equals() calls a private serialize() method
>> that modifies the data about to be checked. I have successfully worked
>> around this in the past by wrapping the Mutation in a new Mutation, which
>> calls serialize under the hood:
>>
>>  assertEquals(expectedMutation, new Mutation(actualMutation));
>>
>> This applies to 1.4.x, I don't know if Mutation.equals() has changed
>> since then.
>>
>> Tim
>>
>> On Tue, Sep 24, 2013 at 8:58 AM, David Medinets <[EMAIL PROTECTED]
>> > wrote:
>>
>>>
>>> http://stackoverflow.com/questions/18541143/how-to-test-a-reducer-containing-a-mutation- there is a question on Stack Overflow about this. And I would not mind
>>> knowing the answer also.
>>>
>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB