Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # dev - Review Request: PIG-3190 Review


Copy link to this message
-
Review Request: PIG-3190 Review
Russell Jurney 2013-03-11, 00:46

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/9843/
-----------------------------------------------------------

Review request for pig, Ashutosh Chauhan, Dmitriy Ryaboy, Jonathan Coveney, and Gunther Hagleitner.
Description
-------

Adding Lucene Standard and Snowball tokenizers to Pig builtin
This addresses bug PIG-3190.
    https://issues.apache.org/jira/browse/PIG-3190
Diffs
-----

  ivy.xml 70e8d50
  src/org/apache/pig/builtin/SnowballTokenize.java PRE-CREATION
  src/org/apache/pig/builtin/StandardTokenize.java PRE-CREATION
  test/org/apache/pig/test/TestSnowballTokenize.java PRE-CREATION
  test/org/apache/pig/test/TestStandardTokenize.java PRE-CREATION
  test/org/apache/pig/test/data/ExpectedSnowballTokens.txt PRE-CREATION
  test/org/apache/pig/test/data/ExpectedStandardTokens.txt PRE-CREATION
  test/org/apache/pig/test/data/InputFiles/ten_enron_emails.txt PRE-CREATION

Diff: https://reviews.apache.org/r/9843/diff/
Testing
-------

Unit tests and local testing.
Thanks,

Russell Jurney