Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - [pig-0.10.0 e2e test]: some tests failed with "Sort check failed" error


Copy link to this message
-
Re:Re: [pig-0.10.0 e2e test]: some tests failed with "Sort check failed" error
lulynn_2008 2012-08-15, 07:57
The patch in PIG-2498 works. Thanks.
At 2012-08-07 01:05:15,"Cheolsoo Park" <[EMAIL PROTECTED]> wrote:
>Hi,
>
>I believe that you're hitting the same problem as PIG-2498:
>https://issues.apache.org/jira/browse/PIG-2498
>
>Please see if that patch fixes your problem.
>
>Or I believe that this should also be fixed by PIG-2782 where old sort
>notation is replaced with new one:
>https://issues.apache.org/jira/browse/PIG-2782
>
>Thanks!
>Cheolsoo
>
>On Mon, Aug 6, 2012 at 6:57 AM, lulynn_2008 <[EMAIL PROTECTED]> wrote:
>
>>  Hi All,
>> I am running pig-0.10.0 e2e test with pig-0.9.2 and hadoop-1.0.3. There
>> are 12 tests failed with "Sort check failed" error.
>>
>> I list Order_6 as a example:
>> Error info:
>> Going to run sort check command: sort -cs -t     +0 -1
>> ./out/pigtest/pig/pig.1344259341/Order_6.out/out_original
>> /bin/sort: ./out/pigtest/pig/pig.1344259341/Order_6.out/out_original:2:
>> disorder: alice allen   36      2.27
>> Sort check failed
>>
>> Related files:
>> studenttab10k file:
>> ulysses thompson        64      1.90
>> katie carson    25      3.65
>> luke king       65      0.73
>> holly davidson  57      2.43
>> fred miller     55      3.77
>> holly white     43      0.24
>> luke steinbeck  51      1.14
>> nick underhill  31      2.46
>> holly davidson  59      1.26
>> calvin brown    56      0.72
>> rachel robinson 62      2.25
>> tom carson      35      0.56
>> tom johnson     72      0.99
>> irene garcia    54      1.06
>> oscar nixon     39      3.60
>> holly allen     32      2.58
>> oscar hernandez 19      0.05
>> alice ichabod   65      2.25
>> wendy thompson  30      2.39
>> priscilla hernandez     73      0.23
>> gabriella van buren     68      1.32
>> yuri thompson   42      3.65
>> yuri laertes    60      1.16
>> sarah young     23      2.76
>> zach white      32      0.20
>> nick van buren  68      1.75
>> xavier underhill        41      1.51
>> bob ichabod     56      2.81
>> zach steinbeck  61      2.22
>> alice garcia    42      2.03
>> jessica king    29      3.61
>> calvin nixon    37      0.30
>> fred polk       66      3.69
>> bob zipper      40      0.28
>> alice young     75      0.31
>> nick underhill  37      1.65
>> mike white      57      0.69
>> calvin ovid     41      3.02
>> fred steinbeck  47      3.57
>> sarah ovid      65      0.00
>> wendy nixon     63      0.6
>>
>> Order_6.pig file:
>> a = load '/user/pig/tests/data/singlefile/studenttab10k';
>> c = order a by $0;
>> store c into '/user/pig/out/biadmin.1344259341/Order_6.out';
>>
>> out.original file;
>> alice allen     74      0.02
>> alice allen     36      2.27
>> alice allen     20      2.47
>> alice allen     72      1.75
>> alice allen     42      2.46
>> alice allen     43      0.88
>> alice allen     27      1.95
>> alice allen     74      2.40
>> alice allen     72      3.63
>> alice allen     46      3.97
>> alice allen     77      2.52
>> alice allen     68      3.51
>> alice allen     34      1.23
>> alice allen     51      1.08
>> alice allen     68      3.39
>> alice allen     38      1.80
>> alice allen     38      0.81
>> alice allen     45      2.80
>> alice allen     19      1.93
>> alice brown     59      2.94
>> alice brown     66      1.57
>> alice brown     73      1.75
>> alice brown     69      3.04
>> ...
>>
>> out_sorted:
>> alice allen     19      1.93
>> alice allen     20      2.47
>> alice allen     27      1.95
>> alice allen     34      1.23
>> alice allen     36      2.27
>> alice allen     38      0.81
>> alice allen     38      1.80
>> alice allen     42      2.46
>> alice allen     43      0.88
>> alice allen     45      2.80
>> alice allen     46      3.97
>> alice allen     51      1.08
>> alice allen     68      3.39
>> alice allen     68      3.51
>> alice allen     72      1.75
>> alice allen     72      3.63
>> alice allen     74      0.02
>> alice allen     74      2.40
>> alice allen     77      2.52
>> alice brown     18      0.68
>> alice brown     21      2.57
>> alice brown     27      3.89