Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 11 to 20 from 25 (0.079s).
Loading phrases to help you
refine your search...
RE: ORDER ... LIMIT failing on large data - Pig - [mail # user]
...Thanks Jonathan and Prashant. The immediate cause of the problem I had (failing without erroring out) was slightly different formatting between the small and large input sets. Duh.  Whe...
[+ more]    Author: william.dowling@..., 2012-01-06, 21:11
grunt mishandles open parenthesis in a comment - Pig - [mail # user]
...Here is grunt session showing a comment line being ignored correctly:  grunt> a = load 'foo' as ( grunt> grunt> describe a; a: {a: int}  But when I end the comment with an...
   Author: william.dowling@..., 2012-01-05, 16:17
RE: Possible Pig 9.1 globing bug in parameter substitution - Pig - [mail # user]
...If   -param input=s3n://foo/bar/baz/*/ blah.pig is part of a command line, you'd have to add quotes:   -param 'input=s3n://foo/bar/baz/*/' blah.pig to inhibit your shell from tryin...
   Author: william.dowling@..., 2011-12-15, 19:25
RE: reading xml file within a UDF - Pig - [mail # user]
...I do this:  define analyze_unif `analyze_unif_recs.py`     input  (stdin)     output (stdout USING PigStreaming(','))     ship   ('$scriptDir/ana...
   Author: william.dowling@..., 2011-09-14, 14:53
rmf for forrced rm - Pig - [mail # user]
...The function ‘rmf’ for forced removal is no longer (0.9.0) mentioned, except that it is a reserved word, in the user docs for pig. It was documented in the 0.8.1.  I wonder -- is this f...
   Author: william.dowling@..., 2011-08-12, 20:22
RE: Manually build tuple from three group relations - Pig - [mail # user]
...You could use two rounds of the outer join/filter by null idiom. For example after the first round you would get allTermsMinusNonNumbers like this:  grunt> sh cat allTerms aa bb cc 1...
   Author: william.dowling@..., 2011-07-07, 13:41
RE: workaround for  java.lang.OutOfMemoryError: Java heap space? - Pig - [mail # user]
...Thank you Thejas! Turning off the combiner let the job go to completion.  Next I can try the two-level approach to see what the performance penalty was.  Kind regards, Will  W...
[+ more]    Author: william.dowling@..., 2011-06-10, 19:57
RE: Loading Files with Comment Lines - Pig - [mail # user]
...I do that kind of streaming on hdfs files using Hadoop streaming, outside of pig. I assume you could do it from inside pig too, but haven’t tested.     William F Dowling  Sr T...
[+ more]    Author: william.dowling@..., 2011-06-07, 19:17
RE: Set visible name of a running pig job - Pig - [mail # user]
...Thanks Jonathan.  I've seen other references to using -D... on the command line, but I haven't had success with it.  I tried   pig -param a=b -Dmapred.job.name=whatever  ...
[+ more]    Author: william.dowling@..., 2011-05-26, 21:35
RE: Set difference in Pig - Pig - [mail # user]
...I saw this somewhere. 'Anti-join' doesn't seem very descriptive to me, but that is what it was called.   Anti-join (set difference) idiom in pig: A = load 'input1' as (x, y); B = load '...
   Author: william.dowling@..., 2011-05-12, 16:14
Sort:
project
Pig (25)
MapReduce (1)
type
mail # user (25)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (1)
last 9 months (25)
author
Daniel Dai (362)
Dmitriy Ryaboy (346)
Alan Gates (333)
Cheolsoo Park (293)
Jonathan Coveney (237)
Rohini Palaniswamy (175)
Russell Jurney (174)
Bill Graham (131)
Olga Natkovich (130)
Prashant Kommireddi (107)
Aniket Mokashi (87)
Julien Le Dem (84)
Thejas Nair (69)
Thejas M Nair (63)
Mridul Muralidharan (61)
Ashutosh Chauhan (41)
pi song (41)
Gianmarco De Francisci Mo...(38)
"Cheolsoo Park (35)
Ruslan Al-Fakikh (35)
Dmitriy V. Ryaboy (34)
Koji Noguchi (34)
Pradeep Gollakota (33)
Jeff Zhang (32)
Santhosh Srinivasan (29)
william.dowling@...
william.dowling@...