|
|
-
small problem with pigUnit
Yang 2012-06-23, 00:34
if I have an assert line:
assertOutput('myinput' , input_data, 'myoutput', output_data); and in my test pig script, I dump out the var myoutput:
dump myoutput;
the UDF used in the script fails to get its parameters , i.e. for the following script: myinput = LOAD 'blahblah' as x: tuple(something something something);
myoutput = FOREACH myinput GENERATE myUDF(x);
dump myoutput; ------ this causes problems
STORE myoutput INTO 'blahbbbbbbb';
does this sound like a bug?
Thanks Yang
-
Re: small problem with pigUnit
Subir S 2012-06-24, 05:14
On Sat, Jun 23, 2012 at 6:04 AM, Yang <[EMAIL PROTECTED]> wrote:
> if I have an assert line: > > assertOutput('myinput' , input_data, 'myoutput', output_data); > > > and in my test pig script, I dump out the var myoutput: > > dump myoutput; > > > > the UDF used in the script fails to get its parameters , i.e. for the > following script: > > > myinput = LOAD 'blahblah' as x: tuple(something something something); > > myoutput = FOREACH myinput GENERATE myUDF(x); > > dump myoutput; ------ this causes problems >
What Problems? Do you have any error logs or exceptions that can be shared.
> > STORE myoutput INTO 'blahbbbbbbb'; > > > > > > does this sound like a bug? > > Thanks > Yang >
-
Re: small problem with pigUnit
Yang 2012-06-24, 05:51
the issue is that if you have the "dump" line, the udf "myUDF(x)" fails to get the parameter : as I debug into the udf, the parameter tuple.get(0) gives NULL Yang
On Sat, Jun 23, 2012 at 10:14 PM, Subir S <[EMAIL PROTECTED]> wrote:
> On Sat, Jun 23, 2012 at 6:04 AM, Yang <[EMAIL PROTECTED]> wrote: > > > if I have an assert line: > > > > assertOutput('myinput' , input_data, 'myoutput', output_data); > > > > > > and in my test pig script, I dump out the var myoutput: > > > > dump myoutput; > > > > > > > > the UDF used in the script fails to get its parameters , i.e. for the > > following script: > > > > > > myinput = LOAD 'blahblah' as x: tuple(something something something); > > > > myoutput = FOREACH myinput GENERATE myUDF(x); > > > > dump myoutput; ------ this causes problems > > > > What Problems? > Do you have any error logs or exceptions that can be shared. > > > > > STORE myoutput INTO 'blahbbbbbbb'; > > > > > > > > > > > > does this sound like a bug? > > > > Thanks > > Yang > > >
|
|