Stanley Xu 2013-01-22, 06:50
Vitalii Tymchyshyn 2013-01-22, 11:27
try something like:
raw_data = load ....... as record;
or you can describe raw_data to check the schema.
On Jan 21, 2013, at 10:50 PM, Stanley Xu <[EMAIL PROTECTED]> wrote:
> Dear all,
> We are using thrift and elephant-bird to store our logs. And I wanted to
> use some UDF to do complex processing on a single record, so I write some
> pig like the following:
> ========================================================> raw_data = load '$INPUT' using
> A = FOREACH raw_data GENERATE com.udf.SomeUDF(raw_data);
> B = LIMIT A 10;
> DUMP B;
> But the pig will told me " ERROR 1000: Error during parsing. Scalars can be
> only used with projections"
> Is there anyway I could run a UDF on the raw_data here?
> Best wishes,
> Stanley Xu
Vitalii Tymchyshyn 2013-01-22, 11:34
Stanley Xu 2013-01-24, 03:56