| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
64 (0.244s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Is there a size limit on tuple or a field in tuple? - Pig - [mail # user]
|
|
...I'm writing a UDF of my own that would produce tuples, each tuple has a string field that could be real large. I did a quick test and the current size of the field is 146,447 characters and ...
|
|
|
Author: Dexin Wang,
2013-02-07, 00:39
|
|
|
Re: reference tuple field by name in UDF - Pig - [mail # user]
|
|
...Thanks. That'll be nice unfortunately we are using EMR which only has 0.9 so that's not an option for us. Similar question for Python UDF. In my Python UDF, is referencing field by ind...
|
|
|
Author: Dexin Wang,
2013-02-01, 22:45
|
|
|
reference tuple field by name in UDF - Pig - [mail # user]
|
|
...Hi, In my own UDF, is reference a field by index the only way to access a field? The fields are all named and typed before passing into UDF but looks like I can only do something...
|
|
|
Author: Dexin Wang,
2013-01-15, 22:15
|
|
|
Re: Passing a BAG to Pig UDF constructor? - Pig - [mail # user]
|
|
...This (your second method) is very neat, thanks a lot Abhinav. Some problems though. First, I would have to do a STORE or DUMP of bag_dummy. Otherwise, Pig won't even run the bag_dummy ...
|
|
|
Author: Dexin Wang,
2012-06-28, 18:46
|
|
|
Re: Passing a BAG to Pig UDF constructor? - Pig - [mail # user]
|
|
...Actually how do you pass a bag to UDF? I did this: a = LOAD 'file_a' AS (a1, a2, a3); *bag1* = LOAD 'somefile' AS (f1, f2, f3); b ...
|
|
|
Author: Dexin Wang,
2012-06-27, 23:08
|
|
|
Re: Passing a BAG to Pig UDF constructor? - Pig - [mail # user]
|
|
...That's a good idea (to pass the bag to UDF and initialize it on first UDF invocation). Thanks. Why do you think it is expensive Mridul? On Tue, Jun 26, 2012 at 2:50 PM, Mridul Mu...
|
|
|
Author: Dexin Wang,
2012-06-27, 17:30
|
|
|
Passing a BAG to Pig UDF constructor? - Pig - [mail # user]
|
|
...Is it possible to pass a bag to a Pig UDF constructor? Basically in the constructor I want to initialize some hash map so that on every exec operation, I can use the hashmap to do a lo...
|
|
|
Author: Dexin Wang,
2012-06-26, 17:27
|
|
|
Re: help!!--Does Pig can be use in this way?! - Pig - [mail # user]
|
|
...Or if it's simple like that, why not just "grep"? On Wed, Apr 4, 2012 at 7:07 AM, Corbin Hobus wrote: te:...
|
|
|
Author: Dexin Wang,
2012-04-04, 16:24
|
|
|
Re: filter out null lines returned by UDF - Pig - [mail # user]
|
|
...yeah. That works great. Thanks you Jonathan. On Thu, Mar 1, 2012 at 5:14 PM, Jonathan Coveney wrote: ...
|
|
|
Author: Dexin Wang,
2012-03-07, 23:08
|
|
|
filter out null lines returned by UDF - Pig - [mail # user]
|
|
...Hi, I have a UDF that parses a line and then return a bag, and sometimes the line is bad so I'm returning null in the UDF. In my pig script, I'd like to filter those nulls like this: &...
|
|
|
Author: Dexin Wang,
2012-03-02, 00:45
|
|
|
|
