| clear query|facets|time |
Search criteria: .
Results from 21 to 30 from
118 (0.217s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: DateTime Proposal Request for Comment - Pig - [mail # user]
|
|
...I wonder if we can pull timezone support into the system... So some day I can say things like 'jiffies between 11am EST and 13:11 IST' and get back the correct answer in P...
|
|
|
Author: hc busy,
2010-07-02, 20:05
|
|
|
Re: UDF for generating top xx % of results? - Pig - [mail # user]
|
|
...ahh, I see, i seem to have misread the question, if it's top xx% entries, then certainly sorting and then limiting. @Thejas I had thought that Limit is distributed and does not g...
|
|
|
Author: hc busy,
2010-06-30, 16:02
|
|
|
Re: UDF for generating top xx % of results? - Pig - [mail # user]
|
|
...That's what I tried to say in my last email.I don't believe you can calculate exactly the percentiles in just one pass. Writing out the pig for two pass algorithm should be easy enough.. &nb...
|
|
|
Author: hc busy,
2010-06-29, 17:17
|
|
|
Re: UDF for generating top xx % of results? - Pig - [mail # user]
|
|
...I think it's impossible to do this within one M/R. You will want to implement it in two M/R in Pig, because you have to calculate the percentile in pass 1, and then perform the filter in pas...
|
|
|
Author: hc busy,
2010-06-29, 16:59
|
|
|
Re: Pig at LinkedIn - Pig - [mail # user]
|
|
...Russell, fire that neurologist who didn't care about what you had to think about your own problems!! ;-) But honestly though, I use booleans in my pig scripts too. The trouble is that ...
|
|
|
Author: hc busy,
2010-06-24, 20:26
|
|
|
Re: Scaling Pig Projects - The Hairy Pig - Pig - [mail # user]
|
|
...More great ideas, Scott! The one thing about idempotency of IMPORT is that you may not necessarily want it. The scripts that I wrote will indeed take alias from a previously imported p...
|
|
|
Author: hc busy,
2010-06-24, 17:24
|
|
|
Re: Scaling Pig Projects - The Hairy Pig - Pig - [mail # user]
|
|
...Hey, Scott, yeah, that's brilliant! Macro expansion means the script that PIG receives is a expanded script with all aliases defined, so that PIG can perform it's optimization. ...
|
|
|
Author: hc busy,
2010-06-22, 21:51
|
|
|
Re: Scaling Pig Projects - The Hairy Pig - Pig - [mail # user]
|
|
...Russ, That is a great wiki page with a lot of insightful discussions!! As a non-Ph.D. I'd like to say that I feel that the theoretic adherence to turing machines is rather artificial(I...
|
|
|
Author: hc busy,
2010-06-22, 21:48
|
|
|
Re: simple way to REPLACE on various columns - Pig - [mail # user]
|
|
...yeah, that'd be really cool. The other way that we can say this, (to make map reduce interface available in pig), is to allow FOREACH to be nested: TRIMED_TABLE = FOREACH TABLE { &nbs...
|
|
|
Author: hc busy,
2010-06-18, 18:20
|
|
|
Re: How to find all possible permutations from a bag - Pig - [mail # user]
|
|
...heh, I want n*(n-1)/2 too... Maybe someone out there has an UDF that does this after a group. On Wed, Jun 16, 2010 at 8:30 AM, Christian wrote: ...
|
|
|
Author: hc busy,
2010-06-16, 18:47
|
|
|
|
