| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
86 (0.746s).
|
|
|
Loading phrases to help you
refine your search...
|
|
[expand - 2 more]
[collapse]
-
Re: COUNT(A.field1) - Pig - [mail # user]
|
|
...I am not sure why second option is better - in both cases, you are shipping only the combined counts from map to reduce. On other hand, first could be better since it means we need to ...
|
|
|
|
|
| |
|
|
Re: COUNT(A.field1) - Pig - [mail # user]
|
|
...Generally speaking, the second option will be more performant as it might let you drop column a3 early. In most cases the magnitude of this is likely to be very small as COUNT is an algebrai...
|
|
|
Author: Dmitriy Ryaboy,
2010-08-25, 22:15
|
|
|
COUNT(A.field1) - Pig - [mail # user]
|
|
...Wondering about performance and count... A = load 'test.csv' as (a1,a2,a3); B = GROUP A by a1; C = FOREACH B GENERATE COUNT(A); performant? C = FOREACH B GENERATE COUNT(A.a...
|
|
|
Author: Corbin Hoenes,
2010-08-25, 20:58
|
|
|
|
|
[expand - 1 more]
[collapse]
-
Re: Child processes on datanodes/task trackers - Hadoop - [mail # general]
|
|
...Use jps to find out pid of the Child. Then use this to find out which job the Child belongs to: ps aux | grep On Wed, Aug 25, 2010 at 12:20 PM, C J wrote: ...
|
|
|
|
Author: Ted Yu,
2010-08-25, 23:17
|
|
|
| |
|
|
Child processes on datanodes/task trackers - Hadoop - [mail # general]
|
|
...Hi, I wanted to know why I see running Child processes on my datanodes even though there is no job running at that time. Are these left over from failed attempts? Is there...
|
|
|
Author: C J,
2010-08-25, 19:20
|
|
|
|
|
data node disk usage per volume? - Hadoop - [mail # user]
|
|
..."dfs.datanode.du.reserved" can limit the size of space per volume that can be used by a data node. I have 2 related questions. 1. How "volume" is defined here? Say I have 2 folders lis...
|
|
|
|
|
|
|
|
[expand - 1 more]
[collapse]
-
Re: svn/git revisions for 0.20.2 - Hadoop - [mail # user]
|
|
...On Aug 25, 2010, at 3:20 PM, Johannes Zillmann wrote: 0.20 was pre-project split, so common included hdfs and mapreduce. ...
|
|
|
|
|
| |
|
|
svn/git revisions for 0.20.2 - Hadoop - [mail # user]
|
|
...Hey folks, can somebody tell me how to get the source versions from git/svn for hadoop-hdfs and hadoop-mapreduce ? In hadoop-common there are branches and tags for the release. B...
|
|
|
Author: Johannes Zillmann,
2010-08-25, 22:20
|
|
|
|
|
[expand - 2 more]
[collapse]
-
Re: quota? - Hadoop - [mail # user]
|
|
...Thanks, Ted. Michael From: Ted Yu Subject: Re: quota? To: [EMAIL PROTECTED] Date: Wednesday, August 25, 2010, 5:47 PM Refer to http://hadoop.apache.org/common/docs/...
|
|
|
|
|
| |
|
|
Re: quota? - Hadoop - [mail # user]
|
|
...Refer to http://hadoop.apache.org/common/docs/r0.20.0/hdfs_quota_admin_guide.html#Space+Quotas On Wed, Aug 25, 2010 at 3:43 PM, jiang licht wrote: ...
|
|
|
Author: Ted Yu,
2010-08-25, 22:47
|
|
|
quota? - Hadoop - [mail # user]
|
|
...Is it possible to tell hadoop to restrict space usage of a specific dfs folder in the cluster, e.g. a user home directory (/user/accountA in dfs)? And is there a way to restrict the si...
|
|
|
Author: jiang licht,
2010-08-25, 22:43
|
|
|
|
|
Pig restricts size of mapper/reducer output? - Pig - [mail # user]
|
|
...Is there a way to tell Pig to restrict the size of map/reduce output that can be saved to dfs? E.g. if a job creates over-limit data, it won't be allowed to save the result to the dfs and th...
|
|
|
|
|
|
|
|
[MAPREDUCE-1923] Support arbitrary precision in the distbbp example - MapReduce - [issue]
|
|
...The precision obtained by distbbp is limited by Java double (IEEE 754 64-bit), which has machine epsilon e=2^(-53). When it is used to compute the 10^15 th bit of π, only 26-bit precis...
|
|
|
|
|
|
|
|
[expand - 2 more]
[collapse]
-
Re: memory usage too high in regionserver - HBase - [mail # user]
|
|
...In HBase client, you can utilize HeapSize through Put: public class Put implements HeapSize, Writable, Row, Comparable { Cheers On Wed, Aug 25, 2010 at 3:13 PM, Ryan Rawson...
|
|
|
|
Author: Ted Yu,
2010-08-25, 22:24
|
|
|
| |
|
|
Re: memory usage too high in regionserver - HBase - [mail # user]
|
|
...Hey, It's all over the place. HeapSize is one interface. There is also stuff in HRegion, Store and Memstore that tracks memory used. On top of it the LruBlockCache do...
|
|
|
Author: Ryan Rawson,
2010-08-25, 22:13
|
|
|
Re: memory usage too high in regionserver - HBase - [mail # user]
|
|
...Hello guys, Is there any documentation on that or if you could point to some sources I will be very thankful (even if sources are particular classes, please name at least few to look ...
|
|
|
Author: Alex Baranau,
2010-08-25, 17:59
|
|
|
|
|
[expand - 5 more]
[collapse]
-
Re: Group By data - Pig - [mail # user]
|
|
...Thanks Xiaomeng, but no luck. On 8/25/10 2:00 PM, "Xiaomeng Wan" wrote: o trunk ate you ? te: ng same t, j, e n of...
|
|
|
|
|
| |
|
|
Re: Group By data - Pig - [mail # user]
|
|
...came across similar problem before. try to break gen_grp_table =FOREACH grp_table { min_creation_date = MIN(gen_table.date); &nbs...
|
|
|
Author: Xiaomeng Wan,
2010-08-25, 21:00
|
|
|
Re: Group By data - Pig - [mail # user]
|
|
...It is older then Aug 9th. I updated the trunk version of pig, but have no luck. On 8/25/10 1:08 PM, "Thejas M Nair" wrote: ...
|
|
|
Author: Wasti, Syed,
2010-08-25, 20:42
|
|
|
Re: Group By data - Pig - [mail # user]
|
|
...I think this issue can be caused by https://issues.apache.org/jira/browse/P IG-1525 , can you check if your trunk version of pig is newer than Aug 9th ? (I haven't tried running query ...
|
|
|
Author: Thejas M Nair,
2010-08-25, 20:08
|
|
|
Re: Group By data - Pig - [mail # user]
|
|
...Hi Dmitriy, Thanks for offering help, attached is the sample data file. From my observation it looks like it has to something with min function on the grouped data. The id's for which it is ...
|
|
|
Author: Wasti, Syed,
2010-08-25, 18:21
|
|
|
Re: Group By data - Pig - [mail # user]
|
|
...Could you send sample data that would allow us to reproduce this error? -Dmitriy On Tue, Aug 24, 2010 at 1:12 PM, Wasti, Syed wrote: e ,...
|
|
|
Author: Dmitriy Ryaboy,
2010-08-25, 06:33
|
|
|
|
|
[AVRO-628] Unions have no getter function (avro_union_get) - Avro - [issue]
|
|
...The union data type has no getter function and as such, the only way to get to the data in the union is to create a structtypedef struct avro_union_datum_t { struct avro_obj_t obj; int64_t d...
|
|
|
|
|
|
|
|
|
|
|
|
