| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
11 (0.847s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: pig script - failed reading input from s3 - Pig - [mail # user]
|
|
...Hello Vitalii, The 5TB limit is only valid if you are using the EMR framework to run ur jobs in a jobflow. I think we cannot use that in my case as I have a CDH4 cluster on EC2. But th...
|
|
|
Author: Panshul Whisper,
2013-04-10, 10:00
|
|
|
Re: pig script - failed reading input from s3 - Pig - [mail # user]
|
|
...Thank you for the advice David. I tried this ant it works with the native system. But my problem is not solved yet, because I have to work with files much bigger than 5GB. My test data...
|
|
|
Author: Panshul Whisper,
2013-04-08, 15:30
|
|
|
pig script - failed reading input from s3 - Pig - [mail # user]
|
|
...Hello I am trying to run a pig script which is suppoesed to read input from s3 and write back to s3. The cluster scenario is as follows: * Cluster is installed on EC2 using Cloudera Ma...
|
|
|
Author: Panshul Whisper,
2013-04-07, 17:11
|
|
|
Re: removing dupes from a bag while saving first occurrence - Pig - [mail # user]
|
|
...I think u should.. Group then... In a nested foreach.. order each group records by date.. Then in another nested foreach perform the distinct in each group.. This should pick the first eleme...
|
|
|
Author: Panshul Whisper,
2013-03-08, 23:21
|
|
|
Re: removing dupes from a bag while saving first occurrence - Pig - [mail # user]
|
|
...Did u try to order them by date before grouping them? On Mar 9, 2013 12:12 AM, "Chan, Tim" wrote: ...
|
|
|
Author: Panshul Whisper,
2013-03-08, 23:18
|
|
|
Re: too many memory spills - Pig - [mail # user]
|
|
...Hello Prashant, I have a CDH installation and by default memory allocated to each task tracker is 387 MB. And yes these spills are happening on Map and Reduce side. Still not sol...
|
|
|
Author: Panshul Whisper,
2013-03-07, 21:01
|
|
|
Re: using hdfs shell commands in a pig script - Pig - [mail # user]
|
|
...Thnx... This worked.. and really helped... Regards, On Wed, Mar 6, 2013 at 3:58 PM, shashwat shriparv <[EMAIL PROTECTED] Regards, Ouch Whisper 010101010101...
|
|
|
Author: Panshul Whisper,
2013-03-06, 21:16
|
|
|
using hdfs shell commands in a pig script - Pig - [mail # user]
|
|
...Hello, Is it possible to use hadoop fs commands in a pig script? What i exactly want to do is, at the end of my pig script, after the execution of store in a file command, I want...
|
|
|
Author: Panshul Whisper,
2013-03-06, 11:33
|
|
|
Re: Limit vs Sample - Pig - [mail # user]
|
|
...Thank you for the replies. I got the point now. :) Regards, Panshul On Thu, Feb 28, 2013 at 11:08 AM, Prasanth J wrote: Regards, Ouch Whisper 010101010101...
|
|
|
Author: Panshul Whisper,
2013-02-28, 10:41
|
|
|
Limit vs Sample - Pig - [mail # user]
|
|
...Hello, Can somebody please explain me the difference between Limit and Sample statements. Does it read the entire input file in case of Sample if the value is set to 0.1 or it reads ra...
|
|
|
Author: Panshul Whisper,
2013-02-26, 23:19
|
|
|
|
