| clear query|facets|time |
Search criteria: .
Results from 1 to 9 from
9 (0.158s).
|
|
|
Loading phrases to help you
refine your search...
|
|
need help about pig script on this case - Pig - [mail # user]
|
|
...Hi, I am trying to do some tasks with 'if else' inside the pig script, specifically, if the folder exists, we do some statements and join the data into some table, otherwise, just igno...
|
|
|
Author: Sheng Guo,
2012-11-20, 00:35
|
|
|
how can I delete a file in pig only after checking if the file exists? - Pig - [mail # user]
|
|
...Hi all, Sorry to bother you guys, I used rm FILE_PATH to delete the file in pig script, but sometimes if the file does not exist, or I am not sure if it exists, this statement will giv...
|
|
|
Author: Sheng Guo,
2012-07-23, 09:12
|
|
|
Re: What is the best way to do counting in pig? - Pig - [mail # user]
|
|
...the pig script: longDesc = load '/user/xx/filtered_chunk' USING AvroStorage(); grpall = group longDesc all; cnt = foreach grpall generate COUNT(longDesc) as allNumber; explain cn...
|
|
|
Author: Sheng Guo,
2012-07-09, 22:54
|
|
|
Re: What is the best way to do counting in pig? - Pig - [mail # user]
|
|
...I guess that's the reason, using single reducer may cause some problem when the data is huge, the counting is very time-consuming or even die at the end. What do you mean by counting s...
|
|
|
Author: Sheng Guo,
2012-07-02, 21:32
|
|
|
Re: What is the best way to do counting in pig? - Pig - [mail # user]
|
|
...No. I try to figure out how many records (rows) in 'm_skill_group' table. (That limit statement actually is not necessary) Thanks! On Mon, Jul 2, 2012 at 1:20 PM, Jonathan Coven...
|
|
|
Author: Sheng Guo,
2012-07-02, 20:34
|
|
|
What is the best way to do counting in pig? - Pig - [mail # user]
|
|
...Hi all, I used to use the following pig script to do the counting of the records. m_skill_group = group m_skills_filter by member_id; grpd = group m_skill_group all; cnt = foreac...
|
|
|
Author: Sheng Guo,
2012-07-02, 18:42
|
|
|
Re: How can I set the mapper number for pig script? - Pig - [mail # user]
|
|
...Thanks for all your help. My pig script may have some cpu-intensive job like nlp processing, so it would be helpful if I have multiple mappers running. Correct me if I am wrong. Thanks...
|
|
|
Author: Sheng Guo,
2012-06-23, 20:48
|
|
|
Re: How can I set the mapper number for pig script? - Pig - [mail # user]
|
|
...I know it is automatically set. But I have a large data set, I want it allocate more mappers during midnight so that more computing resource could be used to speed up. Any suggestions? ...
|
|
|
Author: Sheng Guo,
2012-06-23, 07:30
|
|
|
How can I set the mapper number for pig script? - Pig - [mail # user]
|
|
...Hi everyone, Sorry to bother. How can I configure the number of mappers for my pig script? Thanks a lot! Sheng...
|
|
|
Author: Sheng Guo,
2012-06-23, 02:27
|
|
|
|
