| clear query|facets|time |
Search criteria: .
Results from 21 to 30 from
64 (0.164s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: removing last item in a bag - Pig - [mail # user]
|
|
...Chan, Sorry, I meant ordered = ORDER inputData BY date; not ordered = ORDER inputData BY key; On Wed, Mar 13, 2013 at 7:06 AM, Ruslan Al-Fakikh wrote: ...
|
|
|
Author: Ruslan Al-Fakikh,
2013-03-13, 03:09
|
|
|
Re: removing last item in a bag - Pig - [mail # user]
|
|
...Hi Chan, Your tasks seems to be not trivial in Pig. Basically bags are not ordered, so you have to either sort before or to decide what tuple you want to remove exactly. Some ways to s...
|
|
|
Author: Ruslan Al-Fakikh,
2013-03-13, 03:06
|
|
|
Pig 0.10.0-cdh4.1.1 uses its old JodaTime instead of my new JodaTime dependency in UDF - Pig - [mail # user]
|
|
...Hi guys, I am having a JodaTime maven version issue. I have a Java UDF in the form of a Maven project with this dependency: joda-time joda-time 2.1 Pig itself is dependent ...
|
|
|
Author: Ruslan Al-Fakikh,
2013-01-20, 16:26
|
|
|
Pig 0.10.0-cdh4.1.1: Annoying deprecation warnings - Pig - [mail # user]
|
|
...Hi guys, When runnig Pig I have a lot of WARNs like these: 2013-01-20 19:09:21,318 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use ...
|
|
|
Author: Ruslan Al-Fakikh,
2013-01-20, 16:13
|
|
|
Re: How to perfom a logical diff on two PigStorage files - Pig - [mail # user]
|
|
...Hi, As for point 1: it will always be cumbersome to work on such files. I would recommend using Avro where the schema is included in the file. Also you could try to sort contents or ap...
|
|
|
Author: Ruslan Al-Fakikh,
2012-11-30, 20:49
|
|
|
Re: How to filter by pig datatype? - Pig - [mail # user]
|
|
...Hi, Just in case, can you execute: DESCRIBE data; As per my understanding a relation has a schema for all rows and it cannot have a schema per row. I guess that you will have to treat ...
|
|
|
Author: Ruslan Al-Fakikh,
2012-11-22, 12:11
|
|
|
Re: distributed cache - Pig - [mail # user]
|
|
...Maybe this is what you are looking for: http://ofps.oreilly.com/titles/9781449302641/advanced_pig_latin.html see "Replicated join" On Tue, Nov 13, 2012 at 11:46 AM, yingnan.ma w...
|
|
|
Author: Ruslan Al-Fakikh,
2012-11-14, 19:44
|
|
|
Re: AvroStorage compression ratio - Pig - [mail # user]
|
|
...For me it was: 27.5G for uncompressed tab-delimited plain txt when compressed: Format Size sequence files 1.6G avro deflate with level 1 2.9G avro deflate with level 5 2.4G avro def...
|
|
|
Author: Ruslan Al-Fakikh,
2012-10-23, 13:31
|
|
|
Re: AvroStorage compression ratio - Pig - [mail # user]
|
|
...How do you generate your Avro files? It worked OK for me with: SET avro.mapred.deflate.level 5 inputData = LOAD 'input path' USING org.apache.pig.piggybank.storage.avro.AvroStorage(); ...
|
|
|
Author: Ruslan Al-Fakikh,
2012-10-22, 13:02
|
|
|
Re: debug feature?? - Pig - [mail # user]
|
|
...As for: I remember there was some discussion on this in the past. Actually this is not trivial. What would it do if you changed a UDF internal code, for example? How would it know that it sh...
|
|
|
Author: Ruslan Al-Fakikh,
2012-10-22, 12:55
|
|
|
|
