| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
10 (0.1s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: LOAD multiple files with glob - Pig - [mail # user]
|
|
...To answer myself again, I compiled Pig 0.11 and Piggybank, and it's working very well now, globbing seems to be fully supported! Bart Verwilst schreef op 26.11.2012 15:33:...
|
|
|
Author: Bart Verwilst,
2012-11-26, 15:50
|
|
|
Re: LOAD multiple files with glob - Pig - [mail # user]
|
|
...To answer myself, could this be part of the solution? : https://issues.apache.org/jira/browse/PIG-2492 Guess I'll have to wait for 0.11 then? Bart Verwilst schreef op 26.11...
|
|
|
Author: Bart Verwilst,
2012-11-26, 14:33
|
|
|
Re: LOAD multiple files with glob - Pig - [mail # user]
|
|
...14:16:08 centos6-hadoop-hishiru ~ $ cat avro-test.pig REGISTER 'hdfs:///lib/avro-1.7.2.jar'; REGISTER 'hdfs:///lib/json-simple-1.1.1.jar'; REGISTER 'hdfs:///lib/piggybank.jar'; &...
|
|
|
Author: Bart Verwilst,
2012-11-26, 13:19
|
|
|
Re: LOAD multiple files with glob - Pig - [mail # user]
|
|
...Hi Cheolsoo, Describe shows me: avro: {id: long,timestamp: long,latitude: int,longitude: int,speed: int,heading: int,terminalid: int,customerid: chararray,mileage: in...
|
|
|
Author: Bart Verwilst,
2012-11-26, 12:48
|
|
|
Re: LOAD multiple files with glob - Pig - [mail # user]
|
|
...Just tried this: REGISTER 'hdfs:///lib/avro-1.7.2.jar'; REGISTER 'hdfs:///lib/json-simple-1.1.1.jar'; REGISTER 'hdfs:///lib/piggybank.jar'; DEFINE AvroStorage org.apache.pig.pig...
|
|
|
Author: Bart Verwilst,
2012-11-25, 20:25
|
|
|
Re: LOAD multiple files with glob - Pig - [mail # user]
|
|
...Hello, The schema is displayed by describe when i run it like this: REGISTER 'hdfs:///lib/avro-1.7.2.jar'; REGISTER 'hdfs:///lib/json-simple-1.1.1.jar'; REGISTER 'hdfs:///lib/pig...
|
|
|
Author: Bart Verwilst,
2012-11-25, 20:14
|
|
|
Re: LOAD multiple files with glob - Pig - [mail # user]
|
|
...Hi, I've tried loading a csv with PigStorage(), getting this: txt = load '/import.mysql/trace_ejb3_2011/part-m-00000' USING PigStorage(','); describe txt; Schema for...
|
|
|
Author: Bart Verwilst,
2012-11-25, 11:02
|
|
|
Re: LOAD multiple files with glob - Pig - [mail # user]
|
|
...Hello, Thanks for your suggestion! I switch my avro variable to avro = load '$INPUT' USING AvroStorage(); However I get the same results this way: $ pig -p INPUT=/data/2012...
|
|
|
Author: Bart Verwilst,
2012-11-24, 13:15
|
|
|
LOAD multiple files with glob - Pig - [mail # user]
|
|
...Hello, I have the following files on HDFS: -rw-r--r-- 3 hdfs supergroup 22989179 2012-11-22 11:17 /data/2012/trace_ejb3/2012-01-01.avro -rw-r--r-- 3 hd...
|
|
|
Author: Bart Verwilst,
2012-11-23, 20:45
|
|
|
Reading Avro files with Pig - Pig - [mail # user]
|
|
...Hi, I'm trying to read the Avro file i stored on HDFS, but I seem to be hitting a snag. I'm hoping some of you will be able to shed some light on this and allow me to conti...
|
|
|
Author: Bart Verwilst,
2012-11-19, 15:59
|
|
|
|
