Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 9 from 9 (0.174s).
Loading phrases to help you
refine your search...
Schema design guideline, strict v.s. lenient - Avro - [mail # user]
...During our development of schema based data pipeline, we often run into a debate. Should we make the schema tight and strict so that all the application error can be tested and caught early?...
   Author: Wai Yip Tung, 2015-02-11, 01:02
Re: Python avro performance - Avro - [mail # user]
...Python Avro is super slow. I have built a C module that is about 30 times faster. It does both encoding and decoding. I intend to open source it soon. More testers would be helpful then.Wai ...
   Author: Wai Yip Tung, 2015-01-09, 20:02
Re: Hadoop stream gzipped file with AvroAsTextInputFormat - Avro - [mail # user]
...I think I've figured out how to make this work.Initially I have a file "data.avro". I gzip it as "data.avro.gz" and try to feed it to Hadoop. This does not work.Instead Avro supports "deflat...
   Author: Wai Yip Tung, 2014-07-25, 00:22
Re: Avro binary format to raw binary format - Avro - [mail # user]
...What is raw binary format?Sachin Goyal wrote: ...
   Author: Wai Yip Tung, 2014-06-13, 17:25
[expand - 2 more] - Re: Union resolution in dynamic languages - Avro - [mail # user]
...That's good to know. Would you mind sharing your use case with us?Wai Yip ...
   Author: Wai Yip Tung, 2014-06-05, 17:40
[expand - 1 more] - Re: Schema import dependencies - Avro - [mail # user]
...Let's say we are interested to keep 2 schema file because they come from 2 separate organization. When we generate a data file they need to be merged into one standalone schema. The maven pl...
   Author: Wai Yip Tung, 2014-05-28, 22:40
[expand - 1 more] - Re: embed avro data in an envelop - Avro - [mail # user]
...Thank you. This should work.I wonder if there is a way in the JSON/avsc to reference or compose the schema from other files. So we will have app developer to create `my_app.avsc` and the inf...
   Author: Wai Yip Tung, 2014-05-13, 22:09
[expand - 1 more] - Re: default write value in schema? - Avro - [mail # user]
...Thank you. I'm using the Python API. It seems record builder is not available. But it is good to know the general approach for initializing with default value.Wai YipChristophe Taton wrote:&...
   Author: Wai Yip Tung, 2014-02-20, 19:06
[expand - 1 more] - Re: Schema exclusion from Avro message - Avro - [mail # user]
...I'm planning to stream it via Kafka.I think I've sorted it out. The Object Container Files is not an essential part of the Avro. Instead of using DataFileReader/DataFileWriter, I can use Dat...
   Author: Wai Yip Tung, 2014-01-28, 01:09
Sort:
project
Avro (9)
type
mail # user (9)
date
last 7 days (0)
last 30 days (1)
last 90 days (2)
last 6 months (2)
last 9 months (9)
author
Ted Yu (1947)
Harsh J (1309)
Jun Rao (1075)
Todd Lipcon (1006)
Stack (997)
Andrew Purtell (945)
Jonathan Ellis (857)
stack (797)
Josh Elser (784)
Jarek Jarcec Cecho (771)
Yusaku Sako (767)
Jean-Daniel Cryans (752)
Hitesh Shah (746)
Brock Noland (721)
Eric Newton (720)
Siddharth Seth (706)
Jonathan Hsieh (688)
Roman Shaposhnik (684)
Steve Loughran (679)
Namit Jain (648)
Owen O'Malley (619)
Hyunsik Choi (617)
James Taylor (612)
Neha Narkhede (577)
Bikas Saha (552)
Wai Yip Tung
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB