Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 9 from 9 (0.127s).
Loading phrases to help you
refine your search...
Is there a way to write spark RDD to Avro files - Avro - [mail # user]
...We used mapreduce for ETL and storing results in Avro files, which areloaded to hive/impala for query.Now we are trying to migrate to spark, but didn't find a way to writeresulting RDD to Av...
   Author: Fengyun RAO, 2014-07-30, 09:14
[expand - 3 more] - Re: How to dynamically create a MapSchema with "String" as key, not "Utf8" - Avro - [mail # user]
...I didn't realize this is exactly the right answer, thank you, Harsh!2014-05-19 18:52 GMT+08:00 Harsh J : ...
   Author: Fengyun RAO, 2014-05-23, 14:56
[expand - 1 more] - Re: Is it possible to write a magic byte in Avro file head? - Avro - [mail # user]
...Thanks, Doug. The Avro file metadata is exactly what we need!2014-05-17 7:20 GMT+08:00 Doug Cutting : ...
   Author: Fengyun RAO, 2014-05-19, 03:31
[expand - 1 more] - Error reading map type in C# version but not java version - Avro - [mail # user]
...My data type is Dictionary, I serialize it using:var datumWriter = new SpecificDatumWriter<Dictionary<string,MyType>>(CACHE_SCHEMA);using (var writer =DataFileWriter>.OpenWrit...
   Author: Fengyun RAO, 2014-05-16, 14:36
[expand - 1 more] - Re: How to deserialize java resource file in the jar package? - Avro - [mail # user]
...Thanks Doug, it works!2014-05-03 5:35 GMT+08:00 Doug Cutting : ...
   Author: Fengyun RAO, 2014-05-03, 03:48
[expand - 1 more] - Re: MapReduce: Using Avro Input/Output Formats without Specifying a schema - Avro - [mail # user]
...We also used AvroMultipleOutputs to deal with multiple schemas.the problem stands the same, you have to set a single mapper outputtype (or schema) before submitting the MR job. since there a...
   Author: Fengyun RAO, 2014-05-01, 04:41
what's the efficiency difference between type: "string" and ["string", "null"] - Avro - [mail # user]
...I have some string fields which may be null, while some definitely not null.The problem is that it takes time to distinguish them.There are about 100 fields, 50 of which are string,  10...
   Author: Fengyun RAO, 2014-03-14, 08:16
[expand - 1 more] - Re: MapReduce: How to output multiplt Avro files? - Avro - [mail # user]
...thanks, Alan, it works!2014-03-07 11:21 GMT+08:00 Alan Paulsen : ...
   Author: Fengyun RAO, 2014-03-07, 07:15
[expand - 1 more] - Re: Can Avro serialize and compress in parallel? - Avro - [mail # user]
...Thanks, Martin.  I was using C# on Windows to generate the Avro files, and now learning to use java.  The reason I want to combine the Avro files is that MR & HDFS are better for l...
   Author: Fengyun RAO, 2014-01-08, 08:52
Sort:
project
Hadoop (10)
Spark (10)
Avro (7)
HDFS (1)
MapReduce (1)
type
mail # user (9)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (1)
last 9 months (9)
author
Doug Cutting (426)
Scott Carey (154)
Jeff Hammerbacher (123)
Philip Zeyliger (70)
Thiruvalluvan M. G. (68)
Matt Massie (66)
Douglas Creager (48)
Bruce Mitchener (44)
Harsh J (43)
Scott Banachowski (40)
Martin Kleppmann (35)
Tom White (35)
Jeff Hodges (32)
Lewis John Mcgibbney (25)
Jeremy Lewi (23)
James Baldassari (20)
Christophe Taton (18)
Patrick Hunt (18)
Patrick Wendell (17)
Sharad Agarwal (16)
Vivek Nadkarni (16)
Jeremy Kahn (15)
Miki Tebeka (15)
Yang (15)
Eric Evans (14)
Fengyun RAO
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB