Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 10 (0.063s).
Loading phrases to help you
refine your search...
using get/setMeta() & seek - Avro - [mail # user]
...Hi,  Here's my scenario.  One Hadoop job collects incoming Flume data and keeps appending records to Avro files. Every 30 minutes the file just grows. Another Hadoop job runs every...
   Author: Alan Miller, 2013-09-27, 23:54
Re: How to "repair" .avro files with "Invalid Sync" - Avro - [mail # user]
...Just an idea but... I thought there were some low level methods available that you could use to  get the sync markers.  Maybe then you could sequentially step through the orig file...
   Author: Alan Miller, 2013-01-15, 18:39
[expand - 1 more] - Re: Getting started with Avro - Avro - [mail # user]
...https://sites.google.com/site/developertips/Home/java/apache-avro has 3 complete examples:  1. Use a JSON schema to encode the data and use the same/similar    schema to decod...
   Author: Alan Miller, 2013-01-15, 09:30
aliases, doc and non-standard tags - Avro - [mail # user]
...Hi,  I have a complex schema consisting of primitives, multiple records, and multiple array of records fields.That's all great and everything works fine when I process these avro data f...
   Author: Alan Miller, 2013-01-10, 14:00
[expand - 1 more] - Re: issue with writing an array of records - Avro - [mail # user]
...Thanks Scott, I figured it out. The problem was simply an improper loop design. I corrected the loop code and now I get an array of Ifnet records.  [amiller@loclhost $] avro cat --field...
   Author: Alan Miller, 2013-01-08, 11:48
[expand - 1 more] - Re: How to read with SpecificDatumReader - Avro - [mail # user]
...Thanks Doug, I guess that's the problem (somehow) but I don't see why writing the Avro file works but reading it doesn't. I mean, I',m writing or reading the files in the same way.  Whe...
   Author: Alan Miller, 2012-12-21, 13:54
Re: SpecificData.deepCopy exception with CDH4 - Avro - [mail # user]
...Hi Just a quick idea.  Also check ALL directories returned by   hadoop classpath for any Avro related classes.   I was struggling trying to use avro-1.7.0 with CDH4 but made i...
   Author: Alan Miller, 2012-07-15, 09:00
[expand - 1 more] - Re: avro 1.7.0 with CDH4 - Avro - [mail # user]
...I noticed that CDH4 has avro-1.5.4.jar in hadoop/lib so I modified my job so that:   1.  avro-1.7.0.jar and avro-tools-1.7.0.jar is contained within my jar file in ./lib/   &n...
   Author: Alan Miller, 2012-07-05, 11:02
how to get get field type - Avro - [mail # user]
...I'm writng Avro files for time-related data (data-yyyy-mm-dd.avro) via Java /HDFS and have approx 50 fields of various types. This all works and I'm good the re.  But now, different peo...
   Author: Alan Miller, 2012-05-21, 17:28
eta for 1.7.x release? - Avro - [mail # user]
...Hi,  is there an ETA for  AVRO 1.7.x release? Specifically, I'm looking for a release with AVRO-593.  I just started using Avro Java bindings in my Hadoop (CDH3u3) project and...
   Author: Alan Miller, 2012-05-21, 17:22
Avro (10)
Hadoop (6)
MapReduce (4)
Flume (1)
HDFS (1)
mail # user (10)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (10)
Doug Cutting (418)
Scott Carey (155)
Jeff Hammerbacher (123)
Philip Zeyliger (69)
Thiruvalluvan M. G. (68)
Matt Massie (66)
Douglas Creager (48)
Bruce Mitchener (44)
Harsh J (43)
Scott Banachowski (40)
Martin Kleppmann (35)
Jeff Hodges (32)
Tom White (28)
Jeremy Lewi (23)
Lewis John Mcgibbney (23)
James Baldassari (20)
Christophe Taton (19)
Patrick Hunt (18)
Patrick Wendell (17)
Sharad Agarwal (16)
Vivek Nadkarni (16)
Jeremy Kahn (15)
Miki Tebeka (15)
Yang (15)
Eric Evans (14)
Alan Miller