Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 22 (0.258s).
Loading phrases to help you
refine your search...
using get/setMeta() & seek - Avro - [mail # user]
...Hi,  Here's my scenario.  One Hadoop job collects incoming Flume data and keeps appending records to Avro files. Every 30 minutes the file just grows. Another Hadoop job runs every...
   Author: Alan Miller, 2013-09-27, 23:54
[expand - 2 more] - RE: streaming Avro to HDFS - Flume - [mail # user]
...Thanks again HAri, after I figured out the dependencies I was able to build a myapp.jar that runs the MyApp.class example and streams 10  “Hello’s” to my remote namenode.  Do I und...
   Author: Alan Miller, 2013-02-07, 13:44
Re: How to "repair" .avro files with "Invalid Sync" - Avro - [mail # user]
...Just an idea but... I thought there were some low level methods available that you could use to  get the sync markers.  Maybe then you could sequentially step through the orig file...
   Author: Alan Miller, 2013-01-15, 18:39
[expand - 1 more] - Re: Getting started with Avro - Avro - [mail # user]
...https://sites.google.com/site/developertips/Home/java/apache-avro has 3 complete examples:  1. Use a JSON schema to encode the data and use the same/similar    schema to decod...
   Author: Alan Miller, 2013-01-15, 09:30
aliases, doc and non-standard tags - Avro - [mail # user]
...Hi,  I have a complex schema consisting of primitives, multiple records, and multiple array of records fields.That's all great and everything works fine when I process these avro data f...
   Author: Alan Miller, 2013-01-10, 14:00
[expand - 1 more] - Re: issue with writing an array of records - Avro - [mail # user]
...Thanks Scott, I figured it out. The problem was simply an improper loop design. I corrected the loop code and now I get an array of Ifnet records.  [amiller@loclhost $] avro cat --field...
   Author: Alan Miller, 2013-01-08, 11:48
[expand - 1 more] - Re: How to read with SpecificDatumReader - Avro - [mail # user]
...Thanks Doug, I guess that's the problem (somehow) but I don't see why writing the Avro file works but reading it doesn't. I mean, I',m writing or reading the files in the same way.  Whe...
   Author: Alan Miller, 2012-12-21, 13:54
[expand - 2 more] - RE: datanode startup before hostname is resovable - MapReduce - [mail # user]
...Actually (from day to day)  I don’t get a NEW IP address.  The OS just can’t resolve the hostname when the DataNode starts up. NameNode, JobTracker & TaskTracker services all start...
   Author: Alan Miller, 2012-08-08, 14:52
Re: SpecificData.deepCopy exception with CDH4 - Avro - [mail # user]
...Hi Just a quick idea.  Also check ALL directories returned by   hadoop classpath for any Avro related classes.   I was struggling trying to use avro-1.7.0 with CDH4 but made i...
   Author: Alan Miller, 2012-07-15, 09:00
[expand - 1 more] - Re: avro 1.7.0 with CDH4 - Avro - [mail # user]
...I noticed that CDH4 has avro-1.5.4.jar in hadoop/lib so I modified my job so that:   1.  avro-1.7.0.jar and avro-tools-1.7.0.jar is contained within my jar file in ./lib/   &n...
   Author: Alan Miller, 2012-07-05, 11:02
Avro (10)
Hadoop (6)
MapReduce (4)
Flume (1)
HDFS (1)
mail # user (22)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (22)
Ted Yu (1711)
Harsh J (1299)
Jun Rao (1060)
Todd Lipcon (995)
Stack (979)
Jonathan Ellis (845)
Andrew Purtell (827)
Jean-Daniel Cryans (752)
Yusaku Sako (736)
stack (724)
Jarek Jarcec Cecho (703)
Eric Newton (697)
Jonathan Hsieh (674)
Neha Narkhede (673)
Roman Shaposhnik (666)
Namit Jain (649)
Hitesh Shah (627)
Steve Loughran (626)
Owen O'Malley (625)
Siddharth Seth (615)
Josh Elser (606)
Brock Noland (568)
Eli Collins (545)
Arun C Murthy (543)
Doug Cutting (536)
Alan Miller