Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> Avro file size is too big


Copy link to this message
-
Re: Avro file size is too big
On Fri, Jul 20, 2012 at 10:12 AM, Ey-Chih chow <[EMAIL PROTECTED]> wrote:
> We use the avro tool, fromtext, to compress a json log file.  I didn't find an option that can set the sync interval.

The fromtext tool has a --level option, e.g.:

java -jar avro-tools.jar --level 9 foo.txt foo.avro

Doug
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB