Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> How to "repair" .avro files with "Invalid Sync"


Copy link to this message
-
Re: How to "repair" .avro files with "Invalid Sync"
thanks Alan.

I ran a caveman version which I'm testing now. I used avrotools -tojason
to a file, then ran avrotools -fromjson.

-Terry

On 01/15/2013 01:39 PM, Alan Miller wrote:
> Just an idea but...
> I thought there were some low level methods available that you could use to  get the sync markers.  Maybe then you could sequentially step through the orig file and try to write each record to a new file.  
>
> Alan.
>
>
> Sent from my iPhone
>
> On Jan 15, 2013, at 18:59, Terry Healy <[EMAIL PROTECTED]> wrote:
>
>> I have an .avro file that I'm trying to use within a Map/Reduce job. I
>> believe it was corrupted when I appended one file to another by mistake.
>>
>> Are there any tools to repair this?
>>
>>
>>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB