Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Avro >> mail # user >> listing avro datafile metadata


+
Patrick Linehan 2010-10-23, 01:38
Copy link to this message
-
Re: listing avro datafile metadata
Hm, this can't be done right now I think. In DataFileStream, the
metadata holding HashMap structure (which is populated upon
initialization itself) is not exposed out directly, only via some form
of query via keys.

We could add a patch to allow retrieving the entire metadata HashMap,
which can then be iterated upon if a user wants to. Or do we list out
the keys alone?

Opened a JIRA for this with a patch (exposing the map):
https://issues.apache.org/jira/browse/AVRO-682

On Sat, Oct 23, 2010 at 7:08 AM, Patrick Linehan <[EMAIL PROTECTED]> wrote:
> is there a way to list the metadata fields present in a given file?  the
> methods provided by DataFileReader only seem to allow for get-ing metadata
> with known names, not introspecting on the metadata in general.

--
Harsh J
www.harshj.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB