Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Sorting ...


Copy link to this message
-
Re: Sorting ...
On May 25, 2011 01:43:22 Mark question wrote:
> Thanks Luca, but what other way to sort a directory of sequence files?
>
> I don't plan to write a sorting algorithm in mappers/reducers, but hoping
> to use the sequenceFile.sorter instead.
>
> Any ideas?
>
> Mark

Maybe this class can help?

  org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat

With it you should be able to read (key,value) records from your sequence files
and then do whatever you need with them.
--
Luca Pireddu
CRS4 - Distributed Computing Group
Loc. Pixina Manna Edificio 1
Pula 09010 (CA), Italy
Tel:  +39 0709250452
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB