Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Reading Sequence File from Hadoop Distributed Cache ..


+
Mark Olimpiati 2012-10-10, 23:45
Copy link to this message
-
Re: Reading Sequence File from Hadoop Distributed Cache ..
Hi Mark,

DistributedCache files, when accessed from a Task, exist on the local
file system. You should make sure the SequenceFile.Reader tries to
read it with a LocalFS than a HDFS instance.

On Thu, Oct 11, 2012 at 5:15 AM, Mark Olimpiati <[EMAIL PROTECTED]> wrote:
> Hi,
>
>   I'm storing sequence files in the distributed cache which seems to be
> stored somewher under each node's /tmp .../local/archive/ ... path.
>
> In mapper code, I tried using SequenceFile.Reader with all possible
> configurations (locally, distribtued) however, it can't find it. Are
> sequence files supported in the distribued cache??
>
> Thank you,
> Mark

--
Harsh J
+
Mark Olimpiati 2012-10-11, 19:53
+
Steve Loughran 2012-10-12, 18:27
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB