Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Mechanism of hadoop -jar


Copy link to this message
-
Re: Mechanism of hadoop -jar
As someone already pointed out, you are better off using the DistributedCache (http://hadoop.apache.org/common/docs/r1.0.3/mapred_tutorial.html#DistributedCache) for what you are trying to achieve...

Arun

On Aug 11, 2012, at 7:09 PM, Jay Vyas wrote:

> Sorry for the confusion... To be clear It is TOTALLY okay to jar up a text
> file and access it in hadoop via the class.getResource(...) api !
>
> 1) Hadoop doesn't do anything funny with the class loader, it just uses the
> Simple sun JVM class loader.
>
> 2) My problem was simply that I wasn't jarring up my text file properly.
> This was causing (obviously) all my mappers/reducers to not see my file.
>
> Thanks for all the responses they were helpful !

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB