Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Mechanism of hadoop -jar


Copy link to this message
-
Re: Mechanism of hadoop -jar
As someone already pointed out, you are better off using the DistributedCache (http://hadoop.apache.org/common/docs/r1.0.3/mapred_tutorial.html#DistributedCache) for what you are trying to achieve...

Arun

On Aug 11, 2012, at 7:09 PM, Jay Vyas wrote:

> Sorry for the confusion... To be clear It is TOTALLY okay to jar up a text
> file and access it in hadoop via the class.getResource(...) api !
>
> 1) Hadoop doesn't do anything funny with the class loader, it just uses the
> Simple sun JVM class loader.
>
> 2) My problem was simply that I wasn't jarring up my text file properly.
> This was causing (obviously) all my mappers/reducers to not see my file.
>
> Thanks for all the responses they were helpful !

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/