Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Where do/should .jar files live?


Copy link to this message
-
Where do/should .jar files live?
Hi List,

This should be a simple question, I think.  Disclosure, I am not a java
developer. ;)

We're getting ready to build our Dev and Prod clusters. I'm pretty
comfortable with HDFS and how it sits atop several local file systems on
multiple servers.  I'm fairly comfortable with the concept of Map/Reduce
and why it's cool and we want it.

Now for the question.  Where should my developers, put and store their jar
files?  Or asked another way, what's the best entry point for submitting
jobs?

We have separate physical systems for NN, Checkpoint Node (formerly 2nn),
Job Tracker and Standby NN.  Should I run from the JT node? Do I keep all
of my finished .jar's on the JT local file system?
Or should I expect that jobs will be run via Oozie?  Do I put jars on the
local Oozie FS?

Thanks in advance.
Chris
+
bejoy.hadoop@... 2013-01-23, 02:54
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB