Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> Developing and deploying hadoop


Copy link to this message
-
Developing and deploying hadoop
I am interested in some general tips on how to develop and deploy new
versions of hadoop. I've been trying to compile a new version of  hadoop
and place the new jar to the cluster in the lib folder, however it was not
picked despite the classpath was explicitly set to the lib folder. I am
interested in the following questions:

a) How to deploy a new version? Just copy the new compiled jar file to all
lib folders on all nodes?
b) Should I make just a new compile or a new release ('ant' vs 'ant tar')?
c) How do you develop and deploy hadoop locally and how remotely?  For
deploying builds are you using your own sh scripts or are you using any
tools like ant/maven?
d) What is the purpose of the folder $HADOOP_HOME/share/hadoop?
Any other tips are welcomed..

Thank you
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB