Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # dev >> Picking up local common changes in mr


Copy link to this message
-
Re: Picking up local common changes in mr
Blowing away the common dir in my local m2 repo fixed the issue, for
some reason it wasn't re-populating it.

Thanks,
Eli

On Thu, Aug 18, 2011 at 3:42 PM, Eli Collins <[EMAIL PROTECTED]> wrote:
> Thanks Giri.  That doesn't seem to work from me. Eg if I make a change
> to FileUtil in hadoop-common then mvn-install -DskipTests, it gets
> populated into my local m2 repo but it is not picked up by mvn
> test-compile -Dresolvers=internal in hadoop-mapreduce (ie per below I
> can't introduce a new method that's used in a test). Does this work
> for you or am I doing something wrong?
>
> Thanks,
> Eli
>
> hadoop-mapreduce (trunk)$ git diff
> diff --git hadoop-common/src/main/java/org/apache/hadoop/fs/FileUtil.java hadoop
> index 8e7aa30..0471caf 100644
> --- hadoop-common/src/main/java/org/apache/hadoop/fs/FileUtil.java
> +++ hadoop-common/src/main/java/org/apache/hadoop/fs/FileUtil.java
>
> +  public static boolean fullyDelete2(File dir) { }
> +
>
> diff --git hadoop-mapreduce/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apa
> index 454ef2c..d029529 100644
> --- hadoop-mapreduce/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/had
> +++ hadoop-mapreduce/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/had
> @@ -1,3 +1,4 @@
>     } finally {
>       FileUtil.fullyDelete(procfsRootDir);
> +      FileUtil.fullyDelete2(procfsRootDir);
>     }
>   }
>
>
>
>
> On Thu, Aug 18, 2011 at 3:30 PM, Giridharan Kesavan
> <[EMAIL PROTECTED]> wrote:
>> Hello,
>>
>> Its the same -Dresolvers=internal for the ant build system; For the
>> maven/yarn build system as long as you have the latest common jar in
>> the m2 cache its going to resolve common from the maven cache. If not
>> from the apache maven repo. You can force the builds to use the cache
>> by adding -o option. (offline builds)
>>
>> Thanks,
>> Giri
>>
>> On Thu, Aug 18, 2011 at 3:19 PM, Eli Collins <[EMAIL PROTECTED]> wrote:
>>> Hey gang,
>>>
>>> What's the new equivalent of resolvers=true in the new MR build? ie
>>> how do you get a  a local common change to get picked up by mr?
>>>
>>> Thanks,
>>> Eli
>>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB