Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Compile Just a Subproject


+
Curtis Ullerich 2013-06-19, 23:53
+
Chris Nauroth 2013-06-20, 18:17
+
Curtis Ullerich 2013-06-20, 18:47
+
Omkar Joshi 2013-06-21, 02:17
+
Curtis Ullerich 2013-06-21, 22:12
Copy link to this message
-
Re: Compile Just a Subproject
Arpit Agarwal 2013-06-21, 22:57
Curtis, if you are running 'mvn clean' in a subproject you may be hitting
this bug:
https://issues.apache.org/jira/browse/HADOOP-9383

You might have better luck if you include install along with package in the
same invocation.

-Arpit

On Fri, Jun 21, 2013 at 3:12 PM, Curtis Ullerich <[EMAIL PROTECTED]>wrote:

> I've executed the commands as you've said, and the jar that is run is
> unchanged. Here's exactly what I did.
>
> C:\l\> start-dfs
> C:\l\> start-yarn
> C:\l\> cd
> hadoop-yarn-project\hadoop-yarn\hadoop-yarn-applications\hadoop-yarn-applications-distributedshell
>
> C:\l\hadoop-yarn-project\hadoop-yarn\hadoop-yarn-applications\hadoop-yarn-applications-distributedshell>hadoop org.apache.hadoop.yarn.applications.distributedshell.Client -jar
> target\hadoop-yarn-applications-distributedshell-3.0.0-SNAPSHOT.jar
> -shell_command whoami
> ...output...
> ...modify logging code in
> C:/l/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
>
> C:\l\hadoop-yarn-project\hadoop-yarn\hadoop-yarn-applications\hadoop-yarn-applications-distributedshell>mvn clean install -DskipTests
>
> C:\l\hadoop-yarn-project\hadoop-yarn\hadoop-yarn-applications\hadoop-yarn-applications-distributedshell>hadoop org.apache.hadoop.yarn.applications.distributedshell.Client -jar
> target\hadoop-yarn-applications-distributedshell-3.0.0-SNAPSHOT.jar
> -shell_command whoami
> ...identical output to before...
>
> Do you see anything wrong with what I've done?
>
> Thanks,
> Curtis
>
>
>
>
> On Thu, Jun 20, 2013 at 7:17 PM, Omkar Joshi <[EMAIL PROTECTED]>wrote:
>
>> Hi Curtis,
>>
>> where are you picking your jar file from? once you run above command you
>> will see the updated jar file in
>>
>> "..../hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/target/hadoop-yarn-applications-distributedshell-3.0.0-SNAPSHOT.jar"
>>
>> I hope you are not using below jar file
>>
>> "..../hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.0.0-SNAPSHOT.jar"
>>
>>
>> What chris has said is right.
>>
>> once you have taken latest code, you should follow below steps
>> 1) mvn clean install -DskipTests (clean to remove previously generated
>> code)
>> 2) now say you are updating distributed shell client code. then go to
>> ""..../hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/"
>> and then run "mvn clean install" and use jar from target sub folder.
>>
>> Thanks,
>> Omkar Joshi
>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>
>>
>> On Thu, Jun 20, 2013 at 11:47 AM, Curtis Ullerich <[EMAIL PROTECTED]
>> > wrote:
>>
>>> Hi Chris,
>>>
>>> I really appreciate the response. What you described is what I initially
>>> tried. The changes never seem to take effect though. Here's what I've done
>>> (this is Windows):
>>>
>>> cd %hadoop_install_dir%
>>> mvn clean package -DskipTests
>>> mvn install -DskipTests
>>>
>>> --- modify the code in distributed shell's Client.java ---
>>>
>>>
>>> cd hadoop-yarn-project\hadoop-yarn\hadoop-yarn-applications\hadoop-yarn-applications-distributedshell
>>> mvn clean
>>> mvn package -DskipTests
>>> mvn install -DskipTests
>>>
>>> Then I run the jar, just as before. I've just been changing log
>>> statements to see if the changes worked. They don't--the output doesn't
>>> change after doing this rebuild. I've also tried clearing the files put on
>>> HDFS in my user directory in case that was the issue. I've taken a more
>>> thorough look at BUILDING.txt and I seemed to be consistent with the
>>> procedures described there. Am I missing anything else? I've tried
>>> restarting yarn and dfs, though I didn't think that would matter.
>>>
>>> Thanks,
>>> Curtis
>>>
>>>
>>>
>>>
>>> On Thu, Jun 20, 2013 at 11:17 AM, Chris Nauroth <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Hi Curtis,
>>>>
>>>> I handle this by running "mvn install -DskipTests" once from the root
+
Curtis Ullerich 2013-06-21, 23:09
+
Hitesh Shah 2013-06-22, 00:10
+
Curtis Ullerich 2013-06-22, 00:38
+
Curtis Ullerich 2013-06-24, 16:38