Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - Re: Error while running MapR program on multinode configuration


Copy link to this message
-
Re: Error while running MapR program on multinode configuration
Mohammad Tariq 2013-04-03, 23:47
DistributedCache??

Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Apr 4, 2013 at 5:01 AM, yypvsxf19870706
<[EMAIL PROTECTED]>wrote:

> Hi all
>
>    However,I do think the export jar contains external libraries is too
> huge to  be submitted to the MP by the client.
>    So It comes to the conclusion that the jar without the external jars
> could be suited the situation ,however the runnable jar brings the errors.
>    How to solve the errors. One way is to set the Hadoop_classspath
> explicitly when you run the runnable jars.
>    Any other suggestions?
>
> Regards
>
>
>
> 发自我的 iPhone
>
> 在 2013-4-4,6:47,Mohammad Tariq <[EMAIL PROTECTED]> 写道:
>
> As expected :)
> Actually this is something related to Eclipse. When it comes to the
> creation of executable jars containing external jars we need to be a bit
> careful. One thing which you could probably try is to select the "Package
> required libraries into generated jar" option while exporting your project
> as an executable jar.
>
> HTH
>
> Warm Regards,
> Tariq
> https://mtariq.jux.com/
> cloudfront.blogspot.com
>
>
> On Thu, Apr 4, 2013 at 4:10 AM, Varsha Raveendran <
> [EMAIL PROTECTED]> wrote:
>
>> Thank you! You are right!
>>  I created the jar file using the command line and not eclipse and it
>> worked!
>>
>>
>>
>>
>> On Thu, Apr 4, 2013 at 4:06 AM, Mohammad Tariq <[EMAIL PROTECTED]>wrote:
>>
>>> It seems to be a non-hadoop issue to me. Is the jar which you are
>>> finally creating a runnable jar?We can't reference external classes(jars)
>>> in a runnable jar file. Everything must be contained inside the jar itself.
>>>
>>> Warm Regards,
>>> Tariq
>>> https://mtariq.jux.com/
>>> cloudfront.blogspot.com
>>>
>>>
>>> On Thu, Apr 4, 2013 at 3:28 AM, Varsha Raveendran <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Thanks for replying!
>>>>
>>>> version : hadoop 1.1.1
>>>>
>>>> I am creating a jar file called ga_test.jar and then placing  it in the
>>>> build path of another program.
>>>> Also, I am using eclipse to create another jar file including
>>>> ga_test.jar as a reference library. I do not know why hadoop is taking the
>>>> filename as rsrc:ga_test.jar.  (Maybe thats where the ":" is coming into
>>>> the picture!)
>>>>
>>>> Thanks!
>>>>
>>>>
>>>>
>>>>
>>>> On Thu, Apr 4, 2013 at 3:18 AM, Mohammad Tariq <[EMAIL PROTECTED]>wrote:
>>>>
>>>>> Which version are you using? Could you plz show me your code, if
>>>>> possible for you.
>>>>> Also, how are you running the job? For a detailed explanation you
>>>>> might find this <https://issues.apache.org/jira/browse/HDFS-13>
>>>>>  useful.
>>>>>
>>>>> Warm Regards,
>>>>> Tariq
>>>>> https://mtariq.jux.com/
>>>>> cloudfront.blogspot.com
>>>>>
>>>>>
>>>>> On Thu, Apr 4, 2013 at 3:09 AM, Varsha Raveendran <
>>>>> [EMAIL PROTECTED]> wrote:
>>>>>
>>>>>>  But I do not have a ":" in any of my file names.
>>>>>> What could the other reasons be? I am not able to debug the error..
>>>>>>
>>>>>> Thank you for replying.
>>>>>>
>>>>>>
>>>>>> On Thu, Apr 4, 2013 at 2:02 AM, Mohammad Tariq <[EMAIL PROTECTED]>wrote:
>>>>>>
>>>>>>> Hello ma'am,
>>>>>>>
>>>>>>>    Please make sure that you don't have ":" in your files.
>>>>>>>
>>>>>>> Warm Regards,
>>>>>>> Tariq
>>>>>>> https://mtariq.jux.com/
>>>>>>> cloudfront.blogspot.com
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Apr 4, 2013 at 1:50 AM, Varsha Raveendran <
>>>>>>> [EMAIL PROTECTED]> wrote:
>>>>>>>
>>>>>>>> Hello,
>>>>>>>>
>>>>>>>> I am facing this error while trying to run a jar file on hadoop :
>>>>>>>>
>>>>>>>> 13/04/04 01:48:01 INFO mapred.JobClient: Cleaning up the staging
>>>>>>>> area
>>>>>>>> hdfs://MT2012158:54310/app/hadoop/tmp/mapred/staging/hduser/.staging/job_201304032344_0008
>>>>>>>> Exception in thread "main"
>>>>>>>> java.lang.reflect.InvocationTargetException
>>>>>>>>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>>>     at
>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)