Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Submitting a hadoop job in large clusters.


Copy link to this message
-
Re: Submitting a hadoop job in large clusters.
Which doesn't imply that you should log yourself to the physical machine
where the JobTracker is hosted. It only implies that the hadoop client must
be able to reach the JobTracker. It could be from any physical machines
hosting the slaves (DataNode, Tasktracker) but it is rarely the case.
Often, job are submitted from a machine which doesn't belong to the cluster
but can reach every machine of it.

Regards

Bertrand

On Sun, May 12, 2013 at 7:59 PM, shashwat shriparv <
[EMAIL PROTECTED]> wrote:

> As nitin said , its responsibility of Jobtracker to distribute the job to
> task to the tasktrackers so you need to submitt the job to the job tracker
>
> *Thanks & Regards    *
>
> ∞
> Shashwat Shriparv
>
>
>
> On Sun, May 12, 2013 at 11:26 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote:
>
>> nope
>> in MRv1 only jobtracker can accept jobs. You can not trigger job on any
>> other process in hadoop other than jobtracker.
>>
>>
>> On Sun, May 12, 2013 at 11:25 PM, Shashidhar Rao <
>> [EMAIL PROTECTED]> wrote:
>>
>>> @shashwat shriparv
>>>
>>> Can the a hadoop job be submitted to any datanode in the cluster and not
>>> to jobTracker.
>>>
>>> Correct me if it I am wrong , I was told that a hadoop job can be
>>> submitted to datanode also apart from JobTracker. Is it correct?
>>>
>>> Advanced thanks
>>>
>>>
>>> On Sun, May 12, 2013 at 11:02 PM, shashwat shriparv <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>>
>>>> On Sun, May 12, 2013 at 12:19 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote:
>>>>
>>>>>
>>>>> normally if you want to copy the jar then hadoop admins setu
>>>>>
>>>>
>>>>  Submit you job to Job tracker it will distribute throughout the
>>>> tasktrackers.
>>>>
>>>> *Thanks & Regards    *
>>>>
>>>> ∞
>>>> Shashwat Shriparv
>>>>
>>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>