Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # dev - What protocols are used in Mappers ?


Copy link to this message
-
Re: What protocols are used in Mappers ?
rohit sarewar 2013-09-21, 16:08
Thanks Venkata for the quick response.

I hope this information would be helpful.

I am using CDH4 and I am trying to access GPU from cleanup() method of
mapper class using JOCL <http://www.jocl.org/>.
I am using this as third party jar in my MR code.
(Note: My normal code using JOCL (without map reduce) works fine on GPU).

When I execute my map-reduce code, It throws an error (specified below).

******************************Error********************************************
attempt_201309171647_0021_m_000000_1: No protocol specified
attempt_201309171647_0021_m_000000_1:* No protocol specified*
13/09/20 18:03:01 INFO mapred.JobClient: Task Id :
attempt_201309171647_0021_m_000000_2, Status : FAILED
org.jocl.CLException:* CL_DEVICE_NOT_FOUND*
    at org.jocl.CL.checkResult(CL.java:569)
    at org.jocl.CL.clGetDeviceIDs(CL.java:2239)
    at com.testMR.jocl.WordCountMapper.cleanup(WordCountMapper.java:106)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
    at org.apache.hadoop.mapred.Child.main(Child.java:262)
******************************************************************************

*Each map task throws an error  "No protocol specified". what does this
mean ?*
What are the protocols used in mapper class ?

My mapper runs successfully if I change the mode from GPU to CPU in the
code.

-Regards
Rohit

On Sat, Sep 21, 2013 at 9:18 PM, Venkata K Pisupat <
[EMAIL PROTECTED]> wrote:

> That does not seem to be a Hadoop error message. Check with OS. I believe
> it's coming from the OS level. A little more context on problem would be
> helpful. The full error message and steps that are leading to the problem,
> which version of Hadoop are you using etc.
>
> Thanks and Regards,
> Krishna Pisupat
>
>
> On Sep 21, 2013, at 7:30 AM, rohit sarewar <[EMAIL PROTECTED]> wrote:
>
> > Hi All
> >
> > My map task failed stating the error message "No protocol specified".
> > What does this mean ?
> >
> > Regards
> > Rohit Sarewar
>
>