Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # dev >> What protocols are used in Mappers ?


Copy link to this message
-
Re: What protocols are used in Mappers ?
Thanks Venkata for the quick response.

I hope this information would be helpful.

I am using CDH4 and I am trying to access GPU from cleanup() method of
mapper class using JOCL <http://www.jocl.org/>.
I am using this as third party jar in my MR code.
(Note: My normal code using JOCL (without map reduce) works fine on GPU).

When I execute my map-reduce code, It throws an error (specified below).

******************************Error********************************************
attempt_201309171647_0021_m_000000_1: No protocol specified
attempt_201309171647_0021_m_000000_1:* No protocol specified*
13/09/20 18:03:01 INFO mapred.JobClient: Task Id :
attempt_201309171647_0021_m_000000_2, Status : FAILED
org.jocl.CLException:* CL_DEVICE_NOT_FOUND*
    at org.jocl.CL.checkResult(CL.java:569)
    at org.jocl.CL.clGetDeviceIDs(CL.java:2239)
    at com.testMR.jocl.WordCountMapper.cleanup(WordCountMapper.java:106)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
    at org.apache.hadoop.mapred.Child.main(Child.java:262)
******************************************************************************

*Each map task throws an error  "No protocol specified". what does this
mean ?*
What are the protocols used in mapper class ?

My mapper runs successfully if I change the mode from GPU to CPU in the
code.

-Regards
Rohit

On Sat, Sep 21, 2013 at 9:18 PM, Venkata K Pisupat <
[EMAIL PROTECTED]> wrote:

> That does not seem to be a Hadoop error message. Check with OS. I believe
> it's coming from the OS level. A little more context on problem would be
> helpful. The full error message and steps that are leading to the problem,
> which version of Hadoop are you using etc.
>
> Thanks and Regards,
> Krishna Pisupat
>
>
> On Sep 21, 2013, at 7:30 AM, rohit sarewar <[EMAIL PROTECTED]> wrote:
>
> > Hi All
> >
> > My map task failed stating the error message "No protocol specified".
> > What does this mean ?
> >
> > Regards
> > Rohit Sarewar
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB