Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: C++ example for hadoop-2.2.0


Copy link to this message
-
Re: C++ example for hadoop-2.2.0
Hi,

Did you tried to compile with source?

/Salman.
Salman Toor, PhD
[EMAIL PROTECTED]

On Nov 4, 2013, at 2:55 PM, Andre Kelpe wrote:

> I reported the 32bit/64bit problem a few weeks ago. There hasn't been
> much activity around it though:
> https://issues.apache.org/jira/browse/HADOOP-9911
>
> - André
>
> On Mon, Nov 4, 2013 at 2:20 PM, Salman Toor <[EMAIL PROTECTED]> wrote:
>> Hi,
>>
>> Ok so 2.x is not a new version its another branch. Good to know! Actually
>> 32bit will be difficult as the code I got have already some dependencies on
>> 64 bit.
>>
>> Otherwise I will continue with 1.x version. Can you suggest some version
>> with 1.x series which is stable and work on the cluster environment?
>> especially with C++ ...
>>
>> Regards..
>> Salman.
>>
>> Salman Toor, PhD
>> [EMAIL PROTECTED]
>>
>>
>>
>> On Nov 4, 2013, at 1:54 PM, Amr Shahin wrote:
>>
>> Well, the 2 series isn't exactly the "next version". It's a continuation of
>> branch .2.
>> Also, the error message from the gcc indicates that the library you're
>> trying to link to isn't compatible which made me suspicious. check the
>> documentation to see if hadoop has 64 libraries, or otherwise compile
>> against the 32 ones
>>
>>
>> On Mon, Nov 4, 2013 at 4:51 PM, Salman Toor <[EMAIL PROTECTED]> wrote:
>>>
>>> Hi,
>>>
>>> Thanks for your answer!
>>>
>>> But are you sure about it? Actually Hadoop version 1.2 have both 32 and 64
>>> bit libraries so I believe the the next version should have both... But I am
>>> not sure just a random guess :-(
>>>
>>> Regards..
>>> Salman.
>>>
>>> Salman Toor, PhD
>>> [EMAIL PROTECTED]
>>>
>>>
>>>
>>> On Nov 4, 2013, at 1:38 PM, Amr Shahin wrote:
>>>
>>> I believe hadoop isn't compatible with 64 architecture. Try installing the
>>> 32 libraries and compile against them.
>>> This error (skipping incompatible
>>> /home/sztoor/hadoop-2.2.0/lib/native/libhadooppipes.a when searching
>>> -lhadooppipes) indicates so
>>>
>>>
>>> On Mon, Nov 4, 2013 at 2:44 PM, Salman Toor <[EMAIL PROTECTED]> wrote:
>>>>
>>>> Hi,
>>>>
>>>> Can someone give a pointer?
>>>>
>>>>
>>>> Thanks in advance.
>>>>
>>>> Regards..
>>>> Salman.
>>>>
>>>>
>>>> Salman Toor, PhD
>>>> [EMAIL PROTECTED]
>>>>
>>>>
>>>>
>>>> On Nov 3, 2013, at 11:31 PM, Salman Toor wrote:
>>>>
>>>> Hi,
>>>>
>>>> I am quite new to the Hadoop world, previously was running hadoop-1.2.0
>>>> stable version on my small cluster and encountered some strange problems
>>>> like the local path to the mapper  file didn't copy to the hdfs .... It
>>>> works fine on the single node setup but on multiple node simple word-count
>>>> python example didn't work...  I read on the blog that it might be the
>>>> problem in the version I am using. So I thought to change the version and
>>>> downloaded the Hadoop 2.2.0. This version has yarn together with many new
>>>> features that I hope I will learn in the future. Now simple wordcount
>>>> example works without any problem on the multi-node setup. I am using simple
>>>> python example.
>>>>
>>>> Now I would like to compile my C++ code. Since the directory structure
>>>> together with other things have been changed. I have started to get the
>>>> following error:
>>>>
>>>> ----------------
>>>> /urs/bin/ld:  skipping incompatible
>>>> /home/sztoor/hadoop-2.2.0/lib/native/libhadooputils.a when searching
>>>> -lhadooputils
>>>> cannot find -lhadooputils
>>>>
>>>> /urs/bin/ld:  skipping incompatible
>>>> /home/sztoor/hadoop-2.2.0/lib/native/libhadooppipes.a when searching
>>>> -lhadooppipes
>>>> cannot find -lhadooppipes
>>>> ------------------
>>>>
>>>> I have managed to run the c++ example successfully with the 1.2.0 version
>>>> on single node setup.
>>>>
>>>> I am having 64bit Ubuntu machine. previously I was using Linux-amd64-64
>>>>
>>>> Now in new version, "lib" and "include" directories are in the
>>>> hadoop-2.2.0 directory. No build.xml is available...
>>>>
>>>> Can someone please give me an example of a makefile based on the version