Hi,

I am trying to install pipes on os x following the instructions here

I can compile utils, but not pipes itself.

System:
gcc version 4.2.1, java version "1.6.0_31" , OS X 10.7.3
hadoop: 1.0.3

When I do configure I get the following error. Any help much appreciated

./configure
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for gawk... no
checking for mawk... no
checking for nawk... no
checking for awk... awk
checking whether make sets $(MAKE)... yes
checking for style of include used by make... GNU
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking dependency style of gcc... gcc3
checking how to run the C preprocessor... gcc -E
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for ANSI C header files... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking minix/config.h usability... no
checking minix/config.h presence... no
checking for minix/config.h... no
checking whether it is safe to define __EXTENSIONS__... yes
checking for special C compiler options needed for large files... no
checking for _FILE_OFFSET_BITS value needed for large files... no
checking pthread.h usability... yes
checking pthread.h presence... yes
checking for pthread.h... yes
checking for pthread_create in -lpthread... yes
checking for HMAC_Init in -lssl... no
./configure: line 413: test: please: integer expression expected
./configure: line 416: 1: Bad file descriptor
configure: error: check
./configure: line 302: return: please: numeric argument required
./configure: line 312: exit: please: numeric argument required

Mind if I ask why you prefer pipes to streaming?  I abandoned pipes early in my hadoop efforts and went all engines full on streaming.

On May 21, 2012, at 04:07 , Peter Cogan wrote:

> Hi,
>
> I am trying to install pipes on os x following the instructions here
________________________________________________________________________________
Keith Wiley     [EMAIL PROTECTED]     keithwiley.com    music.keithwiley.com

"I used to be with it, but then they changed what it was.  Now, what I'm with
isn't it, and what's it seems weird and scary to me."
                                           --  Abe (Grandpa) Simpson
________________________________________________________________________________

Hi Keith,

Yeah - maybe that was my first mistake. Since I haven't had much luck getting pipes working I've started looking at streaming. I am still 'early in my hadoop efforts' so now is the time for big course corrections

thanks
Peter

On 21 May 2012, at 18:11, Keith Wiley wrote:

> Mind if I ask why you prefer pipes to streaming?  I abandoned pipes early in my hadoop efforts and went all engines full on streaming.
>
> On May 21, 2012, at 04:07 , Peter Cogan wrote:
>
>> Hi,
>>
>> I am trying to install pipes on os x following the instructions here
>
>
> ________________________________________________________________________________
> Keith Wiley     [EMAIL PROTECTED]     keithwiley.com    music.keithwiley.com
>
> "I used to be with it, but then they changed what it was.  Now, what I'm with
> isn't it, and what's it seems weird and scary to me."
>                                           --  Abe (Grandpa) Simpson
> ________________________________________________________________________________
>

Hubris aside (mine I mean), I'm probably not qualified to be the last word on this with regard to advising you on your project's overall direction, so hopefully others will chime in on this discussion...but that said, when I started with hadoop a few years ago and our project exceed the capabilities of direct-Java hadoop interfacing, we briefly entertained the notion of pipes and learned (to the best of my recollection) that pipes was officially losing its support within the hadoop community (it may have even been depricated although I don't remember for sure) and that streaming was being officially advocated as the replacement (unless I am grossly exaggerating the advice I received at the time).  In fact, the primary reason I abandoned pipes wasn't so much that the technology itself wouldn't work, but that there was far less community support for it than for streaming, so whenever I got stuck I couldn't really ask for help (or I could ask but I would be inquiring a much smaller pool of potential responders, thus decreasing the scope of any response).

At any rate, I have been quite satisfied with streaming.  Gotchas have included coding from a scratch an entire partially abstract C++ class family to offer a streaming interface to communicate between hadoop and underlying native processing, to say nothing of coding up binary/ascii conversion in a variety of formats to shuffle data across the i/o streams (for reasons I can't recall now, the binary streaming interface wasn't a good option for us at the time).

Still, all's well.

Best of luck.

On May 21, 2012, at 10:26 , Peter Cogan wrote:

>
> Hi Keith,
>
> Yeah - maybe that was my first mistake. Since I haven't had much luck getting pipes working I've started looking at streaming. I am still 'early in my hadoop efforts' so now is the time for big course corrections
>
> thanks
> Peter
>
> On 21 May 2012, at 18:11, Keith Wiley wrote:
>
>> Mind if I ask why you prefer pipes to streaming?  I abandoned pipes early in my hadoop efforts and went all engines full on streaming.
>>
>> On May 21, 2012, at 04:07 , Peter Cogan wrote:
>>
>>> Hi,
>>>
>>> I am trying to install pipes on os x following the instructions here
________________________________________________________________________________
Keith Wiley     [EMAIL PROTECTED]     keithwiley.com    music.keithwiley.com

"The easy confidence with which I know another man's religion is folly teaches
me to suspect that my own is also."
                                           --  Mark Twain
________________________________________________________________________________

Hi Keith,

thanks sincerely for the advice and relating your experiences.

regards
Peter Cogan
On 21 May 2012, at 18:57, Keith Wiley wrote:

> Hubris aside (mine I mean), I'm probably not qualified to be the last word on this with regard to advising you on your project's overall direction, so hopefully others will chime in on this discussion...but that said, when I started with hadoop a few years ago and our project exceed the capabilities of direct-Java hadoop interfacing, we briefly entertained the notion of pipes and learned (to the best of my recollection) that pipes was officially losing its support within the hadoop community (it may have even been depricated although I don't remember for sure) and that streaming was being officially advocated as the replacement (unless I am grossly exaggerating the advice I received at the time).  In fact, the primary reason I abandoned pipes wasn't so much that the technology itself wouldn't work, but that there was far less community support for it than for streaming, so whenever I got stuck I couldn't really ask for help (or I could ask but I would be inquiring a much smaller pool of potential responders, thus decreasing the scope of any response).
>
> At any rate, I have been quite satisfied with streaming.  Gotchas have included coding from a scratch an entire partially abstract C++ class family to offer a streaming interface to communicate between hadoop and underlying native processing, to say nothing of coding up binary/ascii conversion in a variety of formats to shuffle data across the i/o streams (for reasons I can't recall now, the binary streaming interface wasn't a good option for us at the time).
>
> Still, all's well.
>
> Best of luck.
>
> On May 21, 2012, at 10:26 , Peter Cogan wrote:
>
>>
>> Hi Keith,
>>
>> Yeah - maybe that was my first mistake. Since I haven't had much luck getting pipes working I've started looking at streaming. I am still 'early in my hadoop efforts' so now is the time for big course corrections
>>
>> thanks
>> Peter
>>
>> On 21 May 2012, at 18:11, Keith Wiley wrote:
>>
>>> Mind if I ask why you prefer pipes to streaming?  I abandoned pipes early in my hadoop efforts and went all engines full on streaming.
>>>
>>> On May 21, 2012, at 04:07 , Peter Cogan wrote:
>>>
>>>> Hi,
>>>>
>>>> I am trying to install pipes on os x following the instructions here
>
>
> ________________________________________________________________________________
> Keith Wiley     [EMAIL PROTECTED]     keithwiley.com    music.keithwiley.com
>
> "The easy confidence with which I know another man's religion is folly teaches
> me to suspect that my own is also."
>                                           --  Mark Twain
> ________________________________________________________________________________
>