Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Avro >> mail # user >> Python for Avro doesn't build on OS X 10.6.8. Stuck.


+
Russell Jurney 2011-12-15, 01:23
+
Joe Crobak 2011-12-15, 01:46
+
Russell Jurney 2011-12-15, 03:07
+
Ken Krugler 2011-12-24, 00:05
Copy link to this message
-
Re: Python for Avro doesn't build on OS X 10.6.8. Stuck.
Avro 1.53 doesn't have this issue? Does it use python-snappy?

Russell Jurney
twitter.com/rjurney
[EMAIL PROTECTED]
datasyndrome.com

On Dec 23, 2011, at 7:05 PM, Ken Krugler <[EMAIL PROTECTED]>
wrote:

I installed brew, then ran 'brew install snappy', which worked.

But 'sudo python setup.py install' still fails, though with a different
problem (I was getting the same compilation errors as below, now I get a
broken pipe error).

running install
running bdist_egg
running egg_info
writing requirements to avro.egg-info/requires.txt
writing avro.egg-info/PKG-INFO
writing top-level names to avro.egg-info/top_level.txt
writing dependency_links to avro.egg-info/dependency_links.txt
reading manifest file 'avro.egg-info/SOURCES.txt'
writing manifest file 'avro.egg-info/SOURCES.txt'
installing library code to build/bdist.macosx-10.6-universal/egg
running install_lib
running build_py
creating build/bdist.macosx-10.6-universal/egg
creating build/bdist.macosx-10.6-universal/egg/avro
copying build/lib/avro/__init__.py ->
build/bdist.macosx-10.6-universal/egg/avro
copying build/lib/avro/datafile.py ->
build/bdist.macosx-10.6-universal/egg/avro
copying build/lib/avro/io.py -> build/bdist.macosx-10.6-universal/egg/avro
copying build/lib/avro/ipc.py -> build/bdist.macosx-10.6-universal/egg/avro
copying build/lib/avro/protocol.py ->
build/bdist.macosx-10.6-universal/egg/avro
copying build/lib/avro/schema.py ->
build/bdist.macosx-10.6-universal/egg/avro
copying build/lib/avro/tool.py -> build/bdist.macosx-10.6-universal/egg/avro
copying build/lib/avro/txipc.py ->
build/bdist.macosx-10.6-universal/egg/avro
byte-compiling build/bdist.macosx-10.6-universal/egg/avro/__init__.py to
__init__.pyc
byte-compiling build/bdist.macosx-10.6-universal/egg/avro/datafile.py to
datafile.pyc
byte-compiling build/bdist.macosx-10.6-universal/egg/avro/io.py to io.pyc
byte-compiling build/bdist.macosx-10.6-universal/egg/avro/ipc.py to ipc.pyc
byte-compiling build/bdist.macosx-10.6-universal/egg/avro/protocol.py to
protocol.pyc
byte-compiling build/bdist.macosx-10.6-universal/egg/avro/schema.py to
schema.pyc
byte-compiling build/bdist.macosx-10.6-universal/egg/avro/tool.py to
tool.pyc
byte-compiling build/bdist.macosx-10.6-universal/egg/avro/txipc.py to
txipc.pyc
creating build/bdist.macosx-10.6-universal/egg/EGG-INFO
installing scripts to build/bdist.macosx-10.6-universal/egg/EGG-INFO/scripts
running install_scripts
running build_scripts
creating build/bdist.macosx-10.6-universal/egg/EGG-INFO/scripts
copying build/scripts-2.6/avro ->
build/bdist.macosx-10.6-universal/egg/EGG-INFO/scripts
changing mode of
build/bdist.macosx-10.6-universal/egg/EGG-INFO/scripts/avro to 755
copying avro.egg-info/PKG-INFO ->
build/bdist.macosx-10.6-universal/egg/EGG-INFO
copying avro.egg-info/SOURCES.txt ->
build/bdist.macosx-10.6-universal/egg/EGG-INFO
copying avro.egg-info/dependency_links.txt ->
build/bdist.macosx-10.6-universal/egg/EGG-INFO
copying avro.egg-info/requires.txt ->
build/bdist.macosx-10.6-universal/egg/EGG-INFO
copying avro.egg-info/top_level.txt ->
build/bdist.macosx-10.6-universal/egg/EGG-INFO
zip_safe flag not set; analyzing archive contents...
creating 'dist/avro-1.6.1-py2.6.egg' and adding
'build/bdist.macosx-10.6-universal/egg' to it
removing 'build/bdist.macosx-10.6-universal/egg' (and everything under it)
Processing avro-1.6.1-py2.6.egg
Removing /Library/Python/2.6/site-packages/avro-1.6.1-py2.6.egg
Copying avro-1.6.1-py2.6.egg to /Library/Python/2.6/site-packages
avro 1.6.1 is already the active version in easy-install.pth
Installing avro script to /usr/local/bin

Installed /Library/Python/2.6/site-packages/avro-1.6.1-py2.6.egg
Processing dependencies for avro==1.6.1
Searching for python-snappy
Reading http://pypi.python.org/simple/python-snappy/
Reading http://github.com/andrix/python-snappy
Best match: python-snappy 0.3.2
Downloading
http://pypi.python.org/packages/source/p/python-snappy/python-snappy-0.3.2.tar.gz#md5=94ec3eb54a780fac3b15a6c141af973f
Processing python-snappy-0.3.2.tar.gz
Running python-snappy-0.3.2/setup.py -q bdist_egg --dist-dir
/tmp/easy_install-jARda8/python-snappy-0.3.2/egg-dist-tmp-DDcMTW
cc1plus: warning: command line option "-Wstrict-prototypes" is valid for
C/ObjC but not for C++
snappymodule.cc:41: warning: ‘_state’ defined but not used
/usr/libexec/gcc/powerpc-apple-darwin10/4.2.1/as: assembler
(/usr/bin/../libexec/gcc/darwin/ppc/as or
/usr/bin/../local/libexec/gcc/darwin/ppc/as) for architecture ppc not
installed
Installed assemblers are:
/usr/bin/../libexec/gcc/darwin/x86_64/as for architecture x86_64
/usr/bin/../libexec/gcc/darwin/i386/as for architecture i386
cc1plus: warning: command line option "-Wstrict-prototypes" is valid for
C/ObjC but not for C++
snappymodule.cc:41: warning: ‘_state’ defined but not used
snappymodule.cc:246: fatal error: error writing to -: Broken pipe
compilation terminated.
cc1plus: warning: command line option "-Wstrict-prototypes" is valid for
C/ObjC but not for C++
snappymodule.cc:41: warning: ‘_state’ defined but not used
lipo: can't open input file: /var/tmp//cc1RAU1Q.out (No such file or
directory)
error: Setup script exited with error: command 'gcc-4.2' failed with exit
status 1
Note that I have to run as sudo, otherwise I get:

Installing avro script to /usr/local/bin
error: /usr/local/bin/avro: Permission denied

I've added my vote to https://issues.apache.org/jira/browse/AVRO-981, and a
comment about why I think it's good to fix this issue.

In the meantime, we're going to use Avro 1.5.3

Thanks,
On Dec 14, 2011, at 7:07pm, Russell Jurney wrote:

I installed the snappy macport, and I still can't get snappy-python to
build.  I'll try switching to brew.

On Wed, Dec 14, 2011 at 5:46 PM, Joe Crobak <[EMAIL PROTECTED]> wrote:

Ken Krugler
http://www.scaleunlimited.com
custom big data solutions & training
Hadoop, Cascading, Mahout & Solr
+
Ken Krugler 2011-12-24, 01:35