Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro, mail # user - When do we get Avro gem for 1.7.7?


Copy link to this message
-
Re: When do we get Avro gem for 1.7.7?
Martin Kleppmann 2014-04-17, 15:48
I'm afraid I'm out of my depth now, as I don't know anything about the Python implementation of Avro. Perhaps someone else can help. Or if you think it's a bug, please post a reproducible test case on https://issues.apache.org/jira/browse/AVRO

Martin

On 16 Apr 2014, at 14:39, Lenin Raj <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi Martin,

I had Homebrew already. So I installed snappy and python-snappy and avro via pip as per https://github.com/phunt/avro-rpc-quickstart

When I tried to run the start_server.py<https://github.com/phunt/avro-rpc-quickstart/tree/master/src/main/python>, I get the following error:

python $ ./start_server.py
Traceback (most recent call last):
  File "./start_server.py", line 20, in <module>
    import avro.ipc as ipc
  File "build/bdist.macosx-10.8-intel/egg/avro/ipc.py", line 35, in <module>
  File "build/bdist.macosx-10.8-intel/egg/avro/schema.py", line 778, in parse
avro.schema.SchemaParseException: Error parsing JSON:
@HANDSHAKE_REQUEST_SCHEMA@

python $
Thanks,
Lenin
On Sat, Apr 5, 2014 at 12:47 AM, Martin Kleppmann <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Try installing Homebrew (http://brew.sh/) and then doing `brew install snappy`. That will put libsnappy in /usr/local/lib.

Martin

On 4 Apr 2014, at 11:51, Lenin Raj <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi Martin,

I have installed the avro version 17.6 by applying the patch directly. But to use the python server, I need to install  "libsnappy-dev" in Mac OS as per https://github.com/phunt/avro-rpc-quickstart. Do you know how to install this library in Mac OS? or is there an alternate way to setup a python RPC server using Avro?
Thanks,
Lenin
On Thu, Apr 3, 2014 at 2:31 AM, Martin Kleppmann <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
This bug is really unfortunate :(

The easiest workaround is to just install an older version: gem install avro --version 1.7.5

The only significant difference between the 1.7.5 and the 1.7.6 Rubygem is that the JSON dependency was switched from yajl to multi_json. If you can live with yajl for now, 1.7.5 should work fine for you.

Martin

On 1 Apr 2014, at 21:07, Lenin Raj <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
I installed it by applying the patch.

Went to lang/ruby/ and modified Rakefile as:

p.runtime_dependencies = %w[multi-json] to p.runtime_dependencies = %w[multi_json]

and `sudo rake install`

I am able to do RPC using Ruby server/client. I want a python server actually. In the repo https://github.com/phunt/avro-rpc-quickstart, there is lib named "libsnappy-dev". Does anybody know its equivalent for Mac OS?
Thanks,
Lenin
On Wed, Apr 2, 2014 at 1:19 AM, Lenin Raj <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi All,

I was trying to install the avro gem and got an error saying,

ERROR:  While executing gem ... (Gem::UnsatisfiableDependencyError)
    Unable to resolve dependency: avro (= 1.7.6) requires multi-json (>= 0)

I learnt that, this was fixed in 1.7.7 (https://issues.apache.org/jira/browse/AVRO-1459) but the gem page(http://rubygems.org/gems/avro) still shows 1.7.6. When do we get the latest version? or How can build the gem locally by applying the patch?

Thanks,
Lenin