Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # dev >> Re: Python client lib for Accumulo?

Edmon Begoli 2012-07-27, 03:15
Keith Turner 2012-07-27, 16:43
David Medinets 2012-07-27, 09:27
Edmon Begoli 2012-07-27, 11:19
Jim Klucar 2012-07-27, 11:37
David Medinets 2012-07-27, 12:50
Copy link to this message
Re: Python client lib for Accumulo?
I have a small proof of concept going. I'm still not sure what the
best way to do results paging is (i.e. your scan has a billion results
and won't fit in memory) My initial work is moving towards opening up
a HTTP/1.1 chunked-encoded stream like Twitter does for its streaming
API. The other thing I've been playing with are using websockets, but
that may restrict you to using JavaScript but I'm sure more client
side websocket libraries are coming.

On Fri, Jul 27, 2012 at 8:50 AM, David Medinets
> Which reminds me. There was a discussion of using a REST interface on
> this list. Several people liked that approach because it would provide
> loose coupling between client and server. Also the client could use
> any language. At the time, nobody could spare the time to implement
> it.
> On Fri, Jul 27, 2012 at 7:37 AM, Jim Klucar <[EMAIL PROTECTED]> wrote:
>> Welcome Edmon. I think as far as a pure python library goes, you would
>> have to interface with the thrift protocols. My sense is that would be
>> discouraged at this point by the devs. I do have some experience with
>> it though, I made an attempt to interface to Accumulo with Node.js. It
>> turned into me writing the JavaScript version of TCompactProtocol, but
>> it's still incomplete at this point. I would vote for either
>> developing an officially supported Thrift interface, or an officially
>> supported REST interface using a JVM language. Then the language
>> barrier would be easier to overcome.
>> Jim
>> On Jul 27, 2012, at 7:19 AM, Edmon Begoli <[EMAIL PROTECTED]> wrote:
>>> Hi David,
>>> I think that Jython is a good idea as at least a prototype or as a bridge
>>> towards a full blown python library.
>>> It is probably not a good end state because most Python developers do not
>>> want JVM and Java environment, and there is also performance overhead.
>>> Personally, I program in both languages, so I am good.
>>> Is there a particular protocol about contributing to accumulo project?
>>> On Jul 27, 2012 5:27 AM, "David Medinets" <[EMAIL PROTECTED]> wrote:
>>>> On Thu, Jul 26, 2012 at 11:15 PM, Edmon Begoli <[EMAIL PROTECTED]> wrote:
>>>>> I have just joined the list with the purpose of volunteering ideas,
>>>>> design and development (and whatever else in lifecycle)
>>>>> related to development of the Python client for accumulo.
>>>> Welcome to the list. There are a lot of Python developers and I'm sure
>>>> that your client would be well received by the community. My own
>>>> advice is to write whatever is simplest (fastest to develop) and
>>>> iterate towards a more complex complete solution.
>>>> Would jython be any use to provide python access to the existing Java
>>>> API without any rewrite or plumbing needed?
Edmon Begoli 2012-07-27, 13:06
Adam Fuchs 2012-07-27, 13:16