Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # dev >> Review Request: Patch submitted by Chris McCubbin to add thrift proxy to Accumulo


+
keith@... 2012-11-07, 20:33
+
keith@... 2012-11-07, 21:14
+
keith@... 2012-11-07, 21:55
+
Chris McCubbin 2012-11-07, 21:40
+
Chris McCubbin 2012-11-07, 21:44
Copy link to this message
-
Re: Review Request: Patch submitted by Chris McCubbin to add thrift proxy to Accumulo

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/7936/#review13224
-----------------------------------------------------------

/trunk/proxy/README
<https://reviews.apache.org/r/7936/#comment28447>

    May be useful to provide guidance on how proxies should be run in a cluster.  For example run one proxy for each client node.
    
    So what should this guidance be?  Whats the best practice?
    
    Running a proxy process on every node where a client runs may be the most efficient.  But if the user has to manage this it could be cumbersome.  We could help by having each tserver run a proxy process may be the most convienet for users.  Could do this and provide a little bit of code for each language that helps a user find proxy.   This utility could prefer a local tserver if there is one and otherwise choose a random one.  Having tservers run a proxy service may make them less stable.
    

/trunk/proxy/src/main/thrift/proxy.thrift
<https://reviews.apache.org/r/7936/#comment28452>

    Having a createBatchWriter(), flushBatchWriter(), closeBatchWriter() methods will allow for a high performance write pipeline.  The single method makes the process synchronous, the user has to wait for writes to complete before sending more.  With multiple methods, the user could be sending a batch to the batch writer while the batch writer is sending the previous batch.
    
    Could possibly offer both.  The single method that does everything in one shot and multiple methods that allow a write pipeline.
    
    
- kturner
On Nov. 7, 2012, 8:33 p.m., kturner wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/7936/
> -----------------------------------------------------------
>
> (Updated Nov. 7, 2012, 8:33 p.m.)
>
>
> Review request for accumulo.
>
>
> Description
> -------
>
> Patch submitted by Chris McCubbin to add thrift proxy to Accumulo
>
>
> This addresses bug ACCUMULO-482.
>     https://issues.apache.org/jira/browse/ACCUMULO-482
>
>
> Diffs
> -----
>
>   /trunk/pom.xml 1406772
>   /trunk/proxy/README PRE-CREATION
>   /trunk/proxy/examples/python/README PRE-CREATION
>   /trunk/proxy/examples/python/TestClient.py PRE-CREATION
>   /trunk/proxy/examples/python/data/__init__.py PRE-CREATION
>   /trunk/proxy/examples/python/data/constants.py PRE-CREATION
>   /trunk/proxy/examples/python/data/ttypes.py PRE-CREATION
>   /trunk/proxy/examples/python/proxy/AccumuloProxy-remote PRE-CREATION
>   /trunk/proxy/examples/python/proxy/AccumuloProxy.py PRE-CREATION
>   /trunk/proxy/examples/python/proxy/__init__.py PRE-CREATION
>   /trunk/proxy/examples/python/proxy/constants.py PRE-CREATION
>   /trunk/proxy/examples/python/proxy/ttypes.py PRE-CREATION
>   /trunk/proxy/examples/ruby/README PRE-CREATION
>   /trunk/proxy/examples/ruby/accumulo_proxy.rb PRE-CREATION
>   /trunk/proxy/examples/ruby/data_constants.rb PRE-CREATION
>   /trunk/proxy/examples/ruby/data_types.rb PRE-CREATION
>   /trunk/proxy/examples/ruby/proxy_constants.rb PRE-CREATION
>   /trunk/proxy/examples/ruby/proxy_types.rb PRE-CREATION
>   /trunk/proxy/examples/ruby/test_client.rb PRE-CREATION
>   /trunk/proxy/examples/ruby/thrift.rb PRE-CREATION
>   /trunk/proxy/pom.xml PRE-CREATION
>   /trunk/proxy/proxy.properties PRE-CREATION
>   /trunk/proxy/src/main/java/org/apache/accumulo/proxy/ProxyHarness.java PRE-CREATION
>   /trunk/proxy/src/main/java/org/apache/accumulo/proxy/ProxyServer.java PRE-CREATION
>   /trunk/proxy/src/main/java/org/apache/accumulo/proxy/TestProxyClient.java PRE-CREATION
>   /trunk/proxy/src/main/java/org/apache/accumulo/proxy/Util.java PRE-CREATION
>   /trunk/proxy/src/main/java/org/apache/accumulo/proxy/api/AccumuloException.java PRE-CREATION
>   /trunk/proxy/src/main/java/org/apache/accumulo/proxy/api/AccumuloProxy.java PRE-CREATION
+
Chris McCubbin 2012-11-07, 21:55
+
keith@... 2012-11-07, 22:05
+
keith@... 2012-11-07, 21:44