Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo, mail # dev - client config files


Copy link to this message
-
Re: client config files
Christopher 2013-08-02, 17:20
Yes, I think that would be provide the best user experience for client
code. I'm not too stuck on this point, though I do think it should be
independent of AccumuloConfiguration for reasons I mentioned on
ACCUMULO-1397.

I've been playing with the idea of creating a generic typed
configuration library that extends commons-configuration to make it
easier to get the same value as AccumuloConfiguration's Property
enums, but without being so monolithic and Accumulo server-specific.
That common interface could form the basis of an
AccumuloClientConfiguration, and independently, an
AccumuloServerConfiguration. Do you think that would be useful for
your client configuration?

--
Christopher L Tubbs II
http://gravatar.com/ctubbsii
On Fri, Aug 2, 2013 at 10:11 AM, Michael Berman <[EMAIL PROTECTED]> wrote:
> So does this mean you'd rather have the config switches be called something
> like javax.net.ssl.trustStore rather than general.server.ssl.trustStore in
> the Accumulo Properties?  Our implementation of SSL will be provided by the
> thrift connectors rather than us using JSSE directly, so we'll have to
> interpret them ourselves rather than JSSE doing it automatically.  Should
> we respect these flags if they're passed in through System.getProperties()
> in addition to whatever the normal config flow ends up being?  Note that we
> won't be able to respect many of the flags, since we're at Thrift's mercy
> for socket construction.
>
>
> On Thu, Aug 1, 2013 at 10:06 PM, Christopher <[EMAIL PROTECTED]> wrote:
>
>> I'm generally not a fan of the way some standard Java things have been
>> reinvented in Hadoop. I've always seen JSSE SSL config as system
>> properties, optionally stored in a properties file. Even if Hadoop is
>> using an XML-based configuration for this purpose, I'd still steer
>> clear of it, for this reason.
>>
>> --
>> Christopher L Tubbs II
>> http://gravatar.com/ctubbsii
>>
>>
>> On Thu, Aug 1, 2013 at 4:33 PM, Joey Echeverria <[EMAIL PROTECTED]> wrote:
>> > I generally prefer properties files to XML, but there may be a argument
>> for reusing Hadoop's SSL configuration system which is XML based.
>> >
>> >
>> > -Joey
>> > —
>> > Sent from Mailbox for iPhone
>> >
>> > On Thu, Aug 1, 2013 at 3:08 PM, Christopher <[EMAIL PROTECTED]> wrote:
>> >
>> >> ^ Another reason I like commons-configuration here is for
>> >> property-interpolation with HierarchicalConfiguration.
>> >> --
>> >> Christopher L Tubbs II
>> >> http://gravatar.com/ctubbsii
>> >> On Thu, Aug 1, 2013 at 3:07 PM, Christopher <[EMAIL PROTECTED]>
>> wrote:
>> >>> I absolutely DO think they should be combined in a properties file
>> >>> located in $HOME/.accumulo/config
>> >>> I absolutely DO NOT think this client configuration should be
>> >>> exclusive to the shell, and I absolutely DO NOT think it should be
>> >>> XML.
>> >>>
>> >>> I would love to see all our clients/client code use
>> >>> commons-configuration to hold properties from the properties file, so
>> >>> that only a --config parameter is needed (with reasonable defaults, so
>> >>> even that is not absolutely necessary). I also think that every
>> >>> property that can exist in the file should be possible to override on
>> >>> the command-line. I personally prefer to use system properties, using
>> >>> commons-configuration's HierarchicalConfiguration, but jcommander may
>> >>> make it easier to do the same thing in a slightly different way.
>> >>>
>> >>> --
>> >>> Christopher L Tubbs II
>> >>> http://gravatar.com/ctubbsii
>> >>>
>> >>>
>> >>> On Thu, Aug 1, 2013 at 12:25 PM, Michael Berman <[EMAIL PROTECTED]>
>> wrote:
>> >>>> As part of SSL, we need to introduce configuration so accumulo clients
>> >>>> (such as ZooKeeperInstance) can find trust stores.  It seems like
>> this has
>> >>>> a lot in common with shell config files in ACCUMULO-1397.  Do people
>> think
>> >>>> these should be combined, or should the shell have its own separate
>> config?
>> >>>>  I was imagining a simple java .properties-style key=value list.