Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo, mail # dev - SplitLarge Utility


+
David Medinets 2012-11-13, 03:19
+
Eric Newton 2012-11-13, 10:59
+
David Medinets 2012-11-13, 13:59
+
William Slacum 2012-11-13, 14:19
+
William Slacum 2012-11-13, 14:21
+
Eric Newton 2012-11-13, 14:24
Copy link to this message
-
Re: SplitLarge Utility
John Vines 2012-11-13, 15:55
We have the admin class invokable from the command line, if it should have
a convenient interface from anywhere, it's there.

Sent from my phone, pardon the typos and brevity.
On Nov 13, 2012 9:25 AM, "Eric Newton" <[EMAIL PROTECTED]> wrote:

> I disagree.  It's hardly ever something reasonable users will need.   The
> shell should only be using the public API and provide normal user access.
> The utility requires HDFS access.
>
>
> On Tue, Nov 13, 2012 at 9:21 AM, William Slacum <
> [EMAIL PROTECTED]> wrote:
>
> > Clarification: I'm all for making a shell friendly interface for invoking
> > SplitLarge. I don't really see a point in moving the code.
> >
> > On Tue, Nov 13, 2012 at 6:19 AM, William Slacum <
> > [EMAIL PROTECTED]> wrote:
> >
> > > If it's used by RFile during a system invoked task, then I'd say leave
> > it.
> > > If you want to make a shell friendly interface for invoking it, I'm all
> > for
> > > it.
> > >
> > >
> > > On Tue, Nov 13, 2012 at 5:59 AM, David Medinets <
> > [EMAIL PROTECTED]>wrote:
> > >
> > >> It is out of place, to me, because the Accumulo Shell should be the
> > >> primary mechanism for Accumulo system administration. Why have a
> > >> utility that can't be invoked from the Shell? Any objections to moving
> > >> it?
> > >>
> > >> On Tue, Nov 13, 2012 at 5:59 AM, Eric Newton <[EMAIL PROTECTED]>
> > >> wrote:
> > >> > Yes, I've had users accidentally ingest key/values that were so
> large
> > >> that
> > >> > they could not be compacted (the tablet server would run out of
> memory
> > >> and
> > >> > crash).  This utility allowed me to remove the large key/values and
> > >> > preserve them for analysis.  Why is it that you want to move it?
> >  Could
> > >> you
> > >> > be a little more specific about why it seems out of place?
> > >> >
> > >> >
> > >> > On Mon, Nov 12, 2012 at 10:19 PM, David Medinets
> > >> > <[EMAIL PROTECTED]>wrote:
> > >> >
> > >> >> Is this utility something useful in a production shop? If so,
> should
> > >> >> it be integrated into the shell? Maybe it should be moved to the
> > >> >> contribs directory? I seems out of place in the current
> > >> >> org.apache.accumulo.core.file.rfile package.
> > >> >>
> > >>
> > >
> > >
> >
>