Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo >> mail # dev >> accumulo-1.3.5rc6


Copy link to this message
-
Re: accumulo-1.3.5rc6
Thanks Eric,

Yeah, running compact cleared out the entries.  I thought accumulo would do
that on it's own if I left it alone long enough.  Minor compaction was
running when I closed my laptop, but zookeeper got in a bad state
overnight.  Maybe it would have cleaned up,  I guess I never noticed it
before.

I just tested on install on RHEL6 and get the same behavior.

So from my testing, I don't see any problems on Mac OSX 1.6 other than my
understanding.

Mike

On Thu, Nov 10, 2011 at 6:46 AM, Eric Newton <[EMAIL PROTECTED]> wrote:

> Well, a delete is really "insert a delete marker" so, yes, the count can go
> up.  You can clear everything up with another compaction
>
> shell> compact junkTable
> shell>
>
> The functional tests passed on 1.3.5rc6... and they check a lot more
> input/output/restart conditions.
>
> Unfortunately, I didn't see the screenshot attached.
>
> -Eric
>
> On Thu, Nov 10, 2011 at 6:05 AM, Michael Wall <[EMAIL PROTECTED]> wrote:
>
> > Same thing this morning, still 15 Million entries in the test_ingest
> table
> > and 2 entries in the junk table.
> >
> > I went back to an earlier version and ran the same test and get the same
> > results.  Is my assumption that the # entries shown on localhost:50095
> > decrement on a delete incorrect?  Is this the functionality on other
> OS's?
> >
> > Mike
> >
> > On Wed, Nov 9, 2011 at 9:29 PM, Michael Wall <[EMAIL PROTECTED]> wrote:
> >
> > > +1 md5
> > > +1 mvn clean package && mvn assembly:single
> > >
> > > reran test/system/test1 again.  Missed the part in the README about
> > > creating that table, so I did that this time.  Much better results, the
> > > args for the CreateTable needed the username and password added.  Here
> is
> > > what I ran:
> > > /opt/accumulo-test/accumulo/bin/accumulo
> > > 'org.apache.accumulo.server.test.TestIngest$CreateTable' 0 5000000 100
> > root
> > > secret
> > >
> > > I realized that the username and password are hardcoded for the tests,
> so
> > > it would not work if you had something different than the defaults.
> > >
> > > After ingest_test.sh, verify_test.sh, ingest_test_2.sh and
> > > verify_test_2.sh I could scan the test_ingest table just fine.  The
> > > get_auths command returns G1,GROUP2,L1,L2
> > >
> > > However, after running test_ingest_3.sh, scan still takes several
> seconds
> > > and returns no results.   Here is the last part of the output from
> > > ingest_test_3.sh
> > > --------------------------------------
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE:
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: TABLET SERVER
> BATCH
> > > WRITER STATISTICS
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: Added
> > >  :  1,000,000 mutations
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: Sent
> > > :  1,000,000 mutations
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: Resent percentage
> > > :       0.00%
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: Overall time
> > > :      82.90 secs
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: Overall send rate
> > >  :  12,062.44 mutations/sec
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: Send efficiency
> > >  :      97.30%
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE:
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: BACKGROUND WRITER
> > > PROCESS STATISTICS
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: Total send time
> > >  :      80.66 secs  97.30%
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: Average send rate
> > >  :  12,397.72 mutations/sec
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: Total bin time
> > > :       1.81 secs   2.18%
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: Average bin rate
> > > : 553,097.35 mutations/sec
> > > 09 21:04:10,389 [impl.TabletServerBatchWriter] TRACE: tservers per
> batch
> > > :     1.00 avg       1 min      1 max
> > > 09 21:04:10,389 [impl.TabletServerBatchWriter] TRACE: tablets per batch