Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo >> mail # dev >> accumulo-1.3.5rc6


Copy link to this message
-
Re: accumulo-1.3.5rc6
Thanks Eric,

Yeah, running compact cleared out the entries.  I thought accumulo would do
that on it's own if I left it alone long enough.  Minor compaction was
running when I closed my laptop, but zookeeper got in a bad state
overnight.  Maybe it would have cleaned up,  I guess I never noticed it
before.

I just tested on install on RHEL6 and get the same behavior.

So from my testing, I don't see any problems on Mac OSX 1.6 other than my
understanding.

Mike

On Thu, Nov 10, 2011 at 6:46 AM, Eric Newton <[EMAIL PROTECTED]> wrote:

> Well, a delete is really "insert a delete marker" so, yes, the count can go
> up.  You can clear everything up with another compaction
>
> shell> compact junkTable
> shell>
>
> The functional tests passed on 1.3.5rc6... and they check a lot more
> input/output/restart conditions.
>
> Unfortunately, I didn't see the screenshot attached.
>
> -Eric
>
> On Thu, Nov 10, 2011 at 6:05 AM, Michael Wall <[EMAIL PROTECTED]> wrote:
>
> > Same thing this morning, still 15 Million entries in the test_ingest
> table
> > and 2 entries in the junk table.
> >
> > I went back to an earlier version and ran the same test and get the same
> > results.  Is my assumption that the # entries shown on localhost:50095
> > decrement on a delete incorrect?  Is this the functionality on other
> OS's?
> >
> > Mike
> >
> > On Wed, Nov 9, 2011 at 9:29 PM, Michael Wall <[EMAIL PROTECTED]> wrote:
> >
> > > +1 md5
> > > +1 mvn clean package && mvn assembly:single
> > >
> > > reran test/system/test1 again.  Missed the part in the README about
> > > creating that table, so I did that this time.  Much better results, the
> > > args for the CreateTable needed the username and password added.  Here
> is
> > > what I ran:
> > > /opt/accumulo-test/accumulo/bin/accumulo
> > > 'org.apache.accumulo.server.test.TestIngest$CreateTable' 0 5000000 100
> > root
> > > secret
> > >
> > > I realized that the username and password are hardcoded for the tests,
> so
> > > it would not work if you had something different than the defaults.
> > >
> > > After ingest_test.sh, verify_test.sh, ingest_test_2.sh and
> > > verify_test_2.sh I could scan the test_ingest table just fine.  The
> > > get_auths command returns G1,GROUP2,L1,L2
> > >
> > > However, after running test_ingest_3.sh, scan still takes several
> seconds
> > > and returns no results.   Here is the last part of the output from
> > > ingest_test_3.sh
> > > --------------------------------------
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE:
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: TABLET SERVER
> BATCH
> > > WRITER STATISTICS
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: Added
> > >  :  1,000,000 mutations
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: Sent
> > > :  1,000,000 mutations
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: Resent percentage
> > > :       0.00%
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: Overall time
> > > :      82.90 secs
> > > 09 21:04:10,387 [impl.TabletServerBatchWriter] TRACE: Overall send rate
> > >  :  12,062.44 mutations/sec
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: Send efficiency
> > >  :      97.30%
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE:
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: BACKGROUND WRITER
> > > PROCESS STATISTICS
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: Total send time
> > >  :      80.66 secs  97.30%
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: Average send rate
> > >  :  12,397.72 mutations/sec
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: Total bin time
> > > :       1.81 secs   2.18%
> > > 09 21:04:10,388 [impl.TabletServerBatchWriter] TRACE: Average bin rate
> > > : 553,097.35 mutations/sec
> > > 09 21:04:10,389 [impl.TabletServerBatchWriter] TRACE: tservers per
> batch
> > > :     1.00 avg       1 min      1 max
> > > 09 21:04:10,389 [impl.TabletServerBatchWriter] TRACE: tablets per batch
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB