Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # user >> FW: Deletes not commiting from custom java API but work in shell interface


+
Bell, Philip S CIV SPAWAR... 2013-04-10, 22:02
+
John Vines 2013-04-10, 22:06
+
Bell, Philip S CIV SPAWAR... 2013-04-10, 22:09
Copy link to this message
-
RE: FW: Deletes not commiting from custom java API but work in shell interface
First, you don't need to flush then close. Close already flushes.

As for your problem, I have only 2 ideas- are you writing to the correct
table?

And as a sanity check, make sure the authorization you construct equals the
column visibility you pull out. I wonder if information is getting lost in
translation.

Sent from my phone, please pardon the typos and brevity.
On Apr 10, 2013 6:09 PM, "Bell, Philip S CIV SPAWARSYSCEN-PACIFIC, 81320" <
[EMAIL PROTECTED]> wrote:

> Ah I forgot to clean up my testing code, when I saw deletes weren't
> working I tried setting it to the last version timestamp to see if it
> required an exact match.
>
> So no matter if I submit
> delMutation.putDelete( colFam, colQual, new ColumnVisibility( colVis ),
> e.getKey().getTimestamp() );
>
> or
>
> delMutation.putDelete( colFam, colQual, new ColumnVisibility( colVis ) );
>
> I am still seeing the entries I wanted to delete
>
> -----Original Message-----
> From: John Vines [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, April 10, 2013 3:07 PM
> To: [EMAIL PROTECTED]
> Subject: Re: FW: Deletes not commiting from custom java API but work in
> shell interface
>
> Deletes will remove all entries which occur before the key. I believe
> there is undefined behavior for when a delete key is identical. It should
> work if you set the delete keys time +1.
>
> Sent from my phone, please pardon the typos and brevity.
>
> On Apr 10, 2013 6:02 PM, "Bell, Philip S CIV SPAWARSYSCEN-PACIFIC, 81320" <
> [EMAIL PROTECTED]> wrote:
>
>
>         Using the following code, rows are never deleted even when
> identified and submitted for deletion to the batchwriter.
>         After running the code the rows still show up in search.
>
>         This has been seen in 1.4.1 and 1.4.2
>
>         The same rows can be deleted from the accumulo shell interface
>
>
> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>
>
>         for( Entry<Key, Value> e : mainScanner )
>         {
>                 Text currentUUID = e.getKey().getRow();
>
>                 Text colFam = e.getKey().getColumnFamily();
>                 Text colQual = e.getKey().getColumnQualifier();
>
>                 String colVis > e.getKey().getColumnVisibility().toString();
>
>                 System.out.println( currentUUID + ":" + colFam + ":" +
> colQual + ":" + colVis + ":" + e.getKey().getTimestamp() );
>
>                 if( colFam.toString().equalsIgnoreCase( "root" ) ||
> colVis.length() > 0 )
>                 {
>                         Mutation delMutation = new Mutation( currentUUID );
>                         delMutation.putDelete( colFam, colQual, new
> ColumnVisibility( colVis ), e.getKey().getTimestamp() );
>
>                         System.out.println( "removing" );
>
>                         try
>                         {
>                                 bw.addMutation( delMutation );
>                         }
>                         catch( MutationsRejectedException e1 )
>                         {
>                                 e1.printStackTrace();
>                         }
>
>                         count++;
>                         if( count % 1000000 == 0 )
>                         {
>                                 System.out.println( this.getName() + ": "
> + count + " completed in " + getTimePassed() );
>                         }
>                 }
>         }// for each entry found
>
>         try
>         {
>                 bw.flush();
>                 bw.close();
>         }
>         catch( Exception e1 )
>         {
>                 e1.printStackTrace();
>         }
>
>
>
+
Bell, Philip S CIV SPAWAR... 2013-04-10, 22:20
+
Bell, Philip S CIV SPAWAR... 2013-04-10, 22:42
+
Josh Elser 2013-04-10, 23:51
+
Billie Rinaldi 2013-04-11, 14:53
+
Keith Turner 2013-04-11, 14:01
+
John Vines 2013-04-11, 14:34
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB