Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Tables & rows disappear


Copy link to this message
-
Re: Tables & rows disappear
1)  Version numbers:

hadoop-0.20.2
hbase-0.20.6
2)  autoFlush to 'true' works, but wouldn't that slow down the insertion
process?

3)  Here's how I had set it up:

In my Mapper's setup method:

           table = new HTable(new HBaseConfiguration(), XYZ_TABLE);

        table.setAutoFlush(false);

        table.setWriteBufferSize(1024 * 1024 * 12);

In my Mappers' cleanup method:
       table.flushCommits();

    table.close();

At the time of writing:

       Put put = new Put(Bytes.toBytes(key));

    put.setWriteToWAL(false);

       put.add(Bytes.toBytes("info"), Bytes.toBytes("code"), Bytes.toBytes(
code));

    & so on... and at the end...

    table.put(put);
Is this not the right way to do it?  Please let me know.  Thanks for the
help.
On Sun, Jan 30, 2011 at 3:03 PM, Stack <[EMAIL PROTECTED]> wrote:

> What version of hbase+hadoop?
> St.Ack
>
> On Fri, Jan 28, 2011 at 8:37 PM, Something Something
> <[EMAIL PROTECTED]> wrote:
> > Apologies for my dumbness.  I know it's some property that I am not
> setting
> > correctly.  But every time I stop & start HBase & Hadoop I either lose
> all
> > my tables or loose rows on tables in HBase.
> >
> > Here's what various files contain:
> >
> > *core-site.xml*
> > <configuration>
> >  <property>
> >    <name>fs.default.name</name>
> >    <value>hdfs://localhost:9000</value>
> >  </property>
> >  <property>
> >    <name>hadoop.tmp.dir</name>
> >    <value>/usr/xxx/hdfs</value>
> >  </property>
> > </configuration>
> >
> > *hdfs-site.xml*
> > <configuration>
> >  <property>
> >    <name>dfs.replication</name>
> >    <value>1</value>
> >  </property>
> >  <property>
> >    <name>dfs.name.dir</name>
> >    <value>/usr/xxx/hdfs/name</value>
> >  </property>
> >
> >  <property>
> >    <name>dfs.data.dir</name>
> >    <value>/usr/xxx/hdfs/data</value>
> >  </property>
> >
> > *mapred-site.xml*
> > <configuration>
> >  <property>
> >    <name>mapred.job.tracker</name>
> >    <value>localhost:9001</value>
> >  </property>
> > </configuration>
> >
> > *hbase-site.xml*
> > <configuration>
> >  <property>
> >    <name>hbase.rootdir</name>
> >    <value>hdfs://localhost:9000/hbase</value>
> >  </property>
> >  <property>
> >    <name>hbase.tmp.dir</name>
> >    <value>/usr/xxx/hdfs/hbase</value>
> >  </property>
> > </configuration>
> >
> >
> > What am I missing?  Please help.  Thanks.
> >
>