Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Unable to store data into HBase


+
Mohammad Tariq 2012-09-03, 07:30
+
shashwat shriparv 2012-09-03, 08:27
+
Mohammad Tariq 2012-09-03, 09:04
+
chethan 2012-09-03, 14:37
Copy link to this message
-
Re: Unable to store data into HBase
Thank you for the response. But even after removing the comma it's not
working. I have noticed 2 strange things here :
1- If I am reading data from HBase and putting it back in some HBase table
it works fine.
2- When I am trying the same thing using older versions, HBase(0.90.4) and
Pig(0.9.1), it is working perfectly fine.

It seems there is some compatibility issue between Pig(0.10.0) and
HBase(0.92.1). Any comments or suggestions?

Regards,
    Mohammad Tariq

On Mon, Sep 3, 2012 at 8:07 PM, chethan <[EMAIL PROTECTED]> wrote:

> STORE raw_data INTO ‘hbase://sample_names’ USING
> org.apache.pig.backend.hadoop.hbase.HBaseStorage (
> ‘info:fname info:lname’);
>
> As above is the example of the HBaseStorage,
>
> 1. it take the column family and value( internally it is separated by
> space as u have given comma for   separation this might be creating
> the problem),
>
> store z into 'hbase://csvdata' USING
>  org.apache.pig.backend.hadoop.hbase.HBaseStorage('cf:id, cf:age,
> cf:gender, cf:height, cf:size, cf:color');
>
> On Mon, Sep 3, 2012 at 2:34 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
> > I don't think there is any problem with that as I am able to execute
> other
> > queries, like loading data from an HBase table and storing it into
> another
> > HBase table.
> >
> > Regards,
> >     Mohammad Tariq
> >
> >
> >
> > On Mon, Sep 3, 2012 at 1:57 PM, shashwat shriparv <
> [EMAIL PROTECTED]
> >> wrote:
> >
> >> What can conclude from the error is that PIG is not able to run in
> >> distributed mode as its not able to connect to Hadoop. just check out if
> >> other map reduce tasks in Pig is working fine. Either pig is searching
> the
> >> file which is not present, check where pig is searching the file its
> >> there..
> >>
> >> Regards
> >>
> >> ∞
> >> Shashwat Shriparv
> >>
> >>
> >>
> >> On Mon, Sep 3, 2012 at 1:00 PM, Mohammad Tariq <[EMAIL PROTECTED]>
> wrote:
> >>
> >> > Hello list,
> >> >
> >> >        I have a file in my Hdfs and I am reading this file and trying
> to
> >> > store the data into an HBase table through Pig Shell. Here are the
> >> commands
> >> > I am using :i
> >> >
> >> > z = load '/mapin/testdata2.csv/part-m-00000' using PigStorage(',') as
> >> > (rowkey:int, id:int, age:float, gender:chararray, height:int,
> size:int,
> >> > color:chararray);
> >> > store z into 'hbase://csvdata' USING
> >> > org.apache.pig.backend.hadoop.hbase.HBaseStorage('cf:id, cf:age,
> >> cf:gender,
> >> > cf:height, cf:size, cf:color');
> >> >
> >> > Although, I can see the data when I dump the relation 'z', but I am
> not
> >> > able to store 'z' in HBase using the above specified command. I am
> >> getting
> >> > the following error :
> >> >
> >> > HadoopVersion PigVersion UserId StartedAt FinishedAt Features
> >> > 1.0.3 0.10.0 cluster 2012-09-03 12:40:31 2012-09-03 12:41:04 UNKNOWN
> >> >
> >> > Failed!
> >> >
> >> > Failed Jobs:
> >> > JobId Alias Feature Message Outputs
> >> > job_201209031122_0009 z MAP_ONLY Message: Job failed! Error -
> JobCleanup
> >> > Task Failure, Task: task_201209031122_0009_m_000001 csvdata,
> >> >
> >> > Input(s):
> >> > Failed to read data from "/mapin/testdata2.csv/part-m-00000"
> >> >
> >> > Output(s):
> >> > Failed to produce result in "csvdata"
> >> >
> >> > Counters:
> >> > Total records written : 0
> >> > Total bytes written : 0
> >> > Spillable Memory Manager spill count : 0
> >> > Total bags proactively spilled: 0
> >> > Total records proactively spilled: 0
> >> >
> >> > Job DAG:
> >> > job_201209031122_0009
> >> >
> >> >
> >> > 2012-09-03 12:41:04,606 [main] INFO
> >> >
> >> >
> >>
>  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> >> > - Failed!
> >> > 2012-09-03 12:41:04,629 [main] INFO
> >> >  org.apache.pig.backend.hadoop.hbase.HBaseStorage - Adding
> >> > family:descriptor filters with values cf:id
> >> > 2012-09-03 12:41:04,629 [main] INFO
> >> >  org.apache.pig.backend.hadoop.hbase.HBaseStorage - Adding
> >> > family:descriptor filters with values cf:age
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB