Hi,

Currently it takes 11 odd minutes to load 1.2 million record into hbase from hdfs. Can u pls share some tips to do the same in few seconds?

We tried doing this in both pig script and in pentaho. Both are taking 11 odd minutes.

Regards,
Rams

On Mon, Sep 10, 2012 at 9:58 AM, Ramasubramanian
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> Currently it takes 11 odd minutes to load 1.2 million record into hbase from hdfs. Can u pls share some tips to do the same in few seconds?
>
> We tried doing this in both pig script and in pentaho. Both are taking 11 odd minutes.
>

You have had a look at http://hbase.apache.org/book.html#performance?
St.Ack

Hi,
Will be helpful if u say specific things to  look into. Pls help

Regards,
Rams

On 10-Sep-2012, at 10:40 PM, Stack <[EMAIL PROTECTED]> wrote:

> On Mon, Sep 10, 2012 at 9:58 AM, Ramasubramanian
> <[EMAIL PROTECTED]> wrote:
>> Hi,
>>
>> Currently it takes 11 odd minutes to load 1.2 million record into hbase from hdfs. Can u pls share some tips to do the same in few seconds?
>>
>> We tried doing this in both pig script and in pentaho. Both are taking 11 odd minutes.
>>
>
> You have had a look at http://hbase.apache.org/book.html#performance?
> St.Ack

Well,

Lets actually skip a few rounds of questions... and start from the beginning.

What does your physical cluster look like?

On Sep 10, 2012, at 12:40 PM, Ramasubramanian <[EMAIL PROTECTED]> wrote:

> Hi,
> Will be helpful if u say specific things to  look into. Pls help
>
> Regards,
> Rams
>
> On 10-Sep-2012, at 10:40 PM, Stack <[EMAIL PROTECTED]> wrote:
>
>> On Mon, Sep 10, 2012 at 9:58 AM, Ramasubramanian
>> <[EMAIL PROTECTED]> wrote:
>>> Hi,
>>>
>>> Currently it takes 11 odd minutes to load 1.2 million record into hbase from hdfs. Can u pls share some tips to do the same in few seconds?
>>>
>>> We tried doing this in both pig script and in pentaho. Both are taking 11 odd minutes.
>>>
>>
>> You have had a look at http://hbase.apache.org/book.html#performance?
>> St.Ack
>