| clear query|facets|time |
Search criteria: .
Results from 71 to 80 from
178 (0.115s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Hbase import Tsv performance (slow import) - HBase - [mail # user]
|
|
...Hi Nick, How many hard drives your slaves has? RPM of those? How many mappers are run concurrently on a node?Did you turn off speculative execution? Have a look at disk i/o to see whet...
|
|
|
Author: anil gupta,
2012-10-24, 16:30
|
|
|
Re: Hbase import Tsv performance (slow import) - HBase - [mail # user]
|
|
...Yeah, we never used HBase client api(puts) for loading a batch of millions of records. Can you tell me by default where the o/p HFile(s) from MR job are stored in HDFS? On Tue, Oct 23...
|
|
|
Author: anil gupta,
2012-10-24, 06:43
|
|
|
Re: Hbase import Tsv performance (slow import) - HBase - [mail # user]
|
|
...Anoop: Only thing is that some mappers crashed.. So thin MR fw will run that mapper again on the same data set.. Then the unique id will be different? Anil: Yes, for the same dataset a...
|
|
|
Author: anil gupta,
2012-10-24, 06:14
|
|
|
Re: Hbase import Tsv performance (slow import) - HBase - [mail # user]
|
|
...Yes, the uniqueId is not part of csv file. In my bulk loader i use combination of nodeId+processId+counter as UniqueID for each row. I have to use the uniqueId since the remaining part of ro...
|
|
|
Author: anil gupta,
2012-10-24, 06:11
|
|
|
Re: Hbase import Tsv performance (slow import) - HBase - [mail # user]
|
|
...That's a very interesting fact. You made it clear but my custom Bulk Loader generates an unique ID for every row in map phase. So, all my data is not in csv or text. Is there a way that i ca...
|
|
|
Author: anil gupta,
2012-10-24, 05:28
|
|
|
Re: Hbase import Tsv performance (slow import) - HBase - [mail # user]
|
|
...Hi Anoop, As per your last email, did you mean that WAL is not used while using HBase Bulk Loader? If yes, then how we ensure "no data loss" in case of RegionServer failure? Than...
|
|
|
Author: anil gupta,
2012-10-24, 05:09
|
|
|
Re: Unable to add co-processor to table through HBase api - HBase - [mail # user]
|
|
...It worked. :) On Thu, Oct 18, 2012 at 10:54 PM, Ramkrishna.S.Vasudevan wrote: Thanks & Regards, Anil Gupta...
|
|
|
Author: anil gupta,
2012-10-19, 16:07
|
|
|
Re: Unable to add co-processor to table through HBase api - HBase - [mail # user]
|
|
...Thanks a lot Guys. I really appreciate you help. I'll try this change in the morning and let you know the outcome. @Ram: Actually, i was trying to add the coprocessor to a per-existing...
|
|
|
Author: anil gupta,
2012-10-19, 05:51
|
|
|
Re: Unable to add co-processor to table through HBase api - HBase - [mail # user]
|
|
...Hi Guys, Do you mean to say that i need to call the following method after the call to addCoprocessor method: public void *modifyTable*(byte[] tableName, &nb...
|
|
|
Author: anil gupta,
2012-10-19, 05:31
|
|
|
Re: Unable to add co-processor to table through HBase api - HBase - [mail # user]
|
|
...Hi Anoop, Sorry, i am unable to understand what you mean by "have to modify the table calling Admin API??". Am i missing some other calls in my code? Thanks, Anil Gupta On ...
|
|
|
Author: anil gupta,
2012-10-19, 04:58
|
|
|
|
