| clear query|facets|time |
Search criteria: .
Results from 31 to 40 from
131 (2.823s).
|
|
|
Loading phrases to help you refine your search...
|
|
Re: hdfs jiras - HBase - [mail # dev]
|
|
...There's a bunch of things in this area, yes: A big one would be to split the connect timeout vs. the readtimeout. Todd created a jira for HDFS, and it could make a huge difference imho. read...
|
|
|
Author: N Keywal,
2012-07-23, 18:46
|
|
|
hdfs jiras - HBase - [mail # dev]
|
|
...Hi, FYI, I created a set of jira in HDFS, related to HBase MTTR or recovery alone. HDFS-3706 :Add the possibility to mark a node as 'low priority' for reads in the DFSClient HDFS...
|
|
|
Author: N Keywal,
2012-07-23, 11:15
|
|
|
Re: Lowering HDFS socket timeouts - HBase - [mail # user]
|
|
...I don't know. The question is mainly for the read time out: you will connect to the ipc.Client with a read timeout of let say 10s. Server side the implementation may do something with anothe...
|
|
|
Author: N Keywal,
2012-07-18, 16:44
|
|
|
Re: Lowering HDFS socket timeouts - HBase - [mail # user]
|
|
...Hi Bryan, It's a difficult question, because dfs.socket.timeout is used all over the place in hdfs. I'm currently documenting this. Especially: - it's used for connections between data...
|
|
|
Author: N Keywal,
2012-07-18, 08:38
|
|
|
Re: hbase mttr vs. hdfs - HBase - [mail # dev]
|
|
...Aggreed. I'm currently doing that. I have as well a set of log analysis that could make it to the ref book. I will create a Jira to propose them. After some iterations I came to a sol...
|
|
|
Author: N Keywal,
2012-07-17, 17:14
|
|
|
Re: hbase mttr vs. hdfs - HBase - [mail # dev]
|
|
...And to continue on this, for the files still opened (i.e. our wal files), we've got two calls to the dead DN: one, during the input stream opening, from DFSClient#updateBlockInfo. This...
|
|
|
Author: N Keywal,
2012-07-16, 17:08
|
|
|
Re: hbase mttr vs. hdfs - HBase - [mail # dev]
|
|
...I found another solution, better than the workaround I was previously mentionning, that could be implemented in the DFS client or the namenode: The NN returns a set of ordered DN. We c...
|
|
|
Author: N Keywal,
2012-07-16, 12:00
|
|
|
Re: hbase mttr vs. hdfs - HBase - [mail # dev]
|
|
...If I put it to an extreme, today we're writing to 3 locations, with local one being often useless. If we write only to the 2 remote locations, we have the same reliability, without the issue...
|
|
|
Author: N Keywal,
2012-07-13, 17:46
|
|
|
Re: hbase mttr vs. hdfs - HBase - [mail # dev]
|
|
...I looked at this part of hdfs code, and - it's not simple to add it in a clean way, even if doing it is possible. - i was wrong the the 3s hearbeat: the hearbeat is every 5 minutes actually....
|
|
|
Author: N Keywal,
2012-07-13, 13:27
|
|
|
Re: Maximum number of tables ? - HBase - [mail # user]
|
|
...Hi, There is no real limits as far as I know. As you will have one region per table (at least :-), the number of region will be something to monitor carefully if you need thousan...
|
|
|
Author: N Keywal,
2012-07-13, 08:14
|
|
|
|