Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> hadoop filesystem cache


Copy link to this message
-
hadoop filesystem cache
After reading this article,
http://www.cloudera.com/blog/2012/01/caching-in-hbase-slabcache/ , I was
wondering if there was a filesystem cache for hdfs. For example, if a large
file (10gigabytes) was keep getting accessed on the cluster instead of keep
getting it from the network why not storage the content of the file locally
on the client itself.  A use case on the client would be like this:

<property>
  <name>dfs.client.cachedirectory</name>
  <value>/var/cache/hdfs</value>
</property>
<property>
<name>dfs.client.cachesize</name>
<description>in megabytes</description>
<value>100000</value>
</property>
Any thoughts of a feature like this?
--
--- Get your facts first, then you can distort them as you please.--
+
Prashant Kommireddi 2012-01-15, 01:33
+
Rita 2012-01-15, 01:57
+
Todd Lipcon 2012-01-16, 00:33
+
Rita 2012-01-16, 16:33
+
Edward Capriolo 2012-01-16, 18:07
+
Rita 2012-01-17, 12:27
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB