Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Best way to collect Hadoop logs across cluster


Copy link to this message
-
Best way to collect Hadoop logs across cluster
Hi,

my clusters are on EC2, and they disappear after the cluster's instances
are destroyed. What is the best practice to collect the logs for later
storage?

EC2 does exactly that with their EMR, how do they do it?

Thank you,
Mark
+
Roman Shaposhnik 2013-04-19, 04:44
+
Mark Kerzner 2013-04-26, 00:08
+
Marcos Luis Ortiz Valmase... 2013-04-19, 04:51
+
Mark Kerzner 2013-04-19, 05:01
+
Marcos Luis Ortiz Valmase... 2013-04-19, 05:55
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB