Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Issue about hive scribe with facebook scribe


Copy link to this message
-
Issue about hive scribe with facebook scribe
hi,maillist:
             Due to scribe maillist is not very active ,so i ask question
here ,hope any expert can answer the problem.

i use scribe write data into HDFS ,the HDFS path is a partition of a hive
table,the partition based on date,what i think is let the scribe category
name as hive table name, so if the hive schema is "mydemo",and hive table
name is "mytable",it partition path is "
hdfs://product/user/hive/warehouse/mydemo.db/mytable/2014-01-21"  ,my
question is how to handle the dynamic directory in scribe ,
another big problem is if i have the same table name on another hive schema
like "hdfs://product/user/hive/warehouse/mydemo2.db/mytable/2014-01-21" ,if
i use mytable as category name ,it will send log to both path,
i do not want to this ,how to do it?

thanks all
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB