Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Issue about hive scribe with facebook scribe


Copy link to this message
-
Issue about hive scribe with facebook scribe
hi,maillist:
             Due to scribe maillist is not very active ,so i ask question
here ,hope any expert can answer the problem.

i use scribe write data into HDFS ,the HDFS path is a partition of a hive
table,the partition based on date,what i think is let the scribe category
name as hive table name, so if the hive schema is "mydemo",and hive table
name is "mytable",it partition path is "
hdfs://product/user/hive/warehouse/mydemo.db/mytable/2014-01-21"  ,my
question is how to handle the dynamic directory in scribe ,
another big problem is if i have the same table name on another hive schema
like "hdfs://product/user/hive/warehouse/mydemo2.db/mytable/2014-01-21" ,if
i use mytable as category name ,it will send log to both path,
i do not want to this ,how to do it?

thanks all