Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> removing hdfs table data directory does not throw error in hive


Copy link to this message
-
removing hdfs table data directory does not throw error in hive
I have a hive table tab3 with two columns (c1 int, c2 int)

hive> load data local inpath '/tmp/orhc466fb981' into table tab3;
Copying data from file:/tmp/orhc466fb981
Copying file: file:/tmp/orhc466fb981
Loading data to table default.tab3
OK
Time taken: 3.907 seconds
hive> select * from tab3;
OK
4       2
4       10
7       4
7       22
.....
//remove the tab3 directory from hdfs
[schakrab@diy-1-2 orch]$ hadoop fs -rmr /user/hive/warehouse/tab3;
Deleted hdfs://localhost:9000/user/hive/warehouse/tab3
[schakrab@diy-1-2 orch]$ hive
Hive history file=/tmp/schakrab/hive_job_log_schakrab_201204231748_1985146177.txt
//no error thrown!
hive> select * from tab3;
OK
Time taken: 3.68 seconds
// of course. metadata still exists.
hive> desc tab3;
OK
c1      int
c2      int
Time taken: 0.127 seconds

// doing another load recreates the directory tab3

Shouldn't the select * query return an error when the underlying table
file is removed ?

-Sukhendu
+
Nitin Pawar 2012-04-24, 03:28
+
Sukhendu Chakraborty 2012-04-24, 03:40
+
Nitin Pawar 2012-04-24, 11:39
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB