Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - Is there any API that tells me what files comprise a hive table?


Copy link to this message
-
Re: Is there any API that tells me what files comprise a hive table?
Nitin Pawar 2013-10-07, 18:13
Answers as per my understanding and I may be wrong. so wait for others to
correct me as well.

1. What files in hdfs constitute a hive table.
If you specifically do an alter table command and map it to a single file,
all the files inside a directory where the table is created are mapped to
the table.

2. What is the size of each of these files.
This you can easily get out of hadoop dfs command.

3. The time stamp of the creation/last update to each of these files.
Tricky, hive does not maintain a file was created or updated.
What you may want to do is, audit your edit log to see all the changes
happenings to files.
Last modification time of all the files is available to you via hdfs apis.

except anything speicific to hive, whatever you mentioned can be  done via
hdfs api as well as using hadoop command line  tool.
On Mon, Oct 7, 2013 at 11:31 PM, demian rosas <[EMAIL PROTECTED]> wrote:

> Hi all,
>
> I want to track the changes made to the files of a Hive table.
>
> I wounder whether there is any API that I can use to find out the
> following:
>
> 1. What files in hdfs constitute a hive table.
> 2. What is the size of each of these files.
> 3. The time stamp of the creation/last update to each of these files.
>
>
> Also in a wider view, is there any API that can do the above mentioned for
> HDFS files in general (not only hive specific)?
>
> Thanks a lot in advance.
>
> Cheers.
>
>
>
--
Nitin Pawar