|
|
-
Transfer Data to new location
Hamza Asad 2013-02-12, 16:50
i want to change my HIVE/HDFS directory.. how can i transfer data which resides in HDFS to some other directory ? either i have have to use sqoop-export followed by sqoop-import to new location?? or is there any easier solution for safely data transfer??
-- *Muhammad Hamza Asad * +923457261988
-
Re: Transfer Data to new location
Dean Wampler 2013-02-12, 16:54
hadoop fs -mv old_path new_path
If one new_path isn't in HDFS, use -get instead of -mv.
If you're moving Hive tables, you should then use ALTER TABLE to change the metadata. Or, if the tables are external and have no partitions, you could just drop them and recreate them with the new location.
On Tue, Feb 12, 2013 at 10:50 AM, Hamza Asad <[EMAIL PROTECTED]> wrote:
> i want to change my HIVE/HDFS directory.. how can i transfer data which > resides in HDFS to some other directory ? either i have have to use > sqoop-export followed by sqoop-import to new location?? or is there any > easier solution for safely data transfer?? > > -- > *Muhammad Hamza Asad * > +923457261988 >
-- *Dean Wampler, Ph.D.* thinkbiganalytics.com +1-312-339-1330
-
Re: Transfer Data to new location
Nitin Pawar 2013-02-12, 16:54
little more clarification
is it same hdfs cluster ? when you say migrating data from one location to another are you keeping the hive table metadata same? how much of capacity you have by disk wise?
On Tue, Feb 12, 2013 at 10:20 PM, Hamza Asad <[EMAIL PROTECTED]> wrote:
> i want to change my HIVE/HDFS directory.. how can i transfer data which > resides in HDFS to some other directory ? either i have have to use > sqoop-export followed by sqoop-import to new location?? or is there any > easier solution for safely data transfer?? > > -- > *Muhammad Hamza Asad * > +923457261988 >
-- Nitin Pawar
-
Re: Transfer Data to new location
Hamza Asad 2013-02-12, 17:08
Actually i have data in HDFS under HIVE/Warehouse path. I ran short of disk space so i'm changing HDFS location (in new HDD partition). so please tell me how can i transfer my existing data safely to new location. On Tue, Feb 12, 2013 at 9:54 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote:
> little more clarification > > is it same hdfs cluster ? > when you say migrating data from one location to another are you keeping > the hive table metadata same? > how much of capacity you have by disk wise? > > > > On Tue, Feb 12, 2013 at 10:20 PM, Hamza Asad <[EMAIL PROTECTED]>wrote: > >> i want to change my HIVE/HDFS directory.. how can i transfer data which >> resides in HDFS to some other directory ? either i have have to use >> sqoop-export followed by sqoop-import to new location?? or is there any >> easier solution for safely data transfer?? >> >> -- >> *Muhammad Hamza Asad * >> +923457261988 >> > > > > -- > Nitin Pawar >
-- *Muhammad Hamza Asad * +923457261988
-
Re: Transfer Data to new location
Hamza Asad 2013-02-12, 17:12
so that i still query existing data successfully On Tue, Feb 12, 2013 at 10:08 PM, Hamza Asad <[EMAIL PROTECTED]> wrote:
> Actually i have data in HDFS under HIVE/Warehouse path. I ran short of > disk space so i'm changing HDFS location (in new HDD partition). so please > tell me how can i transfer my existing data safely to new location. > > > On Tue, Feb 12, 2013 at 9:54 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote: > >> little more clarification >> >> is it same hdfs cluster ? >> when you say migrating data from one location to another are you keeping >> the hive table metadata same? >> how much of capacity you have by disk wise? >> >> >> >> On Tue, Feb 12, 2013 at 10:20 PM, Hamza Asad <[EMAIL PROTECTED]>wrote: >> >>> i want to change my HIVE/HDFS directory.. how can i transfer data which >>> resides in HDFS to some other directory ? either i have have to use >>> sqoop-export followed by sqoop-import to new location?? or is there any >>> easier solution for safely data transfer?? >>> >>> -- >>> *Muhammad Hamza Asad * >>> +923457261988 >>> >> >> >> >> -- >> Nitin Pawar >> > > > > -- > *Muhammad Hamza Asad * > +923457261988 >
-- *Muhammad Hamza Asad * +923457261988
|
|