+
Edmon Begoli 2011-12-21, 03:32
-
Re: Fastest HDFS loaderKonstantin Boudnik 2011-12-21, 06:09
Do you have some strict performance requirement or something? Cause 5Gb is
pretty much nothing, really. I'd say copyFromLocal will do just fine.
Cos
On Tue, Dec 20, 2011 at 10:32PM, Edmon Begoli wrote:
> Hi,
>
> We are going to be loading 4-5 GB text, delimited file from a RHEL file
> system into HDFS to be managed
> as external table by Hive.
>
> What is the recommended, fastest loading mechanism?
>
> Thank you,
> Edmon
pretty much nothing, really. I'd say copyFromLocal will do just fine.
Cos
On Tue, Dec 20, 2011 at 10:32PM, Edmon Begoli wrote:
> Hi,
>
> We are going to be loading 4-5 GB text, delimited file from a RHEL file
> system into HDFS to be managed
> as external table by Hive.
>
> What is the recommended, fastest loading mechanism?
>
> Thank you,
> Edmon
