-Re: Use HDFS file as input when running pig with local mode
Shahab Yunus 2013-10-12, 04:48
Running Pig in localmode means to use local hdfs and m/r framework. There
is no separate concept of localmode for pig apart from hdfs and m/r
framework on which it runs.
On Fri, Oct 11, 2013 at 10:36 PM, Gordon Wang <[EMAIL PROTECTED]> wrote:
> Pig will not load any hadoop conf when running with local mode.
> Does this means that I can not use HDFS files as input when I run pig with
> local mode?
> Say, I have the following script
> ================================> mytable = LOAD 'hdfs://namenodehost/user/hadoop/test.csv'
> USING PigStorage(',')
> AS (col1:chararray, col2:chararray, col3:int);
> dump mytable;
> When I run the script with local mode, it can not load files. So I want to
> debug my script, and I have to change the script to read data from local
> Do you have any best practice to debug pig script without changing the
> input path?
> Gordon Wang