Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> using hdfs shell commands in a pig script

Panshul Whisper 2013-03-06, 11:33
Copy link to this message
Re: using hdfs shell commands in a pig script
Hi Panshul,
        You can write "fs -getmerge source destination;" in your pig script.
On Wednesday, March 6, 2013 at 3:33 AM, Panshul Whisper wrote:

> Hello,
> Is it possible to use hadoop fs commands in a pig script?
> What i exactly want to do is, at the end of my pig script, after the
> execution of store in a file command, I want the pig script to merge the
> multiple output files it creates.
> So either I can try and execute the hadoop fs -getmerge command in the pig
> script, or is there some other way to do it in pig?
> I got this idea, since grunt supports hadoop fs commands so I thought maybe
> it is possible to somehow execute them from within a pig script file.
> Any suggestions are welcome.
> Thanking You,
> --
> Regards,
> Ouch Whisper
> 010101010101
shashwat shriparv 2013-03-06, 14:58
Panshul Whisper 2013-03-06, 21:16