Panshul Whisper 2013-03-06, 11:33
-Re: using hdfs shell commands in a pig script
Harsha 2013-03-06, 14:53
You can write "fs -getmerge source destination;" in your pig script.
On Wednesday, March 6, 2013 at 3:33 AM, Panshul Whisper wrote:
> Is it possible to use hadoop fs commands in a pig script?
> What i exactly want to do is, at the end of my pig script, after the
> execution of store in a file command, I want the pig script to merge the
> multiple output files it creates.
> So either I can try and execute the hadoop fs -getmerge command in the pig
> script, or is there some other way to do it in pig?
> I got this idea, since grunt supports hadoop fs commands so I thought maybe
> it is possible to somehow execute them from within a pig script file.
> Any suggestions are welcome.
> Thanking You,
> Ouch Whisper
shashwat shriparv 2013-03-06, 14:58
Panshul Whisper 2013-03-06, 21:16