Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # dev >> Review Request 13122: PIG-3400 FS commands do not work with S3 paths


Copy link to this message
-
Re: Review Request 13122: PIG-3400 FS commands do not work with S3 paths


> On July 31, 2013, 10:07 p.m., Rohini Palaniswamy wrote:
> > http://pig.apache.org/docs/r0.11.1/cmds.html
> >
> >   The fs commands should be documented as part of http://pig.apache.org/docs/r0.11.1/cmds.html#fs and not http://pig.apache.org/docs/r0.11.1/cmds.html#utillity-cmds. Utility cmds are grunt commands.

Actually, no. The commands that I am fixing are different from "fs" commands. It's confusing, but both of the following work as of now:

grunt> fs ls <path>
grunt> ls <path>
- Cheolsoo
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/13122/#review24376
-----------------------------------------------------------
On July 31, 2013, 7:37 p.m., Cheolsoo Park wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/13122/
> -----------------------------------------------------------
>
> (Updated July 31, 2013, 7:37 p.m.)
>
>
> Review request for pig.
>
>
> Bugs: PIG-3400
>     https://issues.apache.org/jira/browse/PIG-3400
>
>
> Repository: pig-git
>
>
> Description
> -------
>
> Makes fs utility commands work with s3 paths. Documents fs utility commands in the Pig manual. (They were not documented at all.)
>
>
> Diffs
> -----
>
>   src/docs/src/documentation/content/xdocs/cmds.xml 38babd2
>   src/org/apache/pig/tools/grunt/GruntParser.java c785084
>
> Diff: https://reviews.apache.org/r/13122/diff/
>
>
> Testing
> -------
>
> All unit tests pass.
>
> Manually verified the following commands with s3 paths:
> pig -e 'ls s3://<path>'
> pig -e 'mkdir s3://<path>'
> pig -e 'rm s3://<path>'
> pig -e 'cp s3://<path1> s3://<path2>'
> pig -e 'mv s3://<path1> s3://<path2>'
> pig -e 'copyToLocal s3://<path>/<file> .'
> pig -e 'copyFromLocal <file> s3://<path>'
>
>
> Thanks,
>
> Cheolsoo Park
>
>