hadoop dfs cat /my/path/* > single_file
On Dec 5, 2011, at 12:30 PM, Aaron Griffith <[EMAIL PROTECTED]> wrote:
> Using PigStorage() my pig script output gets put into partial files on the hadoop
> file system.
> When I use the copyToLocal fuction from Hadoop it creates a local directory with
> all the partial files.
> Is there a way to copy the partial files from hadoop into a single local file?