Hi Friends,

Can you please suggest me how can I pass 3 files as parameters to the mapper written in python in hadoop streaming API, which will process data from this three different files . Please help.
 

*------------------------*

Cheers !!!

Siddharth Tiwari

Have a refreshing day !!!
"Every duty is holy, and devotion to duty is the highest form of worship of God.”

"Maybe other people will try to limit me but I don't limit myself"
         

Are you looking for something like this?

hadoop jar hadoop-streaming.jar -input 'file1 -input file2

On Sun, Aug 19, 2012 at 11:16 AM, Siddharth Tiwari <
[EMAIL PROTECTED]> wrote:

>
>
> **
>  Hi Friends,
>
> Can you please suggest me how can I pass 3 files as parameters to the
> mapper written in python in hadoop streaming API, which will process data
> from this three different files . Please help.
>
>
>
> **------------------------**
> *Cheers !!!*
> *Siddharth Tiwari*
> Have a refreshing day !!!
> *"Every duty is holy, and devotion to duty is the highest form of worship
> of God.” *
> *"Maybe other people will try to limit me but I don't limit myself"*
>

Hi mohit,
The script normally runs like this locally,
Python mapper.py file1 file2 file3.
How can I achieve this.
Also how can I use paste command in mapper.
Ex, paste file1 file2 file3 > file4
This is in normal shell,
How to achieve it over streaming.
Thanks in advance please help

Date: Sun, 19 Aug 2012 13:42:20 -0700
Subject: Re: FW: Streaming Issue
From: [EMAIL PROTECTED]
To: [EMAIL PROTECTED]

Are you looking for something like this?
 
hadoop jar hadoop-streaming.jar -input 'file1 -input file2
On Sun, Aug 19, 2012 at 11:16 AM, Siddharth Tiwari <[EMAIL PROTECTED]> wrote:


Hi Friends,

Can you please suggest me how can I pass 3 files as parameters to the mapper written in python in hadoop streaming API, which will process data from this three different files . Please help.

 
*------------------------*
Cheers !!!

Siddharth Tiwari
Have a refreshing day !!!

"Every duty is holy, and devotion to duty is the highest form of worship of God.”
"Maybe other people will try to limit me but I don't limit myself"