guys i have hadoop installled in a remote box ... does copyFromLocal method
copies data from tht local box only wht if i have to copy data from uses
desktop pc(for example E drive) thru my my web application will i have to
first copy data to tht remote box using some java code then use
copyFromLocal method to copy in to hadoop....

I use -put -get commands to bring files in/our of HDFS from/to my home directory on EC2. Then use WinSCP to download files to my laptop.

Andy Kartashov
MPAC
Architecture R&D, Co-op
1340 Pickering Parkway, Pickering, L1V 0C4
* Phone : (905) 837 6269
* Mobile: (416) 722 1787
[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>

From: Visioner Sadak [mailto:[EMAIL PROTECTED]]
Sent: Thursday, October 04, 2012 11:53 AM
To: [EMAIL PROTECTED]
Subject: copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method copies data from tht local box only wht if i have to copy data from uses desktop pc(for example E drive) thru my my web application will i have to first copy data to tht remote box using some java code then use copyFromLocal method to copy in to hadoop....

NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel

Hi Sadak

If you are issuing copyFromLocal from a client/edge node you can copy the files available in the client's lfs to hdfs in cluster. The client/edge node could be a box that has all the hadoop jars and config files exactly same as that of the cluster and the cluster nodes should be accessible from this client.

Regards
Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: "Kartashov, Andy" <[EMAIL PROTECTED]>
Date: Thu, 4 Oct 2012 16:51:35
To: [EMAIL PROTECTED]<[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: RE: copyFromLocal

I use -put -get commands to bring files in/our of HDFS from/to my home directory on EC2. Then use WinSCP to download files to my laptop.

Andy Kartashov
MPAC
Architecture R&D, Co-op
1340 Pickering Parkway, Pickering, L1V 0C4
* Phone : (905) 837 6269
* Mobile: (416) 722 1787
[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>

From: Visioner Sadak [mailto:[EMAIL PROTECTED]]
Sent: Thursday, October 04, 2012 11:53 AM
To: [EMAIL PROTECTED]
Subject: copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method copies data from tht local box only wht if i have to copy data from uses desktop pc(for example E drive) thru my my web application will i have to first copy data to tht remote box using some java code then use copyFromLocal method to copy in to hadoop....

NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel

Hey thanks bejoy and andy act my user just has a desktop web user(like we
browsing web) so i guess first i have to upload the file to my linux
box(wher hadoop is installed) using a web app then frm there i have to use
moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
used to upload to hdfs using web ....

On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <[EMAIL PROTECTED]> wrote:

> Hi Sadak
>
> If you are issuing copyFromLocal from a client/edge node you can copy the
> files available in the client's lfs to hdfs in cluster. The client/edge
> node could be a box that has all the hadoop jars and config files exactly
> same as that of the cluster and the cluster nodes should be accessible from
> this client.
> Regards
> Bejoy KS
>
> Sent from handheld, please excuse typos.
> ------------------------------
> *From: *"Kartashov, Andy" <[EMAIL PROTECTED]>
> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
> *To: *[EMAIL PROTECTED]<[EMAIL PROTECTED]>
> *ReplyTo: *[EMAIL PROTECTED]
> *Subject: *RE: copyFromLocal
>
>  I use –put –get commands to bring files in/our of HDFS from/to my home
> directory on EC2. Then use WinSCP to download files to my laptop.
>
>
>
> Andy Kartashov
>
> *MPAC*
>
> Architecture R&D, Co-op
>
> 1340 Pickering Parkway, Pickering, L1V 0C4
>
> ( Phone : (905) 837 6269
>
> ( Mobile: (416) 722 1787
>
> *[EMAIL PROTECTED]*
>
>
>
> *From:* Visioner Sadak [mailto:[EMAIL PROTECTED]]
> *Sent:* Thursday, October 04, 2012 11:53 AM
> *To:* [EMAIL PROTECTED]
> *Subject:* copyFromLocal
>
>
>
> guys i have hadoop installled in a remote box ... does copyFromLocal
> method copies data from tht local box only wht if i have to copy data from
> uses desktop pc(for example E drive) thru my my web application will i have
> to first copy data to tht remote box using some java code then use
> copyFromLocal method to copy in to hadoop....
> NOTICE: This e-mail message and any attachments are confidential, subject
> to copyright and may be privileged. Any unauthorized use, copying or
> disclosure is prohibited. If you are not the intended recipient, please
> delete and contact the sender immediately. Please consider the environment
> before printing this e-mail. AVIS : le présent courriel et toute pièce
> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
> et peuvent être couverts par le secret professionnel. Toute utilisation,
> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
> courriel
>

Here is the information for webhdfs rest call that should allow you to
upload a file:
http://hadoop.apache.org/docs/r1.0.3/webhdfs.html#CREATE

HTH

On Fri, Oct 5, 2012 at 1:16 AM, Visioner Sadak <[EMAIL PROTECTED]>wrote:

> Hey thanks bejoy and andy act my user just has a desktop web user(like we
> browsing web) so i guess first i have to upload the file to my linux
> box(wher hadoop is installed) using a web app then frm there i have to use
> moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
> used to upload to hdfs using web ....
>
>
> On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <[EMAIL PROTECTED]> wrote:
>
>> Hi Sadak
>>
>> If you are issuing copyFromLocal from a client/edge node you can copy the
>> files available in the client's lfs to hdfs in cluster. The client/edge
>> node could be a box that has all the hadoop jars and config files exactly
>> same as that of the cluster and the cluster nodes should be accessible from
>> this client.
>> Regards
>> Bejoy KS
>>
>> Sent from handheld, please excuse typos.
>> ------------------------------
>> *From: *"Kartashov, Andy" <[EMAIL PROTECTED]>
>> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
>> *To: *[EMAIL PROTECTED]<[EMAIL PROTECTED]>
>> *ReplyTo: *[EMAIL PROTECTED]
>> *Subject: *RE: copyFromLocal
>>
>>  I use –put –get commands to bring files in/our of HDFS from/to my home
>> directory on EC2. Then use WinSCP to download files to my laptop.
>>
>>
>>
>> Andy Kartashov
>>
>> *MPAC*
>>
>> Architecture R&D, Co-op
>>
>> 1340 Pickering Parkway, Pickering, L1V 0C4
>>
>> ( Phone : (905) 837 6269
>>
>> ( Mobile: (416) 722 1787
>>
>> *[EMAIL PROTECTED]*
>>
>>
>>
>> *From:* Visioner Sadak [mailto:[EMAIL PROTECTED]]
>> *Sent:* Thursday, October 04, 2012 11:53 AM
>> *To:* [EMAIL PROTECTED]
>> *Subject:* copyFromLocal
>>
>>
>>
>> guys i have hadoop installled in a remote box ... does copyFromLocal
>> method copies data from tht local box only wht if i have to copy data from
>> uses desktop pc(for example E drive) thru my my web application will i have
>> to first copy data to tht remote box using some java code then use
>> copyFromLocal method to copy in to hadoop....
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>