+
Visioner Sadak 2012-10-04, 15:52
+
Kartashov, Andy 2012-10-04, 16:51
+
Bejoy KS 2012-10-04, 17:15
+
Visioner Sadak 2012-10-05, 08:16
-
Re: copyFromLocalRobert Molina 2012-10-10, 00:19
Here is the information for webhdfs rest call that should allow you to
upload a file:
http://hadoop.apache.org/docs/r1.0.3/webhdfs.html#CREATE
HTH
On Fri, Oct 5, 2012 at 1:16 AM, Visioner Sadak <[EMAIL PROTECTED]>wrote:
> Hey thanks bejoy and andy act my user just has a desktop web user(like we
> browsing web) so i guess first i have to upload the file to my linux
> box(wher hadoop is installed) using a web app then frm there i have to use
> moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
> used to upload to hdfs using web ....
>
>
> On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <[EMAIL PROTECTED]> wrote:
>
>> Hi Sadak
>>
>> If you are issuing copyFromLocal from a client/edge node you can copy the
>> files available in the client's lfs to hdfs in cluster. The client/edge
>> node could be a box that has all the hadoop jars and config files exactly
>> same as that of the cluster and the cluster nodes should be accessible from
>> this client.
>> Regards
>> Bejoy KS
>>
>> Sent from handheld, please excuse typos.
>> ------------------------------
>> *From: *"Kartashov, Andy" <[EMAIL PROTECTED]>
>> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
>> *To: *[EMAIL PROTECTED]<[EMAIL PROTECTED]>
>> *ReplyTo: *[EMAIL PROTECTED]
>> *Subject: *RE: copyFromLocal
>>
>> I use –put –get commands to bring files in/our of HDFS from/to my home
>> directory on EC2. Then use WinSCP to download files to my laptop.
>>
>>
>>
>> Andy Kartashov
>>
>> *MPAC*
>>
>> Architecture R&D, Co-op
>>
>> 1340 Pickering Parkway, Pickering, L1V 0C4
>>
>> ( Phone : (905) 837 6269
>>
>> ( Mobile: (416) 722 1787
>>
>> *[EMAIL PROTECTED]*
>>
>>
>>
>> *From:* Visioner Sadak [mailto:[EMAIL PROTECTED]]
>> *Sent:* Thursday, October 04, 2012 11:53 AM
>> *To:* [EMAIL PROTECTED]
>> *Subject:* copyFromLocal
>>
>>
>>
>> guys i have hadoop installled in a remote box ... does copyFromLocal
>> method copies data from tht local box only wht if i have to copy data from
>> uses desktop pc(for example E drive) thru my my web application will i have
>> to first copy data to tht remote box using some java code then use
>> copyFromLocal method to copy in to hadoop....
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
upload a file:
http://hadoop.apache.org/docs/r1.0.3/webhdfs.html#CREATE
HTH
On Fri, Oct 5, 2012 at 1:16 AM, Visioner Sadak <[EMAIL PROTECTED]>wrote:
> Hey thanks bejoy and andy act my user just has a desktop web user(like we
> browsing web) so i guess first i have to upload the file to my linux
> box(wher hadoop is installed) using a web app then frm there i have to use
> moveFromLocal to put tht file in to hadoop,i thought hadoop can be directly
> used to upload to hdfs using web ....
>
>
> On Thu, Oct 4, 2012 at 10:45 PM, Bejoy KS <[EMAIL PROTECTED]> wrote:
>
>> Hi Sadak
>>
>> If you are issuing copyFromLocal from a client/edge node you can copy the
>> files available in the client's lfs to hdfs in cluster. The client/edge
>> node could be a box that has all the hadoop jars and config files exactly
>> same as that of the cluster and the cluster nodes should be accessible from
>> this client.
>> Regards
>> Bejoy KS
>>
>> Sent from handheld, please excuse typos.
>> ------------------------------
>> *From: *"Kartashov, Andy" <[EMAIL PROTECTED]>
>> *Date: *Thu, 4 Oct 2012 16:51:35 +0000
>> *To: *[EMAIL PROTECTED]<[EMAIL PROTECTED]>
>> *ReplyTo: *[EMAIL PROTECTED]
>> *Subject: *RE: copyFromLocal
>>
>> I use –put –get commands to bring files in/our of HDFS from/to my home
>> directory on EC2. Then use WinSCP to download files to my laptop.
>>
>>
>>
>> Andy Kartashov
>>
>> *MPAC*
>>
>> Architecture R&D, Co-op
>>
>> 1340 Pickering Parkway, Pickering, L1V 0C4
>>
>> ( Phone : (905) 837 6269
>>
>> ( Mobile: (416) 722 1787
>>
>> *[EMAIL PROTECTED]*
>>
>>
>>
>> *From:* Visioner Sadak [mailto:[EMAIL PROTECTED]]
>> *Sent:* Thursday, October 04, 2012 11:53 AM
>> *To:* [EMAIL PROTECTED]
>> *Subject:* copyFromLocal
>>
>>
>>
>> guys i have hadoop installled in a remote box ... does copyFromLocal
>> method copies data from tht local box only wht if i have to copy data from
>> uses desktop pc(for example E drive) thru my my web application will i have
>> to first copy data to tht remote box using some java code then use
>> copyFromLocal method to copy in to hadoop....
>> NOTICE: This e-mail message and any attachments are confidential, subject
>> to copyright and may be privileged. Any unauthorized use, copying or
>> disclosure is prohibited. If you are not the intended recipient, please
>> delete and contact the sender immediately. Please consider the environment
>> before printing this e-mail. AVIS : le présent courriel et toute pièce
>> jointe qui l'accompagne sont confidentiels, protégés par le droit d'auteur
>> et peuvent être couverts par le secret professionnel. Toute utilisation,
>> copie ou divulgation non autorisée est interdite. Si vous n'êtes pas le
>> destinataire prévu de ce courriel, supprimez-le et contactez immédiatement
>> l'expéditeur. Veuillez penser à l'environnement avant d'imprimer le présent
>> courriel
>>
>
>
