Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> copyFromLocal


Copy link to this message
-
Re: copyFromLocal
Hi Sadak

If you are issuing copyFromLocal from a client/edge node you can copy the files available in the client's lfs to hdfs in cluster. The client/edge node could be a box that has all the hadoop jars and config files exactly same as that of the cluster and the cluster nodes should be accessible from this client.

Regards
Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: "Kartashov, Andy" <[EMAIL PROTECTED]>
Date: Thu, 4 Oct 2012 16:51:35
To: [EMAIL PROTECTED]<[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: RE: copyFromLocal

I use -put -get commands to bring files in/our of HDFS from/to my home directory on EC2. Then use WinSCP to download files to my laptop.

Andy Kartashov
MPAC
Architecture R&D, Co-op
1340 Pickering Parkway, Pickering, L1V 0C4
* Phone : (905) 837 6269
* Mobile: (416) 722 1787
[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>

From: Visioner Sadak [mailto:[EMAIL PROTECTED]]
Sent: Thursday, October 04, 2012 11:53 AM
To: [EMAIL PROTECTED]
Subject: copyFromLocal
guys i have hadoop installled in a remote box ... does copyFromLocal method copies data from tht local box only wht if i have to copy data from uses desktop pc(for example E drive) thru my my web application will i have to first copy data to tht remote box using some java code then use copyFromLocal method to copy in to hadoop....

NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr?sent courriel et toute pi?ce jointe qui l'accompagne sont confidentiels, prot?g?s par le droit d'auteur et peuvent ?tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris?e est interdite. Si vous n'?tes pas le destinataire pr?vu de ce courriel, supprimez-le et contactez imm?diatement l'exp?diteur. Veuillez penser ? l'environnement avant d'imprimer le pr?sent courriel

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB