Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> copy chunk of hadoop output


+
jamal sasha 2013-02-19, 22:08
+
Harsh J 2013-02-19, 22:14
Copy link to this message
-
Re: copy chunk of hadoop output
Awesome thanks :)
On Tue, Feb 19, 2013 at 2:14 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> You can instead use 'fs -cat' and the 'head' coreutil, as one example:
>
> hadoop fs -cat 100-byte-dfs-file | head -c 5 > 5-byte-local-file
>
> On Wed, Feb 20, 2013 at 3:38 AM, jamal sasha <[EMAIL PROTECTED]>
> wrote:
> > Hi,
> >   I was wondering in the following command:
> >
> > bin/hadoop dfs -copyToLocal hdfspath localpath
> > can we have specify to copy not full but like xMB's of file to local
> drive?
> >
> > Is something like this possible
> > Thanks
> > Jamal
>
>
>
> --
> Harsh J
>
+
Jean-Marc Spaggiari 2013-02-20, 19:44
+
Harsh J 2013-02-20, 20:21
+
jamal sasha 2013-03-01, 23:21
+
jamal sasha 2013-03-01, 23:27
+
Azuryy Yu 2013-03-02, 00:38
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB