Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Mapreduce outputs to a different cluster?


Copy link to this message
-
RE: Mapreduce outputs to a different cluster?
Just use "hdfs://machine.domain:8080/tmp/myfolder"
Yong

Date: Thu, 24 Oct 2013 20:25:35 -0700
From: [EMAIL PROTECTED]
Subject: Re: Mapreduce outputs to a different cluster?
To: [EMAIL PROTECTED]

Thanks Shahab & Yong. If cluster B (in which I want to dump output) has url "hdfs://machine.domain:8080" and data folder "/tmp/myfolder", what should I specify as the output path for MR job?
Thanks
 
 
     On Thursday, October 24, 2013 5:31 PM, java8964 java8964 <[EMAIL PROTECTED]> wrote:
    Just specify the output location using the URI to another cluster. As long as the network is accessible, you should be fine.YongDate: Thu, 24 Oct 2013 15:28:27 -0700From: [EMAIL PROTECTED]ubject: Mapreduce outputs to a different cluster?To: [EMAIL PROTECTED]he scenario is: I run mapreduce job on cluster A (all source data is in cluster A) but I want the output of the job to cluster B. Is it possible? If yes, please let me know how to do it.Here are some notes of my mapreduce job:1. the data source is an HBase table2. It only has mapper no reducer.ThanksSenqiang    

          
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB