Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Copy kafka data between servers?


Copy link to this message
-
Re: Copy kafka data between servers?
As Jun described, the purpose of broker.id is to be able to move data from
one broker to the other without changes. I believe this should work in 0.8
as well. However, we've never tried it so not sure if there are bugs. Let
us know how it goes.

Thanks,
Neha
On Wed, Feb 27, 2013 at 1:31 PM, Jason Huang <[EMAIL PROTECTED]> wrote:

> Thanks for the response.
>
> I apologize - I should have mentioned that we are trying out kafka 0.8
> because of its new exciting features.
>
> So for 0.8, what do I need to do with the zookeeper data? copy
> zookeeper file from $dataDir in zookeeper.properties from server A to
> server B, and then run server B's kafka instance?
>
> Jason
>
> On Wed, Feb 27, 2013 at 12:57 PM, Neha Narkhede <[EMAIL PROTECTED]>
> wrote:
> > Jason,
> >
> > Assuming this question is for 0.7, you can just copy the data in the log
> > directory and restart the new broker. You don't need to copy the
> zookeeper
> > data.
> >
> > Thanks,
> > Neha
> > On Feb 27, 2013 2:11 AM, "Jason Huang" <[EMAIL PROTECTED]> wrote:
> >
> >> Hello,
> >>
> >> Is there a way to migrate kafka data from server A to another server B?
> >>
> >> Can I just copy the data from $log.dir in server.properties and
> >> zookeeper file from $dataDir in zookeeper.properties from server A to
> >> server B, and then run server B's kafka instance?
> >>
> >> thanks,
> >>
> >> Jason
> >>
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB