Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Flume 0.94 with CDH4


+
Kumar, Deepak8 2012-10-03, 06:26
Copy link to this message
-
Re: Flume 0.94 with CDH4
Hi Deepak,  

Hadoop made some significant changes from 0.20.2 to 2.0.0. As such something build using Hadoop-0.20.x/1.0 will not run with Hadoop-2.0, and vice versa. So you need to use Flume build against the correct version of Flume, or you will hit these issues. Are you running Flume from CDH3 on CDH4? Unfortunately, that will not work because of this reason.

I'd recommend switching to Flume-ng, flume-1.2.0 which is the current version.

Thanks,
Hari

--  
Hari Shreedharan
On Tuesday, October 2, 2012 at 11:26 PM, Kumar, Deepak8 wrote:

> Hi Hari,
> I am trying to use Flume 0.94 with CDH4. I am getting following exception.
>  
> 1.       Without hbase 0.9.2 jar file, flume throws following error
> 2012-10-01 13:29:13,958 ERROR com.cloudera.flume.core.connector.DirectDriver: Exiting driver logicalNode vm-ccf5-9333.nam.nsroot.net_synch-56 in error state KeywordSynchSource | ConsoleEventSink because Not a host:port pair: �^@^@^@![EMAIL PROTECTED] (mailto:[EMAIL PROTECTED]),60020,1348696066287
> It’s a version conflict error if you try to access to hbsae 0.9.2 from hbsae 0.90.4 client.
> 2.       Hbase 0.9.2 + hadoop 0.20.2 jar files, flume throws following error.
> Exception in thread "Heartbeat" java.lang.NoClassDefFoundError: org/apache/hadoop/net/SocketInputWrapper
>        at org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:1035)
>         at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:897)
>         at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
>         at $Proxy7.getProtocolVersion(Unknown Source)
>         at org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:183)
>         at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:303)
>         at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:280)
>         at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:332)
>         at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:236)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1278)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1235)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1222)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:918)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:814)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:782)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:915)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:818)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:782)
>         at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:249)
>         at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:213)
>         at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:171)
>         at com.citi.sponge.flume.sink.ELFNotifyCacheSink$1.build(ELFNotifyCacheSink.java:117)
>         at com.cloudera.flume.conf.SinkFactory$SinkBuilder.create(SinkFactory.java:42)
>         at com.cloudera.flume.conf.SinkFactoryImpl.createSink(SinkFactoryImpl.java:318)
>         at com.cloudera.flume.conf.FlumeBuilder.buildEventSink(FlumeBuilder.java:500)
>         at com.cloudera.flume.conf.FlumeBuilder.buildEventSink(FlumeBuilder.java:531)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB