Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> flume 1.4.0 avro source/sink with hdfs sink configuration - no hdfs files created


Copy link to this message
-
RE: flume 1.4.0 avro source/sink with hdfs sink configuration - no hdfs files created
Did you try splitting this configuration into agent and collector?
And also change agent to something else in the collector conf.

Regards,
Prashanth.

From: Suhas Satish [mailto:[EMAIL PROTECTED]]
Sent: Thursday, September 12, 2013 8:46 AM
To: [EMAIL PROTECTED]; dev
Subject: Re: flume 1.4.0 avro source/sink with hdfs sink configuration - no hdfs files created

This is my launch cmd -
../bin/flume-ng agent --conf ./  -f flume-avro.conf -Dflume.root.logger=DEBUG,LOGFILE -n agent &

Cheers,
Suhas.

On Wed, Sep 11, 2013 at 8:08 PM, Suhas Satish <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:

On Wed, Sep 11, 2013 at 7:55 PM, Suhas Satish <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
up the following flume top

I find this in the log file -
11 Sep 2013 20:06:15,723 ERROR [conf-file-poller-0] (org.apache.flume.node.AbstractConfigurationProvider.loadSinks:432)  - Sink hdfs-sink has been removed due to an error during configuration

Can you point out what the error is?

Thanks,
Suhas.
______________________________________________________________________
Disclaimer:This email and any attachments are sent in strictest confidence for the sole use of the addressee and may contain legally privileged, confidential, and proprietary data.  If you are not the intended recipient, please advise the sender by replying promptly to this email and then delete and destroy this email and any attachments without any further use, copying or forwarding
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB